And what if you are using a media remote and not a controller?
I agree with the "more options than 1 and 6" point though.
Button input
Most people will pause a movie or tv show for long enough sessions to grab another beer (food, drink lol you get it). Reset the timer when it detects an input.