The worst is when you've attracted some enemy attention (cue battle music), look around frantically and can't see what the hell is after you, only to have the peaceful music cut back in after 20 seconds.
Its the video game equivalent of a Dungeon Master making a hidden die roll behind his RPG screen and laughing maniacally.