If a President is unpopular enough, he will draw a challenger, if times are bad enough, someone outside of the 2 main parties may jump in.
But this year features neither of those.
One caveat - Bush II almost lost, which would have broken the trend. So you could argue that we're in a new era, one in which the old rules don't apply. Seriously doubt that, though.