More people aren't PC gamers because of a number of factors :
#1 - Exclusive games. This is far and away the best reason to have a console, and why I have mine. This is not going to change, but at the same time, I'm not giving up PC gaming either.
#2 - Price. If you don't know how to build your own system, the pre-builts ARE indisputably more expensive than a current console for similar results.
#3 - Fear & Misunderstandings. 'It's too hard', 'I don't know how to install drivers', 'I can't use a controller', 'I can't hook it up to my big screen'. All of this is really silly to people that know what they're doing, but at the same time we can understand why not everyone knows this stuff.
Optimization and the lower-overhead of consoles is of course a factor, but not nearly as much as it used to be. Previous consoles almost always launch with oddball (in terms of development process) hardware, which took a good while to get a handle on and use to its fullest. This is dramatically less relevant to the new consoles which are basically stripped gaming PCs at their hearts. And another thing which has given a flawed perception is the combination of PS3/360 launching with AMAZING hardware for the time (not true this time) and them running titles at less than 720p and upscaling. If you take even a low end GPU from the past few years and run a game at 1280x720 or less, with medium details and no AA (console settings IOW), then you DO actually get similar results even with a gimpy PC.
I'm not suggesting that everyone will jump to PC gaming, but that it will continue to grow. I'm also not suggesting that people will abandon console gaming at all, in fact that would be stupid considering the many games that are and will only be available there.
All that said, the quality gap that's already there with even today's midrange gaming PCs > consoles is going to turn into a staggering chasm. And many people once they experience 4K ultra-high-detail gaming on familiar titles, and find out that it doesn't cost an insane amount of money to do it, will want to get in on that action. Not all people, and probably not even most people, but a considerable number for sure over time. This is all a fair ways off, as the price tag right now to do so is simply too high for most to justify. By 2017-2018 though? It will be stuff you can buy in Walmart and Bestbuy at basic pricing.