I think video games became an acceptable pastime (for my demographic at least) when the original Halo was released. That was the first time I would hear people talking about video games on an almost every-other-day basis, and although it was still kind of "weird", there were fairly normal people who could openly admit to playing vidoegames (or at least that specific one) until the wee hours of the night, and brag about their prowess.
I also think (again, from my observation) that from Co Modern Warfare onward, there has been at least one game (usually the next iteration of CoD) that was part of the zeitgeist; a game that almost everyone knew about and enjoyed.
But a passion, in the same sense that one would be passionate about literature or painting, or any other art form...? No. Absolutely not.
Spoiler warning:
But have I been ostracized for it? No. So I've never had to be "ashamed". But most do find it odd...
Except for when I mention that I play WoW. I have received numerous "Oh, you're one of those people" looks.