The sound is probably leaking from your headphones a lot more than you realise.
Either that or you're just making a tonne of noise yourself. People tend to be really oblivious to this shit when their headphones are drowning it all out.
Try playing with the headphones off, muting the game and seeing how loud you actually are.