Obviously to some of your persuasion, it is a BFD.
When was the last time you heard of someone getting harassed because they are straight?
When was the last time you heard of someone getting fired from their job for being straight?
When was the last time you heard of a parent disowning their child for being straight?
When was the last time you heard of someone being killed because they are straight?
I'll go ahead and answer the question for you - never. However, for someone who is gay, these kinds of concerns are very real.
You say you don't advertise your sexuality? Bullshit. As others have already pointed out, every time you talk about your wife or girlfriend, you advertise it. When you show any kind of PDA (holding hands, a kiss goodbye, etc), you advertise it. Every time a breeder gets married, they advertise it.
God help us if a queer does those very same things - suddenly a large part of society starts crying "I don't mind if you're gay, but you don't have to push it down my throat.", coupled with a plethora of jeers, snide remarks, and dirty looks (unless your one of the unlucky few who gets something worse). It's a wonder why anyone even bothers coming out anyway. Someone has to take the first step - someone has to embolden the closeted masses to stop hiding their identities, to stop living lies and start living life.
You say it doesn't matter to you, that you could care less about someone's orientation? That's a fucking lie - if it was true, you would never have replied to this thread to begin with.