No, you don't get it. No where in my scenario am I just reaching for my pistol, pulling it out, and shooting someone. In my scenario I'm on one side of the street, a group or even a single person is on the other, I see they see me, they now cross over to my side and I determine they are threatening to me by their behavior. I now move to the middle of the street or the other side of the street, and they decide when they see me doing this to now intercept me. I still haven't drawn, but, I probably am brandishing at that point. At some point I've stopped and am now in a defensive posture clearly with my hand on my pistol.
We have now arrived at you putting me in what I've considered the aggressors shoes. As this aggressor, I am now intercepting this person, this person is brandishing a firearm, I am continuing to walk towards this person, this person has stopped walking towards me and is clearly on the defensive, and your response to this is I should pull out my own firearm and shoot him?
Lets give your argument the benefit of I somehow haven't realized that I'm being considered a threat to this person until I get within range that I can see this person is carrying and oh look at that, now brandishing but not yet having pulled. How do you arrive at I now pull and shoot him, rather than choose a much better course of action and either now stop myself and talk it out, or, just move away from such a person which I can clearly do and move on my merry way?
I guess my point here really is an argument can almost be made for anything...one can create any scenario to fit their argument. What my point is, and I'm sorry if I haven't been clear/verbose enough, is that being allowed to legally brandish likely will prevent far more shootings/altercations than the limited number of two good guys misreading each other and one gunning the other - although I freely admit, it's going to happen.