If you've got rhythm, you can kick ass at them.
If not, you can learn, but you won't ever be world class.
I've got friends of both calibers. I know a man who plays around the world. He's got a drum set that breaks down into three separate, complete sets, and is worth MORE THAN MY TRUCK.
On the other hand, I know a guy who has been playing as long as I have (and he's even taking lessons), but I still kick ass on him.
If you have a natural knack for rhythm, you can most likely teach yourself. But I wouldn't advise trying unless you've got a top notch drummer around in your life to help you out or point out what you can do to improve a skill. That's what I've done. I've taught myself.
As of now, I am familiar with every style, but cannot play hardcore punk or industrial music. That industrial stuff cramps my arms. But I have no problem playing anything else. Including African time signatures like 11/4, 15/6, or other absolutely crazy stuff.
The only draw back is buying the set. A decent starter-kit will cost you around $400. With the preset talent of rhythm, the urge to play drums along with songs, the habit of pounding on things every now and then without realizing it, a drum set, and a drummer friend to help, you'll be up there wailing away in NO time...
<EDIT>
oh yeah... another draw back would be the Neighbors getting freakin' pissed off from the noise...
<EDIT>