I've been doing RC for about 15 years now. Flew for ten but got out of it when it started becoming a money pit. It's very easy to get carried away, and I've still got a few models I need to sell off or condemn to the fire pit.
It really boils down to what you want to get out of it. Foam park fliers are good for beginners, and can be bought quite cheaply from Chinese suppliers like Hobby King. My only issue with import models is parts availability. Really small models like the one Kaido posted are also quite vulnerable to wind, so they can only be flown indoors or on dead calm days. So they're not ideal for straight beginners IMO. The Multiplex Easy Star that was posted will be a better bet. Personally, I'd go for a larger balsa trainer and get instruction at a club if you're serious. Otherwise, that's good for just farting around with.
Another beginner foam EP model I really love is the GWS Slowstick. It looks like a piece of junk but flies nice and predictably. Because it flies so slow, you can maneuver it safely low to the ground. This is a three-channel model that steers with elevator and rudder. The wings are angled to self level, so it doesn't need ailerons.
http://store.gwsus.com/product/gws-slowstick/
You should check out the Academy Of Model Aeronautics. They offer liability insurance for pilots and membership is necessary to join any club. They can also give you a list of clubs. Joining a club is better then going solo. Most have training programs with an experienced instructor. Plus you have a dedicated place to fly. Most decent RC radio systems come with a "Buddy Box" port that allows you to slave a dummy transmitter. This allows the instructor to take over flying.
As for power systems, I think EP is really the only way to go these days. All the old farts still swear by glow engines. However they're messy, difficult to tune, more prone to failure, and require a lot more ground equipment.
Brushless power systems have come down in price substantially. Especially import ones. The only downside is recharge time. You'll need to purchase enough batteries you think you'll need for your day of flying. Get them from Hobby King as the local stores rip you off.
Other equipment you need with EP is charger. I'm really pissed Great Planes discontinued the Triton Junior. That was the best affordable catch-all system out there. I swear by mine. Most ready to fly models come with one in box. If you need one though, I'd talk to the local hobby store. I'm not sure what the best one is these days. You may need a bench power supply with DC only ones. Though you can get ones that power from AC or DC.
Aside from that, just some basic tools. Phillips screw drivers and Allan Wrenches mostly, scissors, hobby knife, some CA glue for patch repairs.
If your model needs a radio system, make sure you get one with a 2.4ghz spread spectrum transmitter and receiver. There's no frequency management required, nor is interference an issue. They still sell new 72mhz FM systems, which should really be taken off the market IMO. I don't think they're safe.