My advice is to join a camera club. Most clubs have opportunities for newbies to try out different camera bodies and lenses. A club is also a good way to get a deal on older gear. Local dealers often offer substantial discounts to club members, too.
This is true. Clubs are great for new comers. I've always found the meetings to be useless but the photowalks are great because they force you to get out and shoot. You can observe and see what everyone else is doing and formulate your own ideas.
That said, be careful. There are a lot of people that prey on those clubs with their events and deals. Kinda sad but I've seen it in three different cities. Often times the claim to be professionals or event organizers or something like that. Definitely listen to what they have to say but be careful of the catch.
During photowalks, the people standing there saying, "I can't make this work, I need help", move away from them. Seek out the person that looks the oddest and standing by themselves. They typically see something no one else is. Usually they are way in front or way behind the crowd.
On the flipside if you see a guy with an old school medium or full format camera, a pipe, and a beard, go talk to him.
Camera stores are great if you are in a pinch but buying equipment online is the way to go, including used equipment. That said, my local camera shop usually has a lot of great used stuff.