Honestly the best thing to do to get involved in pvp is to join a 0.0 alliance that is active in 0.0 warfare. Most corps will even provide newbie tackling frigates at no cost. In my opinion training up for a tackling rifter (which takes hardly any time) and getting involved in 0.0 warfare as a tackler is the single best way to start out in pvp. My alliance makes our new members come straight out to our 0.0 space from day one. If you move out to 0.0 from day one you can usually scavenge wrecks from 0.0 ratters that don't loot and make millions an hour which will easily keep you in pvp frigates and cruisers.

Turbonapkin mentioned EvE university and I've heard good things about them so that is always an option. Regardless of who you join I seriously recomend everyone get out to 0.0, its what EvE is all about. There is very little empire has to offer beyond safety. What are all those new shiny ships good for if you can't use them for anything! 0.0 may not be safe but the risk is offset by the riches that 0.0 space offers. Get out there and see the real EvE.