I've never had any trouble with public trackers. As long as you've got half decent security and keep it up to date you're fine.
Of course use common sense, do some reading and don't just grab anything you come across. It's no different to grabbing warez from file hosts really.