I know this guy who has thousands of vinyl records. He hammered most of them to a wall and that's probably for the best.
DON'T buy one of those 'budget' things. Not only will they sound bad and bust but they will stuff your records as well.
I was really into it in my 20s. Now my records just sit there taking up space. I'll take MP3s any day... they're so much easier to deal with.
I couldn't wait to stop buying LP's. They're too fragile, have too many sound defects. I've been a CD fan since day one.