Everyone keeps on saying records are expensive.. it depends what you're looking for to buy. If you're looking to re-buy all your favorite classic records, then yeah, it can cost more than $10 a pop per record. Personally, I try to go into the record store with the goal of buying 4 to 5 LPs for around $20. I'm typically looking for jazz, soul, whatever... used stuff ($2/3 a record)
You can do what you want, but if every single record you're buying is over $12, you're going to be spending a lot of money... Occasionally if a record shop has a record I really love and it's $12 bucks or whatever, I'll pick it up. But it's really not worth it to blow all your money on records... The more you buy records, the more you'll understand what you want out of it.
NEW records, as in records that haven't come out yet/came out this week, will be a typical $12-15 or whatever - if it's a current band/artist that I really dig, I personally have no issue with spending the $12 to get their new record. But if I wanted to get all of Zeppelin's records for $15 a pop... I probably won't be doing that
my advice is ask older people that you know (family/friends/friend's family) if they have their record player sitting in a closet. Take theirs off their hand for $15, buy a new needle ("replacement stylus"), make sure it is compatible with the turntable you got (there aren't too many different types as far as I know). Also - if you buy a used turntable, make sure it has the grounding cable. The turn table that I bought used didn't have the grounding cable, I found one that fit in my turntable on some random website.
Record players have RCA out, but you need to plug it into a phono preamp. If you have a receiver with a PHONO input, that will do the job. Otherwise, you can buy a phono preamp on Amazon for like $15, the reviews say it does the job fine.
Just call them records... vinyls sounds dumb as fuck