Yes. I have a HP Pavilion p6387c (Any different p6000 series PC will do) and it is a great starter PC. It has 7GB of RAM, and a pretty new (Although at it's end of life) and solid dual-core Intel Pentium E6300. The PC is great for upgrading, and is cheap on eBay. Although watch out for the hard drive! After 5-7 years, a mechanical hard drive can and will fail. Super-strong magnets become faulty, heads crash into other components, circuits die out, or the spinning motor fails or the bearings are too worn to spin. I recommend buying a Western Digital Blue hard drive. They're reliable, cheap ($54.99), and spacey. Then buy a Windows 7 Starter (So you can get Windows 10 Home, it's a lot cheaper then getting Home Premium just to get the same product.(Windows 10 is free, by the way, if you have the proper updates and Windows 7 or 8, but 7 is cheaper.)) MAKE SURE TO GET THE 64-BIT VERSION OR ELSE BAD THINGS WILL HAPPEN.
You also want a USB network adapter, because it doesn't come with that. I just got a cheap Belkin Wireless Adapter, and it does the job.
If you want something on the market right now, I would recommend the Digital Storm Vanquish 4. It's already good for gaming and just under $900.
For an even cheaper option, get a Dell Inspiron Small Desktop- whichever you like. But beware ungodly amounts of bloatware and abysmal customer service!
If you don't like that, go on Google and search "dell", and on the side, under "People also searched for", just browse all of those sites and you'll find a desktop that's right for you.