Yes, in a desktop computer the power supply is typically here:
And a typical power supply looks like this:
However, given your lack of knowledge concerning PC hardware I would strongly advise you to find someone who has done this kind of thing before, or take the PC to a repair shop. Replacing a power supply is relatively easy, but there are a lot of connections that have to be made just so.