New
#11
This is a 'simple' problem. The BIOS chip does not retain settings because it is losing power or shorting out.
Batteries are cheap enough to try another one just for kicks and grins. This time get a CR2032. It should not make any difference, but stranger things have occurred.
Another thing occurred to me:
Check you motherboard (refer to you manual if you have one) and find the CMOS Reset jumper. There are 3 pins. Normally the jumper is set on pins 1-2. To clear the CMOS settings you would move the jumper to 2-3 (with power off and battery out) to clear and then back to 1-2 to run. But if the jumper is loose (not pushed in all the way), incorrect, or missing that might explain the behavior with a good battery.
Otherwise you are shopping for repairs (at a computer shop) or a new motherboard.