It's 100% safe. It's like removing a small light bulb inside the glove department of your car. The engine and tires do not get touched.

Re-naming the file will keep it out of reach from windows programs. It's like hiding the cookie jar from a blind person. Malware won't be able to see it.