Hello Dylan,
Close Personalization, then double check in the the
hidden C:\Users\User-Name\AppData\Local\Microsoft\Windows\Themes folder for a
Custom.theme listed. This will be the
Unsaved Theme in
Personalization. See if you may be able to delete it from this location instead.
Hope this helps,
Shawn