This is a Known issue with Windows since the start of the User Folders
Although it may be possible to rename the folder structure from another administrator account the amount of work involved to change all the references throughout the system to keep the system running is vast.
These references proliferate throughout the system and the registry.
The only way I have seen this done is to create a new user with the correct name and migrate the user settings from the old to the new user. Even this I have not seen done for some years
It involves the use of the User Profiles dialog in the advanced system settings which is present in professional but I think may not be in the home versions.
If you have the option it should be a simple matter to use the Copy to ... option to copy the settings from the old account to the new one