I'm going to guess that since this is a guest account that we are talking about, you don't have too much invested in it in terms of settings. You can log on to an admin account and delete the profile:
Restart the computer to free up the Guest profile account.
Log on to an admin account
Right click on Computer
Select Properties from the context menu
Once the computer's propertied window displays...
...click on the link named Advanced system settings
The System Properties window should appear and the Advanced tab should be selected.
In the User Profiles area, click on the button named Settings...
Once the User Profiles window appears...
...CAREFULLY select the row for the guest account
...confirm that you have selected the correct row
...click on the button named Delete.
...confirm the deletion process
Sometimes this deletion works without any errors. Other times you will get a notice something to the effect that "not all files were deleted - folder not empty". If you see such an error, restart the computer again, log on to an admin account and manually deleted the remaining files for the guest account.
Log on to the Guest account. The profile file/settings should be rebuilt. Test IE11 and let us know the results.
