Sorry but you are mistaken. IMAP stays on the server and it will remain until you delete it.
POP gives you a choice that you can configure from Outlook and the specific account.
If you dot want to remove your email from the website, you have to get a different service that supports POP.
I persnonally use GMX. and I think its great.