Its actually a small, but annoying problem. Rather than trying to solve the problem, when you could be enjoying. Can you start a new folder in your documents, call it junk or whatever and drag the icon there. It will be out of sight and you can start enjoying a great OS, again.
Edit Just had a thought, go to search in start menu. Put the name of the icon, you might be able to find the source and delete that.