Hello Nick, and welcome to Seven Forums.
Sometimes a simple restart will get rid of them if you haven't already tried that.
Another option is to reinstall the program the icon is for, unpin the icon, then uninstall the program.
Hope this helps,
Shawn