Hello Towelie, and welcome to Seven Forums.
Sorry, but Windows Defender is a part of Windows 7. The Windows Defender folder is a proteced operating system folder and cannot be deleted.
If you do not want to use it, then you can turn off Windows Defender
to have it not run or use any resources other than the very tiny amount of HDD space for the files.
Hope this helps,