Make sure in Disk Mgmt the external isn't marked Active.
During bootup, this will cause it to look for boot files there.
You can mark it Inactive using Diskpart or free Partition Wizard.
I would try formatting it again as well.
Make sure your chipset
drivers are up to date.