Make sure in Disk Mgmt the external isn't marked Active.
During bootup, this will cause it to look for boot files there.
You can mark it Inactive using Diskpart or free Partition Wizard.
I would try formatting it again as well.
Make sure your chipset drivers
are up to date.