What's your old gpu?
I hate to be the bearer of bad news, but Ultra PSU's have historically been bottom of the barrel psus... some of them so bad they could do damage to the machine and are to be avoided at all costs.
The Ultra X-Finity is a really old series (surprised they're still selling them) that's, at best, a Tier 4 psu from several years back. You'd be well advised to swap if for a decent one... take care of your hardware.
I still remember at DFI Street the name Ultra just brought shudders every time we heard someone paid for one...
Scroll down to the old list, tier 4. Official XS Power Supply Ranking Phase I - XtremeSystems Forums