Have you tried an alternative RDP provider? I have used Teamviewer in the past for remote server / workstation access, and have found it more efficient that the Built in option.

There are also some pared down Open Source VNC options around that may help