where do I set the ipv4 or ipv6 option in windows 7

I am having problems trying to use a T Mobil wifi hotspot with a desktop running windows 7 home premium.
I can connect fine. But when I key in www.google.com it stalls and finally times out. If I put the IP address in Google all goes fine and it connects immediately. I have found an article that says that the DNS server settings may not be set right. T-Mobil says all is ok on their end as the two tablets being used work fine.
is there something that should take place on my desktop so that it sends IP addresses?
I don't fully understand IPv4 and IPv6. I did see one diagnosis report and I think that it was from the hotspot connection that both were listed missing?
I have cleared the dns cache on the machine.
Larry

Kaktussoft No we had this machine on a wifi service in a park. however our machine does not have a wireless card in it so the admin. put a T-Link adapter on the machine for his Wifi and it work just great.
Right now i am trying to resolve if he may have changed some settings in handling web addresses so that his
wifi system could track usage and sites.
I have printed out your comments and will test them end of the week as the desktop is not available.
I will keep in touch.
larry

Kaktussoft Thank you for all the great information and detail instructions.
We now have everything running as it should.
Larry