If its Bing in particular that you don't like, simply download another toolbar from the providers webiste for free. I use google. During the toolbar download, you will be given the option to make that your default setting rather than Bing.
You can then hide the tool bar by clicking X and choosing the option of permanantly hiding the toolbar. But the search bar stays beside the address bar, but at least its google search and not Bing.