You must be talking about the THUMBNAIL view?
If so, under the Control Panel (make sure you change the view by to large or small icons to achieve a detailed list of what is in the CP) and enter / choose the Folder Options the Popup Window will have a view tab, select it. Then make sure the first option is UNCHECKED and the third option is CHECKED this way you can see the default program icon on the thumbnail view.
You can set the default views for all folder windows GLOBALLY by opening a window choosing the Tools on the file menu in the window, and options, then select /deselect the option in the advances settings under view,and click Apply To Folders...
Cheers...
Shane