Windows 7: Video Thumbnails (Change Default Key Frames?)

I manage quite a bit of video files..and for the most part...
Windows always shows a thumbnail of the first "key frame",
which is usually a black screen. Not very helpful.



So far I know of two ways to change this.

1) Using video software... involves re-compiling the ENTIRE video just to add 1 friggen frame to beginning??

2) Convert each .AVI to .MP4...then download an additional program that let's you browse for a thumbnail..??

3) Create a short-cut of the video..then change the icon of the "short-cut" to an .ICO.
involves designing custom icons for EACH video-clip and the second you move things around everything falls apart.


______________

These are all rediculouse options...
would there be a third party APP, or Registry Hack that let's you change "keyframe" to the middle?