There's nothing to worry about, I have the same thing happen to me occasionally, if I have too many items in the taskbar; the file icons will be fine and then disappear and then load up again all together in a few seconds.
I don't get the problem if I have 6 or less programs on my taskbar at boot.