Sounds like you have some software the runs either on startup or shutdown that is cleaning these things out. Windows by default doesn't delete these things. Unless maybe there is a size limitation of the cache I'm not sure.
Thumbnail Caches are here: C:\Users\[USERNAME]\AppData\Local\Microsoft\Windows\Explorer
Icon Cache would be here: C:\Users\Logic\AppData\Local\IconCache.db