The behavior of Internet Explorer only remembering the very last window closed is by design.
This happens because each new window becomes a new session.
Internet Explorer is designed to remember the last, not necessarily the most important, window/session that was open.