Hello Brandon, and welcome to Seven Forums.
Yes, the memory that you allocate for a virtual machine is only actually allocated and used when the virtual machine is running.
You can look in the Memory tab in Resource Monitor
to help see what is using your memory.
Hope this helps,