That's normal. It only shows "peripheral" or external devices, plus the computer itself. If you right-click the computer icon in there and choose "Properties" all the internal stuff (including the CD/DVD drive) will be listed.
A CD/DVD drive would only have it's own icon in there if it was an external model.