Is it for your system with Windows 7 Home Premium, as Windows 7 Home Premium supports only one language. Multiple language support is available for Ultimate and Enterprise versions only.
The language icon on startup screen and on the desktop's taskbar will appear only when your windows has more than one language installed (the default windows language and any additional language packs).
To remove the language icons from the system, you may have to remove additional language keyboards from the system, keeping one language (ex: English) only.
The languages can be removed from Control Panel - Region and Language - Keyboards and Languages tab - Change Keyboards.
Here select the additional language keyboards and remove them, keeping only one language of your choice.
Then go to Language bar tab and select "Hidden" Language bar and remove any check marks present in the bottom 3 fields. Close all the windows and reboot the system.