The Start menu is harder, are you sure you want to remove it? Did you mean the start orb (button)? The Start menu could conceivably be removed with Group Policy, but if the orb and taskbar are removed only, you could still access it via the windows key. I hesitate to link to possible methods to remove the start menu as they require registry edits. IF you decide to go there, make a registry backup at least. A System image is a better idea.
Maybe I will listen to you and will keep start menu. I didn't find my solution about taskbar so I used 3rd party application called "Taskbar Eliminator".