The PSU has a pretty good reputation.
The CPU is serious overkill for what a kid would need at school, but if it fits the budget, go ahead on.
Likewise, 4 GB of RAM is likely enough for any prospective use, but if it fits the budget......
Case is personal preference---they may want red, side panel windows, etc. I'd look at an Antec 300 for the same price, but it's all personal preference.
I assume you don't need to buy any Windows licenses?
No DVD drive?