CAN you do it -- sure? Should you do it -- NO. Messing with that partition risks your not being able to restore from it in the future.
If you really need the space, an alternative is to use something like Macrium Reflect (free) or Acronis True Image to image off your current setup to an external drive. That way, you have a restorable image and don't need the Recovery partition.