I think you should look at this situation from another perspective, Eichhornchen. Just pave over the garden or lay concrete and you can either put up portable basketball stands with nets so you can play basketball. you could also use it as a squash court or play deck hockey on it. I'm sure there are other things you could do as well.
Now you have a nice recreation area.