It is a self deprecating joke about the terrible output of their personal garden because they are not good at it, not gardens in general.