I would not be too concerned. Sadly, the majority of folks, certainly the younger ones ,do not enthuse over gardens, the prospect of upkeep necessity is actually a negative factor in their decision making.
Best 'tidy' it , and emphasize the safe play space. Any more energetic true garden lover will see it as a blank canvas
Because you are a garden lover, look to keep your options open, any new plants could be kept containerised and placed. Simpler to keep looking good , and ready to move, should that day come.
Keep cheerful, what will be, will be.