Hi,
I think it would taste better if you leave it longer, it will sweeten as it ripens in the autumn. The skin will harden too and make it keep better.
There is still plenty of time for the marble sized ones to grow, all mine are still not much bigger than marbles!
T.