Not really, but what will you do in bad weather, winter & in case of not being able to get to the plot on a regular basis? Your wormery will be handy then if it's near the house? In a month or so, you may fill your allottment bins with the left over foliage from potatos, beans, peas etc....
Just a thought, but then again I am rather fond of my worms ( ???) and my allottment is a bit too far away to drop round just whenever.
Cheers