We are on farm land and the diseases did not take long to arrive. And I bet there are a lot of slugs in those weeds.
Peas and sweetcorn can create a visual barrier pretty quickly.
I personally would not waste time sieving out stones. Those who did here are not doing any better than those who did not. I put recycled compost in narrow strips on top of the soil to give small seeds something to get their first roots into and believe also that it helps keep them moist for those all important first few days. Though plants grown in modules do get away better particularly brassicas. But stones or no stones my psb grow 4-5 ft tall or more, my beans are dripping from the plants etc etc. My parsnips are huge though may not win prizes. I do not do OK I have been doing very well.
But what about availability of water? Stoney soils can be rather too well drained. Also is it liable to be flooded?