i am growing winter savory - same story. it does say to sow them outdoors - and i am wondering if they should really have been sown in something like root trainers or loopaper rolls, to enable them to sink deep roots?
mine where pr i cked out into modules and are still small. but, they are steadily gorwing. so will pot them into something deeper, and then they can go out next month into their allocated spots.
btw, savory is super! you will not regret growing it, and cooking/eating it with beans.
it's not for nothing that this is called 'the bean herb' in germany :)
good luck to us both
svea