I leave mine till the end of the year, then pot them on, unless they're obviously crowded, then plant them out ofter two years. I'm just taking stock of what I lost in the cold spell; a lot of Paeonies, some Hellebores, some Trilliums (I think; they may yet be late), and a kitchen sink full of Lilium regale.