I'd water the roots then pull up the plant or use a fork and carry the entire thing to the wild area and slot it in next to a live ragwort so the caterpilars can transfer easily.
The plant is poisonous to cattle and horses and we have both on 3 sides of our plot so I've been pulling ragwort up by hand, after checking for caterpillars, and have had no ill effects.