I've always composted foxgloves, I can't see a mechanism for their toxicity surviving rotting down, being spread and then entering any vegetables growing in the soil, though I haven't done the science. I tend to think that if compost is well made, then most dodgy stuff is rendered harmless.