Lupins, I would chop off the stalks and discard. The chances are that what the seeds will produce will not be as good as the ones you have.
The foxgloves, well it depends on you, Each flower will produce a million seeds. You can allow some to fall and weed out any which grow where you do not want them, and/or you can save a few in a paper envelope and sow them yourself in spring.