For the geraniums, I would have no problem watering them with Provado, the systemic insecticide.
With regard to the chillies, if you have any french marigold seeds, I would sow a few in the compost at the top of the pots. Might take a little while for them to germinate, and become effective, but that would be my 'organic' remedy.
We are organic, insofaras we will not spray/use any noxious chemicals on anything we eat, but have no problem using them on the 'ornamentals'.
From experience the french marigolds are the only reliable form of 'companion' planting we have used, and found to be effective.
valmarg