If you can take a picture of the overside and undersides of one of the affected leaves, we'll be able to help.
You mention not watering when it rains, but unless the level of rainfall matches your normal watering routine, which is unlikely, this may still constitute erratic watering.
For example I water my tomatoes, which are planted in the ground, with two pints of water, on Saturday and Wednesday. I water through a pipe that is embedded into the root area at planting out. Now two pints directly to the roots is a lot of water when compared to typical rainfall, if on Tuesday night I got 12mm of rain, this would not provide the plants with anywhere near the amount of root zone water they'd get from me watering, so I still water them anyway.
If your tomatoes are in pots, rainfall is unlikely to provide them with much water at all.