On the east dacing wall, you could try a blackberry, loganberry or tayberry type of cane fruit - training the current fruiting growth to one side of the fan, and training in new season's growth to the other side. They don't mind a bit of shade, know they aren't trees, but would do ok there.
On the exposed south facing wall, you don't say where you are in the country, but you'd probably get away with almost anything if you can offer a little protection from severe damage.