I grew yellow pattpan last year and they were fairly productive, though not wildly so.
So it does sound like pattypan are a bit hit-and-miss, you're right.
I think next year I'm going to grow something more reliable and early. I chose a lot of interesting and tasty veg, but the trade-off is sometimes you get a bit envious, looking at other people's plots if they grow earlier stuff!