With the current weather, it's a difficult one. We have an Ashmeads Kernel which had a heavy crop, not quite ready. We picked them yesterday rather than risk them being blown down by the high winds. They'll ripen indoors.
But we've left the remaining Coxes on the tree, because they really do need a bit longer.
If we do get an Indian summer (though the forecast isn't looking good) it will have been worth leaving them. But who knows?