I've got rid of them in the past by letting out the contents of a can of wasp/fly killer into the entrance. I don't like killing wasps, but if they're in the wrong place... and this is them or you!
Poor your nose, post a piccie & we can all call you Rudolph!!!