Well, the good news is that once the nest inhabitants have died, ie Autumn, it will not be used again.
Most councils charge for the destruction of wasps' nests. Our's charges something like £50, on top of the extortionate council tax!!
If its not too invasive Mark, I would leave it alone. Once it has outlived its usefulness it will be abandoned.
valmarg