This happened to us last year. We were about to spray when the ladybirds arrived and cleaned up the lot. Within a few days, no blackfly! I haven't had to spray at all this year.
Leave it for a day or two and see what happens. (If nothing does, do something about it yourself!)