Firewall notification steals focus and wont disappear when you click Allow/Block

The firewall notifications sometimes just stay no matter how many times you click Allow/Block. This is really annoying and inconvenient at times as it blocks you from seeing anything behind it. Anyone else with this issue? Any fix?

I clicked allow like 50 times! Actually 30 or so......but still!!!