[regression] Can't quickly remove a firewall rule any more

It is detailed in the User Guide and FAQ, but I agree that re-installing the app to reset is not the most intuitive method.