After you have changed your firewalling configuration, the firewalls need to be reloaded for these changes to take effect.
The firewalls will be reloaded automatically every 30 minutes (on the hour and half hour) if there are any pending configuration changes to be made. Outside of these times, there may be additional reloads that are run.
On your firewalling overview, the "Status" column indicates whether the latest configuration is live, or if it is "Out of Date" and a reload is required.
In the example above there are two servers with live rule groups, that both show as "Out of Date";
As soon as the firewall reloads with the new rule information the "Out of Date" will change to "Up to Date" as seen in the example below;