Custom Policy Question

I have a custom policy question. I set it on custom policy to alert me, but it won’t remember my settings. Each time i start firefox it pops up and i have to click allow even though remember my setting is checked. Does anyone know how i can have the firewall alert me of everything accessing the internet but me be able to allow something to always access the internet after it pops up the first time? Thanks