How Fiery is your Firewall!!!!

Yes, I am talking about the software based firewall which most of us use .... free or paid...
And most often than not, the decision of a particular firewall is based on its price and recommendation by our "friends", but then have we seen any comprehensive tests of these... something which would test each firewall for vulnerability...?

I came across one such study in the always useful Scott's Newsletter. You can get a copy of the same at http://www.scotsnewsletter.com/91.htm . Yes, its free . Its amazing how someone can write such a useful stuff, which obviously takes up loads of effort and maintain good quality and yet keep it free.

Coming to the discussion, Scott Newsletter pointed me to quite a comprehensive lists of tests done for personal firewalls. yes, it includes the seemingly popular firewalls , Zone Alarm( free and Pro versions tested separately), McAfee, Norton Internet Security, Sygate and lots of others and it ranks them. You will be surprised by the results of the effectiveness of your firewall and perhaps your "sense" of security might change once you go through the results.

Here is the link to the full report,
http://www.matousec.com/projects/windows-personal-firewall-analysis/leak-tests-results.php#firewalls-ratings

Or take a look at the firewall effectiveness at this website:
http://www.firewallleaktester.com/tests_overview.php
(Click View results to see the results comparing different firewall products).

Well, though it has been stressed in tests, but its a point worth noting that the firewall tests were carried out after "disabling" the antivirus. The raw strength of firewall defence was used to asses them. But in a real world, there is generally an antivirus running on user's pc, hopefully with latest definitions and engines. These antivirus can block some of the attacks , but then quite few and not really a great alternative to firewall's own strength to catch them up.

Hope this helps in choosing the firewall, more on rationale.