What happens in the background when you ‘correct’ an email at Onlinespamfilter?

A hand pressing a large glowing button

Despite our careful approach and our self-learning system, we do make mistakes now and then. We notice that people sometimes live under the illusion that a spam filter stops everything and never makes mistakes. There are zero spam filters in the world that never make mistakes.

Has the spam filter made a mistake? Then you correct that email. By a mistake we mean that we let through an email the user considers spam. Or that we hold back an email we take for spam, when to you it is not spam.

Correcting an email

In our portal you can look up that email and mark it as spam or not spam with 1 press of a button. That is all you need to do to correct an email with us. We also believe this is the right level for the user. It should not be complicated. On top of that, it is a quick process. If someone does need help, a quick phone call does the trick. If we get 10 calls in a week across thousands of customers, that is a lot. So our system does pretty well. Why? Because it is a self-learning system. Among other things, it looks for parallels between emails for different domains. The system fine-tunes a great deal internally based on the activity that comes past.

What do we do?

As a user, you notice nothing of what we do with corrections. It is all processed automatically in the portal. Onlinespamfilter is built from modules. We use a lot of open source components. These parts are good in themselves, but nowhere near the quality that Onlinespamfilter.nl delivers. In general we always remove more than 99% of the spam from the email traffic. For some customers even 99.9% or more.

How do we reach these high percentages? The big secret is that an overarching management process has been written for all those components. This process monitors the outcomes of all the sub-modules and combines their results into an overall verdict, using a form of Bayesian statistics.

A unique spam filter for every customer

The strength of our system also shows in the customer domain. For each of our customers, this is a unique spam filter. The filter is adjusted per customer to the activity that does and does not get through our spam filter. In turn, the customer gives us more knowledge by correcting emails as spam or not spam in the portal. This makes the spam filter even smarter. So the spam filter we offer is fully tuned to the company concerned.

At Onlinespamfilter you can set up your own grey area without having to think about numbers. All you have to do is press the ‘spam’ or ‘innocent’ button. If you do this faithfully, your detection rate will be high and little will go wrong.

Overarching process

When we see that a great many people make the same correction, an overarching process kicks in. It may then be a large spam attack that we have not detected before. The spam filter parameters are adjusted based on the corrections, although for larger adjustments an Onlinespamfilter operator always has to be involved.