An improved version of the “Greylist”

An envelope on a conveyor belt passes through a gate, with a stopwatch in the foreground

Greylisting, one of the best defence techniques against spam, was starting to lose some of its strength. So we improved the mechanism. This has made greylisting considerably faster!

We have talked before about the black list and the white list for email: do you trust the sender of an email or not? Based on that, an email is rejected or let through. But this mechanism (which, incidentally, is almost superfluous at Onlinespamfilter) only works for email from senders you already know. What if it’s a new sender? How does Onlinespamfilter know it’s safe then?

In the waiting room

To check whether the sender of an email is genuine, we use a greylist: the email is initially rejected and placed in a waiting room.

Onlinespamfilter then tells the sender: come back in a moment. If the details (IP, sender and recipient) are the same, we know almost for certain that you’re a ‘regular’ sender. That’s because regular email servers use the so-called queueing mechanism: they offer an email, and if it doesn’t get through straight away, the server tries again later (usually after a few minutes). Most spammers don’t do this. It’s too much effort for them, and it also takes considerable resources when you’re sending bulk email.

Too many email servers

For years this greylisting worked well. But gradually some problems arose. What happened was this: a large party offered an email, the greylist put it in the waiting room, but when the sender came back to offer the email again, they used one of the (thousands of) other email servers at their disposal – one with a different IP address. So mail could be rejected again and again, and be delayed considerably as a result.

Selective greylisting

One way to counter this is to switch off the greylist completely. But that would mean switching off one of the strongest security techniques. That’s why we’ve added a new improvement to greylisting for our customers: this new version of Greylisting only becomes active when the offered email fails the SPF check. Many large parties have their SPF records perfectly in order, so their mail is let through immediately. This way of greylisting considerably improves the delivery speed for ‘clean’ emails and still gives the same protection.