Politics and Delivery

Last week I posted some deliverability advice for the DNC based on their acquisition of President Obama’s 2012 campaign database. Paul asked a question on that post that I think is worth some attention.

I am fascinated by the ramifications of email deliverability for political donations.
Are there sysadmins at the big ISPs who make human decisions on deliverability issues anymore? The power they have to make one candidate’s mail get delivered over another candidate’s mail is enormous. Paul Rydell

There are a lot of issues inside his questions, all of which deserve some discussion.
The first is who makes deliverability decisions inside ISPs. My experience is that it isn’t really sysadmins who do that. Even in the early days (late 90s) most of the delivery decisions were made by someone other than the sysadmins, at least at the big consumer ISPs. In the early 2000s most blocking decisions were handled by humans, making decisions based on data from their internal tools. As the tools became better, the decisions were handled automatically. By the mid to late 2000s, many systems were handling blocks and bans without a human having to review and allow them.
I don’t believe at most of the consumer ISPs and webmail providers that there is any single person with the authority to block mail. There are multiple people who are permitted to block mail that meets the criteria for blocking. But, those criteria are based on performance, not based on message. I’ve written about this many times before. (The Perils of Politics, Censorship, Email and PoliticsThey’re not blocking you because they hate youIt really can be your emailMore on TruthoutAnother perspective on the politico article).
There’s also an implication that one person “a sysadmin” shouldn’t have the ability to make decisions about what traffic is OK and what traffic isn’t. Except that’s exactly how it is. Sysadmins have a lot of access to our private data. Some of them can even read our email. Many sysadmins, particularly those who herd large numbers of machines, are very careful about respecting recipient needs, wants and privacy. I was once working with a friend who was a sysadmin at supernews to try and troubleshoot some USENET problems I was having. He made very sure to get direct permission from me to actually look at my account and log information.
Do I think every sysadmin is a bastion of integrity? Of course not. No group of people is perfect all the time. But I do think those individuals who have the power to block messages “follow the rules” when making blocking decisions. Those rules are written by the ISP management team, and people who block traffic have to answer to their manager (and manager’s manager) when they violate the internal processes and block things for reasons that are not behavior based. Everyone who has the power to block mail has a management chain that enforces behavior based blocking.
Then there’s the complexity of what a sysadmin is and what their job is. I asked Mary, who was a sysadmin at a giant consumer ISP in the late 90s, to talk about her experiences as a sysadmin and blocking issues.
Finally, there’s an implication that ISPs have a responsibility to accept and deliver every piece of email sent to them. It’s been established case law, for almost 20 years now, that ISPs do not have to accept and deliver every piece of mail (Cyberpromo v. AOL). If recipients are complaining about mail, there is no obligation for the ISP to deliver it.
Now, Paul and I have had these discussions before. We’ve worked together to address deliverability challenges for political mailers. Some of that work inspired some of my earlier posts on political mail and blocking. A lot of people really believe that email is a public channel, after all most of the public can use it. But it’s not a public channel. Most of the internet, in fact, is privately owned. The owners have a lot of authority to only allow certain traffic on their networks, and blocking email is in that realm of authority.

Related Posts

AHBL Wildcards the Internet

AHBL (Abusive Host Blocking List) is a DNSBL (Domain Name Service Blacklist) that has been available since 2003 and is used by administrators to crowd-source spam sources, open proxies, and open relays.  By collecting the data into a single list, an email system can check this blacklist to determine if a message should be accepted or rejected. AHBL is managed by The Summit Open Source Development Group and they have decided after 11 years they no longer wish to maintain the blacklist.
A DNSBL works like this, a mail server checks the sender’s IP address of every inbound email against a blacklist and the blacklist responses with either, yes that IP address is on the blacklist or no I did not find that IP address on the list.  If an IP address is found on the list, the email administrator, based on the policies setup on their server, can take a number of actions such as rejecting the message, quarantining the message, or increasing the spam score of the email.
The administrators of AHBL have chosen to list the world as their shutdown strategy. The DNSBL now answers ‘yes’ to every query. The theory behind this strategy is that users of the list will discover that their mail is all being blocked and stop querying the list causing this. In principle, this should work. But in practice it really does not because many people querying lists are not doing it as part of a pass/fail delivery system. Many lists are queried as part of a scoring system.
Maintaining a DNSBL is a lot of work and after years of providing a valuable service, you are thanked with the difficulties with decommissioning the list.  Popular DNSBLs like the AHBL list are used by thousands of administrators and it is a tough task to get them to all stop using the list.  RFC6471 has a number of recommendations such as increasing the delay in how long it takes to respond to a query but this does not stop people from using the list.  You could change the page responding to the site to advise people the list is no longer valid, but unlike when you surf the web and come across a 404 page, a computer does not mind checking the same 404 page over and over.
Many mailservers, particularly those only serving a small number of users, are running spam filters in fire-and-forget mode, unmaintained, unmonitored, and seldom upgraded until the hardware they are running on dies and is replaced. Unless they do proper liveness detection on the blacklists they are using (and they basically never do) they will keep querying a list forever, unless it breaks something so spectacularly that the admin notices it.
So spread the word,

Read More

Content based filtering

Content filtering is often hard to explain to people, and I’m not sure I’ve yet come up with a good way to explain it.
A lot of people think content reputation is about specific words in the message. The traditional content explanation is that words like “Free” or too many exclamation points in the subject line are bad and will be filtered. But it’s not the words that are the issue it’s that the words are often found in spam. These days filters are a lot smarter than to just look at individual words, they look at the overall context of the message.
ISP_tolerances
Even when we’re talking content filters, the content is just a way to identify mail that might cause problems. Those problems are evaluated the same way IP reputation is measured: complaints, engagement, bad addresses. But there’s a lot more to content filtering than just the engagement piece. What else is part of content evaluation?

Read More

Deliverability and IP addresses

Almost 2 years ago I wrote a blog post titled The Death of IP Based Reputation. These days I’m even more sure that IP based reputation is well and truly dead for legitimate senders.
There are a lot of reasons for this continued change. Deliverability is hard when some people like the same email other people think is spam

Read More