Do it yourself mail systems

Through my position here at Word to the Wise I’ve interacted with dozens of companies over the years. Some companies outsource the mechanics of email sending to email service providers, others buy a software or MTA solution from one of the many vendors out there. For both these groups delivery problems are usually issues with permission or user expectations. Technically there are few problems with sending, bounce handling, unsubscriptions and rate limiting. The commercial software, either as created by an ESP or a vendor, typically does these things well.
The last group, those who use a home built system, are a whole different story. They often do no bounce processing relying on the underlying mail transport agent (typically qmail) to do all that work. The problem is that a general mail transport agent handles bounces for a particular email send, but does not have any functionality to handle future emails to addresses that bounce. Consequently the list does not get bounce handled, dead addresses pile up and their delivery rates plummet.
A few weeks ago Derek talked about senders using homegrown email systems and the pitfalls therein. He has a good list of things companies should think of before deciding a home grown system is right for them.

First, there’s a platform’s subtle complexity. Sending an e-mail is a trivial task and it’s easy to think, “How hard can using an in-house system be?” But managing bulk e-mail delivery can be very hard. Million-to-one chances, things you’re never likely to see using your desktop software, show up every day and must be handled gracefully. Plus the major ISPs all have their own standards for acceptable bulk delivery. They have a multitude of concurrency and session limits, extremely variable response codes, and a plethora of other requirements, some of which contradict Internet standards.
A second challenge is scope. A good system must handle bounces, vacation messages, replies, click-throughs, opens, opt-outs, opt-ins, profile management, and forwards to a friend. It must be able to monitor deliverability and reputation and facilitate corrective action where necessary. And it must be capable of collating these results and presenting them in a meaningful manner in real time.
Third is moving goalposts. Once a system is built, it must be maintained. In this young medium, best practices are constantly evolving and your system must run just to stand still. Adding support for systems such as DomainKeys and DomainKeys Identified Mail (DKIM) takes significant time and expertise. We can expect this trend to continue with such requirements as support for SMS, RSS, behavioral targeting, and dynamic messaging.
Finally, there’s expertise. The same Forrester report indicates that most companies have fewer than four employees managing their e-mail marketing programs. The additional requirements of software, e-mail, and deliverability expertise will inevitably require the team to be substantially larger with a commensurate increase in cost. Staying abreast of current developments and industry best practices can be a full-time job.

I have worked with a clients to improve their homegrown MTA and it is possible. It is also expensive to repair the damage done by a home grown MTA, both in terms of the delivery hit and in terms of development effort.

Related Posts

Mailing to corporate domains

One of the struggles of delivery consulting is doing ISP relations and problem resolution for clients attempting to mail to corporate domains. The rules for getting mail into ISPs are generally pretty clear, and if they’re not I can typically find someone there who will give me the time of day. At corporate domains, though, all bets are off.
While ISPs strive to deliver wanted mail to their customers while protecting them from spam, businesses have different goals for email. For most businesses email is a tool. Mail boxes belong to the business, not the employee. In many cases, businesses do allow personal use of email so some marketing mail to employees is acceptable. However, if a corporation blocks personal marketing email, they are less likely than commercial ISPs to let even legitimate email through.
Large corporations typically run their own mail systems. Once a sender is blocked, however, the corporation will not unblock their email unless the sender can demonstrate that the mail is business related.
Smaller businesses typically use commercial appliances or filtering services. In these cases there is less need to justify the business related nature of email. Unfortunately, some commercial filters do not listen to senders or provide block resolution. At least one filter claims that the only way you can deliver mail to their users is for the users themselves to whitelist the sender.
Businesses of all types are much more security conscious than home users. Some “spam” blocking may be more related to security than actual spam. Finally, there are workplace and environment issues. Companies may be liable under the hostile workplace laws if they allow porn or other offensive emails into their employee mailboxes. One company I know of blocks any email with the word “viagra” in it. The email administrator of said company says that in the years this block has been in place there has only been one false positive… and that employee was told his wife should not use that word when emailing him shopping lists in the future.
All of these issues make it difficult to troubleshoot delivery problems at corporations.

Read More

Marketing and Delivery blogs

Mark Brownlow links to a number of marketing and delivery blogs over at his website. Different perspectives and different thoughts will give you the tools to create the best email marketing campaign for your business.

Read More

ISPs like boxes of meat

On the heels of JDs post about building relationships with ISPs, many of our Abacus customers and our ISP contacts have been commenting that boxes of meat are always welcome.
Please, remember to send them boxes of meat.
Meat may not get your email delivered, but it will make the ISPs remember you fondly.

Read More