Validity Charging for Feedback Loop Emails

History

Return Path was a major driver for the establishment of Feedback Loops (FBLs) back in the mid to late 2000s. They worked with a number of ISPs to help them set up FBLs and managed the signup and validation step for them. In return for providing this service to senders and receivers, they used this data as part of their certification process and their deliverability consulting. Return Path had a strong corporate ethos of improving the overall email ecosystem that originated from the CEO and permeated through the whole organization.

In 2019 Validity acquired Return Path and within two months closed two offices and laid off more than 170 employees, many who are industry leaders and long time colleagues. In 2020 Validity acquired 250OK, one of their major competitors. Over the next year they then ended long term agreements with ESP partners, sued competitors and significantly raised prices for their product suite.

I was always a little concerned about Return Path’s near monopoly on certain parts of the email ecosystem. Under the guidance of the leadership team at the time, most of that power was used to improve email and drive the adoption of good practices (and a brief visit through old Return Path blog posts reinforces that memory). But that ethos left with that leadership team. In my blog post about the Return Path acquisition I noted that Validity’s announcement did not focus on the health of the email ecosystem. Instead they seemed focused on building a suite of tools designed to minimize the bad effects of acquiring addresses through channels other than direct opt-in.

It turns out that Validity is a very different company from Return Path. The dedication to keeping the email ecosystem healthy is no longer a part of their company ethos. As one Glassdoor reviewer put it: “at Validity you’re either sales or you’re sales support. There is no other position in the company.”

What happened

In mid-August a number of people reported getting emails from Validity announcing they would be charging to receive individual email messages (ARF reports) from their universal FBL. An example shared with me:

Email from Amber Bunch at Validity with the Subject Line: Important Update: Enhancements to our Feedback Loop Service and the text:
<p>Dear Valued Subscriber,
We are thrilled to announce some exciting changes coming in September to our Feedback Loop service!
What's Changing:
•Service Model Enhancement: Moving forward you will only have access to aggregated data insights within the application. To continue receiving spam complaints (ARF reports) you will need to upgrade your package.
• Login Method Update: We are introducing a new, more secure login method. Email authentication will change from a secure email link to a username and password method supported by Autho.
You will receive an additional reminder one week before the launch with additional information to ensure that you are well-prepared for the transition and have all the information you need to securely log in to your account.
Thank you for your continued support.
Best regards,
Universal Feedback Loop team" class=“wp-image-16549” srcset="/2023/09/validity-charging-for-feedback-loop-emails/validity-fbl.jpg 1544w, /2023/09/validity-charging-for-feedback-loop-emails/validity-fbl-300x207.jpg 300w, /2023/09/validity-charging-for-feedback-loop-emails/validity-fbl-450x311.jpg 450w, /2023/09/validity-charging-for-feedback-loop-emails/validity-fbl-150x104.jpg 150w, /2023/09/validity-charging-for-feedback-loop-emails/validity-fbl-768x530.jpg 768w, /2023/09/validity-charging-for-feedback-loop-emails/validity-fbl-1536x1060.jpg 1536w, /2023/09/validity-charging-for-feedback-loop-emails/validity-fbl-720x497.jpg 720w, /2023/09/validity-charging-for-feedback-loop-emails/validity-fbl-580x400.jpg 580w, /2023/09/validity-charging-for-feedback-loop-emails/validity-fbl-320x221.jpg 320w" sizes="(max-width: 1544px) 100vw, 1544px"/></figure></p>
<div class=

Other folks received similar emails, but without mention of charges. Still others received multiple emails, some saying they would be charged for emails and some only discussing the login update. Needless to say, there was and is a lot of confusion about what was actually going on.

At the end of August, Validity made a blog post about the program, indicating that summary data would be available for free, but actual ARF reports would be charged at a rate of $1500 a year, including a maximum of 100K emails, starting September 21. According to Validity employees in the emailgeeks slack channel, additional blocks of 100K emails can be purchased for $1500. Current Validity customers paying for any sort of product are apparently exempt from this payment.

Since this was announced, I’ve been talking to a lot of folks about their FBL makeup and volumes to try and get an understanding of how this change would affect them. As with most things in deliverability, the details matter, but there are a few trends I found.

  • The bulk of ARF reports are, unsurprisingly, from Yahoo/AOL and from Microsoft’s JMRP program, which are not part of Validity’s Universal FBL program.
  • Senders focusing on the business market or who send to non-US residents have very low volumes of Universal FBL reports coming in.
  • Of the reports coming from the Validity managed Universal FBL most reports are from Comcast (note: this may reflect the US nature of the folks I talked to).

Senders use ARF reports in a few ways: to suppress folks who report mail, to provide deliverability support for customers, and as part of their compliance actions against customers. The images provided by Validity as an example of their summary report doesn’t look like those reports are going to be useable for any of those functions. It’s possible that the “export as CSV” will have useable details, like the IP address or the customer identifier, but that remains to be seen.

A screen shot from a recent Validity email showing what their new summary page looks like. It has a graph with lots of lines, each one being a different ISP.  The X axis is a range of dates and the Y axis runs from 0 to 12K. There is a button for "filter" and a button to "export as CSV".

Validity’s rationale for doing this is that managing their Universal FBL product costs them money. That is valid. In the past they covered the costs of the program by leveraging that data in their deliverability and certification services. Return Path’s dominant position in the market and their commitment to the health of the email ecosystem allowed them to generously support FBLs for the benefit of senders, recipients and end users. But now Validity, an investment vehicle, has shareholders expecting healthy returns. In the face of a number of well-funded competitors in the deliverability space, the gutting of their deliverability consulting program, and an overall decrease in the value of IP based certification I expect they just can’t monetize the data the same as they did in the past. Consequently they’re going to charge for the FBL service directly.

What now

FBL consumers are now faced with some hard decisions. These charges are set to take effect September 21. This is a new expense coming at very short notice near the end of the fiscal year and right before the holiday mailing season. Talking with various FBL consumers the costs they’re estimating to cover their current Universal FBL reports range from $10,000 a year (sending 3 billion emails a month) to >$250,000 a year (sending over a trillion emails a month). One person I talked to pointed out that the amount they would be paying was more than 10% of their entire deliverability budget, including MTA costs, organizational memberships and conference travel. Many senders are scrambling to decide what to do. Some senders have publicly stated they’re just going to stop using Validity’s service.

Senders are understandably concerned that their deliverability will suffer if they cannot get the ARF reports. I’m not sure that’s as true as it may have been in the past. The major example is Google. Google does not provide ARF reports, they provide summary data. But folks still manage to get good deliverability at Google without the ability to suppress recipients that complain. Other ESPs don’t send FBL emails for every this-is-spam report and delivery is still possible there.

There are a lot of factors involved in the business decision to pay Validity for a previously free resource. I do expect, however, that few companies are going to be able to find the necessary funding in such a short period of time. I did have one colleague tell me they absolutely would not be able to find the funding before their next budget period starting next June.

If there’s one thing I have seen demonstrated over the years it’s the resilience and adaptability of ESP compliance departments. For practical and cost reasons I think a lot of compliance groups are not going to be able to access FBL emails at the current price point. I don’t think costs are something they can easily absorb and if they intend to pass them along to customers, that’s going to involve product and billing changes.

As a product rollout, this was badly executed by Validity. Even now, less than 2 weeks out from when the product is supposed to be live, there is nothing on the Validity FBL signup page about pricing or even any notice that there is a cost associated with receiving FBL reports. Their Universal FBL FAQ mentions nothing about pricing. There is no product page.

Next Steps

I think many email programs can thrive without FBL reports and don’t need to pay Validity for them. Some of this depends on what’s in the .csv download of the free summary reports; there may be enough information in them to be useful. But, overall, the vast majority of consumer mail goes to Gmail who doesn’t provide FBL reports and companies manage deliverability there quite well.

I also expect that some ISPs are looking at other options for providing FBL emails to senders. I spoke with one ISP employee that was supportive of the idea of a public discovery process for FBL emails. There’s even an independent RFC defining new header field for FBL messages to be sent to.

Opinions

I think, honestly, this is a badly managed money grab. Someone who doesn’t understand their existing FBL partners, perhaps someone new to Validity, saw something they thought they could get immediate revenue from and made that decision. They announced it publicly without putting together an actual product. There’s no landing page, there’s no pricing page, there’s no information on the FBL signup page, there’s no example free summary report. The only evidence of the new charges is a blog post and some confusing emails.

I also find it telling that what they’re charging for is the ARF reports and providing summary reports for free. It cannot be cheaper for them to extract and store all the data, manage a new interface and generate summary reports and forward email than simply to forward the email directly.

What I think is going to happen is many companies aren’t going to be able to pay for the FBL when it starts next week. They’re going to struggle through the next few months without access to FBL reports and then discover other data is just as useful at identifying problem customers. They’re going to find out that they can maintain their reputation and deliverability, particularly at the major consumer mailbox providers, without FBL reports from Validity’s Universal FBL.

I also think it’s long past time any of us who remember Return Path fondly to stop thinking of Validity as anything to do with Return Path. It’s not the same company. It doesn’t have the same values. They’re not here to make the email ecosystem better.

I am glad there are more competitors around and Validity is but one company in a diverse industry and, unlike many years ago, there are other options for most of their products.

This blog post would not have happened without the assistance of industry colleagues. You took the time to answer my questions, correct my misconceptions, share your data and emails, and provide feedback on this post. I thank all of you individually and collectively.

Related Posts

Deliverability, Return Path, List-Unsubscribe Header

Here are a few blog posts covering the email industry from Constant Contact, Return Path, and SpamResource.
Constant Contact posted a blog post about how they measure email deliverability on January 10th.  They started with just tracking bounce backs and using that metric to calculate deliverability but then moved to using seed list through a third-party and report that they get 97% deliverability.  Read more at Constant Contact
On January 6th, Return Path recapped their most read blog posts which includes covering Yahoo’s DMARC Reject Policy, Blacklist Basics, and GMails new FBL and Unsubscribe button. Read more at Return Path
Return Path and SpamResource both have an excellent write-ups about the preference change at Outlook.com/Hotmail regarding the List-Unsubscribe header.  Microsoft, like Google, prefers to use mailto instead of http or other URI protocols for the List-Unsubscribe header.
 

Read More

The Case of the 500-mile Email

I stumbled across this story again this morning, and it’s such a lovely delivery yarn I thought I’d share it.

Read More

Delivery Metrics

Last week ReturnPath published a study that shows 20% of permission based email fails to be delivered to the inbox. For this study, ReturnPath looked at the mail sent by their mailbox monitor customers and counted the number of deliveries to the inbox, the number of deliveries to the bulk folder and the number of emails that were not delivered.
At US ISPs 21% of the permission based emails sent to the ReturnPath probe network did not make it to the inbox. 3% of the emails sent went to the bulk folder and 17% did not make it to the mailbox at all.  MSN/Hotmail and Gmail were the worst ISPs to get mail to. They each failed to deliver more than 20% of the mail that was sent to them. At Canadian ISPs, even less of the mail made it to the inbox, primarily because primus.ca is such a large portion of the Canadian market and they use Postini as a filter. Postini is a quite aggressive filter and takes no feedback from senders.
ReturnPath’s take home message on the survey is that one set of metrics is not enough to effectively evaluate a marketing program. Senders need to know more about their mailings than they can discover from just the bounce rate or the revenue rate or response rate or open rate.
There are a lot of reasons an email doesn’t get to the recipient’s inbox or bulk folder. Mail can be hard blocked at the MTA, and rejected by the ISP outright. Mail can be soft blocked at the MTA and the ISP can slow down sending. Sometimes this is enough to cause the sending MTA to stop attempting to deliver the mail, thus causing mail to not show up. Both of these types of blocks are usually visible when looking at the bounce rate.
Some ISPs accept mail but then fail to deliver it to the recipient. Everything on the sender end says the ISP accepted it for delivery but the ISP just drops it on the floor. This is the type of block that a mailbox monitoring program is best able to identify.
Despite all the discussions of numbers, many marketers are still not measuring the variables in their email campaigns. Ken Magill wrote today about a study released by eROI that indicates more than a third of marketers are not doing any testing on their mailings.
Now, both of these studies are done in an attempt to sell products, however, the numbers discussed should be making smart senders think about what they are measuring in regards to their email campaign, how they are measuring those factors and what the measurements mean.

Read More