Has Google moved the email marketing cheese yet again? No we are not talking Gmail Tabs. If you keep a close eye on the industry and have your finger on the pulse of email then you just may be under the impression that it has. If you are one to listen to the rumours then you may be of the belief your unable to track opens at Gmail anymore at all, or that you can track unique opens, but not repeat opens: that this problem is ubiquitous across the industry. There was discussion on an industry list today, that intimated there were big problems with open tracking, I was obviously concerned.
It may well be the case depending on what email platform you use, that your open tracking has been disrupted at Gmail, however it is NOT a given, and you should test and/or ask your provider yourself. I have spoken with ESP’s that say image tracking appears completely ‘broken’, others who say they can only record unique opens. In my own tests I found at least one large self service ESP that only recorded one open per recipient, unless that recipient changed device. As the Postmaster for Campaign Monitor, sending tens of thousands a message to Gmail every hour, I have not seen any issues with open tracking. However some of our more advanced features such as geo-location tracking have been affected. This is a very small subset of any senders recipient base (see earlier discussions about the impact of tabs for more background on this).
SmartFocus & Campaign Monitor are both completely unaffected in regards to open tracking and the latest Gmail changes, further ExactTarget & Lyris report they have no issues. To see a video illustrating this check out my Youtube Upload.
Laura Atkins blogged early and provided some extremely valuable initial intelligence. I however needed to clarify what the situation was exactly for my clients who entrust me to have their mail delivered, their lists managed, and their activity tracked. There are a number of issues at play here, and by digging into the data available to me at Campaign Monitor I was able to crunch some numbers and draw some conclusions, I hope by sharing this it can prove useful to some of my colleagues and counterparts in the industry.
Why would Gmail change things?
I rather suspect user experience, they are betting they can do things faster this way. From my personal experience and the anecdotal evidence of others, Gmail has been much faster the last day or so.Anything that improves the customer experience of the email channel is generally a very good thing for the legitimate email marketer.
What has changed at Gmail?
Images are being served via a proxy for Gmail users. From what I can see from logs (and the numbers do not lie) this issue started to occur 3 days ago.
There are four issues at play:
1) Cache; Content caching which has been around for a while
2) Proxy; IP address masked caused by the requests being proxied
3) User Agent; Google appears to grab with their own User Agent
4)Hard Limits; The proxy/cache does not seem to support files in excess of 10MB in size
Point 1 is one that many fixated on, however this has been going on for some time now, Gmail has been caching images client side for some time now. Reloading your browser window gets round this and the new change that took place recently does not impact this in any way at all from what I and others can see.
Point 2 Gmail is proxying requests for images and in doing so is Proxying their requests and thereby masking the original IP address. For reporting on geo-location, or serving up different images based on geo-location this IS a problem. For example Campaign Monitor This does not seem to affecting our ability to track opens, however it is affecting our Geo Location lookups with everything opened via the Gmail client seeming to come from Mountain View, CA.
Steve Atkins from Word to the Wise recorded the http headers from a request and it seems to indicate NO x-forward header (HTTP_FORWARDED or HTTP_X_FORWARDED) is being issued. If Gmail would add this, EDM platforms and providers could fix these issue of their own accord.
Gmail appears to provide the original user-agent within the request, however code changes are likely to be required at various EDM, Tracking and Reporting Platforms to ensure this issue can be worked around. However it is not out of the control of EDM platforms to resolve this issue without any further change or assistance from Gmail. This is a problem still, see comments from Harald…
Point 4 Honestly I know some people are doing some real ‘smart’ things with email, and video is oh so popular, but – that was not what email was designed for. I see no issue with this.
When did it start?
From what we can see 3 days ago. The following stats for the geo-location of opens show a significant increase from Mountain View CA since the 1st of Nov.
The numbers below represent a small subset of Campaign Monitor client lists (by taking a statistically significant portion of the client databases, I can be sure of accurate results but utilise far less computing time). What we can see is an unnatural spike in opens from Mountain View, so either tens of thousands of people moved there this week, or something strange is happening. In this case, this subset of clients all happen to have their campaigns housed in a DataCentre thats fastest rout to Google is straight into Mountain View, CA. For other vendors, platforms and marketers the opens may not spike in Mountain View, it depends on the location of your DataCentre and what interconnectivity and peering arrangements you may or not have in place.
DATE : Opens from Mountain View, CA (Google DC)
So in short, I think of the 4 issues that people are discussing there is only one that is proving to be an issue that EDM platforms cannot resolve for themselves and would need some assistance from the Gmail team. That is “Point 2 Gmail is proxying requests for images” It may be that Google is playing some kind of ‘Privacy card’, and that they had every intention of achieving this, and it was not an unintended consequence. I have even heard the suggestion that this may in some way relate to limiting the amount of information that could be provided to the NSA by Google, though I am not sure I truly understand that concept.
I have a direct contact on the Gmail team and will forward my synopsis, a request that they include an x-header that identifies the original IP and a link to this post. I believe if it is not privacy concerns that are at stake they may make a change. I don’t however expect any feedback from the team, and definitely no statement would be released by way of EmailExpert.org. Hopefully the Gmail Team may blog about this, especially so if it is their intention to obfuscate the recipients IP address.
I plan to continue to monitor the situation closely, I will see and report on any changes.
edit, read the latest post on the subject here: The fix for Gmail Open Tracking is revealed here
Please Note: This POST does NOT represent the views of my employers. They have a great blog here, and will likely make an official statement of their own.