You already know about Facebook over-calculating how much time people spent, on average, watching Pages’ organic videos and brands’ video ads. You already know it’s done away with only calculating that figure when people viewed a video for at least three seconds. But how much do you know about how Facebook is replacing that metric or whether the platform-provided metric even matters?
Facebook’s new average watch time metric may sound straightforward, but it has a twist. And soon enough it won’t be the only average watch time metric that Facebook offers advertisers and Page owners.
Facebook’s new average watch time measurement, which is provided for Pages’ organic videos and for video ads, takes the total amount of time that people watched a video and divides by the number of times that video was played, either automatically or after being clicked. Simple enough, except that Facebook defines a “play” differently than you might expect. Facebook counts a play only once when someone watches a given video within a 30-minute period that the company refers to as a “user session,” i.e. any replays within that time frame are not counted and it’s possible for a video’s average watch time to exceed the actual length of the video, a Facebook spokesperson confirmed.
Let’s take a 30-second cooking video as a hypothetical example of how the new average watch time metric is calculated.
I come across this video while scrolling through my news feed, but I’m not paying attention to it yet. I scroll slightly past it to some post about some back-to-back-to-back shark attacks in Florida, so it plays in view but only partially. After 15 seconds, a splash of milk catches my eye and I watch the rest of the way through. It’s a cooking video, so I’m mesmerized. But I don’t catch the first step, so I replay it but only to see the 15 seconds I missed in the first watch. As measured by Facebook, I spent 45 seconds watching the video but only played it once since the replay happened during the same user session as the initial play.
My girlfriend also comes across the video. She’s cool with cooking videos but is lactose intolerant, so when the milk gets poured into the frame 15 seconds in, she tunes out. Facebook jots this down as 15 seconds in watch time and one play.
Then Facebook crunches the numbers. Based on these two viewers alone, the 30-second video’s average watch time clocks in at 30 seconds. And its percentage watched metric — a video’s average watch time divided by its actual length — is 100%, even though the video was only watched to completion once.
Facebook’s new average watch time (and percentage watched) metric “is telling you something
Sep 30, 2016 at 10:57am by Nadine Dietz & Erica Seidel
What does food delivery have to do with the presidential debates? Well, up until a few days ago, many would have said nothing. But not Barbara Martin Coppola, chief marketing officer of Grubhub.
“Food is personal, and presidential preferences are personal, too,"…
Sep 26, 2016 at 3:09pm by Marketing Land
At MarTech Europe, you'll hear stories from marketing and technology experts about their digital transformation challenges and success. Find out their secrets for building their marketing stacks… and doing it right. Register for an All Access Pass by Friday and…
Sep 22, 2016 at 11:33am by Matt McGee
Google is rolling out its Accelerated Mobile Pages (AMP) platform to the core mobile search results. AMP results used to only show in the news carousel, but now these pages will be mixed in with all mobile search results. It's…
Sep 22, 2016 at 10:16am by Nadine Dietz & Erica Seidel Hilton Amsterdam Airport Schiphol (c) 2016 HHonors
When we interviewed Geraldine Calpin, the Chief Marketing Officer of Hilton Worldwide, we couldn’t help but think in terms of “Magical Thinking and Heroic Action.” As the new marketing leader of…
Sep 20, 2016 at 8:57am by Marketing Land
SMX East kicks off in just a few days! Why settle for flat SEO and SEM performance? Get actionable SEO and SEM tactics and best practices in retargeting, AdWords scripts, backlinks, adaptable content, and more. View the exceptional content in our agenda, then register for the ultimate…
Sep 19, 2016 at 11:02am by Matt McGee
With the holidays fast approaching, shopping season has already begun for some and others are sure to start very soon. Online retailers can bring in new customers with a well-planned shopping campaign on both Google and Bing.
In this week's…
Sep 12, 2016 at 12:12pm by Marketing Land
Back in 2007, I took a job with a large software company that built a massive but traditional software business. My team was challenged with shifting our enterprise CIO customers perspectives away from traditional products to cloud-based enterprise offerings. At…
Sep 12, 2016 at 11:55am by Matt McGee
Apple dominated the news space this week with its iPhone 7 and other hardware announcements, but marketers should be paying more attention to what happens next week when Apple releases iOS 10 to the world. In this week's episode of…
Sep 8, 2016 at 10:41am by Nadine Dietz & Erica Seidel GE Healthcare's US Life Sciences headquarters in Marlborough, Massachusetts, via the company's Instagram account.
In this look into how CMOs are transforming marketing organizations for the challenge of reaching people today, we spoke with Justin Steinman, CMO…
Sep 6, 2016 at 2:12pm by Stephanie LeVonne
You've probably heard the phrase "duplicate content" being thrown around from time to time, and like any savvy webmaster, you’d never dare to publish the same content twice — but have you?
Duplicate content is the equivalent of overdrawing your checking…
Sep 6, 2016 at 12:57pm by Marketing Land
Classes are in session, and not just for the kids. Polish your SEO & SEM skills at any of the four incredible full-day workshops on Monday, September 26. All workshops are held the day before SMX East kicks off in New…
Sep 6, 2016 at 9:34am by Chad White
I’m a sucker for a good sound bite, and I heard plenty of great ones at our company's *conference in Boston a few weeks ago. However, as a researcher and former journalist, I also like to dig into a sound…
Sep 6, 2016 at 8:43am by James Green
We all know digital video is leaving its mark on television, but the jury is still out as to just how significantly it's affected. TV still dominates in terms of viewership and ad spend, but data shows that consumer behaviors…
Sep 6, 2016 at 8:30am by Amy Gesenhues
There's no single event as big as the Super Bowl when it comes to brand advertising. This year, more than 50 brands invested upwards of $4.5 million to buy a Super Bowl ad – and that doesn't include what each…
Sep 2, 2016 at 12:35pm by Maggie Malek
Once upon a time, great brand strategists understood that one of the best ways to reach consumers was through the people they love and align with.
At its core, it’s a great idea! Get leaders, celebrities or someone with an audience…
Sep 2, 2016 at 10:45am by Chris Kerns
If you're beginning to see fewer and fewer vacation photos in your social streams, you're not alone. As the summer winds down, so does the busiest time of the year for travelers, airlines and hotels.
But the season passing doesn’t mean…
Sep 2, 2016 at 9:47am by James Collins
The ideal brand relationship is much more than a single experience. It comprises multiple experiences and events that tie the consumer to that specific brand. That brand becomes the go-to for purchasing the perfect birthday gift or the top destination…
Sep 1, 2016 at 11:40am by Matt McGee
You may not have noticed, but things are changing substantially in the local search space. Google has made several moves this year that have some local search watchers talking about visibility becoming more of a pay-to-play scenario. Meanwhile, voice search…
Sep 1, 2016 at 9:35am by Lori Weiman
Welcome to the final article of my series on how to work more effectively with ad partners in highly regulated industries.
My goal has been to show advertisers how to embrace, not fear, the federal ad regulations governing them and their…
Aug 31, 2016 at 12:05pm by Matt McGee
There are probably countless articles on Marketing Land (and Search Engine Land) that encourage readers not to put all of their marketing eggs in one basket. And I know that message has been drilled home countless times over the years…
, but I would chalk it up more to being confusing than necessarily good or bad,” said Noah Mallin, head of social at MEC North America.
It is confusing. Probably because we’re used to thinking of average watch time as a measure how long people spend watching a video each time they watch it. But that’s not what Facebook is measuring here. This isn’t average watch time per view; it’s closer to average watch time per viewer (though if it were really per viewer, then Facebook would count one play per user, not one play per 30-minute user session and thereby count replays outside of that user session as if the viewer was somebody else entirely). Facebook is trying to account for people who watch a video more than once because, according to a Facebook spokesperson, advertisers have told Facebook they want to factor in repeat viewers because that would help them evaluate a video’s popularity.
“If average watch time exceeds the length of the video, that means you have something incredibly watchable,” said Mallin.
That watchability can also translate into the numbers that advertisers really care about, like whether someone is more likely to think of a brand when they’re in the market for a product in its category. That’s why Facebook’s methodology blunder — “they had the wrong denominator,” said Horizon Media’s executive VP and managing partner of digital investment, Sarah Baehr — has gotten so much attention. On the one hand it’s a math error specific to a supplemental metric that doesn’t affect how brands are charged for their ads; on the other hand it’s a metric that has a ripple effect.
“Time spent with ads and content is often highly correlated to metrics like awareness, interest and action like sales, so [average watch time] is an important KPI [key performance indicator],” said Scott Symonds, managing director of media at AKQA.
What about brands, publishers or other Page owners who want something closer to the old, if ill-defined, average watch time metric that told them how much time people spent watching a video per view? Facebook’s working on one.
Facebook is developing a Unique Average Watch Time metric (and corresponding Unique Percentage Watched metric) that would approximate a video’s average watch time by view. According to a Facebook spokesperson, the unique average watch time would take the longest single instance that an individual watched a video and add that duration — and only that duration — to the video’s total watch time, would count one play toward the total number of plays and would divide total watch time by total number of plays.
Let’s return to that hypothetical 30-second cooking video to lay out how Facebook’s unique average watch time measurement is calculated.
I watched the video twice — once in full and again for 15 seconds — and my girlfriend watched it once but only for 15 seconds. Instead of adding both of my watch times, Facebook would only take the longest one because it just wants to know the maximum amount of the video I watched in one go. So my 30 seconds plus my girlfriend’s 15 seconds equals 45 seconds in total watch time. Since Facebook is only taking one watch instance per viewer, it’s taking one, and only one, play per person. So while the normal, non-unique average watch time totaled 30 seconds (100% percentage watched), the unique average watch time would work out to be 22.5 seconds (75% unique percentage watched).
Neither Facebook’s new average watch time or upcoming unique average watch time metrics are perfect. But even if they were more exact — such as by removing the 30-minute user session stipulation to make average watch time a truly per-viewer metric — they wouldn’t be perfect.
“In a perfect world, what we want to see is complete third-party verification of all data,” said Mallin. “That’s what everybody would like, and it’s not just a Facebook issue.”
It’s not necessarily that media buyers think Facebook would fudge its numbers to make itself look better — or if they think that, they don’t say it aloud, at least not to me — but that an independent auditor could erase room for error. Publicis Groupe used Facebook’s measurement error to emphasize “the absolute need to have 3rd party tagging and verification on Facebook’s platform,” the agency holding company wrote in a letter to clients, according to The Wall Street Journal.
But here’s the thing about that need for independent verification of Facebook’s video ad metrics: It’s already available. In the past year Facebook has signed deals with Moat, comScore, Integral Ad Science and Nielsen to independently measure its video ads. And Moat CEO Jonah Goodhart told AdExchanger earlier this week that his company’s measurements of Facebook’s video ads, including average watch time, “are accurate.”
And it’s not like measurements from independent firms are immune to error. Earlier this year comScore got called out for over-calculating how much time people were spending within Facebook’s mobile apps. The reason? A bug in Facebook’s code that made it seem like people were actively checking Facebook when in reality the app was running in the background.
But the fallibility of Facebook’s or independent firms’ measurements isn’t really the issue. They’re a problem part of a bigger problem. Many brands want to be able to measure their Facebook ads in a way that they can stack them against their Snapchat ads or Twitter ads or YouTube ads or TV ads. That’s the root of why they want to have objective parties do the measuring; those firms can set their own measurement methodologies in order to establish metrics that can be applied across different platforms. “We prefer to use third-party metrics so they are comparable across platforms,” said Symonds.
So would sports fans trying to settle barstool arguments over who’s the greater athlete among Serena Williams, Michael Jordan and Michael Phelps. But what are the criteria: Championships won? Championship winning percentage? Quality of opponents? Longevity? Difficulty of sport?
Not all media buyers are in agreement that, even if such apples-to-apples comparisons become available, they’re worthwhile.
“The key thing is how do we get to a metric that’s about evaluating video that’s on a mobile phone within a feed,” said Baehr. “And if it really is about a replacement for a declining viewership in TV, is the expectation that that video is one-for-one going to have the same impact? I think we all agree that watching anything on your mobile phone is just different.”
And even within the context of the mobile phone, it’s different. A sound-on, full-screen vertical video on Snapchat is not the same as a sound-off, in-feed horizontal video on Facebook is not the same as a sound-on, full-screen horizontal video on YouTube.
At the risk of overusing sports analogies, it’s like trying to compare athletes of the same sports across eras. It’s easier to compare Serena Williams to Steffi Graf and Billie Jean King than to Michael Jordan and Michael Phelps — but not by much. You can standardize the comparison by looking at stats like matches won and winning percentage. But how do you account for less quantifiable variables. Does it matter that medical treatment and training/diet regimens were different for each athlete, and if so, by how much? What about how much money they made in their careers, and the extent to which that income relieved (or didn’t) off-court pressures, making it easier or more difficult to skip less meaningful tournaments or smaller obligations? What about travel accommodations? Or the pressure that comes with how high-profile the sport in general and Serena in particular has become? How do you account for context?
But let’s say marketers come up with a way to quantify context. Maybe there’s a way to weigh sound-on versus sound-off, vertical vs. horizontal, full-screen vs. in-feed. Then the concrete metrics become even more important.
If a brand can know with some certainty that a person watching a sound-on, full-screen vertical video is worth 150% more than a sound-off, in-feed horizontal video, then it matters if people are spending 150% more minutes on average watching the sound-off, in-feed horizontal video. And it really matters that those time-spent measurements are accurate, not inflated by 60% to 80%, as Publicis has claimed Facebook’s self-reported average watch time was.
Without those concrete metrics being a solid foundation, any consideration of context and any cross-context evaluation crumbles.
“Everybody wants to understand better what the actual impact is of what they’re doing, not just on Facebook but all of these platforms,” said Mallin. “Since they’re such different environments, it lends itself to having a lot of different questions arise. The more we’ve been able to learn from the platforms, the more ability we have to put things into context and get down to true performance.”