5 Pitfalls of Measuring Social Media ROI

Trap
Photo by lavverue

“Social media” and “ROI” - it’s hard to find two bigger buzzwords among internet marketers over the past couple of years.* Yet the combination of the two of these fields create both a compelling, yet elusive industry. Literally dozens of social media analytics companies have popped up over the past few years. Radian6, Visible Technologies, Scout Labs, Meteor Solutions, Techrigy (Alterian) and 20 Decibels are just a few of the most well known professional social media analytics tools available. That’s not to mention the countless number of free measurement tools - a list that includes Social Mention, Twitalyzer, Monitter, Klout, Twendz, Twitter Grader, Trendistic, and more. The list goes on and on.
*I should know, two of the topics I write on most extensively for Viralogy are social media tactics and online ROI.

These companies continue to pop up because nobody has done (or can do) a perfect job of social media analysis. Social media analysis and ROI measurement is a difficult thing to measure, and there are some who say it’s immeasurable. A once-common retort is “how do you measure the ROI of your telephone”? The plain fact is that measuring social media ROI is not (nor will it ever be) an exact science. But it can be measured and analyzed. The important thing is to be wary of and avoid the frequent pitfalls that come about when measuring it.


ROI Background

First off, keep in mind that when we talk about measuring ROI, we’re talking about measuring a dollar value - ROI (return on investment) a monetary metric. We’re talking about measuring the revenue (return) of a product compared with the cost (investment). In simple terms, the return on investment is equivalent to: (the final value minus the initial value of the investment) divided by the initial value of the investment. Or, r = (Vf - Vi)/Vi . This number is returned as a percentage.

So, in order to measure a return, you need to know how much money you’re spending on a campaign, as well as how much you’re making on it. Sounds pretty simple. So what are the problems we run into?

Calculating Monetary Metrics

Unfortunately, most of the numbers social media tools (especially free ones) measure are not monetary metrics - they’re impact metrics. Clickthroughs, impressions, followers and pageviews are not tied to a monetary value. They can be, but first you have to assign a dollar value to it. Is a clickthrough worth $0.01? $0.50? $1? It all depends on your individual business. How about impressions? How much value is it to you to get an additional impression? If your tweet or Youtube video reaches 100,000 people, what is that value worth to you? One way to value a web impression is to think of it like a billboard ad - how much would you be willing to pay to put a billboard (or any old media - TV ad, radio ad) up per impression? Obviously the way that you measure it depends on what type of campaign you’re running.

Saying “we spent $2,000 on a campaign and got 100 retweets, 200 replies, 10,000 Youtube views and 25 comments” may be great to tell your friends and a few other marketers, but it doesn’t do much to justify the cost until you calculate the value of those individual variables. If you want ROI, you have to convert your variables into monetary values.

Last year, eMarketer put out a statistic that 84% of social media users still do not measure the ROI of their programs. My guess is that the number of users measuring their social media programs’ ROI is even smaller than 16%. Some people who believe that they are measuring ROI are still only measuring impact metrics, which are often very superficial in nature. If you’re just measuring impressions, subscribers and clickthroughs, you’re not measuring ROI.

Confounding Variables

The beauty of social media measurement is that it is extremely easy to gather data and track your social media campaigns (especially on Twitter). Of course there is (as is always the case with data analysis) an issue of correlation vs. causation. If you are measuring data for a short period of time, you will run into a number of confounding statistics. Just because you see a 10% bump in sales during the week-long period that you’re tracking doesn’t mean it’s necessarily due to your social campaign. Same thing goes for a 10% drop.

The only real way for you to measure a change in sales and to positively tie it to a social media campaign is to have every other value be constant (no other marketing campaigns, no changes in your products sold, no change in the time of year, etc). Suffice to say, that is unlikely to ever happen. Make sure you’re tracking the right causes for your increase or decrease in revenue. People have a tendency to ignore any factors other than the ones they’re hoping to measure.

An Outlier Problem

If one major influencer picks up your social media campaign and promotes it to their followers, you have a big outlier problem (not the worst problem to have, to be sure). Sure, you can measure and report on the results of that individual campaign, but moving forward, you’re going to have issues duplicating and predicting future success.

The problem is with data extrapolation. If one user with millions of followers retweets your post, it changes everything. It’s just like if a new post or viral video you’ve made lands on the Digg front page - an event that provides an exponential boost in traffic.

Though you can measure that one event, it will be extremely difficult to account for that when predicting future events. So if you’re running a contest that costs $5,000, it’s certainly something to keep in mind. If you consider each impression on Twitter to be worth one tenth of a cent ($0.001 - due the relatively small number of people that actually *read* each tweet), a retweet by @aplusk would put you immediately at break-even when your campaign might have otherwise lost thousands of dollars.

Real Time vs. Long Term

We’re really very good at calculating real-time metrics and analysis when it comes to social media. I can tell you how many new followers, retweets, mentions and clickthroughs I got in thepast week. Yet, when it comes to long-term tracking, marketerss are generally pretty bad at it. The trouble is, long-term analysis is the only way to measure change. You can’t measure change over time if you’re just looking at one data point.

If you really want to see how well a social media campaign is doing, make sure that you go back and look at it over time. Of course you should measure each campaign individually, but also measure your overall efforts over time. If you’re just setting up a social media account or profile, figure out what metrics matter most for analyzing your ROI, and make sure to set up times to take snapshots to monitor progress. Just tracking counting stats (followers, subscribers) is not enough.

Data Availability

Much more data is available for certain social media networks than for others. While you could build Twitter metrics until you’re blue in the face, you’re much more limited in gauging a social media campaign using a network like Youtube (subscriptions, views, comments).

The issue of data availability makes it very easy to value certain platforms much higher than others. If you tie every single metric to a monetary amount for Twitter, you will almost certainly double-count the value of certain metrics, and with a platform like Facebook, you won’t be able to track a great deal of the results of your campaign. Be sure to keep in mind which platform you’re using, and what metrics you may be ignoring or double-counting.

Conclusion

As far as we’ve come in terms of measuring marketing campaigns online, there are still plenty of issues we run into when measuring social media ROI. When faced with the idea of measuring ROI, many simply give up and claim it’s impossible. Many prefer to measure impact metrics. If you’re spending a significant amount of resources (time, money, energy) on social media campaigns, you owe it to yourself to measure your efforts in monetary terms.

By ignoring ROI entirely, you allow for the strong possibility that you’re wasting time that could be better spent elsewhere. There are hundreds of companies and marketers who embrace social media regardless of if it’s right for them or their customer. Ignorance may be bliss, but it’s still ignorant.

Related Posts with Thumbnails

RSS feed | Trackback URI

221 Comments »

Comment by Amber Naslund
2010-02-24 08:22:03

Hi Jaremy,

This one of the better and more clearly articulated, well presented posts on ROI I’ve read. Thanks for bringing some clarity to a topic that needs it, and for emphasizing that ROI is a single, monetary metric.

The other thing I see a lot is a lack of a discipline of measurement overall. To me, the statistic about measuring social media ROI is probably more indicative of companies not measuring too much to start with, either because they don’t have the data or tools, or because they’re not sure where to start. It’s super hard to demand solid metrics and measurements for social media if you’re not accustomed to applying the rigor of measurement to everything that you do in a business framework.

Thanks again for the discussion.

Cheers,
Amber Naslund
Director of Community, Radian6
@ambercadabra

Comment by Jaremy
2010-02-24 12:43:13

Thank you for your thoughtful response, Amber.

I think the problem is twofold - not only do companies and marketers often not have the tools to track or know where to start, but for many marketers, it’s actually advantageous to say “well, we can’t really measure that” or “it’s difficult to put this into monetary terms”. If you don’t measure it, you can’t analyze determine that it’s a waste of time/money. Which is not to say that if a campaign is returning a loss that it’s not still worthwhile - but it’s pretty difficult to argue that with the CEO of your company :-).

It’s always difficult to measure a human response to a creative campaign with a dollar value, but ignoring the metrics entirely is not the answer. Unfortunately, that’s the decision many companies have come to make.

 
 
2010-03-01 06:29:31

like most company that do image brand campaign ads, it’s really hard to track if the ads was resposible for increasing sales. Awareness of tracking every business metrics should be increased among companies.

 
Comment by Scott Scanlon
2010-03-09 21:27:38

Awesome post and well written. Tracking and tools are one thing but what most people I work with want is something that tracks to the bottom line. I spend X or I spend Y on this and what can I expect is the question I get a lot. I personally think image building is a complete waste of time, to me the focus should be on direct response metrics and how those play out.

 
2010-03-15 20:14:56

i think it’s really 2 fold, lack of discipline and know-how. Unless we have the discipline to tag a SM campaign to an outcome, measurable by sales revenue, then its all fluff…

 
Comment by Neil Beam
2010-03-25 21:57:36

Nice post Jaremy. You nailed it.

Thanks again for supporting the SMB Seattle breakfast events. Looking forward to continued future dialogue.

Neil

Comment by Jaremy
2010-03-30 11:19:44

Thanks Neil! Love the SMB Seattle events. Hope to see you at a Seattle social media event at the near future.

 
 
Comment by Ben Bland
2010-03-29 08:21:14

This is a very good overview of the problem, thanks.

You’ve done a great job of defining a framework from which to gather and analyse social media metrics but I’m left wondering quite how a business makes that mathematical conversion of a dollar value for each metric. Do you think there’s a simple answer?

I suspect that final step of assigning monetary value is likely to come down to a bit of an educated estimate, although that doesn’t have to be the end of the world.

 
Comment by Amir Arif
2010-05-26 04:31:43

Enagic Ionizers achieve this by the use of a multistage activated carbon filter containing antibacterial granular activated carbon and Calcium Sulfite. Next, a small electrical charge is introduced into the water through platinum-coated titanium electrodes. The process of electrolysis that follows takes place in a chamber designed to separate the water into two streams of ionized water.

 
Comment by Arturas
2010-06-24 02:09:31

Thanks for a great insight Jeremy! And I will agree with Amber, that it is more of an overall problem, when businesses simply are not used to measuring everything, and when speaking about social media ROI, first of all you must a have a clearly defined ROI measuring process for your website (online business).

 
Comment by 40deuce
2010-08-05 12:37:24

Great post Jaremy!

This a fantastic explanation of ROI in social media and I will be pointing people towards this post, as I get asked a lot of questions about the topic.

One point I think that most people should be taking away is that these measurements need to happen over time and not just right away. For an already overused example, when Old Spice did their little Twitter video response thing the web went nuts for it, and then started criticizing it almost right away. In less than a week after the videos started I saw people writing about how it hadn’t helped their sales. The problem was that not even a week had gone by. People were expecting people to rush from their computers right to the drug store and buy some Old Spice. I don’t know about those people, but I don’t go to buy new soap until my old one is almost completely finished (or unless I come across a good sale, but that’s off my point). People expect that because social media happens in almost real time, so should everything connected to it. But we know that this is not the case.

Measurement needs to take place over time. Sometimes even a long period of time. Measurements need to be made before, during and after (sometimes much after) campaigns to be benchmarked and measured against each other. Only when all of these measurement have been tested against each other can someone really see the affect of what they did.

The other thing about social media ROI is that it’s not always going to turn into immediate sales. Social media is also about building relationships. I may build a relationship with a company that builds computers. That doesn’t mean I’m going to run out and buy their computer now, but when it comes time for me to buy a new computer chances are I’ll think about that company because of the positive relationship I’ve been able to build with them as a consumer and a business.

Sure things can happen fast in social media, but sometimes figuring out if it was worth it (your ROI) can take a great deal of patience.

Thanks again for this great post.

Cheers,

Sheldon, community manager for Sysomos

 
Comment by Andrej Volčanšek
2010-08-11 00:58:00

simply put: many brands fail EXACTLY because of overoptimisation. and measuring twitter ROI is supermegaextreme overoptimization.

people who trust their instinct, can make sense of data, not people who need data in order to be able to take a risk of decisson,..

 
2011-07-02 15:12:43

I don’t see too many companies making money of social media. It seems it is expected and people look for a social media presence so in that respect it is important.

 
Comment by flavored coffee
2011-08-08 14:54:52

This was a great post, thanks for the info.

 
Comment by langlang33
2011-09-10 13:47:31

Outstanding short article! Would like treasured the main studying. Im hoping to see a bit more away from you. I do think you might have amazing awareness and also mission. My business is very happy because of this advice.

 
2011-09-26 18:20:51

Aw man. Are you looking for a Assisted Living Facilities?

 
Comment by Jets Tickets
2011-10-02 04:35:48

great shot. that spider really looks cool. good work on the photo.

 
Comment by Produk Kecantikan
2011-10-21 21:54:55

I was just searching for this info for some time. After six hours of continuous Googleing, finally I got it in your site. I wonder what’s the Google’s issue that doesn’t rank this kind of informative web sites closer to the top. Normally the top websites are full of garbage.

 
Comment by cell phone trace
2011-10-28 18:09:14

Of course like your web site but you need to have to check the spelling on several of your posts. Several of them are rife with spelling difficulties and I locate it very bothersome to tell the truth nevertheless I’ll definitely come back once again.

 
Comment by Burt & Associates
2011-11-04 01:24:26

Your blog was tweeted by a friend last night. Decided I’d give it a look. Best decision ever.

 
Comment by Cheese
2011-11-07 23:04:30

I am curious to find out what blog system you have been using? I’m having some small security problems with my latest website and I would like to find something more risk-free. Do you have any recommendations?

 
Comment by Maragaret
2011-12-04 20:35:56

I have gone forward and even book-marked your website within Digg.com so my buddies can find it too. I merely used 5 Pitfalls of Measuring Social Media ROI | Viralogy Social Commerce Blog as the title in my digg.com bookmark, as i realized if it is suitable for you to name your website post that, then you certainly probably would like to see it book marked the same way.

 
Comment by Francesca Aridas
2012-01-05 00:26:12

If you’re still on the fence: grab your favorite earphones, head down to a Best Buy and ask to plug them into a Zune then an iPod and see which one sounds better to you, and which interface makes you smile more. Then you’ll know which is right for you.

 
2012-01-05 00:26:51

Clora Brogna

 
2012-01-20 03:40:20

advertising and *********** with Adwords. Well I?m adding this RSS to my e-mail and could glance out for a lot extra of your respective intriguing content. Ensure that you update this again very soon..

 
Comment by Karyn Poduska
2012-01-27 12:25:34

Hi would you mind letting me know which webhost you’re utilizing? I’ve loaded your blog in 3 completely different browsers and I must say this blog loads a lot faster then most. Can you recommend a good internet hosting provider at a fair price? Thank you, I appreciate it!

 
Name (required)
E-mail (required - never shown publicly)
URI
Your Comment (smaller size | larger size)
You may use <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong> in your comment.

Trackback responses to this post