For more mythbusting and social media science, don't forget to register for my Science of Social Media webinar .
In
my study
to understand the effects of "engaging in the conversation" in social media, Facebook was one of the places where I actually thought "conversation" resulted in better reach-building and marketing effects.
But I was wrong
.
I looked at two variables available only though Facebook insights (data you can only get when you're the admin of a page): Impressions-per-post and feedback percentage per post. I calculated an impressions-to-likes percentage for each post over the last 12 months for the two large pages I have access to (HubSpot and OnStartups). I then compared that number to the amount of feedback (likes and comments) each post got. I expect to find that they were positively correlated, the more feedback on a post, the most views it got. But all I found was a weak, negative correlation .
I also looked at the relationship between feedback on a post and the number of impressions the next post got, and found the same (non-existant) relationship.
I know many people will bring up EdgeRank , so let's look at that quickly. For those who aren't familiar with it, EdgeRank is an algorithm that determines if an individual person sees a peice of content on Facebook in their newsfeed. It's composed of three variables: a time-decay (the newer the content, the more likely it is to be seen), weight for the type of content (certain kinds of content are more likely to be seen, comments are better than likes, and new "creates" like wall posts and photos are more heavily weighted than comments), and an affinity score between the content creator and the viewer (if the person visits your Facebook page a lot they're more likely to see your content). If I comment or like a specific peice of content on your page, I'm more likely to see your future posts, but it does not mean other people will be more likely to see it.
As the data shows, (and as EdgeRank suggests) the amount of "conversation" that happens on your Facebook posts has nothing to do with the number of people who will see it. Once again, we find that conversations have very little (if anything) to do with reach-building social media marketing effectiveness .

Freelance Article Writers 9:08 AM on July 05, 2011
Good efforts Dan, but unlikely your other posts this one seems to be too technical for masses. However, the gist/crux of the matter is alarming/eye opener stuff. It seems social media myth has to be debunked.
Tony Darrick Baker 9:47 AM on July 05, 2011
It would be interested to see the same study on Twitter. I've found that the more retweets I get, the more traffic I get to my sites. But then again, retweets are a type of endorsement rather than a conversation that's growing.
Carmen Sognonvi 9:54 AM on July 05, 2011
If I comment or like a specific peice of content on your page, I'm more likely to see your future posts
This is the part of Facebook's algorithm that I really dislike.
There are a lot of people and pages that I really want to hear from, though I rarely comment or like their updates.
Why not? Because there are way too many others liking and commenting on their stuff, and I don't want to be inundated with notifications about new comments to that thread.
So I actually don't think commenting/liking is such a reliable indicator if whether your content is engaging or not.
Carmen Sognonvi 9:56 AM on July 05, 2011
Oops! Forgot the closing tag for italics in my original comment - apologies!
Tom Collins 10:03 AM on July 05, 2011
Hi Dan,
So what?
Let me be clear. You say "More Facebook Conversation Does Not Lead to More Views." From there you apparently jump to the absurd conclusion that conversation does not (cannot? will never?)lead to "better reach-building and marketing effects."
My "so what" question comes from wondering why you think "more" likes or even comments equals more conversation. Unless you're willing to do the hard work of examining the content and quality of the comments - especially looking for two-way and multi-party exchanges that involve the page owner - you aren't really looking for conversation.
Aside from building your nifty chart on a sampling of just TWO "large pages" on Facebook, your blind faith in counting things that are poor analogs for conversation continues to amaze me. You measure data you can find a yardstick for and pretend that's the data that matters.
Valuable "marketing effects" can flow from a single two-way exchange, but that's lost in your obsession with large data sets.
At this point in our "science" of measuring social media, I'm skeptical that we have any reliable way for you to do what you say you want to do: "understand the effects of 'engaging in the conversation' in social media."
There are enough spectacular success stories (anecdotal though they are) that I think the Nike rule applies to social media for business: Just do it.
Tom
Bonnie 11:38 AM on July 05, 2011
@ Tom can you provide examples of that "Anecdotal" success.. what drove them... free offers, Extremely well known brands... I'm finding the same results... and also that most of the conversion comes from off topic/niche content! we also get more conversion from teaser text that lead to the site! (if enough of the info is posted they just won't click through! But I've been hesitant to adopt, not sure how that will work fro visibility
Jason Stuart 11:43 AM on July 05, 2011
Interesting data, but, at least for business pages, wouldn't a more useful metric be to measure how likely a person engaged in conversation is to buy from you in the near future (say <10 days)? Granted, this seems to show that engagement is not going to lead to chain reaction of "likes" or new fans, but I think engagement has to be a valuable way to ramp up brand loyalty among existing fans.
Tom Collins 5:59 PM on July 05, 2011
@Bonnie - I could, but don't take my word for it! There are whole books full of case studies and examples.
If you like history (or chronological order), start with Groundswell, by Charlene Li and Josh Bernoff, and Personality Not Included, by Rohit Bhargava, both from way back in 2008.
Move on to Trust Agents, by Chris Brogan and Julien Smith, and Tactical Transparency, by Shel Holtz and John Havens, from 2009. Disclosure: Shel and John are clients.
Then, The New Rules of Marketing and PR (Second Edition), by David Meerman Scott, and The Hyper-Social Organization, by Francois Gossieaux and Ed Moran, in 2010. Disclosure: Francois is a long-time social media friend and will be the closing keynote at our BlogPaws 2011 conference.
And for both how-to and some great examples, the just-released Content Rules, by Ann Handley and C.C. Chapman, from 2011. I love their title for Part Three of the book, "Content that Converts: Success Stories (With Ideas You Can Steal" - a concept that likewise gets lost in the obsession with numbers.
Notably, the examples in Content Rules range from a newly-opened golf academy to major corporations, even including HubSpot itself.
Enjoy!
Tom
Anonymous 7:58 AM on July 06, 2011
I agree that SocialMedia isn't the best method for those looking for pure lead generation. But for consumer engagement and branding purposes, I think it achieves that objective. For those reading this and thinking the sky is falling, take it with a grain of salt. Dan is great at what he does but remember that we all knew social media wasn't necessarily the direct marketing tool traditional marketers are used to.
Glenn 12:06 PM on July 06, 2011
Without the calcs, I see the same thing...lots of 'fans', no leads, no comments, no converstions...well, not 0 but pretty close. Just a bunch of high school kids adding more 'likes' to their Interests list. Facebook is a fun place for friends and family communication - not worth the cost of FB ads for business.
David 6:52 PM on July 06, 2011
I'll add that the opposite is also true. I see a lot of views on my page w/o conversation and I used to be concerned. It's not always obvious or immediately known who will take action, or if I'm adding value based on a facebook post alone. I get hundreds of impressions on subjectively awesome offers/giveaways with zero comments and/or little participation and other "decent" offers get tons of comments (e.g. Free Fandango movie passes (decent) versus sold out concert and/ or sports events tickets, visa gift cards, (awesome) etc...). It's strange behavior to me, but it is what it is. I try not to over-think it. What's even more interesting to me is I get a ton of emails stating they found me on twitter and facebook wanting to know more about what I do. This curiosity had turned into more business for us. My point is that although I'd like more participation on facebook, mostly because of perception, I don't necessarily mind for now as long as the business is rolling in.
All in all, data can help you adjust the sails, but it's often just a mild form of entertainment for the geek squad. If I relied solely on the data I've found so far, I'd probably quit doing what I'm doing. In the immortal words of Han Solo, "Never tell me the odds", or in this case, the data.
Ef Rodriguez 1:54 PM on July 07, 2011
Piece is spelled piece. Not peice.
:-)
Adam Carley 10:40 PM on July 07, 2011
Your method might be flawed here. By dividing impression by likes, you will find that articles with a lot of likes will have low ratios (higher denominator). Why not just look at the correlation between total volume of feedback and total impressions?
Alan Talanoa 12:06 AM on July 08, 2011
Agree with Adam, for every impression you get, your feedback ration goes down. Data is (purposely?) misleading. Throwing out a "spectacular" headline along the lines of this blog post is a short term win(say something crazy, get a reaction), and I would expect more for a post from a Hubspot employee.
Bruce Aristeo 9:14 AM on July 08, 2011
Hello Dan,
I think it's important to mention I do enjoy your work, and have followed most of it as I have progressed. This post has brought forth a question sitting with me for some time. The question is “Of the data you examine, how many of those have you qualified as having an interest in what you are using as bait to collect your data from?” In other words, if you post an article about wine making, then how many of the readers have an interest (they follow) in wine making?
Having a degree in psychology with experimental research, subjects and data are qualified first before conducting the experiment. There are too many variables left open for misinterpretation if the qualification process is not executed. Such as; how many visitors received an impression who were simply passing through and had no interest, how many visitors know of your work but have seen it before, or how many visitors are not Type-A personality and think their words don't matter (not joining the conversation)?
I think qualifying subjects before collecting data is extremely important. Being an Internet marketer, and on the HubSpot platform, the majority of individuals floating around reading HubSpot and other Internet related material are in the same industry. Personally, I pass-by a dozen or so regurgitated articles each day, all of the same subject and written by those who are trying to impress their audience.
I know that what I suggest is a complicated task, and the fact that the subjects are qualified changes the experiment. But can we continue to follow human behavior blindly knowing that behavior rests upon the shoulders of a giant created from needs, wants, and desires?
Danny Brown 1:14 PM on July 08, 2011
Wait - this "analysis" is based on just two Pages? Isn't that kinda - read, very - inconclusive? Pretty sure there are more than two pages on Facebook...
Joe Sabado 3:37 PM on July 09, 2011
How about studying RenRen? Unlike facebook, they're more open with their social graph and so I think you can have a more comprehensive data to analyze. A study was done at UCSB to analyze relationships/activities.
Ted Sindzinski 4:11 PM on July 09, 2011
Dan -
Perhaps it’s the audience type, or the metrics we’re comparing but working with b2c pages I've seen quite the opposite on multiple pages, especially over time.
In my experience, it seems that the more interactions wall a post gets, the higher it ranks for both friends o the people who have engaged as well as fans of the page in general. Taking this to extreme posts that “fall off” the top news come back from time to time based on interactions.
Over time this becomes critical as EdgeRank erodes impression counts as pages grow in following and those with more engagement in previous posts see their baseline impressions increase before the first comment is made. It’s not just about you seeing it more, it seems to be a network wide effect, possibly with different weighting for your friends versus general followers but certainly more than just you.
Every time I've worked on a brand's page that had low impression count our first "trick" has been to change up posting to get more responses and too and from there impressions seem to start to creep back adding tens of thousands between posts.
Brian Barela 7:05 PM on July 11, 2011
is there a correlation between the types of posts in terms of theme or call to action? were some more 'likable' than others?
ghahga 12:04 AM on July 15, 2011
Well that's Burberry Bags! I have an intuitively fueled answer to the question of how the administration of Burberry Mens Bags would be addressed so funds are released at the correct time and in proper disbursements.thanks for the sharing Burberry Totes
Burberry Sling Handbags
Burberry Shoulder Bags
Burberry Hobos Bags
Burberry Crossbody Bag
Burberry Bowling Bags
From Burberry Sale. Hurry Up!
A quick glance at this new Jimmy Choo Boots. Something about the nike dunk sb of color blocking and material usage just oozes with elements of the fan favorite. Jimmy choo Flats put the Retro hue on plain display via the toe, paneling and stitching in the same way that Jimmy choo Pumps was used. There are a lot of fashion shoes on my store, Jimmy choo Wedge not only nice ,but also confotbale,give everyone different feeling.Nike dunk mid shoes of patent leather on the heel and lace plates form a great overall contrast also. Jimmy Choos designed to focus on the elements of style and fashion of the source, the overall design style in Jimmy Choo Shoes design is the primary position. Let us take a closer look 10 years Jimmy choo Sandals three elements of costume design and overall concept of the United States, the feeling in enhancing their design inspiration! moncler jacket outer shape mainly refers to the silhouette of the clothing, which means the clothing style style house, including structure line, provincial, collar, bag and so on. Mmoncler down in line with the overall appearance of the shap.