Are visitors to your website completing the tasks they set out to do? Are they leaving happy?
I didn't know the answer to that one either. In general I write stuff in the best way I can and then measure the results using Google Analytics. If a page has a high bounce rate, that may be a Bad Thing, and if the time spent on a page is low, then that may also be Bad.
But traffic statistics don't reveal visitor intent, or satisfaction for that matter. They don't measure emotional response. A particular visitor may have returned 10 times in a week (wow!) but that doesn't mean they love your material. It may mean that they've been struggling to (and failing to) find a certain piece of information numerous times! They may be on the verge of cutting their own throat in frustration. The stats don't always give the full picture.
But visitor feedback does. Or at least a better picture.
4Q provide a means of getting this valuable feedback from your visitors via a free service that delivers visitor surveys. I'm going to show you just how illuminating visitor surveys can be by using one of my sites (not this one) as an example.
Signing up to their service is free, and once membership is sorted out, you get to create your own survey. This survey is shown to only a certain proportion of the visitors to your site and is designed to determine what they came for, whether they got it, and what their overall experience of your site was. Damning stuff!
4Q Survey Questions
It's a simple survey we get to set up with 4Q and it's broken down into four questions:
- What was your overall experience of my site (1 - 10)?
- What was the purpose of your visit?
- Did you get what you wanted?
- Open ended question depending on whether the visitor got what they came for:
- If not - why not?
- If so - what was the best bit?
As you can see, this is a very simple survey. The results are like platinum plated penguins though. Err.. valuable.
4Q Results
I put a 4Q survey on one of my sites half way through February 2010. In February the site received around 6,000 unique visitors whereas in the last 30 days the site received 15,000. There were 316 respondents, so you can see that it's not every visitor that gets the survey and not everyone responds to it.
The results of the survey reveal some interesting insights. Check this out:
Wow! This month, 22% of the respondents (note that this may or may not be representative of all my visitors) came to my site to buy something! Woo hoo! You know what that means? Maybe I can sell them something!
This is a valuable insight. This tells me that some visitors arrive with their buying shoes on.
Suddenly, however, the hurtful truth arrives.
12% of this month's respondents didn't get what they came for. That's a shame. If they had left their contact details, I would send them flowers. Is a 12% failure rate a Bad Thing? I don't know. It's not as good as a 100% success rate, that's for sure, but that's the unobtainable goal. Maybe further investigation of the survey results will shed some light on why those people failed to complete their tasks. Do you see the way that the "NO" rate is decreasing over time? Could this increase in task completion be caused by the increase in articles on this site? In February there were 23 published articles but there are now 35.
Let's move on to task completion by purpose of visit. Up to this point, I had been trusting customer feedback to be an accurate reflection of "what really happened". But just look at this:
Apparently, 86% of my visitors succeeded in buying a product on my site this month.
Even though I don't sell products on my site...
To me, this can mean one of three things:
- my respondents are babbling like baboons on the pop
- they mistakenly think they bought something
- they misunderstood the question.
I do display Adsense on this site, so maybe they clicked on an ad and bought something that way.
Let's now look at overall satisfaction by purpose of visit:
75% of the people who came to my site to buy a product left satisfied! What are these people buying?! This site does generate a lot of Adsense revenue, so maybe these product hungry visitors are clicking on ads and buying things. The lowest satisfaction level is for this month for people who came to read an article or to find a solution to a problem: 57%.
Why is this figure so low, and indeed, is it so low that we need to worry about it? Most of my traffic is from the search engines so this raises some interesting questions about the match between what my visitors searched for and the page that the search engines displayed. If people are searching for green bananas and my page for pink cravats is turning up, I have a problem. I'll need to check the search terms that bring the most visitors and see what pages get returned. What about the links to my site from other sites: are they setting expectations about my site that aren't met? If the anchor text in those links to my site is "monkey milk", the visitors that arrive via those links won't leave satisfied (my site isn't about monkey milk). So that's another thing I can check.
The last section is very, very useful. Open ended commentary by segment allows visitors to give feedback about what stopped them completing their tasks on the site, or what they valued most about the site if they managed to complete their tasks.
Many of the comments that were made don't help us. Some of the less useful comments are:
- It is easy to follow directions
- Good
- Very useful
- etc
These don't give us actionable insights. We need something that tells us we need to improve the site, and hopefully - how. The 11th comment I read is a revelation:
I was unable to find the xxx tools in xxx. You showed me where they were hiding! Now I'm trying to find how to insert a yyy like the one in the zzz. Still looking. Great site!
This is a really useful comment. I'm not interested in what the visitor liked or what they succeeded in doing (although that does give me a warm glow), I'm interested in what the visitor wants but didn't get! Look - they want to insert a yyy like the one in zzz. This information is like gold dust because in telling me their precise requirements, this visitor makes it easy for me to make them happy. All I need to do now is create a page that explains how to insert a yyy like the one in zzz. And if doing so makes this one visitor happy, the chances are it will make others happy too.
If I had this visitor's postal address, I would leather bind the article and send it by courier to them.
If I had the address of the visitor who left the following comment, however, I'd send my Mum round to box their ears.
Nothing,because you are gays,a gang of bitch,i hate you all pet of your boss GO SHIT RIGHT NOW
No actionable insights there.
Moving down the list, we find that the more useful comments will be left by the people who didn't complete their intended task.
Still not understanding how to use the xxx. just started to use this xxx. not very easy to use for a first time user
This is great. I need to be clearer when I explain how to do xxx.
I want to know how to xxx
Fantastic - a clear instruction about what the visitor wants that is missing from my site.
I have slow internet access, also i was not able to find what i was looking for
Not able to find what they were looking for? Are they saying my navigation sucks?! You know, they've got a point. All I've got at the moment is a dry looking list of links. They're not even categorised! What I will endeavour to do is include links at the bottom of articles that suggest related material. Also, I think I'll provide eye catching signposts to the more important/popular pages on the site. Good comments!
Your xxx instructions are hopelessly wordy and complex. Your "help" searches are incompletely indexed. I have spend a half hour trying to figure out hot to access the yyy, and still have not found an answer. WHAT A WASTE OF TIME FOR YOUR USERS!
Oh dear. My articles are hopelessly wordy and complex. Boo hoo. This is compelling evidence that video is needed to supplement the written articles. I had planned to provide some video content at some point, but it seems the sooner I get round to that, the better.
No information on the xxx features. Even just searching for yyy turns up anything but an overview of that zzz and its xxx.
Estupendo! I have no idea what this visitor is talking about! But give me an hour and I will, and I will then start writing stuff that helps them.
I'm looking for a xxx to make yyy into zzz for quality
I know exactly what this visitor wants and it should be pretty easy to give it to them.
There are many more useful comments like these, but I won't bore you with those. You get the picture. With feedback like this, you can no longer use "writer's block" as an excuse when trying to create new content. Just give 'em what they ask for!







