So what IS the difference between Feedback and Surveys?

11 February 2009 5 Comments

Many conversations we have had over the past year have revealed to us that there is a certain amount of confusion among website owners regarding the feedback tools available to them on the web. Many of them feel confused, or are not aware of the differences between the various services such as “Voice of Customer”, “Surveys”, “Feedback Analytics” etc. That’s why we thought they could benefit from a post explaining the available methodologies to collect the website users’ subjective data and the differences between them.

More and more website owners today understand the importance of knowing “Why”: “Why did the user behave as he did on my website?”

Measuring a website with analytics tools (objective data) just isn’t enough, because it leaves the website owner with too much guess work to do. There are too many possible reasons for each of the user’s actions, and there is a great need for tools that can help you make the best choices. For instance, why did a user abandon the shopping cart? Was it the price? Shipping issues? Or was it bugs; missing information; usability issues…the list goes on.

The big question is: what are the available methodologies to collect the subjective user-data and which one better fits your site’s needs?

Here at Kampyle, we usually see these as divided into 3 categories: Feedback, Surveys and Polls, and Idea Management. Here is a quick description of each one:

1. Feedback Analytics – (Kampyle Feedback Analytics) Provides website owners with the ability to create feedback forms that can be customized to fit the website and placed on all pages, so that website users can submit feedback in case they run into a problem, do not find something, have an idea, etc. A feedback button is visible all the time on each of the sites pages. Feedback analytics will provide you with page level and website level high quality (i.e. specific comments) and actionable data, allowing you to read and manage feedback and also get back to the users. The feedback will be accessible to you (the website owner) only, therefore protecting your brand, and making Feedback Analytics suitable for all lines of businesses. Feedback analytics also gives you the ability to prioritize feedback collection: you can choose to actively ask your users to submit feedback in the pages in which you feel that you need it the most, using a pop up mechanism (you might want to use this option in your site’s shopping carts for instance). The ability to choose the location as well as the frequency of this pop-up makes this a very non-intrusive approach. The data can also be integrated with Web Analytics, allowing you to understand both the ‘What’ and the ‘Why’. This flexibility makes it suitable for all lines of business.

2. Surveys and Polls – (Most popular tools: SurveyMonkey, 4Q, OpinionLab) by using these methods you will get high level understanding of what’s going on your website. You can ask your users to answer 5/10/25 questions that you’ve composed in advance and get a statistical review of their answers. You can use this option to ask ‘site level’ questions such as: “Where did you hear about our site”, “What are you looking for”, “How old are you”, etc. The answers to those questions can help you to know your users better, but will not necessarily help you to find problems in your shopping cart, missing information and products etc. The fact that the data is ultimately statististical might cause the solution to be relevant mainly to large websites with a lot of traffic. This means that not all lines of businesses can benefit equally from it. Some issues need to be addressed, such as how to initiate the survey without annoying your users.

3. Idea Management – (Most popular tools: GetSatisfaction, UserVoice, SuggestionBox) Have users suggest ideas, report problems, vote for other users’ ideas and have them made publicly available to all. This solution resembles live forum with an open discussion about your products. It can be very helpful to reduce support efforts, since in some cases people will see that their comment, problem or solution has been reported previously. It may also be useful for businesses looking to use their users to publicly vote for their next development steps. This solution can, however, damage your brand, in cases where lots of users report complaints, and others see them. This makes this solution less suitable for certain businesses for which this would be a sensitive issue.

For the benefit of our busiest readers, here is all that information in one “Executive Summary” table:

feedback_vs_survey_small_table

For those of you who wish to go into further details, we’ve prepared the following table which contains an in-depth comparison of the various subjective data collection services available. The table is divided into categories representing characteristics of the services (General, Submission, Results), and sub categories representing specific features:

Feedback Analytics Surveys

Idea Management

General

Feedback level

Website and page level

Website level

Website level

Best used for

Get quality feedback about products, services and user experience as well as high level understanding of customer satisfaction on a site/page level. Can also serve for targeted usability testing.

Get high level understanding about your website and answers to specific questions.

Get new ideas, have users share data and rate ideas, save time on support as data is shared. Good as a support forum.

Size of website

Fits websites of all sizes, as qualitative data can be achieved from small or large amount of users.

Fits large websites because results are statistical.

Fits large websites, since prioritization largely depends on many users voting.

Amount of data

Fits Small and large amounts of data.

Allows analysis of all data, as well as reading specific feedback items. The system also prioritizes tasks.

Fits when large amounts of data can be collected, since results are statistically based.

Fits when small amounts of data are collected. Difficult to handle when there are many different topics in the forum, and the administrator must read every post.

Required Planning

Simple customization process. The feedback form can be modified in seconds without problems, categories can be added and removed without consequences at any point and time.

The questions asked in the survey need to be carefully thought through in order to be effective in the long term.

Not relevant

Submission

Where is it launched?

From all pages. Especially helpful to solve painful issues or processes.

From a landing page or home page.

From all pages.

Adjust the questions to different website locations

Different forms for different areas of the website, e.g. Home page, Shopping cart, Search, etc.

One survey on one page of the website.

One form for the entire website.

Data is collected by

New pop up window on top of the existing page. Does not remove the user from the website.

Usually on a new page.

Usually on a new page or starts with a floating window and takes the user to a new page.

Time required from the user

1 minute

5-10 minutes

5 minutes

Form of collection

Free text and categories of feedback.

5/10/25/… questions

Free text and ability to rate or vote for others’ comments.

Results

Results you’ll get

Feedback about processes, products, services, pages as well as overall high level view. Ability to win back customers by communicating back to their feedback.

Statistical analysis based on the answers to the questions asked.

Comments about products, brand and services.

Data is visible to

Website owner

Website owner

Public, visible to all

Management Application

Dashboards, Charts and CRM like application to manage the data and get back to the users.

Dashboards and Charts

Similar to Forum management

Communicate with your users

You can get back to the reporting users who provided email

Usually anonymous and getting back to users isn’t relevant.

Communication is public, and open for all to see.

Integration with Web Analytics to combine the ‘What’ with the ‘Why’

Available

Not relevant

Not relevant

We hope that this explanation will have clarified several issues for website owners searching for subjective data collection solutions.

Click here to register on Kampyle now.

5 Comments »

  • Thakur said:

    Hi Eran,
    The comparison is awesome.
    what i understand is surveys are not limited to one’s website. they can be done on all through the internet, to get the answer on some specific queries.
    on the other hand feedback’s are limited to your own site.
    To compare both of them on website platform, is like giving weight age to feed backs.

  • Emil Stenström said:

    Hi,

    I don’t think category 1 and 3 really are different categories. It seems you just picked a couple of your features and made it a new category. Not being able to discuss ideas openly (”Brand protection”), and integration with web analytics, is not enough to make it a new category.

    Why not the others? With getsatisafaction you can easily collect feedback for specific products too, making it suitable for websites of many sizes. Customizing the popup to only show up on some pages is easy too.

  • Kampyle (author) said:

    Hi Emil,
    Being able to collect feedback on a website level as well as on a page level is a key factor. It provides the website owner with the ability to view his feedback from a high level view as well as drill down and identify key issues with pages or products. Being a non intrusive solution is also an important differentiator (eg: Kampyle never takes the user away from the website): If the user is providing feedback while in a key conversion process (e.g. shopping cart), taking him to a different support forum could in fact harm the conversion of those users.
    Brand Protection refers to the fact that the feedback is kept internally. If a certain website gets a bad feedback, it does not necessarily mean that everybody has to know it.
    Integration with Web Analytics is a very important differentiator as well. If you can combine your subjective data (feedback) with objective data (website analytics), you can get the full picture: what did your users do on the website and why.

    Both GetSatisfaction and UserVoice are more of a public support forum, enabling the website owner to create a community of users who are willing to share ideas and rank each other’s ideas. This does not necessarily suit all types of websites and products. With those solutions, it’s important to have many users on the site willing to ‘play’ the game, or else the whole voting up and down is meaningless. Moreover, not all users of all ages are willing to ‘play’ the game of voting publicly.

    We hope this answers your questions,

    thank you,

    the Kampyle team

  • An Introduction to Online Surveys and Feedback for your website | Distilled blog said:

    [...] form or with livechat. There’s a full (if slightly biased) definition of these on the Kampyle blog, but here are my one line (ahem) [...]

  • Marcus Nelson said:

    It’s nice to see a good array of feature differences, but if I may chime in to get a few facts straight…

    Page / Product Level Feedback — Yes, UserVoice allows unlimited forums to be target specific for products or pages w/ links via widgets or hyperlinks.

    Brand Protection — This is our core feature. Being a white label solution allows us to offer this level of freedom to our customers.

    Fits Websites of all sizes — True, very small websites do not benefit as much as volume is needed to gather aggregated information.

    Integration with Web Analytics — Inserting Google analytics or any other package is a trivial matter when you’re given access to UserVoice’s custom designs.

    Fits all amounts of Data — Some of our best installations are larger ones where huge amounts of data can be aggregated into actionable items.

    And finally, in regards to “UserVoice is more of a public support forum…” Not entirely true. Many of our customers utilize private forums including our Single Sign On solution called ZeroLogin, which requires no login from your customers and only allows those with an existing authentication in place to have access to the forum.

    For more accurate information about UserVoice, please check out:
    http://uservoice.com/faq

    Thank you.

Leave your response!

Add your comment below, or trackback from your own site. You can also subscribe to these comments via RSS.

Be nice. Keep it clean. Stay on topic. No spam.

You can use these tags:
<a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

Feedback Form