Userlytics, Personal Approach To Remote Usability Testing

Userlytics, Personal Approach To Remote Usability Testing

Share these actual insights

Yes, I have tested quite a few remote usability testing tools in my years on the job. There are definitely a few, let’s say two or three, that I would always consider using. Funny thing though, even though there are only a small handful of remote user testing service vendors, all of them having their own uniqueness.

Userlytics, based out of San Francisco and Madrid, is a company that I had heard of before, but one which I had not personally tested… and guess what… I have just shortlisted Userlytics to my ‘preferred tools’ list!

Remote Usability Testing, the concept


Userlytics Logo
For those of you who are not sure by what I mean with the term Remote Usability Testing, it is the term I use in which the process of conducting moderated usability tests in labs (user testing) is transformed to unmoderated usability tests (remote user testing). The process entails that users are tested via a predefined set of tasks/goals that they must perform on their own computer (desktop, laptop, mobile device…) while a screen and audio recording tool runs in the back ground.

Still not sure, check out these examples of remote user tests that I conducted:

  1. Airbnb vs Wimdu
  2. London 2012 iPhone app

Userlytics in a nutshell…

Why type, when this quick video can give you the low-down on Userlytics:

Userlytics’ Realistic Pricing & Plans

Userlytics has been around for a while now. Their approach, not only in the actual functionality of performing remote user testing, is a little different from other vendors. Userlytics’ most attractive selling point is that it offers a great and seriously useful ‘Free’ account option.

Userlytics - Plans

Plans range from free to… well anything you want ;)

There has been a lot of talk about Freemium vs. Premium on many other blogs, but when it comes to opening a relatively niche service to the public, you want them to be able test drive it properly before becoming a Premium user. Let’s face it, we do the same with other products in the non-digital world and furthermore, in order to get the internal budget holder to open up his/her wallet… you need to be able to show value-for-money.

Freemium

A quick note on Userlytics’ Freemium model… you can sign up for a free monthly subscription to the service. The free account will give you 7 credits a month that you can use towards tests. There is a small catch… testing using your own panel will cost you 1 credit/participant. If you want to test using Userlytics’ panel it will cost you 8 credits/participant. Definitely not a deal breaker, but just so you know.

Userlytics - Panel

Using a Userlytics’ panel member will cost you 8 credits

Looking to create your own panel and save some costs… we have an article on that:

Reading Tip: How to recruit your own usability test panel, for free!

What makes Userlytics ‘Personal’?

Ok, busted… Userlytics is no more personal than other vendors. However, the big difference is one that I personally find interesting, especially if you are interested in psychology. By using the webcam on the participant’s computer, Userlytics doesn’t only allow you to view the screen of the participant, but also the participant him-/herself. This makes the experience for me, the user experience researcher, more ‘Personal’.

Userlytics - Clip Screenshot

Actual screenshot of a Userlytics remote user testing session

Why do I find this of interest? Well, as you can see in the screenshot above, being able to see the user perform your tasks will allow you to see his facial/bodily reactions. Stress, joy, frustration, enthusiasm, whatever emotion it may be, it can often be derived from watching a human being (I know I make some hand gestures to the screen when something is working correclty). Userlytics plays into this quite well simply by recording users during their test… just like a moderated lab usability test.

Tasks & Segmentation

Userlytics has some good functionality for segmenting your participants… or should I say selecting your participants. If you decide to use Userlytics panel, you have several options that will allow you to choose the best candidates. One option that I liked was ‘Employment’. I personally feel that employment can play a significant role on a user’s online behavior. Less shopping, and more job-hunting to name one, more attention to sale items, than high quality products to name another… unless they’ve retired after selling a bucket load of stocks of course…

Maybe they should also put in an option for ‘Retired‘ (maybe even ‘Student’)

Here is a quick run down of the rest of the options:

  • Residence (USA/UK)
  • Gender, Age (18-34, 35+)
  • Education
  • Employment
  • Family Status
  • Language (English/Spanish)

Show Me Some Insights

I will, I will, trust  me. This blog post is getting a little long though, so in a follow-up post I will share with you my insights of my Userlytics remote user test of Refer.ly. I recruited 5 participants to check out the new social affiliate platform Refer.ly. I am really looking forward to their experiences!

Need help with remote user testing? Let me help you. Check out my service’s page to learn more.

Personal Note: The products that I recommend on this site are products that I have personally used and continue to use in my daily UX activities. I believe that bloggers, professionals, call us what you want, have the moral obligation to be honest and forthright when dealing with like-minded professionals seeking more insights and information on how to improve their skills.

Receive FREE updates

Get FREE updates and UX product discounts directly in your inbox by simply signing up for my newsletter. You can unsubscribe at any time.

Your information will never be shared, period!
About Matthew Niederberger

Matthew works as Conversion Optimisation Manager at Ziggo BV. In his free time he enjoys family life as well as digging into online user research material whilst frequently generating some of his own, which he freely shares here on actualinsights.com.

Comments

  1. Kristin Due Holmegaard says:

    How is the video quality and sound? In my experience this can be an issue with some of the remote usability tools. I found a cheap tool once but the quality of the videos was really low. Maybe I should just try it out :) . Thanks for sharing

    • Hi Kristin. Well, I hate to sound negative, but the sound with Userlytics was a bit of an issue. Then agian, I tested them well over a year ago, so I cannot speak for the advances that they have since then. Previewing panel members on quality of sound, video, and of course willingness to really help seems essential. I would definitely give them a go. YOu can get a lot of free credits per month, especially on their free plan. Good luck!

Trackbacks

  1. [...] A more personal approach to Remote User Testing” #ux #usability http://t.co/Eu9siM7o Link – Trackbacks Posted in User experience (UX) | Permalink. ← New or optimised Tech? [...]

  2. [...] Userlytics officially announced their solution for mobile remote user testing for iOS devices. This [...]

  3. [...] Visit Userlytics.com or make use of our special Userlytics’ offer worth up to $720 [...]

Leave a Reply

FREE Course!

Get FREE access to my User Feedback Fundamentals course at Udemy, a $29 value. Just sign-up to my newsletter.
Unsubscribe at anytime and keep access to the course.

Nope, we don't deal in spam, not even the canned sort.
x