From set up to insights. Over the past week, I have done some video work for this website to help you get to grips with remote user testing.
I started by creating a short tutorial video on how to set up a remote user test at Usertesting.com. The second video showed you how to use the website’s features to analyse a remote user test and in this post, I want to share with you a compilation video of the remote user test of Refer.ly.
Referly is an Online Referral System for your social network.
Earning money through various affiliate programs is hard. Managing the huge number of accounts you’ll need to sign up for all of those affiliate programs is a nightmare. It is for this reason that Danielle and Kevin Morrill started Refer.ly back in May 2012. According to Crunchbase:
Referly tracks the links you share, and rewards you for your friends’ actions. When you share your favorite products and services, you build a reputation as the “go-to guru” for the things you love, and get rewards for generating purchases.
In other words, Refer.ly makes earning money through affiliate programs easy for you, since all you need to do is sign up for the Refer.ly service, and they will do the rest. Of course, they’ll take a percentage of the fee, and the rest is put into your account at Refer.ly.
Interested in Refer.ly? Visit Refer.ly now
New Business, New Functionalities & New Users
I signed up myself just a few weeks ago and although I don’t catch myself using it daily, I still like the idea. I have emailed the team a few times with some questions about my account, and they were quick to reply. The team is very eager and it looks like they are working hard on paving the road in front of them.
With every new online business come new functionalities and new user. I was interested to learn how others found the sign-up process and experienced the different functionalities on the website. So, I turned to my trusted friend… Remote User Testing. Let’s have a look at some of those insights!
: This review was created by myself and is in no way ‘complete’. Some shortcuts were taken for the purpose of publishing this blog post since I do all of this in my spare time, which, with 3 kids, is not much. I like to consider myself objective and skilled enough to detect possible issues on a website and discuss these in the open. I agree that because only 1 user was tested it is impossible to claim significance, but I know that any finding could be a catalyst to improving the website overall’s experience.
Remote User Testing: Refer.ly
The following is a summary of the test. It includes the tasks as they were presented to the participant, a list of insights gained from the single 8 minute test result, and answers to the open-ended questions which the participant completes after the video portion of the test. Interested in how the test was set up? Make sure you watch our tutorial video.
- Look around the home page and talk about what you think the site is about: what can you do here, what’s it for, what strikes you about it?
- Do you trust this company? Do they look reliable?
- Complete the steps necessary to create a new account. Stop after your account has been created.
- When prompted to add your first product to your personal page go to Amazon.com, find a random product, copy and paste the URL to Refer.ly.
- Persuasion ‘Brand Logos’: Since Refer.ly is new to people, getting people to sign up can be difficult. As the participant experienced this first hand, she correctly notes that placing the logos of some very popular brands could have persuaded her to sign up more easily.
- Sign-up Bug: When trying to sign up, using the social media buttons, the participant ran into what looked like a lag issue causing her to grow impatient with the responsiveness of the website.
- Persuasion ‘$1 Referral Bonus’: After the participant had completed the sign-up, she was presented with an interesting selling point. Everyone who signs up can earn a $1 referral bonus for signing other people up to the service. The participant correctly mentioned that this selling point would be more effective if shown prior to signing-up.
- Overlapping UI Elements: A quick investigation needs to be done into the overlapping UI elements the participant experienced after signing-up. The elements associated with the ‘add link’ form field were not properly aligned with the form field element. This could be an isolated local issue.
- Adding Bookmarklet: Although the participant recognised the bookmarklet as a tool, it was unclear to her how it worked, or could get it to work. The instructions were quite clear from an objective point of view, but clearly there is room for improvement.
With every test, you can ask up to 4 open-ended questions for participants to answer. Here are the responses to the default questions for the Refer.ly test.
- What frustrated you most about this site? Just the confusion of exactly how it worked. I was unsure if I added my product or not.
- If you had a magic wand, how would you improve this site? I would add a step by step tutorial. I wasn’t sure if everything worked properly so a tutorial would’ve been great for clarification.
- What did you like about the site? I liked the concept of it. I liked the ability to look for a product and get a commission if somebody buys your referral.
- How likely are you to recommend this site to a friend or colleague (0=Not at all likely, and 10=Very Likely)? 7, only because I’m still unclear on how the process works.