User research

Using moderated usability testing

Give feedback about this page

From:
User research community

Moderated usability testing is where you watch participants try to complete specific tasks using your service.

Asking them to 바카라 사이트榯hink aloud바카라 사이트� as they move through the service helps you understand what they are doing, thinking and feeling.

When to use moderated usability testing

Moderated usability testing is most useful in the alpha, beta and live phases to test prototypes or the service you바카라 사이트檝e built. You can also use it in the discovery phase to learn about problems with an existing service.

Doing it helps you to:

  • see if users understand what they need to do and can complete all relevant tasks
  • identify specific usability issues - for example, problems with the language or layout
  • generate ideas for how to improve your service

Steps to follow

Plan your moderated usability testing carefully so you learn things that can help improve your service.

Plan the sessions

Usability test sessions usually take between 30 and 60 minutes, depending on the number and complexity of the tasks you want users to attempt. Plan for no more than 6 one-hour sessions a day and allow at least 15 minutes between sessions, plus additional time for lunch.

Before planning any sessions, work with your team to agree the research questions, types of users and parts of your prototype or service you want to focus on. Once you know this:

Design the tasks

You need to design test tasks carefully to make sure they answer your research questions. Good test tasks:

  • set a clear goal for participants to try and achieve
  • are relevant and believable to participants
  • are challenging enough to uncover usability issues
  • do not give away 바카라 사이트榯he answer바카라 사이트� or hint at how a participant might complete them

You may have one long or complex task that you want to research but it바카라 사이트檚 more common to give users several smaller tasks. When you have several:

  • arrange them in a logical order and work through them one at a time
  • use the time between them to set up different parts of the prototype or service - for example, you may have to switch from a live service to a prototype if you have not got a working end-to-end product
  • bring a selection to each session and choose the tasks that are most relevant to the participant

Once you바카라 사이트檙e happy with the tasks, create a 바카라 사이트榙iscussion guide바카라 사이트�. This should include:

  • your introduction script - this tells the participant who you are, explains the research and reminds them about things like recording
  • descriptions of each test task, along with any instructions
  • a planning checklist to make sure you바카라 사이트檒l have everything you need

You can use your discussion guide to:

  • try out the test tasks and instructions with a colleague
  • stay on track during test sessions
  • make sure participants are given tasks in a consistent way
  • maintain a record of what you do in this round of research

Run a session

Participants are often nervous and worried about making mistakes. Before you ask them to do any tasks:

  • give them time to relax
  • run through your introduction script to explain what바카라 사이트檚 going to happen
  • let them know that you바카라 사이트檙e testing the service, not them - reassure them that they are not being judged or assessed
  • ask a few friendly questions to learn more about them - you can use this information later to make tasks more relevant to the participant

When you introduce a task, explain what you want the participant to do using clear, neutral instructions. You should also:

  • personalise the task if you can - for example 바카라 사이트榶ou told me your daughter is ready for nursery, can you choose a nursery that would be right for her?바카라 사이트�
  • ask the participant to tell you their thoughts as they run through the task
  • try to stay quiet - mostly just watch and listen

Occasionally, you may want to interrupt a participant. For example, you can:

  • ask the participant about anything really interesting that you see or hear so you can understand what바카라 사이트檚 happening
  • help the participant get back on track if they get completely stuck - giving them a chance to recover means you can continue learning
  • ask the participant about any opinions or suggestions they give - ask open-ended questions like 바카라 사이트榳hat makes you say that?바카라 사이트� or 바카라 사이트榟ow would that help?바카라 사이트�

Reserve some time at the end of the session to:

  • ask follow-up questions about the things you observed but did not clearly understand
  • check if the participant has any final thoughts about the things they바카라 사이트檝e seen

Once you바카라 사이트檝e finished:

  • thank the participant for their time and what they바카라 사이트檝e helped you learn
  • explain what will happen with your research
  • ask the participant what they thought of the session, so you can improve next time

If you바카라 사이트檝e finished for the day:

  • make sure any personal data you바카라 사이트檝e collected (on paper or in recordings) is stored securely
  • pack away your equipment (use your planning checklist)

Testing with personal data

Whenever possible, ask participants to carry out tasks using their own data and documents. They바카라 사이트檙e likely to be more engaged in the task and you바카라 사이트檒l probably learn more than if you use dummy data.

Using real data is only possible if:

  • your service can access and process data - prototypes will not always be able to do this
  • you are able to keep personal data secure

Using dummy data

If you cannot use real data or do not have enough time to set up appropriate test conditions, you should set up dummy data. You바카라 사이트檒l need to create a character for the participant to play and mock up documents like driving licences, letters or credit cards with that character바카라 사이트檚 name and details on them.

Participants using dummy data provide useful insights. However, they are likely to be less engaged than if they were using their own data and will probably uncover fewer contextual issues.

Researching with assistive technologies

Users of assistive technologies often have personal set-ups that are hard to replicate - for example, speech recognition software needs to be trained to a user바카라 사이트檚 voice. This means it바카라 사이트檚 usually best if participants can use their own devices.

Participants may be able to bring portable devices to a lab. Sometimes, however, you may need to visit someone at home or work.

Understanding assistive technologies

It바카라 사이트檚 helpful to understand how assistive technologies (like screen readers or screen magnifiers) work before you run any sessions with a participant who uses them. If a user has any problems completing a task, you바카라 사이트檒l be able to understand whether it바카라 사이트檚 down to the service or the technology they바카라 사이트檙e using.

You can familiarise yourself with assistive technologies by:

  • watching online demonstrations - for example,
  • watching sessions run by other user researchers
  • trying out software yourself - ask the developers or testers in your team if they have any you can use

Examples and case studies

You may find the following blog posts useful:

You can also:

  • find out
  • download
  • download the

You may also find these guides useful:

Updates to this page

Published 21 February 2017
Last updated 3 October 2017 show all updates

  1. Added guidance on researching with assistive technologies and how to end sessions.

  2. Guidance first published