Search icon CANCEL
Subscription
0
Cart icon
Your Cart (0 item)
Close icon
You have no products in your basket yet
Arrow left icon
Explore Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Conferences
Free Learning
Arrow right icon
Remote Usability Testing
Remote Usability Testing

Remote Usability Testing: Actionable insights in user behavior across geographies and time zones

Arrow left icon
Profile Icon Inge De Bleecker Profile Icon Okoroji
Arrow right icon
₱1683.99
Full star icon Full star icon Full star icon Full star icon Half star icon 4.5 (8 Ratings)
Paperback Aug 2018 202 pages 1st Edition
eBook
₱579.99 ₱1346.99
Paperback
₱1683.99
Subscription
Free Trial
Arrow left icon
Profile Icon Inge De Bleecker Profile Icon Okoroji
Arrow right icon
₱1683.99
Full star icon Full star icon Full star icon Full star icon Half star icon 4.5 (8 Ratings)
Paperback Aug 2018 202 pages 1st Edition
eBook
₱579.99 ₱1346.99
Paperback
₱1683.99
Subscription
Free Trial
eBook
₱579.99 ₱1346.99
Paperback
₱1683.99
Subscription
Free Trial

What do you get with Print?

Product feature icon Instant access to your digital eBook copy whilst your Print order is Shipped
Product feature icon Paperback book shipped to your preferred address
Product feature icon Download this book in EPUB and PDF formats
Product feature icon Access this title in our online reader with advanced features
Product feature icon DRM FREE - Read whenever, wherever and however you want
OR
Modal Close icon
Payment Processing...
tick Completed

Shipping Address

Billing Address

Shipping Methods
Table of content icon View table of contents Preview book icon Preview Book

Remote Usability Testing

Why Everyone Should Run Remote Usability Studies

If you are reading this book, then you probably already know what usability testing is, but we don't want to make any assumptions about that, which takes us right to the essence of this book: usability testing is about not making assumptions. In fact, it takes the opposite approach. Usability studies are executed in order to gain concrete, actionable insights. Instead of assuming that users will use an interface in a certain manner, usability tests are run to actually monitor their use of the interface, identify where they stumble and what they appreciate, hear their thoughts, understand their decisions and ultimately use this information to improve the product.

Let's take a step back and talk about usability. Usability refers to how easy an interface is to use. It is a quality that every interface inherently possesses. Issues arise when this quality is not very pronounced. ISO 9241-11 defines usability as the "extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency, and satisfaction in a specified context of use".

Effectiveness (how well the user achieves their goal) and efficiency (how much effort is required from the user to achieve their goal) are unsurprising in the ISO description. Satisfaction, however, is interesting: even if an interface is effective (meaning that it does what it needs to do) and efficient (meaning that it does not require a lot of effort to do it), how the user feels about using the interface is also relevant. For every app someone uses, there is probably a plethora of competing apps that do exactly the same thing. So how does the user choose? Oftentimes, they go by the very subjective feeling of being satisfied or not. The evaluation of the usability of an interface is therefore based on both very objective measures, such as the task completion rate or the time spent on a task, but also on the very subjective perception of the individual user using the interface. Did the user like the design? Are the colors pleasing? Does the interface make the user feel good about themselves? Understanding what users like or dislike, where they struggle, and which tasks come easy to them, helps with the following:

  • Evaluate the usability of the interface
  • Identify areas to fix and patterns to avoid
  • Determine a usability baseline across product iterations
  • Compare an interface with the competition

A more formal approach to evaluate the usability of a product is to run a usability test. Usability testing refers to "evaluating a product or service by testing it with representative users" (https://www.usability.gov/how-to-and-tools/methods/usability-testing.html). Usability testing is a subdiscipline of User Experience (UX). Its goal is to ensure that a given product is easy to use and that the user's experience with the product is intuitive, useful, and satisfying. Essentially, users, who are representative of the target users, are monitored while using an interface to complete tasks that are relevant to their needs. A usability test can be run at any stage of the product development lifecycle. Usability tests in the early design stages can be used to validate a navigation concept using wireframes, for example, or test the usability of new features using early prototypes, or benchmark the ease-of-use of the final product. The feedback is then used to refine and improve the user interface, ideally in an iterative process.

We want to point out that usability testing is not market research. While usability testing is mostly focused on the interaction with a particular product, market research is usually less specific; usability testing is about ease-of-use, whereas market research is mostly about user opinions or past experience. Usability testing does not require a large number of participants in order to generate valuable results, whereas most market research tools depend on large, statistically relevant sample sets.

Usability testing is also not Quality Assurance (QA). Quality assurance is performed by qualified testers, whereas usability testing is preferably run with non-QA testers. Quality assurance is aimed at finding bugs, whereas usability testing is preferably run on bug-free implementations. Usability testing usually involves a user completing a task the way they normally would, while quality assurance testers will repeat that same task multiple times in order to mimic every possible permutation a real user might encounter.

Usability testing methodologies

Usability tests can be run in different ways and for various types of studies. Let's first look into the different ways (or methodologies) of executing a usability test. These are mainly differentiated by the following characteristics:

  • In-person versus remote 
  • Moderated versus unmoderated

In-person or lab usability testing

This is the traditional way to run a usability test: users who meet the user profile requirements are invited to participate in a usability study at a lab. This methodology is almost always moderated, meaning that there is always a UX researcher present who moderates the user sessions. 

In-person usability testing

We are listing this methodology for completeness, but this book only covers remote methodologies.

Remote usability testing

While in-person usability testing has been around for some time, remote usability testing has only more recently become feasible due to advances in technology and the availability of new tools. 

Connectivity and the internet have made it possible for us to run usability studies remotely using software that allows the moderator to view and capture the participant’s screen, hear their audio input, and view their faces. Enhanced distribution and recording tools have also made it possible to target participants offline and receive high-fidelity user videos and feedback.

Remote usability testing

Remote usability testing allows companies to gain insights into user behavior in their natural environment and on their own schedule. It involves fewer logistics, allows participation regardless of location, and is quicker and cheaper to execute compared to in-person studies, while still delivering valuable insights and feedback. In today's globally connected world, quickly getting local insights is imperative for providing the same standard of user experience while remaining culturally specific.

Advantages of remote methods

We are raving fans of remote usability testing (you might have guessed this by the fact that we wrote a book about it) for the following reasons.

Extended reach

Remote studies make it easy to include participants from different geographic locations in the same study. Essentially, anyone with a smart device and an internet connection can participate. Imagine that the product under testing is a social app aimed at allowing people to connect with each other when in proximity of another person using the same app. The typical users are city dwellers in densely populated capitals around the globe. Setting up in-person studies in each of the major cities would be logistically complex and expensive. This is where remote studies provide the biggest benefit. 

Typical devices

In a remote study, study participants use their own devices. That variety of devices combined with operating system versions (and, optionally, browser versions) and connectivity speeds is near impossible to match in a lab setting. Imagine a wayfinding app that provides directions to a selected target which is meant to be rolled out globally. A remote, globally distributed study will allow the study sponsor to gather realistic feedback with regards to how the app deals with the connectivity available locally on typical devices.

No travel required

It is easier to recruit study participants when there is no travel required as it lowers the hurdle for participants to take part in the study. A remote usability study can be completed within as little as half an hour. Imagine a study for a restaurant supply ordering site where the target user group is restaurant chefs. These folks work so many hours that it is very hard to convince them to travel to a lab. Or imagine a company that develops products that are mostly sold in rural areas, such as farming or harvesting equipment. It will be challenging enough to find participants for this study, let alone asking these participants to travel to an in-person study location.

No travel costs

Requiring participants to travel to a lab not only substantially increases the time required for the participants, but also their compensation. As remote studies eliminate the need to travel to a lab location for both the UX researcher and the participants, the costs associated with travel do not apply.

No lab costs

As no lab space is required, it follows that there are no costs for it. In a remote study, the study participants are either in an environment that they select or one mandated by the study (for example, if the study requires that the participants complete the study at their place of work), but they are never required to come into a lab.

No lab environment

A remote study allows the participant to remain in their own environment using their own devices. Any UX study is by definition an artificial event since participants knowingly sign up to provide feedback. We can reduce the level of artificiality around a study in a number of ways. One significant factor is the participant's surroundings and the devices they are using. The participant will feel more comfortable in their own environment than in a lab environment. Imagine that the website being tested is a banking website and the target users are existing customers. If the study requires that real tasks are completed on the website, participants will probably feel more comfortable displaying their banking details on their screens while in their homes than in a lab.

Familiar equipment

In a remote study, the study participants are required to use their own devices to complete the tasks. This is another significant advantage of the remote methodology because it removes the hurdle of participants having to familiarize themselves with new hardware and/or software. Imagine the usability test of some gaming software. Gamers can be very particular about the equipment they use to play. The remote study allows them to play using the devices they are familiar with, and thus eliminates the hurdle of first having to get used to devices provided to them in a lab. Another relevant scenario is users who require assistive technology, such as a screen reader; using their own devices will ensure that they do not first have to configure settings to suit their individual needs.

User's natural environment

Capturing the participant's own environment can also help discover important aspects of how users might interact with the product. Imagine testing a TV-streaming device. The study sponsor will be interested in understanding the individual setup of the participants' environment, such as where they sit when using the device, what the distance to the TV is, or what lighting is available. These settings are difficult to replicate to everyone's individual taste in a lab.

Interruptions can also provide valuable insight into a product's usability with respect to how easy it is to pick back up after an interruption. This is relevant for any interface that is frequently or typically used in an environment or at a time when interruptions might occur, such as a colleague coming over to the user's desk or the doorbell ringing, and so on.

In the wild testing

In a remote study, it is possible to send participants out into “the wild” and ask them to test an interface in a real situation. Imagine an app for browsing a conference program and navigating within a conference center. Testing the app in the participant’s home will probably not yield the same insights as compared to when they are actually using it in the conference halls and trying to find the lecture they are interested in via the built-in GPS function. Another example is a scenario where a customer is ordering ahead and picking up their order in a store or restaurant. Study participants are first asked to use an app or a website to order something and are then asked to go and pick it up. These types of studies provide insight into the broader customer experience, such as how easy it was to match up the order with the orderer, whether the order was ready at the time promised, and so on.

Larger number of participants

As a consequence of the lower costs and effort associated with running a remote study, it is possible to recruit more participants. With a larger number of participants, it is easier to determine the magnitude of any issue that is found.

Disadvantages of remote methods

We see only one main drawback to remote usability studies (although we might be biased as we are raving fans, after all).

Distributing the product under testing

When the product to be tested is not a production version, such as an app that can be downloaded from an app store, a website that is publicly accessible, or a product that the user already owns, the user will have to be adequately equipped. The study sponsor will either have to provide early versions of their designs, their software, or their product to each participant for testing.

This can usually be managed when planning the study, and we will talk about this in more detail in the following chapter. It only proves to be insurmountable when the study sponsor cannot or does not want to share these early versions outside of their lab or company for security or logistical reasons. In this case, only in-person testing is possible.

Other disadvantages

Some people will say that not being able to run the study in a controlled environment, such as a lab, is a disadvantage of remote methodologies, but we would argue that it provides a more natural context to the study. How likely is it that the user of an app will always have a completely quiet environment, with perfect lighting, free of any interruptions when they are using it? No one lives in a vacuum: the phone will ring, someone will be at the door, the participant’s child will want attention, and so on. If you remember the definition of usability testing, it states that the interface is tested by “representative users”. You can only really judge whether an interface is easy to use when it is being used by the people whom the products target in order to achieve a goal the users would actually have and in the environment that the users would naturally be using the interface in.

Another disadvantage of the remote methodologies that we try to turn into a benefit is that users might run into issues when installing or setting up the interface to be tested. When this setup is identical to how the actual product would be set up, this is valuable feedback regarding how easy it is to get started with the product under testing. However, when the study is based on early prototypes, their installation might require additional time and effort in order to get the participant set up correctly, and this is admittedly more difficult to do remotely than it would be if both parties were present in the same lab together.

Remote moderated usability testing

In a remote moderated usability study, the UX researcher and the study participant are both present and connected, but not physically in the same room. The UX researcher serves as a moderator and observer during the session. Moderated studies use the internet and collaborative software so the UX researcher can moderate and observe the participant's view of the product being tested and their facial expressions if using a webcam.

Advantages of remote moderated studies

All of the advantages of the remote methodologies listed previously apply to the moderated variation as well. In addition, the following are advantages of the remote moderated study when compared to the unmoderated variation.

Body language

If the remote moderated study uses software that allows the UX researcher to see the participant while they are completing the study, the facial expressions and potentially the body language of the participant may provide additional insight and context. This is often considered an advantage of the remote moderated study over the unmoderated variation.

Tailored follow-up questions

The ability to observe the participants in real time as they complete tasks allows the UX researcher, and any study sponsors who are observing remotely, to ask follow-up questions based on what they see. This can provide valuable, additional insights.

Disadvantages of remote moderated studies

The UX researcher has to establish a rapport without personal contact and pastries, although we would argue that the tone of the interaction can also help establish a rapport.

Remote unmoderated usability testing

In a remote unmoderated usability study, the UX researcher sets up the UX study and analyzes the results, but contrary to the moderated version, the study participants participate when it is convenient for them to do so, and without the moderation of the UX researcher. This allows the study participants to complete the study tasks where and when it is most natural to them.

Advantages of remote unmoderated studies

All of the advantages of the remote methodologies listed previously apply to the unmoderated variation as well. In addition, the following are advantages of remote unmoderated studies when compared to the moderated variation.

Natural behavior

Not being in a lab will already allow the participants to feel less inhibited and under observation, but remote unmoderated studies allow the participants to act completely natural. Imagine a music-streaming app. Ideally, the participants should use the app where and when they would naturally use it. This may be while working out or riding a bike, or even doing household chores. Participants might feel inhibited to work out or dance while being observed by a UX researcher. An unmoderated study has both the benefit that the participants can complete the study at their own convenience using the product as naturally as possible while also enabling the UX researcher to gather valuable feedback regarding the use of the app under real conditions. This is the biggest benefit of the remote unmoderated usability study.

Time zone independent

Remote unmoderated studies are independent of time zones. This is especially relevant for globally distributed studies where the study participants are located in varying time zones. In an unmoderated study, there is no interaction required between the UX researcher and the participants, thereby allowing them to complete the study at a time that suits them.

Less effort for the UX researcher

The effort for the UX researcher conducting a remote unmoderated study is significantly less than it would be if they were conducting a remote moderated study. This is because, while the effort for preparing and reporting on the study are comparable, no dedicated sessions between the UX researcher and each participant are required.

Eliminates influence

The absence of a joint session eliminates any inadvertent influence on the study participant by the UX researcher. The validity of the data could be compromised by as subtle an influence as a sigh, or obviously taking notes, for example. Moderating a usability study requires a skilled moderator who is experienced enough to know when to jump in and when to hold back. Remote unmoderated studies can be run by UX researchers who do not necessarily have this experience.

No schedules to manage

In an unmoderated study, no effort is required for scheduling the sessions between the moderator and the participants. In order to handle no-shows, moderated studies very often use "floaters". These floaters are on standby in case someone arrives late or doesn’t show up. Managing these schedules and the floaters generates a lot of overhead, not to mention the cost of having additional participants on standby. This effort and cost are absent in remote unmoderated studies.

Testing with minors

Testing with children is easier in remote unmoderated studies because parents can observe their kids and respond to their questions. Imagine a usability study where the product under testing is an educational app targeted at three- to six-year-olds. In an unmoderated study, the parents can be more flexible in interrupting the study and attending to their children if they might have lost patience or interest in the app, and resume the study at a later point in time.

Faster turnaround

The reduced effort required for remote unmoderated studies makes them faster to complete and easier to integrate into iterative testing processes. 

Disadvantages of remote unmoderated studies

There is one main disadvantage of remote unmoderated studies when compared with moderated ones.

Guidance

Participants in an unmoderated study require guidance in the form of a script to let them know what they are required to do. This script requires a lot more attention to get it right than a discussion guide for a moderated session. This is obvious when you look at the advantages of this method: The fact that the participants are geographically dispersed and complete the tasks on their own schedule makes it impossible for the UX researcher to be available to guide them through any bit of the study that may be unclear or a dead end that they may inadvertently encounter. In our experience, this is the biggest stumbling point for UX researchers who are comfortable with in-person usability testing and wish to try out the remote unmoderated variety.

The scripts need to cater to any and every outcome, given that there is no possibility to help the participants during the study. You cannot always be sure what the participants are seeing and whether they are exactly where you expect them to be, so you have to anticipate each possible path and cater for it. This is not an insurmountable disadvantage; it just requires more effort and skill on the part of the UX researcher. 

Other disadvantages

Another disadvantage of remote unmoderated studies as compared to moderated testing is the lack of immediate observation. Body posture and other physical expressions that could provide the moderator with additional insight during a study are not available. We don't view this as an absolute argument against remote unmoderated testing because you could also argue that, especially in globally distributed tests, the UX researcher may not be familiar with local gestures, and thus potentially interpret them wrongly. In India, for example, shaking your head does not mean "no"—it actually means "ok" or "I understand". Thus, asking participants to explicitly express their opinions in writing in an unmoderated study is less subject to bias than interpreting body language.

The lack of personal contact could also be viewed as a disadvantage because the unmoderated study does not allow for building a strong personal rapport between the UX researcher and the study participants. To some extent, it is possible to build a rapport in a remote unmoderated study just through how the participants are addressed in the script. As we saw with the previously mentioned disadvantage, though, what might help to build rapport with members of one culture might not work with others, or might even have the opposite effect.

One last disadvantage of the remote unmoderated methodology is that it is not possible to get reliable time-on-task values. Some unmoderated testing platforms may record the time taken on a task, but there is no guarantee that this will be valid because it is not possible to determine whether the participant continuously worked on the task or was distracted by a phone call during the execution of the task, for example.

Types of usability studies

In addition to the usability testing methodologies, there are also different types of studies that can be executed using the various methodologies:

  • Formative (exploratory) versus summative (assessment)
  • Qualitative versus quantitative
  • Longitudinal studies versus single session
  • Comparative studies versus single product under testing

These types are not mutually exclusive: For example, a comparative study can also be a formative study and a longitudinal study can also be a qualitative study.

Formative and summative usability studies

The difference between formative and summative studies is determined by the development stage of the interface to be tested and the goal of the test. Formative, or exploratory, studies are run on early versions of the product when it is still being designed with the aim of understanding user behavior, needs, and wants, and how people expect to interact with the product while summative, or assessment, studies are run on half-completed to completed products, with the aim of validating the improvements made as a result of previous formative tests, validating individual features or determining a baseline usability. Formative studies are run to shape the product while summative studies are run to assess its usability. Jeff Sauro describes this as follows:

"Summative tells you how usable an interface is and formative tells you what isn't usable."

Both types are compatible with remote methodologies.

Qualitative and quantitative usability studies

Qualitative and quantitative types of study differ in the type of data that they gather. Qualitative usability studies are focused on gaining in-depth understanding based on narrative data, while quantitative studies collect numerical data in order to produce statistically relevant metrics. A qualitative study will uncover usability issues and identify why users stumble there, whereas quantitative studies will determine the task completion rate, the time-on-task, the users' satisfaction, or other relevant metrics.

A small number of participants is sufficient to provide valuable results in qualitative studies, whereas quantitative studies rely on large numbers of participants in order to provide statistically relevant metrics. How many participants are actually required for a quantitative study is determined by the study parameters, whereas qualitative studies can be run with as few as five participants, according to Nielsen (https://www.nngroup.com/articles/how-many-test-users/).

Both study types are compatible with remote methodologies.

Longitudinal and single-session studies

In a single-session study, the participant is only required to participate once in order to complete the study, while a longitudinal study is run over a longer period of time and includes repeated contact with the participants during this time. This time period can be anything from a couple of days to weeks. The study participants are asked to use a product over that period of time. If the aim of the longitudinal study is that the participants record their behavior around and with the interface, this type of study is called a diary study.

Both longitudinal and single-session studies are compatible with remote methodologies.

Comparative and single test object studies

These studies differ in the number of interfaces that are being tested. Single test object studies will cover only a single product, while comparative studies involve two or more products in order to compare them. Comparative studies may be run in order to determine which alternative of a product’s early design better reflects the user's expectations. The aim of this type of study is to either find a preferred candidate or identify the best aspects of either alternative which can then be used to drive the further design of the product. Comparative studies can also be used to determine how competing products measure up against each other.

Another aspect of comparative studies is whether all study participants will test all test objects (within-subjects) or whether each study participant only tests one of the test objects (between-subjects). Both have their advantages and disadvantages; fewer participants are required for a within-subject study, but the study duration is necessarily longer, while a between-subjects study eliminates anchoring bias (judging subsequent test objects by comparing them to the subjective baseline made after using the first one). 

Comparative studies and studies of a single test object are compatible with remote methodologies.

Other study types

There are other, more specific, study types. One such example is the end-to-end, multichannel customer experience study. A remote unmoderated survey approach works well in gathering data on an end-to-end customer experience that includes a digital and a physical aspect; one example of an activity that includes such aspects could be ordering pizza from a fast food chain on a mobile app and then picking it up at the restaurant. The study can evaluate the ease of installing and registering on the app; ordering food, paying, and selecting the pick-up location; the quality of the messages received apropos pickup time; and the order completion progress, if available. For the actual physical pickup, the study can gather feedback on the punctuality of the order, whether it was clear where to go to pick it up in the restaurant, what information was needed to verify the identity of the orderer, and whether it was fulfilled correctly.

Summary

The advantages of remote usability studies significantly outweigh the disadvantages. A strength of this methodology is the ease of testing across geographical areas. There are only very few situations where a remote usability study would be ill-advised.

In the next chapter, we will look into how to go about planning a remote usability study in order to prepare the foundations for a successful study.

Left arrow icon Right arrow icon

Key benefits

  • Understand the different usability testing methodologies and their strengths and weaknesses
  • Master the execution of remote studies
  • Learn how to analyze and present study results

Description

Usability testing is a subdiscipline of User Experience. Its goal is to ensure that a given product is easy to use and the user's experience with the product is intuitive and satisfying. Usability studies are conducted with study participants who are representative of the target users to gather feedback on a user interface. The feedback is then used to refine and improve the user interface. Remote studies involve fewer logistics, allow participation regardless of location and are quicker and cheaper to execute compared to in person studies, while delivering valuable insights. The users are not inhibited by being in a new environment under observation; they can act naturally in their familiar environment. Remote unmoderated studies additionally have the advantage of being independent of time zones. This book will teach you how to conduct qualitative remote usability studies, in particular remote moderated and unmoderated studies. Each chapter provides actionable tips on how to use each methodology and how to compensate for the specific nature of each methodology. The book also provides material to help with planning and executing each study type.

Who is this book for?

This book is for user experience (UX) professionals familiar with traditional in-person usability testing methodologies, or for UX designers with no prior exposure to user research and usability testing. Customer experience professionals or product managers who want to understand remote usability testing will also find this book useful. No knowledge of remote usability testing is needed.

What you will learn

  • Choose the most suitable remote study methodology
  • Establish a clear goal for the study 
  • Plan the study execution 
  • Understand recruitment logistics, expectations and compensation
  • Set up and moderate remote studies 
  • Write good tasks and questions for each methodology 
  • Analyze and document the study results 
  • Deliver results that align with the goal for the study
Estimated delivery fee Deliver to Philippines

Standard delivery 10 - 13 business days

₱492.95

Premium delivery 5 - 8 business days

₱2548.95
(Includes tracking information)

Product Details

Country selected
Publication date, Length, Edition, Language, ISBN-13
Publication date : Aug 23, 2018
Length: 202 pages
Edition : 1st
Language : English
ISBN-13 : 9781788999045
Concepts :

What do you get with Print?

Product feature icon Instant access to your digital eBook copy whilst your Print order is Shipped
Product feature icon Paperback book shipped to your preferred address
Product feature icon Download this book in EPUB and PDF formats
Product feature icon Access this title in our online reader with advanced features
Product feature icon DRM FREE - Read whenever, wherever and however you want
OR
Modal Close icon
Payment Processing...
tick Completed

Shipping Address

Billing Address

Shipping Methods
Estimated delivery fee Deliver to Philippines

Standard delivery 10 - 13 business days

₱492.95

Premium delivery 5 - 8 business days

₱2548.95
(Includes tracking information)

Product Details

Publication date : Aug 23, 2018
Length: 202 pages
Edition : 1st
Language : English
ISBN-13 : 9781788999045
Concepts :

Packt Subscriptions

See our plans and pricing
Modal Close icon
$19.99 billed monthly
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Simple pricing, no contract
$199.99 billed annually
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Choose a DRM-free eBook or Video every month to keep
Feature tick icon PLUS own as many other DRM-free eBooks or Videos as you like for just ₱260 each
Feature tick icon Exclusive print discounts
$279.99 billed in 18 months
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Choose a DRM-free eBook or Video every month to keep
Feature tick icon PLUS own as many other DRM-free eBooks or Videos as you like for just ₱260 each
Feature tick icon Exclusive print discounts

Frequently bought together


Stars icon
Total 6,175.97
Hands-On UX Design for Developers
₱2245.99
Remote Usability Testing
₱1683.99
Fixing Bad UX Designs
₱2245.99
Total 6,175.97 Stars icon
Banner background image

Table of Contents

11 Chapters
Why Everyone Should Run Remote Usability Studies Chevron down icon Chevron up icon
What Not to Forget When Planning Your Study Chevron down icon Chevron up icon
How to Effectively Recruit Participants Chevron down icon Chevron up icon
Running a Remote Moderated Study Chevron down icon Chevron up icon
Running a Remote Unmoderated Study with User Videos Chevron down icon Chevron up icon
Running a Remote Unmoderated Study with a Survey Chevron down icon Chevron up icon
Running a Remote Unmoderated Study with a Hybrid Approach Chevron down icon Chevron up icon
What to Consider When Analyzing and Presenting the Study Results Chevron down icon Chevron up icon
Thanks! And What Now? Chevron down icon Chevron up icon
Sample Material and Further Reading Chevron down icon Chevron up icon
Other Books You May Enjoy Chevron down icon Chevron up icon

Customer reviews

Top Reviews
Rating distribution
Full star icon Full star icon Full star icon Full star icon Half star icon 4.5
(8 Ratings)
5 star 87.5%
4 star 0%
3 star 0%
2 star 0%
1 star 12.5%
Filter icon Filter
Top Reviews

Filter reviews by




Wesley Chan Oct 24, 2018
Full star icon Full star icon Full star icon Full star icon Full star icon 5
If you want to dive deep into the nitty-gritty tactical details of running remote usability studies in industry, this is your book. Each chapter guides you through a specific step of the remote research process: there's one for planning & scoping your study, another for recruiting the right participants, individual chapters for executing moderated, unmoderated, and hybrid remote studies, and more on analyzing and presenting research insights after the data has been collected.Research method books may seem like a crowded space, but what makes this one by De Bleecker & Okoroji special is its focus on remote *usability* testing, and nothing else. Great for both seasoned professionals and junior researchers seeking fresh perspectives and ways to expand their research toolkit.One unexpected bonus is that De Bleecker and Okoroji offer plenty of suggestions and insights throughout the book for advocating & defending research findings to people who may be unfamiliar or skeptical with the role and scope of research. My favorite includes how to handle debriefing sessions in Chapter 9: "Thanks! And What Now?", and how to address critiques regarding the study itself.If the book was only about executing remote usability studies, that would already be great. But the practical, actionable advice it gives for communicating those research findings is what keeps me coming back. I keep a copy at my desk and use it as a "cookbook" to reference whenever I have a new study to kick off or wrap up.
Amazon Verified review Amazon
peter Nov 19, 2020
Full star icon Full star icon Full star icon Full star icon Full star icon 5
I really appreciate the tenets of remote research being distilled down into bite sized nuggets of initiatives. As a business owner, it bolsters the necessity and efficacy of adding research to a product development cycle. Well done, congratulations to Inge and Rebecca!
Amazon Verified review Amazon
Tom G Sep 07, 2018
Full star icon Full star icon Full star icon Full star icon Full star icon 5
The $23 you spend on this iBook will save your company thousands in more productive UX and customer feedback studies. Inge and Rebecca have run hundreds of UX studies and provide great examples, tips, dos and don’ts. If you are even Remotely considering doing a UX study you need to read this book!
Amazon Verified review Amazon
J. Stearns Sep 08, 2018
Full star icon Full star icon Full star icon Full star icon Full star icon 5
This book is a must for anyone looking to understand their products and how they are used. It's packed with information and details on how to run remote usability studies, how to know you are doing it right, and even pitfalls to watch out for. I am already putting the information in this book to use.
Amazon Verified review Amazon
Rebecca Sep 24, 2018
Full star icon Full star icon Full star icon Full star icon Full star icon 5
One can only hope that this book, in the right hands, will result in the broader adoption of rigorous usability testing across the board. Consumers around the globe would benefit. I am operating on the assumption that many product owners do not fully usability test because of the perceived high cost and cumbersome logistics to do so. This book proves that these barriers don’t really exist, and fully educates anyone in the target audience to accomplish an effective study. UX pros can confidently turn to this book for clear, step-by-step instructions for planning and executing a quality remote usability study...as well as to find logical arguments that advocate for doing one.I have a few complaints, not related to content, and my suspicion is that they are attributable to editing/publishing decisions. Without heading numbers, I sometimes failed to keep track of what was a topic, or sub-topic, or sub-sub-topic. There were no callout boxes for visual interest, or to emphasize key takeaways. And some concepts (like the pros and cons of various types of usability studies) would have been better organized into table form - or at least summarized that way. A passionate reader may need to distill the contents into something more digestible “at a glance” to make the case to senior leadership for doing remote usability. That said, the information in the book is clear and accessible enough that I hope they do!!
Amazon Verified review Amazon
Get free access to Packt library with over 7500+ books and video courses for 7 days!
Start Free Trial

FAQs

What is the delivery time and cost of print book? Chevron down icon Chevron up icon

Shipping Details

USA:

'

Economy: Delivery to most addresses in the US within 10-15 business days

Premium: Trackable Delivery to most addresses in the US within 3-8 business days

UK:

Economy: Delivery to most addresses in the U.K. within 7-9 business days.
Shipments are not trackable

Premium: Trackable delivery to most addresses in the U.K. within 3-4 business days!
Add one extra business day for deliveries to Northern Ireland and Scottish Highlands and islands

EU:

Premium: Trackable delivery to most EU destinations within 4-9 business days.

Australia:

Economy: Can deliver to P. O. Boxes and private residences.
Trackable service with delivery to addresses in Australia only.
Delivery time ranges from 7-9 business days for VIC and 8-10 business days for Interstate metro
Delivery time is up to 15 business days for remote areas of WA, NT & QLD.

Premium: Delivery to addresses in Australia only
Trackable delivery to most P. O. Boxes and private residences in Australia within 4-5 days based on the distance to a destination following dispatch.

India:

Premium: Delivery to most Indian addresses within 5-6 business days

Rest of the World:

Premium: Countries in the American continent: Trackable delivery to most countries within 4-7 business days

Asia:

Premium: Delivery to most Asian addresses within 5-9 business days

Disclaimer:
All orders received before 5 PM U.K time would start printing from the next business day. So the estimated delivery times start from the next day as well. Orders received after 5 PM U.K time (in our internal systems) on a business day or anytime on the weekend will begin printing the second to next business day. For example, an order placed at 11 AM today will begin printing tomorrow, whereas an order placed at 9 PM tonight will begin printing the day after tomorrow.


Unfortunately, due to several restrictions, we are unable to ship to the following countries:

  1. Afghanistan
  2. American Samoa
  3. Belarus
  4. Brunei Darussalam
  5. Central African Republic
  6. The Democratic Republic of Congo
  7. Eritrea
  8. Guinea-bissau
  9. Iran
  10. Lebanon
  11. Libiya Arab Jamahriya
  12. Somalia
  13. Sudan
  14. Russian Federation
  15. Syrian Arab Republic
  16. Ukraine
  17. Venezuela
What is custom duty/charge? Chevron down icon Chevron up icon

Customs duty are charges levied on goods when they cross international borders. It is a tax that is imposed on imported goods. These duties are charged by special authorities and bodies created by local governments and are meant to protect local industries, economies, and businesses.

Do I have to pay customs charges for the print book order? Chevron down icon Chevron up icon

The orders shipped to the countries that are listed under EU27 will not bear custom charges. They are paid by Packt as part of the order.

List of EU27 countries: www.gov.uk/eu-eea:

A custom duty or localized taxes may be applicable on the shipment and would be charged by the recipient country outside of the EU27 which should be paid by the customer and these duties are not included in the shipping charges been charged on the order.

How do I know my custom duty charges? Chevron down icon Chevron up icon

The amount of duty payable varies greatly depending on the imported goods, the country of origin and several other factors like the total invoice amount or dimensions like weight, and other such criteria applicable in your country.

For example:

  • If you live in Mexico, and the declared value of your ordered items is over $ 50, for you to receive a package, you will have to pay additional import tax of 19% which will be $ 9.50 to the courier service.
  • Whereas if you live in Turkey, and the declared value of your ordered items is over € 22, for you to receive a package, you will have to pay additional import tax of 18% which will be € 3.96 to the courier service.
How can I cancel my order? Chevron down icon Chevron up icon

Cancellation Policy for Published Printed Books:

You can cancel any order within 1 hour of placing the order. Simply contact customercare@packt.com with your order details or payment transaction id. If your order has already started the shipment process, we will do our best to stop it. However, if it is already on the way to you then when you receive it, you can contact us at customercare@packt.com using the returns and refund process.

Please understand that Packt Publishing cannot provide refunds or cancel any order except for the cases described in our Return Policy (i.e. Packt Publishing agrees to replace your printed book because it arrives damaged or material defect in book), Packt Publishing will not accept returns.

What is your returns and refunds policy? Chevron down icon Chevron up icon

Return Policy:

We want you to be happy with your purchase from Packtpub.com. We will not hassle you with returning print books to us. If the print book you receive from us is incorrect, damaged, doesn't work or is unacceptably late, please contact Customer Relations Team on customercare@packt.com with the order number and issue details as explained below:

  1. If you ordered (eBook, Video or Print Book) incorrectly or accidentally, please contact Customer Relations Team on customercare@packt.com within one hour of placing the order and we will replace/refund you the item cost.
  2. Sadly, if your eBook or Video file is faulty or a fault occurs during the eBook or Video being made available to you, i.e. during download then you should contact Customer Relations Team within 14 days of purchase on customercare@packt.com who will be able to resolve this issue for you.
  3. You will have a choice of replacement or refund of the problem items.(damaged, defective or incorrect)
  4. Once Customer Care Team confirms that you will be refunded, you should receive the refund within 10 to 12 working days.
  5. If you are only requesting a refund of one book from a multiple order, then we will refund you the appropriate single item.
  6. Where the items were shipped under a free shipping offer, there will be no shipping costs to refund.

On the off chance your printed book arrives damaged, with book material defect, contact our Customer Relation Team on customercare@packt.com within 14 days of receipt of the book with appropriate evidence of damage and we will work with you to secure a replacement copy, if necessary. Please note that each printed book you order from us is individually made by Packt's professional book-printing partner which is on a print-on-demand basis.

What tax is charged? Chevron down icon Chevron up icon

Currently, no tax is charged on the purchase of any print book (subject to change based on the laws and regulations). A localized VAT fee is charged only to our European and UK customers on eBooks, Video and subscriptions that they buy. GST is charged to Indian customers for eBooks and video purchases.

What payment methods can I use? Chevron down icon Chevron up icon

You can pay with the following card types:

  1. Visa Debit
  2. Visa Credit
  3. MasterCard
  4. PayPal
What is the delivery time and cost of print books? Chevron down icon Chevron up icon

Shipping Details

USA:

'

Economy: Delivery to most addresses in the US within 10-15 business days

Premium: Trackable Delivery to most addresses in the US within 3-8 business days

UK:

Economy: Delivery to most addresses in the U.K. within 7-9 business days.
Shipments are not trackable

Premium: Trackable delivery to most addresses in the U.K. within 3-4 business days!
Add one extra business day for deliveries to Northern Ireland and Scottish Highlands and islands

EU:

Premium: Trackable delivery to most EU destinations within 4-9 business days.

Australia:

Economy: Can deliver to P. O. Boxes and private residences.
Trackable service with delivery to addresses in Australia only.
Delivery time ranges from 7-9 business days for VIC and 8-10 business days for Interstate metro
Delivery time is up to 15 business days for remote areas of WA, NT & QLD.

Premium: Delivery to addresses in Australia only
Trackable delivery to most P. O. Boxes and private residences in Australia within 4-5 days based on the distance to a destination following dispatch.

India:

Premium: Delivery to most Indian addresses within 5-6 business days

Rest of the World:

Premium: Countries in the American continent: Trackable delivery to most countries within 4-7 business days

Asia:

Premium: Delivery to most Asian addresses within 5-9 business days

Disclaimer:
All orders received before 5 PM U.K time would start printing from the next business day. So the estimated delivery times start from the next day as well. Orders received after 5 PM U.K time (in our internal systems) on a business day or anytime on the weekend will begin printing the second to next business day. For example, an order placed at 11 AM today will begin printing tomorrow, whereas an order placed at 9 PM tonight will begin printing the day after tomorrow.


Unfortunately, due to several restrictions, we are unable to ship to the following countries:

  1. Afghanistan
  2. American Samoa
  3. Belarus
  4. Brunei Darussalam
  5. Central African Republic
  6. The Democratic Republic of Congo
  7. Eritrea
  8. Guinea-bissau
  9. Iran
  10. Lebanon
  11. Libiya Arab Jamahriya
  12. Somalia
  13. Sudan
  14. Russian Federation
  15. Syrian Arab Republic
  16. Ukraine
  17. Venezuela