Trends In Usability Testing - IA Summit 2010 & Maine IxDA

50 %
50 %
Information about Trends In Usability Testing - IA Summit 2010 & Maine IxDA

Published on July 23, 2009

Author: usableinterface



Presented to Maine UX (Maine IxDA) on 7.22.09 and the IA Summit on 4.9.10.

About the Presentation
Over the years, there have been some exciting developments in the way usability tests are facilitated. During this session we will take a closer look at the trends in the tools and techniques used in usability testing and discuss the benefits and drawbacks of each.

Some of the topics that will be covered include:

• Current Think Aloud (CTA) vs. Retrospective Think Aloud (RTA) Technique
• Pros and Cons
• How to moderate using RTA
• When to use RTA
• Remote Testing
• Pros and Cons
• Tips for proper facilitation
• Testing paper and low-fidelity prototypes remotely
• Overview of different remote testing tools
• Automated Testing (unmoderated remote testing)
• What you can and can’t learn
• When it should be used
• Overview of different automated testing tools
• Interview-based Tasks vs. Pre-defined Tasks
• Pros and cons
• Tips for proper facilitation
• Observer Debriefing
• Tips for proper facilitation
• Overview of different debriefing techniques

Videos and live demos of these trends will be included, which should make for an entertaining hands-on learning experience!

TRENDS in ti ng > Tes il ity s ab U Kyle Soucy, Founding Principal follow me: UsableInterface MaineUX July 22, 2009

Think Aloud Techniques

Think Aloud Techniques Concurrent (CTA) Retrospective (RTA) Vs.

Variation of RTA... Show the participant their video after they’re done testing.

Usability “Labs”

Vs. Source: Kent State University Image source: facit digital

Ideal “Lab-Less” Set Up

Remote vs. In-person Testing Vs.

Remote Testing Pros & Cons Pros: Cons: Participants stay in their native environment. Can’t see the user’s facial expressions. Accessible to a larger & more diverse pool of Can’t see if the user is using peripheral participants. devices. Recruiting is easier. Less no shows & easier Dependent on an Internet connection. last minute replacements. Can only recruit participants with a high- Opportunity to gather ethnographic data. speed Internet connection. Cost & time savings. No travel & lab rental fees. Easier for observers to “attend” a session. Risk of compromising data because the participant is using a foreign PC is removed.

Remote Testing Paper Prototypes (Yes, it is possible!)

Remote Testing Tools • UserVue • GoToMeeting • LiveLook • Adobe Connect • Silverback • Many more...

Remote Testing Tips • Disable IM programs, Outlook meeting reminders, or anything else that may be distracting • Use a phone recording controller. • Use as few tools as possible • Back up, back up, back up!

Automated Testing (Unmoderated Remote Testing)

What You Can Learn • Analytic data • Task completion rates • Number of clicks/clickstream • Time on task • Satisfaction ratings • In-context feedback

When to Conduct Automated Testing? Not a replacement for moderated testing or research. Best used to compliment your qualitative research.

Automated Testing Tools • Keynote WebEffective $$$ • UserZoom $$ • Treejack & Chalkmark $ • Loop11 (private beta) • $



Chalkmark Results

Loop11 Results

Web Analytic Video Tools • BlueFly • ClickTale • TeaLeaf

Pre-defined Tasks vs. Interview-based Tasks

Improv Testing Process 1. Interview participant about how they use the product. 2. Use the answers given in the interview to create tasks on the fly. When in doubt just ask, “what was the last thing you did when you used this product? Can you show me?”


Add a comment

Related presentations

My Music Magazine Pitch

My Music Magazine Pitch

October 30, 2014

music mag pitch

Questionaire charts

Questionaire charts

November 4, 2014


Final research

Final research

November 5, 2014

final research

Cersaie 2014

Cersaie 2014

October 30, 2014

allestimento in cartone per il Cersaie 2014 alberi in cartone scultura in cartone

Quarta turma do workshop de Infografia, ministrado por Beatriz Blanco e Marcos Sin...

Related pages

Usability Testing Kathryn Summers ©2010 - Documents

Usability Testing Kathryn Summers ©2010 Sep 18, ... Usability Testing For La2 M, ... Trends In Usability Testing - IA Summit 2010 & Maine IxDA
Read more

User Interface Design Trends | IxDA

... 2011 12:07 PM To: Subject: Re: [IxDA] User Interface Design Trends. ... using usability testing as a ... I a nOOb for quoting Nielen ...
Read more

Usability Manager | IxDA - Interaction Design Association ...

USABILITY SPECIALIST/ MANAGER ... -Familiar with industry trends in usability ... -facilitating usability testing, focus groups, ...
Read more

Maine | LinkedIn

Trends In Usability Testing - IA Summit 2010 & Maine IxDA. 2,300 Views. cardiacinfo. 2008 Maine EMS Protocol Revision. 917 Views. kaplanthompson ...
Read more

* Usability Testing | LinkedIn

Current Onderzoeker financiële communicatie at Universiteit Utrecht, Expert usability testing at Freelance Past Docent Master 'Communicatie en ...
Read more

Emotional Design with A.C.T :: Presentations ...

usability of a design. But what ... (I still reference his IA Summit presentation ... It appears to me that one of the main factors which has limited the ...
Read more

Chris Baum « Boxes and Arrows

Chris is a UX practitioner who started his career in technology as a ... he moved on to usability and design management ... the 2009 IA Summit ...
Read more

IA Summit 2008, Day 1 « Boxes and Arrows

IA Summit 2008 , Day 1. Podcasts from ... of the most creative minds in the fields of IA, UX, and IxDA for Boxes ... at the 2010 IA Summit in Denver and ...
Read more

Megan Grocki | Mad*Pow

Megan Grocki: ... the 2010 IA Summit in Phoenix, the 2010 Usability Professionals' Association ... Discussing the latest trends in strategic experience ...
Read more