Chisnell Pew Ballot Testing 120908.Key

40 %
60 %
Information about Chisnell Pew Ballot Testing 120908.Key
News & Politics

Published on December 18, 2008

Author: danachisnell



A talk I gave at a conference sponsored by the Pew Making Voting Work project and the JEHT Foundation in Washington, DC on December 9, 2008.

1 What is a usability test?

2 Sit next to someone. Watch. Listen. Dana Chisnell

3 When something changes Take constraints into account Complement to Reveal best practice remedies

4 Hesitating Comments Questions Body language What to look for Behaviors

5 Ballot testing. Dana Chisnell

The question 6

7 The question How successfully do voters vote?

The plan 8

9 1 day Dana Chisnell

10 a ballot and instructions Nancy Frishberg

11 voter participants Dana Chisnell

12 observers Dana Chisnell

13 results due: today



16 How we got value  Used the ballots and instructions at hand  Focused on one thing at a time  Had participants generate and collect data  Drafted observers and debriefed

17 1. Plan, minimally 2. Get the team on board 3. Use the LEO Kit 4. Recruit participants 5. Conduct sessions Follow these steps: 6. Debrief and decide

18 Conduct sessions  Rehearse (P1)  Checklist of tasks  Short, focused sessions  Adjust what you’re doing, if you need to Dana Chisnell

19 Greet the participant Explain the test, your role, and their role Watch the voter vote Ask follow-up questions Debrief with participant Session outline Debrief with observers

20 Impartial, unbiased observing No teaching! Listen and watch Ask open-ended questions: Why? Moderating, not training How? What?

21 Debrief and decide  What could cause a recount?  What could make it difficult to tell intent?  What could draw unwanted attention?  What could cost money if it is not fixed? Dana Chisnell

22 Resources • Usability Professionals’ Association: • LEO Usability Testing Kit: civiclife/voting/leo_testing.html • Ballot Usability and Accessibility Blog:

Add a comment

Related presentations