A structured testing protocol for identifying e-pollbook usability problems before Election Day, using mock-election scenarios with poll workers.
This tool was published by the National Institute of Standards and Technology (NIST) as VTS 100-3 Part 2, also available on NIST’s website.
Usability test protocol (NIST VTS 100-3 Part 2)
A step-by-step usability test protocol for evaluating e-pollbooks, including scenario scripts, data collection sheets, prop templates, and scheduling options.
What it includes:
27 voter scenarios across 7 categories (scannable ID, manual lookup, similar names, status flags, record updates, wrong place, not in database)
Printable props: ID card templates, voter registration cards, utility bill, and name change document
Data collection sheet with stoplight rating scale (green/yellow/red)
Recruitment criteria, participant demographics form, and consent form template
Scheduling options for single and parallel sessions
Checklists for Usability and Accessibility (NIST VTS 100-3 Part 2 Supplement 1)
A set of checklists for evaluating e-pollbook usability and accessibility, organized by poll worker tasks. Use alongside the usability test protocol or independently when reviewing or purchasing systems.
What it includes:
General usability checklist (yes/no questions covering screen clarity, text size, button placement, and error messages)
Task-based checklists covering voter lookup by scan and search, reviewing results, checking voter status, handling exceptions, collecting signatures, and supporting voters in line
Accessibility checklist covering display adjustability and assistive technology compatibility
Guidance on rating items using the green/yellow/red stoplight scale
Based on usability research conducted in 2017 by Whitney Quesenbery and Lynn Baumeister (Center for Civic Design) and Shanée Dawkins (NIST Information Technology Laboratory) and published in 2023. Read the reserach.