This is a report of qualitative research to gain deeper insights about how voters mark, review, verify, and cast their ballots. It was conducted as part of the work to update the human factors— accessibility, usability, and voter privacy—requirements in federal voting system standards (VVSG) and fill gaps in our understanding of how voters interact with ballot marking devices.
This research was published by the National Institute of Standards and Technology (NIST) as NIST GCR 24-0511, also available on NIST’s website.
Each participant voted with the same ballot on paper and on a ballot marking device (a total of 70 voting sessions). Some big themes emerged about the influences that shape attitudes and behaviors about voting:
A voter’s “mental model” of the process is heavily influenced by their local election history and familiarity with technology.
Over two-thirds of participants (25/35) preferred BMDs over hand-marked ballots for their ease of use and error correction.
Voters generally did not feel the need to verify the final printed output of a BMD.
The use of technology alone did not prompt voters to check the printed paper for accuracy.
Efficiency varied significantly based on the voter’s intent and the system used.
Range of time: While the fastest voters finished in barely a minute (focusing only on specific contests), the BMD’s structured review screens allowed for a more streamlined verification process than manual page-by-page review.
Speed of interaction: The electronic interface allowed for quicker navigation through contests compared to the manual process of reading and marking a paper ballot.

Average voting times by activity
| Total | Orient | Mark | Review | Verify & Cast | |
| Hand marked | 294 sec | 38 sec | 227 sec | 17 sec | 12 sec |
| BMD | 266 sec | 34 sec | 141 sec | 59 sec | 32 sec |
This research was conducted by Suzanne Chapman, Lynn Baueister, and Whitney Quesenbery.
This was a qualitative study, focused on observing participants as they voted. Each participant voted twice, first using a hand-marked paper ballot and then one of three ballot marking devices (BMDs). After each of the voting sessions, we interviewed them about their experience allowing us to confirm observations and clarify their intent. 35 voters marked both a pre-printed paper ballot and a ballot marking device, for a total of 70 voting sessions.
Visit our page on voting systems to find more resources about the usability and accessibility of voting systems.