Note-Taker 2.0: The Next Step Toward Enabling Students who are Legally Blind to Take Notes in Class
David S. Hayden, Liqing Zhou, Michael J. Astrauskas, John A. Black · 2010 · Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2010) · doi:10.1145/1878803.1878828
Summary
This paper describes the iterative design and usability testing of the Note-Taker, a portable assistive device that enables students who are legally blind to take notes during classroom lectures. The core problem is that note-taking requires rapidly switching between a far-sight task (viewing the board or projected slides) and a near-sight task (writing notes), creating what the authors call the Board-Note-Board (BNB) delay. Existing assistive technologies typically address only one of these tasks — monoculars for far-sight or magnifiers for near-sight — forcing low-vision students to spend significant time switching between devices. The Note-Taker solves this by combining a pan/tilt/zoom camera aimed at the front of the classroom with a digital notepad on a single Tablet PC display, eliminating the need to switch between near and far-sight devices. The paper traces the evolution from a proof-of-concept prototype (2007-2008) through Note-Taker 2.0, guided by nine design principles including portability, independence from classroom infrastructure, non-disruption of the classroom environment, and the BATE (Beyond Accessibility To Efficiency) principle — that the solution should let users access information as readily as sighted students. The 2.0 prototype features a custom-built PTZ camera with 36x zoom, titanium-geared servo motors, and touch-driven camera control using tap-to-center, touch-and-drag, and multitouch pinch-to-zoom gestures.
Key findings
Usability testing with the proof-of-concept prototype involved two legally blind undergraduates over 3 months and 1 month respectively. The first student (D) used it for 150 hours and found it very beneficial despite camera droop and clunky directional controls. The second student (M) had a more mixed experience, partly due to unfamiliarity with Tablet PCs, but remained optimistic about the concept. Testing of the Note-Taker 2.0 PTZ camera with three legally blind students (visual acuities ranging from 20/30 to worse than 20/200) showed all three achieved an effective visual acuity of 20/10 — better than normal — when using the camera. Participants successfully read equations, located target words, read a periodic table, and scanned wide text across whiteboards. All three strongly agreed they would like to use the device in class. Key problems identified included: difficulty controlling zoom precisely (especially at high magnification), camera vibration/jitter during repositioning, and the lack of commercially available screen magnification software compatible with pen/stylus input — a critical gap for STEM students who need handwritten mathematical notation. Additional features include a "look-back" function (cached frames to see past occluded content), real-time histogram equalization and colour inversion for poor board contrast, and automatic file management organised by class and date.
Relevance
This paper addresses a significant gap in educational accessibility: the cognitive benefits of active note-taking (improved retention, focus, and processing) are well established in education research, yet students with low vision are effectively excluded from this learning activity. The alternatives mandated by the ADA — note-takers hired to copy notes, or lecture recording systems — make students passive recipients rather than active learners. The Note-Taker's design principles are broadly applicable to assistive technology design: the insistence on portability, independence from infrastructure, non-disruption of social interaction, and the BATE principle (matching rather than accommodating sighted users' efficiency) represent a mature design philosophy. The discovery that no commercial screen magnifier was compatible with pen/stylus input — despite Tablet PCs existing for over a decade — highlights how mainstream assistive technology can have blind spots that particularly affect specialised use cases like STEM education. For practitioners, the iterative user-centred design approach and detailed usability findings provide a model for developing complex assistive hardware/software systems.
Tags: low vision · legal blindness · note-taking · STEM accessibility · education · assistive technology · magnification · camera · tablet PC
Standards referenced: Americans with Disabilities Act