How to Operate a PC Without Using the Hands
Torsten Felzer, Rainer Nordmann · 2005 · Proceedings of the 7th International ACM SIGACCESS Conference on Computers and Accessibility (Assets '05) · doi:10.1145/1090785.1090828
Summary
This demo paper presents HaMCoS (Hands-free Mouse Control System), a biosignal interface developed at Darmstadt University of Technology that enables people with severe physical disabilities to operate a Windows PC using intentional contractions of a single muscle of choice — without any hand or arm movement. The system fills a gap between speech-based interfaces (which require the ability to speak) and brain-computer interfaces (which are slow and error-prone). HaMCoS uses a sensor incorporating a piezo element attached to the user's body (in the prototype, on the forehead via a headband) that detects muscle contractions through electromechanical coupling rather than conventional passive EMG electrodes. This approach actively generates voltage potentials, providing nearly interference-free recording without expensive acquisition hardware — the sensor plugs directly into a standard PC soundcard microphone input. The Main Module constantly monitors the input signal, detecting intentional muscle contractions that exceed a threshold, and translates them into mouse movements and clicks.
Key findings
HaMCoS demonstrates that a single binary input channel (muscle contract/relax) can be sufficient to provide full mouse control of a PC. The system's framework includes several purpose-built applications optimised for mouse-only, keyboard-free interaction with large, easily clickable buttons: a Keypad for simulating essential keystrokes (ESC, Enter); a Start Screen serving as a central application launcher; a Reversi game for learning the system; a Mouse Editor providing Notepad-like text editing without a keyboard; a Config Screen for personalising parameters; and support for Macros that allow arbitrary keystroke sequences to be triggered from single button clicks. The system was classified as ongoing work, with the basic idea presented in 2002, a working prototype completed in 2004, and the demonstrated version containing minor refinements. The authors were actively adapting the input sensor for a patient with Multiple Sclerosis whose only retained physical ability was moving their head, demonstrating the system's potential for users with very severe motor impairments.
Relevance
HaMCoS illustrates a practical, low-cost approach to hands-free computer access that occupies an important niche between speech recognition and brain-computer interfaces. Its use of a piezo element on a soundcard input rather than expensive EMG or EEG equipment made it unusually affordable and portable for its time. For accessibility practitioners, the system highlights that even a single reliable binary input can be leveraged into full computer control with appropriate software design — large targets, scanning interfaces, and macro capabilities. The principle that the entire interaction framework must be redesigned for the input method (not just the input device adapted to existing interfaces) remains a key lesson for assistive technology development. The work also foreshadows modern muscle-based interfaces and EMG wearables that are now being explored for consumer hands-free interaction.
Tags: biosignal interface · EMG · hands-free operation · mouse emulation · motor disability · alternative input · assistive technology · muscle control