Melodie: A Design Inquiry into Accessible Crafting through Audio-enhanced Weaving
Katya Borgos-Rodriguez, Maitraye Das, Anne Marie Piper · 2021 · ACM Transactions on Accessible Computing · doi:10.1145/3444699
Summary
This design inquiry examines accessible crafting through an ethnographic study at a weaving studio within a residential community for adults with vision impairments. The research involved 60 hours of field observations over eight months and 15 semi-structured interviews with weavers (most legally blind) and sighted instructors. The findings informed the design of Melodie, an interactive audio-enhanced floor loom that senses the three basic weaving steps—pressing treadles, passing the shuttle, and pulling the beater—and provides customizable audio feedback. Weaving emerged as a complex skilled practice requiring mastery of vocabulary (shed, warp, weft, pick, beat), coordination of repetitive sequences, and development of an internal "rhythm." Weavers stressed the importance of creating high-quality products and avoiding mistakes, while also describing weaving as a therapeutic, aesthetic experience. Some used "Braille weaving" techniques to embed textual messages in their cloth. Critically, participants expressed tension about technology potentially interfering with the valued manual nature of their craft, and concerns that added sounds might disrupt the relaxing atmosphere or the organic sounds of the loom that already guide their work.
Key findings
Melodie uses ultrasonic sensors for treadle detection, hall effect sensors for shuttle tracking, and an IMU for beater velocity, with two Arduino boards managing the logic and Processing providing a customization interface. Two sound profiles were developed—musical instruments (piano tones, guitar strings) and nature sounds (footsteps, bird chirps, crickets)—with adjustable volume, activation timing, and velocity thresholds. Design exploration sessions with four participants revealed four distinct use scenarios: (1) Scaffolding learning—an instructor saw potential for audio cues to help novices learn weaving sequences and build vocabulary; (2) Raising system state awareness—an experienced blind weaver wanted combined verbal and tonal feedback to prevent mistakes and track progress; (3) Enhancing aesthetics—a novice weaver who was also a pianist imagined matching sounds to her mood, likening the treadles to piano pedals; (4) Supporting artistic performance—a blind sound artist envisioned the loom as a musical instrument for collaborative performances between weavers and musicians. Key design insights emerged: audio enhancements must complement rather than compete with organic loom sounds; technology should offer assistance without assuming it's needed, preserving weaver agency; in communal spaces, headphones may be necessary to avoid disturbing others; and systems should support skill-building rather than merely increasing efficiency.
Relevance
This research extends accessible making beyond high-tech fabrication tools (3D printers, laser cutters) to traditional craftwork—an important contribution since maker culture often overlooks manual crafts as valid forms of making. The central tension identified—technology should augment rather than replace valued manual work—offers crucial guidance for designers of assistive technologies in any domain where the process itself, not just the outcome, matters to users. For practitioners, the study demonstrates that accessible craft technologies must be highly customizable (some users want more feedback, others want silence) and should fade into the background as skills develop. The insight that technology can open new creative possibilities (weaving as musical performance) while respecting existing practices challenges deficit-based approaches to assistive technology. The emphasis on interdependence—technology extending rather than substituting for human assistance in communal spaces—provides a framework for designing systems that support collaborative accessibility rather than isolated independence.
Tags: accessible making · crafting · weaving · visual impairment · blindness · audio feedback · maker movement · fiber arts · participatory design