Reviews

Search results

• Fast Human-Computer Interaction by Combining Gaze Pointing and Face Gestures

  David Rozado, Jason Niu, Martin Lochner · 2017 · ACM Transactions on Accessible Computing

  This paper presents FaceSwitch, an open-source multimodal accessibility system that combines eye gaze tracking for cursor positioning with facial gesture recognition for triggering actions. The system addresses limitations of existing gaze-based interaction methods: gaze-only…

  eye tracking · gaze interaction · face tracking · facial gestures · motor disabilities

• Principles for Designing Large-Format Refreshable Haptic Graphics Using Touchscreen Devices: An Evaluation of Nonvisual Panning Methods

  Hari Prasath Palani, Nicholas A. Giudice · 2017 · ACM Transactions on Accessible Computing

  This paper addresses a fundamental challenge in touchscreen-based accessibility: how to provide non-visual access to large-format graphical materials like maps that exceed the device's screen size. While touchscreens represent the fastest-growing computing platform among people…

  tactile graphics · blindness · touchscreen accessibility · haptic feedback · spatial cognition

• Wearables for All: Development of Guidelines to Stimulate Accessible Wearable Technology Design

  Jobke Wentzel, Eric Velleman, Thea van der Geest · 2016 · Proceedings of the 13th International Web for All Conference (W4A)

  This paper from the University of Twente and The Accessibility Foundation (Netherlands) presents the rationale and methodology for developing accessibility guidelines specifically for wearable technology — a domain where no dedicated accessibility standards existed at the time.…

  wearable technology · universal design · guidelines · visual impairment · multimodal interaction

• Supporting Engagement and Comprehension Online Through Multiple Means of Expression

  Boris N. Goldowsky, Peggy Coyne · 2016 · Proceedings of the 13th International Web for All Conference (W4A)

  This paper from CAST (the organization that developed the Universal Design for Learning framework) examines how offering multiple means of expression — writing, drawing, and audio recording — in online academic discussions affects engagement among struggling readers in grades…

  Universal Design for Learning · education accessibility · multimedia · learning disabilities · intellectual disability

• Comparing Tactile, Auditory, and Visual Assembly Error-Feedback for Workers with Cognitive Impairments

  Thomas Kosch, Romina Kettner, Markus Funk, Albrecht Schmidt · 2016 · Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '16)

  This paper compares three modalities of error feedback — tactile, auditory, and visual — for cognitively impaired workers performing manual assembly tasks at sheltered work organizations. Industrial manufacturing companies increasingly outsource assembly tasks to these…

  cognitive accessibility · intellectual disability · workplace accessibility · assistive technology · multimodal interaction

• Magic Touch: Interacting with 3D Printed Graphics

  Lei Shi, Ross McLachlan, Yuhang Zhao, Shiri Azenkot · 2016 · ASSETS '16: Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility

  Magic Touch is a computer vision-based system that augments 3D printed tactile graphics with audio information, addressing a key limitation of physical models for blind users: while 3D printing can effectively convey shapes and textures, text annotations and labels are difficult…

  tactile graphics · 3D printing · computer vision · blind accessibility · audio labeling

• A4TV: Assessing and Ameliorating the Accessibility of the Ascending Connected TV Platforms

  Daniel Costa · 2015 · Proceedings of the 12th International Web for All Conference (W4A)

  This doctoral consortium paper proposes a two-stage research programme to study and improve the accessibility of connected TV platforms for visually impaired users. Connected TVs — smart TVs and set-top boxes with internet connectivity — use web technologies (HTML5, JavaScript)…

  connected TV · blindness · visual impairment · accessibility evaluation · multimodal interaction

• Capti-Speak: A Speech-Enabled Accessible Web Interface

  Vikas Ashok · 2014 · Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS)

  This paper presents Capti-Speak, a speech-augmented screen reader interface for the web that allows blind users to issue voice commands alongside traditional keyboard shortcuts. Built on top of the Capti web browsing application (which provides a JAWS-like screen reader…

  screen readers · speech recognition · voice interface · web accessibility · blindness

• Enhancing Caption Accessibility through Simultaneous Multimodal Information: Visual-Tactile Captions

  Raja S. Kushalnagar, Gary W. Behm, Joseph S. Stanislow, Vasu Gupta · 2014 · Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS)

  This paper addresses a fundamental limitation of captions (subtitles) for deaf and hard of hearing (DHH) viewers: captions force viewers to split attention between reading text at the bottom of the screen and watching the visual action, inevitably causing them to miss…

  captioning · deaf and hard of hearing · haptic feedback · multimodal interaction · non-speech information

• Designing a Text Entry Multimodal Keypad for Blind Users of Touchscreen Mobile Phones

  Maria Claudia Buzzi, Marina Buzzi, Barbara Leporini, Amaury Trujillo · 2014 · Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS)

  This paper presents MTITK (Multimodal Text Input Touchscreen Keypad), a software-only text entry system for blind users of touchscreen phones that combines the familiar 12-key telephone keypad layout with multimodal audio-tactile feedback. The work is grounded in the personal…

  mobile accessibility · text entry · blindness · multimodal interaction · haptic feedback

• Speech Dasher: A Demonstration of Text Input using Speech and Approximate Pointing

  Keith Vertanen, David J.C. MacKay · 2014 · Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS 2014)

  This paper demonstrates Speech Dasher, a multimodal text entry system that combines speech recognition with the Dasher zooming interface to enable fast, corrected text input using only voice and gaze direction. The core problem addressed is that while speech dictation is fast,…

  speech recognition · eye tracking · gaze input · text entry · error correction

• A Mobile Interactive Maps Application for a Visually Impaired Audience

  Nikolaos Kaklanis, Konstantinos Votis, Dimitrios Tzovaras · 2013 · Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility (W4A)

  This demo paper presents "Open Touch/Sound Maps," an Android mobile application that makes interactive maps accessible to visually impaired and blind users through multimodal feedback. Web-based spatial information resources like OpenStreetMap are inherently visual, leaving…

  visual impairment · accessible maps · sonification · haptic feedback · mobile accessibility

• A Haptic Tool for Group Work on Geometrical Concepts Engaging Blind and Sighted Pupils

  Jonas Moll, Eva Pysander · 2013 · ACM Transactions on Accessible Computing

  This study investigates how haptic technology can support collaborative geometry learning between visually impaired and sighted pupils in inclusive classrooms. The researchers developed two haptic applications using PHANTOM devices: a static environment where pupils explore…

  haptic interfaces · collaborative learning · visual impairment · education · geometry

• HapticRiaMaps: Towards Interactive Exploration of Web World Maps for the Visually Impaired

  Nikolaos Kaklanis, Konstantinos Votis, Panagiotis Moschonas, Dimitrios Tzovaras · 2011 · Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A)

  This paper presents HapticRiaMaps, a free open-source web application from the Centre for Research and Technology-Hellas (CERTH) in Greece that makes online 2D maps accessible to visually impaired users through haptic force feedback and audio sonification. The system retrieves…

  blind and low vision · haptic technology · accessible maps · sonification · multimodal interaction

• Write-N-Speak: Authoring Multimodal Digital-Paper Materials for Speech-Language Therapy

  Anne Marie Piper, Nadir Weibel, James D. Hollan · 2011 · ACM Transactions on Accessible Computing

  This paper presents Write-N-Speak, a digital pen toolkit that enables speech-language therapists to create custom multimodal therapy materials for clients with aphasia—a communication disorder often resulting from stroke that affects approximately 80,000 Americans annually. The…

  aphasia · speech-language therapy · AAC · digital pen · multimodal interaction

• Multimodal Summarization of Complex Sentences

  Naushad UzZaman, Jeffrey P. Bigham, James F. Allen · 2011 · Proceedings of the 16th International Conference on Intelligent User Interfaces (IUI 2011)

  This paper introduces the concept of multimodal summarization (MMS) for complex sentences — automatically generating diagrams that combine pictures, simplified compressed text, and structural layout to help people understand difficult text. The system, ROC-MMS, targets people…

  cognitive accessibility · reading accessibility · natural language processing · augmentative and alternative communication · text simplification

• Developing Accessible TV Applications

  José Coelho, Carlos Duarte, Pradipta Biswas, Patrick Langdon · 2011 · The Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This paper describes the GUIDE (Gentle User Interfaces for Elderly People) framework for developing accessible TV applications through multimodal interaction, user interface adaptation, and impairment simulation. The research combines a survey of 46 elderly participants (ages…

  aging · multimedia accessibility · multimodal interaction · adaptive systems · personalization

• Towards collaborative annotation for video accessibility

  Pierre-Antoine Champin, Benoît Encelle, Nicholas W. D. Evans, Magali O.-Beldame, Yannick Prié, Raphaël Troncy · 2010 · Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A)

  This paper presents the ACAV (Collaborative Annotation for Video Accessibility) project, a French research initiative involving Dailymotion, the University of Lyon (LIRIS), and EURECOM, aimed at making web video accessible to blind and deaf users through rich, collaborative…

  video accessibility · audio description · captioning · crowdsourcing · speech recognition

• 3D HapticWebBrowser: towards universal web navigation for the visually impaired

  Nikolaos Kaklanis, Konstantinos Votis, Konstantinos Moustakas, Dimitrios Tzovaras · 2010 · Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A)

  This paper presents the 3D HapticWebBrowser, a free open-source web browser that uses haptic (touch feedback) technology to enable visually impaired users to navigate web pages and explore 2D maps. The system transforms HTML elements into "hapgets" — haptically-enhanced 3D…

  haptic technology · visual impairment · blindness · multimodal interaction · accessible maps

• Enabling the blind in virtual worlds

  William S. Carter · 2010 · Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A)

  This paper from IBM's Human Ability and Accessibility Center describes experimental techniques for enabling blind users to participate in virtual world environments. Unlike conventional web content where text and images can be given alternative descriptions, virtual worlds…

  virtual reality · blindness · virtual worlds · multimodal interaction · cognitive overload

• Usability of a Multimodal Video Game to Improve Navigation Skills for Blind Children

  Jaime Sánchez, Mauricio Saenz, Jose Miguel Garrido · 2010 · ACM Transactions on Accessible Computing

  This paper presents an evaluative study of a multimodal system combining a custom haptic device (Digital Clock Carpet) with a 3D audio-based video game (MOVA3D) to develop orientation and mobility (O&M) skills in blind school-aged children. The Digital Clock Carpet is a low-cost…

  blindness · orientation and mobility · haptic interface · audio games · spatial cognition

• Multimodal Presentation of Two-Dimensional Charts: An Investigation Using Open Office XML and Microsoft Excel

  Iyad Abu Doush, Enrico Pontelli, Tran Cao Son, Dominic Simon, Ou Ma · 2010 · ACM Transactions on Accessible Computing

  This paper presents a comprehensive system for making Microsoft Excel charts accessible to people who are blind or visually impaired through multimodal haptic and audio feedback. The system extracts chart data from the OOXML format introduced in Excel 2007, then presents it…

  haptic feedback · data visualization · screen readers · multimodal interaction · force feedback

• Introducing Multimodal Paper-Digital Interfaces for Speech-Language Therapy

  Anne Marie Piper, Nadir Weibel, James D. Hollan · 2010 · Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2010)

  This paper explores how multimodal digital pen and paper technology can support speech-language therapy for adults with aphasia and apraxia of speech following stroke or brain injury. The researchers conducted five months of field observations with 15 speech-language therapists…

  aphasia · apraxia of speech · augmentative and alternative communication · speech-language therapy · older adults

• Augmenting social media accessibility

  Roberto Borrino, Marco Furini, Marco Roccetti · 2009 · Proceedings of the 2009 International Cross-Disciplinary Conference on Web Accessibililty (W4A)

  This paper presents SOMFA (SOcial Media For All), an architecture that transforms web-based social media content into multimodal audio/video presentations suitable for television sets. The system addresses the growing social divide created by social media: while technologically…

  social media · digital divide · aging · content adaptation · text-to-speech

• Haptic User Interface Design for Students with Visual Impairments

  Hyung Nam Kim · 2009 · Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility (Assets '09)

  This short paper explores the design of haptic user interfaces to help students with visual impairments understand science concepts related to heat and temperature — topics where common misconceptions are prevalent even among sighted students and where traditional teaching…

  haptic technology · visual impairment · STEM accessibility · science education · multimodal interaction