CHIMELIGHT: Augmenting Instruments in Interactive Music Therapy for Children with Neurodevelopmental Disorders
Joana Lobo, Soichiro Matsuda, Izumi Futamata, Ryoichi Sakuta, Kenji Suzuki · 2019 · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3308561.3353784
Summary
This paper presents CHIMELIGHT, an IoT-based system that augments handchime musical instruments with real-time visual feedback to support music therapists working with children who have neurodevelopmental disorders (NDDs) including autism spectrum disorder (ASD) and ADHD. The system addresses two key limitations of conventional music therapy: the difficulty of objectively evaluating children's performance during sessions, and the challenge of maintaining engagement, especially during group activities. Each CHIMELIGHT device is a portable, 3D-printed circular enclosure containing a microcontroller, BLE module, 4x8 RGB LED matrix, accelerometer, gyroscope, magnetometer, and lithium battery, designed to attach to the top of a standard handchime without disturbing its acoustic properties. The device uses sensor fusion to detect three motion states in real-time: still (child is waiting), random movement (non-play movement), and good handchime play (a clear slow-up-fast-down-brief-stop motion sequence that produces the expected tone). Visual feedback is delivered contingently: static blue light rewards stillness and waiting behaviors (important for turn-taking), while an animated filling yellow light rewards good handchime play — the yellow color chosen to convey excitement and reward. No feedback is given for random movements. Multiple devices connect simultaneously via BLE to a dedicated Android app that serves as the therapist's control and data management platform, providing real-time session monitoring and post-session performance summaries.
Key findings
A six-session evaluation study over six months (one session per month, ABBAAB design alternating baseline and feedback conditions) was conducted during real group music therapy sessions at a child development center with nine children with NDDs and four music therapists. Detailed case study results are reported for three participants (ages 7-9, all diagnosed with ASD and ADHD). The visual feedback increased children's attention to the handchime — participants P1 and P2 clearly looked more at the handchime during feedback sessions than baseline sessions. Negative behaviors decreased: non-imitative plays (plays not attempting to follow the therapist) decreased during feedback conditions for all participants, and the percentage of plays while looking away from both the instrument and therapist also decreased. Some positive behavior changes were observed, including a slight increase in synchronized play in two participants. Therapist evaluations via SUS, Health-ITUES, and adapted uMARS questionnaires showed the system had high perceived impact (4.0/5) and engagement (3.8/5) scores. Therapists valued the contingent feedback — stating "Contingency is important: you play, it lights — you stop the play and it goes off" — and noted that it increased children's motivation and concentration. However, they raised concerns about the device potentially distracting from natural human-human interaction and the music itself. The SUS score was 57.5 (below average), primarily due to low learnability and aesthetics scores — therapists wanted a smaller, more refined device. All therapists expressed willingness to use the system again with improvements.
Relevance
CHIMELIGHT demonstrates how augmenting familiar therapeutic objects with embedded sensing and feedback can enhance therapeutic interventions without fundamentally changing the therapy activity. The approach of adding technology to existing instruments rather than introducing new technological devices is strategically important — children with NDDs benefit from familiarity and predictability, and therapists can integrate the technology into established practices. For accessibility practitioners, the system illustrates several key principles: contingent feedback (reward delivered immediately when the desired behavior occurs) strengthens cause-effect understanding, which is particularly difficult for children with NDDs; multimodal augmentation (adding visual feedback to an inherently auditory activity) creates multiple sensory channels for engagement; and real-time performance metrics enable evidence-based therapy by providing objective data that was previously unavailable. The therapist concern about balancing technology engagement with human interaction is an important design tension — the technology should enhance the therapeutic relationship, not compete with it. The portable IoT approach using BLE-connected devices managed through a smartphone app provides a practical model for technology-enhanced therapy that doesn't require expensive specialized equipment or significant changes to the therapy environment.
Tags: music therapy · neurodevelopmental disorder · autism spectrum disorder · ADHD · children · IoT · assistive technology · visual feedback · behavior modification · social playware · applied behavior analysis