Repository logo
  • English
  • Español
  • Log In
    Have you forgotten your password?
Universidad Tecnológica Indoamérica
Repository logo
  • Communities & Collections
  • Research Outputs
  • Projects
  • Researchers
  • Statistics
  • Investigación Indoamérica
  • English
  • Español
  • Log In
    Have you forgotten your password?
  1. Home
  2. CRIS
  3. Publications
  4. Sensory Substitution in Music: Enhancing Deaf Perception Through Vibrotactile Feedback
 
Options

Sensory Substitution in Music: Enhancing Deaf Perception Through Vibrotactile Feedback

Journal
Lecture Notes in Networks and Systems
Proceedings of Ninth International Congress on Information and Communication Technology
ISSN
2367-3370
2367-3389
Date Issued
2024
Author(s)
Johann Jadán
Zapata, Mireya
Centro de investigación en Mecatrónica y Sistemas Interactivos
Remache Vinueza, Byron
Facultad de Ingenierías
Type
book-chapter
DOI
10.1007/978-981-97-3559-4_2
URL
https://cris.indoamerica.edu.ec/handle/123456789/9613
Abstract
Music experienced through vibrotactile interfaces is a method of perceiving musical elements through the sense of touch, often involving vibrations. This technology functions by converting audio signals into physical sensations that can be sensed through the skin, typically via a wearable device like a wristband. Beginning with an initial audio file devoid of tactile feedback, the procedure entails altering it through sinusoidal modeling and, if necessary, implementing a Space-Fixed Audio transformation by utilizing the Head-Related Transfer Function (HRTF). In this study, we successfully transformed sound files into tactile stereo vibrations using specialized hardware. This process was rigorously tested and validated through experimentation involving ten individuals. Our findings confirm that psychophysical sensations can indeed be perceptible. Notably, the most consistent responses were observed when applying the Vibrato and Tremolo effect, following an HRTF transformation. The Space-Fixed Audio transformation primarily introduced variations in azimuth, covering 360∘ in a clockwise direction. Consequently, this processing led to significant spectral changes, effectively rescaling and compressing the audio’s frequencies into lower equivalents. These modified spectral characteristics were subsequently transmitted through vibrotactile actuators, thereby transforming the essence of sound into a tactile experience. This innovative system creates a sensory replacement approach based on the psychophysical sensations perceived on the skin. It has proven to be exceptionally beneficial, particularly for individuals with hearing impairments who may not perceive music in the same way as individuals with typical hearing abilities.
Subjects
  • HRTF

  • Sensory substitution

  • Sinusoidal modeling

  • SMS

  • Vibrotactile actuator...

Views
3
Acquisition Date
Sep 24, 2025
View Details
google-scholar
Downloads
Logo Universidad Tecnológica Indoamérica Hosting and Support by Logo Scimago

Built with DSpace-CRIS software - Extension maintained and optimized by 4Science

  • Cookie settings
  • Privacy policy
  • End User Agreement
  • Send Feedback