Options
Remache Vinueza, Byron
Mapping Monophonic MIDI Tracks to Vibrotactile Stimuli Using Tactile Illusions
Phantom sensation: Threshold and quality indicators of a tactile illusion of motion
2022
,
Remache Vinueza, Byron
,
Trujillo-León A.
,
Clim M.-A.
,
Sarmiento-Ortiz F.
,
Topon-Visarrea L.
,
Jensenius A.R.
,
Vidal-Verdú F.
In this project, we propose an algorithm to convert musical features and structures extracted from monophonic MIDI files to tactile illusions. Mapping music to vibrotactile stimuli is a challenging process since the perceptible frequency range of the skin is lower than that of the auditory system, which may cause the loss of some musical features. Moreover, current proposed models do not warrant the correspondence between the emotional response to music and the vibrotactile version of it. We propose to use tactile illusions as an additional resource to convey more meaningful vibrotactile stimuli. Tactile illusions enable us to add dynamics to vibrotactile stimuli in the form of movement, changes of direction, and localization. The suggested algorithm converts monophonic MIDI files into arrangements of two tactile illusions: “phantom motion” and “funneling”. The validation of the rendered material consisted of presenting the audio rendered from MIDI files to participants and then adding the vibrotactile component to it. The arrangement of tactile illusions was also evaluated alone. Results suggest that the arrangement of tactile illusions evokes more positive emotions than negative ones. This arrangement was also perceived as more agreeable and stimulating than the original audio. Although musical features such as rhythm, tempo, and melody were mostly recognized in the arrangement of tactile illusions, it provoked a different emotional response from that of the original audio. © 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.
2024
,
Remache Vinueza, Byron
,
Trujillo-León A.
,
Vidal-Verdú F.
Utilizing a randomized, blind, controlled experiment, and the ascending method of limits, we determined the minimum amplitude of motion at which individuals perceive a tactile illusion called moving phantom sensation, the perceived level of clarity and continuity of motion. Implementing tactile illusions in virtual/augmented reality, sensory substitution systems, and other human–computer interaction technologies results in interfaces with improved resolution, using two vibrating actuators only. The actuators are attached to the skin in different locations to render a moving phantom sensation. The intensity of vibrations increases in one actuator while decreases in the other according to the envelope of the voltage supply signals. This intensity variation creates the illusion of a vibrating point moving between the actuators. We gradually increased the amplitude of motion until the participant reported perceiving the illusion, for eight values of duration of the stimulus from 0.1 to 6.0 s. Participants perceived the illusion at a minimum amplitude of motion of 20%; being 100% the motion from one actuator to the other. The median level of clarity of the perceived illusion at the minimum amplitude of motion was 2 (not so clear). Finally, we found a positive correlation between duration and continuity of motion. © 2024 The Author(s)