TY - JOUR
T1 - The relative importance of visual, auditory, and haptic information for the user's experience of mechanical switches
AU - Mortensen, Ditte H.
AU - Bech, Søren
AU - Begault, Durand R.
AU - Adelstein, Bernard D.
PY - 2009/12/1
Y1 - 2009/12/1
N2 - While the use of hand tools and other everyday manually controlled devices is naturally accompanied by multisensory feedback, the deployment of fully multimodal virtual interfaces requires that haptic, acoustic, and visual cues be synthesised. The complexity and character of this synthesis will depend on a thorough understanding of the multimodal perceptual experience, including the interrelations between the individual sensory channels during manual interaction. In this study seventy participants were asked to rank the manual operation of ten electro-mechanical switches according to preference. The participants were randomly assigned in groups of ten to one of seven sensory presentation conditions. These conditions comprised six bimodal and unimodal sensory combinations created by selectively restricting the flow of haptic, auditory, and visual information, plus one condition in which ful sensory information was available. A principal components analysis on the obtained ranking data indicated that the sensory conditions with unimpeded haptic information were clearly distinct from those in which the haptic cues were impeded. The analysis also showed that, for switch use, the unimodal haptic condition most closely approached the condition with combined haptic, auditory, and visual feedback, compared with all of the conditions where haptic feedback was restricted.
AB - While the use of hand tools and other everyday manually controlled devices is naturally accompanied by multisensory feedback, the deployment of fully multimodal virtual interfaces requires that haptic, acoustic, and visual cues be synthesised. The complexity and character of this synthesis will depend on a thorough understanding of the multimodal perceptual experience, including the interrelations between the individual sensory channels during manual interaction. In this study seventy participants were asked to rank the manual operation of ten electro-mechanical switches according to preference. The participants were randomly assigned in groups of ten to one of seven sensory presentation conditions. These conditions comprised six bimodal and unimodal sensory combinations created by selectively restricting the flow of haptic, auditory, and visual information, plus one condition in which ful sensory information was available. A principal components analysis on the obtained ranking data indicated that the sensory conditions with unimpeded haptic information were clearly distinct from those in which the haptic cues were impeded. The analysis also showed that, for switch use, the unimodal haptic condition most closely approached the condition with combined haptic, auditory, and visual feedback, compared with all of the conditions where haptic feedback was restricted.
UR - http://www.scopus.com/inward/record.url?scp=76549134391&partnerID=8YFLogxK
U2 - 10.1068/p5929
DO - 10.1068/p5929
M3 - Journal article
C2 - 19950486
AN - SCOPUS:76549134391
SN - 0301-0066
VL - 38
SP - 1560
EP - 1571
JO - Perception
JF - Perception
IS - 10
ER -