TY - CONF

T1 - Using All Our Senses: the need for a Unified Theoretical Approach to Multi-sensory Information Visualization

AU - Roberts, Jonathan C.

AU - Walker, Rick

PY - 2010/10/1

Y1 - 2010/10/1

N2 - There is an opportunity to consider the theory of visualization for each of our senses together. We should have a united theory of visualization that covers all senses and allows users to integrate modalities. We believe there are several important facets to the theory that need to be addressed at all stages of the multi-sensory visualization process. (1) Data enhancement for multi-sensory visualization; (2) perceptual variables for each sense; (3) Transference of the visualization methods and designs from one domain to another. (4) Cross-modal device integration. How multi-sensory devices are built and are used together; (5) Sensory integration and cross-modal interference: how different sensations interfere or reinforce each other. We need a body of research that will help researchers tackle questions such as ‘what are the perceptual variables that are available?’, ‘what are their limitations?’, ‘Do ideas and concepts that work in one modality transfer to another?’ and ‘what are the best design strategies for depicting information in another modality?’.

AB - There is an opportunity to consider the theory of visualization for each of our senses together. We should have a united theory of visualization that covers all senses and allows users to integrate modalities. We believe there are several important facets to the theory that need to be addressed at all stages of the multi-sensory visualization process. (1) Data enhancement for multi-sensory visualization; (2) perceptual variables for each sense; (3) Transference of the visualization methods and designs from one domain to another. (4) Cross-modal device integration. How multi-sensory devices are built and are used together; (5) Sensory integration and cross-modal interference: how different sensations interfere or reinforce each other. We need a body of research that will help researchers tackle questions such as ‘what are the perceptual variables that are available?’, ‘what are their limitations?’, ‘Do ideas and concepts that work in one modality transfer to another?’ and ‘what are the best design strategies for depicting information in another modality?’.

KW - information visualisation

KW - non-visual visualisation

KW - multimodal

KW - visualisation

KW - senses

KW - modalities

KW - Scientific Visualisation

KW - sonification

KW - haptification

KW - olfaction

KW - gustation

M3 - Paper

T2 - IEEE VisWeek 2010 Workshop: The Role of Theory in Information Visualization, Salt Lake City, Utah, October 2010.

Y2 - 25 October 2010 through 25 October 2010

ER -