Scientific visualization extended with sonification for data analysis
Authors: Malikova, E., Pilyugin, V., Adzhiev, V., Pasko, G. and Pasko, A.
Journal: Proceedings of the International Conferences on Interfaces and Human Computer Interaction 2014, Game and Entertainment Technologies 2014 and Computer Graphics, Visualization, Computer Vision and Image Processing 2014 - Part of the Multi Conference on Computer Science and Information Systems, MCCSIS 2014
Pages: 348-352
ISBN: 9789898533227
Abstract:A well-known definition of the visualization is a mapping of initial data to a representation, which can be perceived by humans. The addressed human senses include not only vision, but hearing, sense of touch, smell and others including combinations of them. Formulation of a formalized approach to such a mapping of data to various human sensor signals (sensory stimuli) is an open research topic. We discuss here scientific visualization as a method of data analysis extended by data sonification, which provides mapping of data to sounds. A formalization of the correspondence between the initial data and sensory stimuli is proposed. We propose an approach to mapping data via multidimensional geometric models onto multimedia objects described in multimedia coordinates, and illustrate our approach with a case study of analysis of a scalar field using both visual and auditory data representations.
Source: Scopus