Multisensory analytics: Case of visual-auditory analysis of scalar fields

Authors: Malikova, E., Pilyugin, V., Adzhiev, V., Pasko, G. and Pasko, A.

Journal: VISIGRAPP 2017 - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications

Volume: 3

Pages: 322-329

DOI: 10.5220/0006255003220329

Abstract:

A well-known definition of visualization is the mapping of initial data to a visual representation, which can be perceived and interpreted by humans. Human senses include not only vision, but also hearing, sense of touch, smell and others including their combinations. Visual analytics and its more general version that we call Multisensory Analytics are areas that consider visualization as one of its components. We present a particular case of the multisensory analytics with a hybrid visual-auditory representation of data to show how auditory display can be used in the context of data analysis. Some generalizations based on using real-valued vector functions for solving data analysis problems by means of multisensory analytics are proposed. These generalizations might be considered as a first step to formalization of the correspondence between the initial data and various sensory stimuli. An illustration of our approach with a case study of analysis of a scalar field using both visual and auditory data representations is given.

Source: Scopus