Physical, semantic and pragmatic levels for multimodal fusion and fission
Résumé
Multimodal fusion is linked to the integration of information in human-machine interactive systems where several communication modalities are proposed to the user. It is mainly used in input, for instance when the user can interact with the system using speech and
2D gestures. As a symmetric process, multimodal fission is linked to the repartition of information among several communication modalities. It is mainly used in output, and consists of one of the processes of an Intelligent Multi-Media Presentation System (IMMPS). We propose a unified vision of multimodal fusion and fission, where parameters for the first are exploited for the second
and vice-versa.
2D gestures. As a symmetric process, multimodal fission is linked to the repartition of information among several communication modalities. It is mainly used in output, and consists of one of the processes of an Intelligent Multi-Media Presentation System (IMMPS). We propose a unified vision of multimodal fusion and fission, where parameters for the first are exploited for the second
and vice-versa.
Origine :
Fichiers produits par l'(les) auteur(s)
Loading...