MEDIA ET INTERACTIONS (D6)
This department focuses on one or more media or modalities, be it text (digital or handwritten), speech, sound, image or video. Research is devoted to the aspects of analysis, modeling, generation and usage. The objective is either to reproduce human behaviour or to allow interactions with data and documents that are relevant to humans.
To do this, we focus on four challenges and rely on an intensive use of technological platforms :
- Synergies analysis/synthesis: We believe that increasing synergies between these two scientific fields is the best way to produce new scientific advances. This synergy is useful to produce new models and algorithms for the synthesis of credible virtual human based on the observation of the real human movement of an individual or a crowd (acquisition for modeling). In addition, the production of multimodal document content will be based on the extraction and analysis of existing documents.
- Complexity processing and performance management: Faced with the complexity of problems and new computer architectures (multi-core and multi-GPU) or systems (cloud), all the proposed algorithms must be scalable to maintain real-time response to allow interactions with humans while increasing the quality of multimodal restitution (visual, auditory, or force feedback) and processing very large media databases.
- Human behavior, semantics and cognition: Our work is dedicated to natural interaction and relies on the expressivity and emotional content of artificial data based on human semantics rather than formal semantics. The reproduction and consideration of the human in the proposed methods is of primary importance.
- Uses and interactions : Usage and interaction modalities must be imagined to manipulate, query, navigate and enrich all types of information processed by the Media and Interactions department.
- Technological platforms are proposed within the department. They are the support to test, qualify, optimize and demonstrate the relevance of the proposed methods for a natural multimodal interaction.