INTROSPECT

INTROSPECT

Introspect is a new ANR project, on the digital introspection of archaeological material.

It is a joint France-Quebec project.

 

 

 

 

 

 

 

 

 

Partners :

INSA Rennes (Leader FR)

Université de Laval (Leader QC)

Inrap (FR)

INRS (QC)

CNRS (FR)

Université de Rennes 1 (FR)

Musée des Abénakis d’Odanak (QC)

ENS de Rennes (FR)

Société du patrimoine urbain de québec (QC)

Image ET (FR)

Musée de la nature et des sciences de Sherbrooke (QC)

Abstract

Material culture and the relationship to its historical context and environment are at the heart of archaeologists’ concerns. Archaeological artefacts and sediments are fragile testimonies that should be analyzed, interpreted, preserved, and enhanced. This complex relationship is changing in the digital era where archaeologists have access to virtual representations of the object or a copy obtained by 3D printing. In recent years, digitization methods markedly progressed providing a relevant response with non-destructive solutions for preservation, analysis, and dissemination of knowledge on material culture and the built environment we work on. However, those analytical techniques are limited to the surface of the objects, monuments or sites. Yet, the structural information yielding information on the transformation of raw material and the contextual relationship of its acquisition and use is a key aspect that can be handled by innovative digital approaches.

We offer to archaeologists novel uses, tools and accesses to new knowledge through digital interactive introspection methods that combine medical imaging technologies such as CT scans with 3D visualization technologies, such as mixed reality (virtual/augmented reality, tangible interactions) and 3D printing. CT scans provides a cartography of archaeological material and a systematic record of its densities; further, it allows a three-dimensional reading of the artifact. Such method analyzes the inner part of the artifact without altering it and allows the specialist to define and understand its internal structure, method of manufacture and state of conservation. When applied to archaeological sediments, that technology opens a door to an array of behaviors unavailable to the naked eye. Mixed reality provides a new context to the object and enhance the interaction between the analyst and the subject under investigation. Multidisciplinarity brings a major methodological challenge, however, the approach we propose involves the pooling of methods used in engineering, archeology and museology. Team members were selected based on their experience in team work and experience in various domains of research. They all collaborated in joint projects where everyone’s experience was put to use.

This project is part of the thematic focus “research in social sciences in the digital era” by proposing innovative ways of working based on digitization for the analysis and use of data in cultural heritage studies.

IRMA

Projet CNRS Imag’In IRMA
Imagerie et InteRactions Multi-modales pour l’Archéologie

Une collaboration SHS – STIC autour de cas réels d’étude

– archéologues (CreAAH et Inrap)

– chercheurs en informatique (IRISA / Centre Inria Rennes Bretagne Atlantique)

– l’entreprise Image ET

Objectifs :

– Proposer des méthodologies innovantes pour le patrimoine archéologique
     – Basée sur des technologies d’imagerie avancées (tomodensitométrie, µ-tomographie, lasergrammétrie, photogrammétrie…)
     – Restitutions 3D interactives physiques et virtuelles
          – Réalité virtuelle, augmentée, mixte
          – Impressions 3D complexes
          – Interactions tangibles

Présentation du projet IRMA PDF

 

 

 

VRShooting

Electrophysiological correlate of top-down attention bias in a realistic virtual shooting environment,

Michael Pereira

CNBI, Institute of Bioengineering

EPFL, Lausanne, Suisse

One well-known source of sport performance variability is the shifting of the attention locus from the task due to a disturbing environment. In this collaboration, we aim at studying the neural correlates of such attentional
shifts using scalp electroencephalography (EEG) in a virtual reality simulation. For this purpose we considered an Olympic virtual shooting scenario which requires a high degree of concentration and does not involve intense physical activity. The lack of physical activity ensures that EEG recordings will not be polluted with artefacts due to excessive movements. The experimentation was done at the Immersia platform which provided the optimal conditions to implement such a realistic sports scenario in virtual reality, assuring a high degree of immersion and providing an ecologically valid competition scenario.

CollisionDetection

Collision Avoidance and Distance Perception in the Presence of Real and Virtual Objects in a Large Immersive Projection Space

Dr. Gerd Bruder

Immersive Media Group (IMG)

Department of Computer Science

University of Würzburg, Germany

Our main objective in this project was to compare obstacle avoidance behavior between simple real or virtual geometrical objects as well as real or virtual humans with different affordances. We conducted a behavioral dynamics experiment, which revealed different avoidance behavior of participants towards the considered virtual objects compared to their physical counterparts. During additional pilot tests in the large walking area of the IMMERSIA setup we considered different potential contributing factors. We observed differences in distance estimates to virtual objects depending on the position of the observer in the projection setup. In order to formally investigate this factor we conducted a second experiment. The experiment revealed interaction effects between accommodation distances, stereoscopic parallax, and target distance on distance judgments in the projection environment, which provides interesting guidelines and vistas for future research.

JNA2014

Journées Nationales de l’Archéologie 2014

 

La plateforme Immersia a participé aux JNA 2014 :

Des archéologues de l’Inrap (Institut National de Recherche en Archéologie Préventive)  et du CReAAH  (Centre de Recherche en Archéologie, Archéosciences et Histoire) se sont associés à des chercheurs de l’IRISA (Institut de Recherche en Informatique et Systèmes Aléatoires) pour reconstituer des sites archéologiques en réalité virtuelle. Ces reconstitutions s’appuient sur la plateforme technologique Immersia qui permet d’immerger un utilisateur dans un univers virtuel de grande dimension.

Dans le cadre de cette manifestation, nous avons proposé des visites de différents sites sur des casques de réalité virtuelle, et dans une structure immersive. Les différents sites présentés étaient :

  1. la villa Gallo-Romaine du Bourg-Saint-Père
  2. le temple Gallo-Romain du Haut-Corseul
  3. la chapelle de Languidou
  4. Le Boullongne, navire de la Compagnie des Indes (projet Asialog, CERHIO, Université de Bretagne Sud)
  5. l’épave de la Santa-Cruz, jonque chinoise du XVe siècle (Mission FEFNA en collaboration avec le Musée national des Philippines, dirigée par Franck Goddio, publication en cours. ©Franck Goddio/Hilti Foundation)
  6. l’allée couverte de la Contrie


En collaboration avec le projet de Conservatoire Numérique du Patrimoine Archéologique de l’Ouest :

Couverture média : articles et reportages parus/diffusés

Pages web des tutelles: OSUR / Rennes 1
Évocations dans la presse: TVRennes Soir – Le JT du 03 Juin 2014 (10m25) / Actualité culture du site de Rennes Métropole (04 Juin 2014) / Ouest-France Rennes du 07 Juin 2014Ouest-France Ille-et-Vilaine du 08 Juin 2014

Merci à l’Université de Rennes 1, l’Inrap, l’IRISA, le CReAAH, pour leur soutien dans l’organisation de cette manifestation.

Merci aux bénévoles qui se sont joints à l’équipe Immersia pour l’encadrement de cette journée.

Merci au personnes qui se sont déplacées pour ce voyage virtuel dans le temps.

 

 

Surrounded by contact

 

Proposer : Francesco Grani, Alboorg University, Denmark

Visit Dates: 8 July- 19 July 2013

 

The teams included Francesco Grani and Stefania Serafin, who are with the Section for Medialogy, Aalborg University, Denmark. Ferran Argelaguet, Valérie Gouranton, Marwan Badawi, Ronan Gaugne and Anatole Lécuyer are with IRISA/INRIA/Insa de Rennes/Université de Rennes 1/CNRS, Campus Universitaire de Beaulieu, Rennes, France.

Aim and context

• Test the importance of spatialized audio in a VR walking experience, in a large space.
• Build an interactive audio-visual environment where the user walks around in presence of sounding objects.
• Test the interaction with the environment in different conditions:
 – Sound is rendered with binaural techniques
 – Binaural sound field is affected by a roto-translation
 – Sound is rendered with stereo technique.
• Test the degree of immersion that the user can achieve in the different conditions
• Test the main differences that can be identified between those different kinds of auditory feedbacks.

VR accelerator for learning basketball throws

Proposer : Alexandra Covaci, Transilvania University of Brasov, Romania

Visit Dates: 21 May- 31 May 2013

The teams included Alexandra Covaci from  Transilvania University of Brasov, Romania. Franck Multon, and Marwan Badawi, who are with IRISA/INRIA/Université de Rennes 2/Insa de Rennes/CNRS, Campus Universitaire de Beaulieu, Rennes, France.

 

 

 

 

 

Context and aim

• Implementation of a free-throw simulator
 – user-friendly interface
 – modular program
 – learning platform for people
• Increasing the quality and speed of learning
• Developing motor skills
• Multidisciplinary work
 – Computer science, Virtual reality, Sports science, Biomechanics
• Immersia in VISIONAIR project was a unique chance to address the problem
• Basketball free throw involves
 – large spaces (requiring large screens),
 – high speeds (requiring high-speed tracking facilities)
 – high accuracy (requiring accurate motion capture facilities).
• Technical facility gives the possibility to evaluate if immersive environments are promising means to improve physical performance.
 – Many papers demonstrate that this type of environment improves motivation
 – It is still difficult to demonstrate a real improvement of the physical skills with such a technology.
• Next step of this project is to more clearly analyze how to involve such an approach
 – in a real learning process and with low cost systems.

JNA2013

Journées Nationales de l’Archéologie 2013

 

La plateforme Immersia a participé aux JNA 2013 :

Des archéologues de l’Inrap (Institut National de Recherche en Archéologie Préventive)  et du CReAAH  (Centre de Recherche en Archéologie, Archéosciences et Histoire) se sont associés à des chercheurs de l’IRISA (Institut de Recherche en Informatique et Systèmes Aléatoires) pour reconstituer des sites archéologiques en réalité virtuelle. Ces reconstitutions s’appuient sur la plateforme technologique Immersia qui permet d’immerger un utilisateur dans un univers virtuel de grande dimension.

Dans le cadre de cette manifestation, nous avons proposé une visite par groupe, d’une durée totale d’environ 1h, organisée en deux temps :

  1. Présentation de l’archéologie préventive, du conservatoire numérique du patrimoine archéologique de l’Ouest et de la recherche en réalité virtuelle menée grâce à la plateforme Immersia. Intervenants : chercheurs de l’Inrap, du CreAah et de l’IRISAInria (durée 30mn)
  2. Démonstration de la plateforme Immersia, avec possibilité pour chacun de visiter, en réalité virtuelle immersive, une villa gallo-romaine reconstituée en 3D relief (1 mn environ par pesonne). Il s’agit d’un site fouillé par l’Inrap à Bais, près de Vitré. Intervenant : chercheurs d’Immersia.

À l’issue de la visite, chaque groupe était accueilli dans un espace d’exposition où les visiteurs ont pu découvrir, en réalité virtuelle non immersive, la chambre centrale du cairn de l’île de Carn, de courts films sur la plateforme Immersia, sur l’archéologie préventive et sur la reconstitution virtuelle de la villa gallo-romaine de Bais. Des panneaux d’exposition présentaient les différentes facettes de l’archéologie préventive.

  • Découverte de la chambre centrale du cairn de l’ile de Carn :

 

  • Le projet de Conservatoire Numérique du Patrimoine Archéologique de l’Ouest :

 

  • Visite virtuelle en immersion de la villa gallo-romaine de Bais :

 

Couverture média : articles et reportages parus/diffusés
France 3 (8 juin)
“Une villa gallo-romaine, comme si vous y étiez !”

TV Rennes 35 Bretagne (7 juin)
TVR Soir – Le JT (début à 8m 10s)

Ouest-France (9 juin)
“Plongée virtuelle dans une villa gallo-romaine”

Rennes Métropole (en ligne le 10 juin)
“Immersia vous entraîne dans une autre réalité”

Le Télégramme (17 juin)
“La réalité virtuelle prend ses aises avec Immersia”

RCF (8 juin) Virgin Radio (8 juin)

Merci à l’Université de Rennes 1, l’Inrap, l’IRISA, le CReAAH, l’UEB, le pôle Image et Réseaux pour leur soutien dans l’organisation de cette manifestation.

Merci aux bénévoles qui se sont joints à l’équipe Immersia pour l’encadrement de ces deux journées.

Merci au personnes qui se sont déplacées pour ce voyage virtuel dans le temps.

 

 

Visionair TNA – VR-GO : Ergonomics in virtual environment

VR-GO – Ergonomics in virtual environment

 

Proposer : Madeleine Pascal, Alboorg University, Denmark

Visited laboratory: INRIA, Rennes, France

Visit Dates : 24 June- 7 July 2012

The objectives of the VR-GO – Ergonomics in virtual environment project are to perform manual handling tasks in both real environment (RE) and virtual environment (VE). More specifically, the effects of VE, without or with force feedback, compared with RE are analyzed in terms of changes in the movement pattern and muscle coordination by means of kinetic, kinematics and multi-channel surface electromyography (EMG) recordings.

The teams included Afshin Samani and Pascal Madeleine, who are with Center for Sensory-Motor Interaction (SMI), Aalborg University, Denmark. Charles Pontonnier, Marwan Badawi, and Georges Dumont are with IRISA/INRIA/ENS Cachan, Campus Universitaire de Beaulieu, Rennes, France.

The research involved sixteen healthy subjects without known neuromuscular disorders or pain, and without previous experience in VR. Their task consisted of grabbing wooden objects from a shelf and passing it through a work panel if it fits, otherwise they have to set it aside on a disposal shelf. Volunteers repeated the task 12 times with six fitting (fitter) objects and six non-fitting (non-fitter) objects. The task was performed at two timing regimes: as fast as possible and time managed.

Recordings & Results: All the recordings were performed using Immersia facilities, which include a high-resolution stereoscopic immersion room with a wall and a floor, 3D glasses tracked with a 360° tracking system and 16 ART infrared cameras (IRISA Rennes, France) and EMG amplifiers (Aalborg University, Denmark).

In Pontonnier et al. (2012), motion of the upper body and five muscle EMG activities all along the kinematical chain were recorded to compute normalized and averaged objective indicators, i.e., rapid upper limb assessment (RULA) score, averaged muscle activations (AMA) and total task time (TTT). Rate of perceived exertion (RPE), using the CR-10 Borg’s scale, and a questionnaire were used as subjective indices.

We found significant differences between measured indicators in RE and VE. RULA score and AMAs tended to decrease in VE under the same task conditions, whereas TTT and RPE tended to increase. This indicates that even if VE resulted in more comfortable postures, subjects experienced more discomfort and more fatigue in VE than in RE, in accordance with the questionnaire results. Fairly good correlation levels were found between VE and RE for six of the objective indicators, i.e. RULA score, Erector Spinae AMA, Deltoideus Medialis AMA, Biceps Brachii, Triceps Long Head AMA and Flexor Carpi Ulnaris AMA.

In Samani et al (2012), high density EMG was recorded over trapezius and split into its cycles. The linear envelop of EMG was computed across cycle and resampled in time to get 20 samples representing a cycle in five percent intervals. The EMG was ordered in a 13×4 grid to map its spatial configuration. The disparity, similarity and center of spatial distribution of EMG maps were compared for the three platforms in terms of normalized mutual information and center of the gravity of the maps. The virtual platform indicated a fair similarity and comparable disparity with the real platform, but depending on the timing regime and object type (fitter/non-fitter), the force feedback platform differed from the real one.

Conclusions: Using VR for ergonomics purposes needs to be done with caution, as interaction and simulation choices deeply affect cognition and motor control. Such assessment can be done if the offset between VE and RE is defined and taken into account. The use of force feedback in VE was especially challenging. Finally, designing a VE simulator relies on a compromise between functional and subjective fidelity, as subjective experience may be counter-productive in terms of functionality.

Publications (in process):

Pontonnier et al. (2012). Subjective and Functional Realism. Assessing the Propensity of VR Simulators to Properly Evaluate Physical Risk Factors. Submitted to IEEE Virtual Reality 2013 (16-20 March 2013, Orlando, Florida, USA)

Samani et al. (2012). Assessing the Spatial Pattern of Muscular Activity in Simulated Assembly Tasks Comparing Real and Virtual Environment. Submitted to IEEE Virtual Reality 2013 (16-20 March 2013, Orlando, Florida, USA)