Post-Doctoral Research Visit F/M Interpretable Classifier based on Multi-Modal Embeddings for rare classes: Application to identification of marine ecosystems

il y a 3 semaines


Orsay, France INRIA Temps plein

Contexte et atouts du poste

The success of supervised machine learning has given rise to a new priority, that of being able to interpret the models learned (explainable artificial intelligence, or XAI). The main directions investigated in XAI for computer vision include: building saliency maps (for example by exploiting the gradient of the classifier); the identification of relevant sub-concepts for the classes under consideration, based on examples and/or the exploitation of sub-images of labelled images. New approaches based on the exploitation of multimodal embeddings, such as those integrated into CLIP, avoid the main limitations of the above guidelines (see [1] and references therein). However, multimodal embeddings reflect common concepts, which hinders their use in specific domains (ranging from biology to industrial environments) where classes involve rare sub-concepts (e.g., "protists"; "planktonic larvae"). Another challenge is to define *frugal* interpretable classifiers, supporting the interaction with researchers and end-users.

The target applications is the characterization of marine ecosystems from the wealth of data collected within the Inria Challenge OcéanIA [2] (see also This project involves Inria teams in Chile, Paris, Saclay, and Sophia-Antipolis, and the Fondation Tara Océans, the Center of Mathematical Modeling (CMM, U.Chile), the Pontificia Universidad Católica de Chile (PUC), the GO-SEE CNRS Federation, and the Laboratoire des Sciences du Numérique de Nantes (LS2N).

This application is at the heart of the "AI for the Planet" initiative, where new tools are needed to exploit the mass of data collected by multidisciplinary teams to record current marine ecosystems and how they are changing under the impact of climate change.

[1] Nicolas Atienza, Roman Bresson, Cyriaque Rousselot, Philippe Caillou, Johanne Cohen, Christophe Labreuche, Michele Sebag Cutting the Black Box: Conceptual Interpretation of a Deep Neural Network with Multi-Modal Embeddings and Multi-criteria Decision Aid. IJCAI 2024.

[2] Sanchez-Pi, N., Martí, L., Abreu, A., Bernard, O., de Vargas, C., Eveillard, D., Maass, A., Marquet, P. A., Sainte-Marie, J., Salomon, J., Schoenauer, M., & Sebag, M. . OcéanIA: AI, Data, and Models for Understanding the Ocean and Climate Change. (N. Sanchez-Pi & L. Martí, Eds.). Lille, Paris, Saclay, Santiago, Sophia-Antipolis: Inria – Institut national de recherche en sciences et technologies du numérique.

Mission confiée

We seek a postdoctoral researcher interested in interpretable supervised learning and in AI for good. The data are available; they include large collections of images (4 to 400 million images) collected during the Tara Oceans expeditions.

The challenge is to extend XAI approaches (including the "Cutting the Black Box" one) to semi-supervised learning (circa 1\% of the images are annotated), to rare domains, where the available multi-modal embeddings and/or LLM resources are hardly effective. Creativity is required to leverage the domain knowledge (diatomea, larvae ontologies) and ground the relevant sub-concepts in the classifier latent space.

Principales activités

The tasks of the successful candidate will be to:

Define a manageable corpus, supporting a sufficiently efficient classifier (current systems exist). Define a dictionary of possibly relevant sub-concepts, based on plankton ontologies and hierarchical classifications, and leveraging existing resources (Wikipedia). Work in collaboration with researchers from other OceanIA teams, including visits to teams in France and Chile;  Co-develop software/functionalities with Inria project teams and participate in their dissemination through Oceania meetings and ML conferences. Participate in the production of scientific articles and reports, in collaboration with other project members

Compétences

Good knowledge of Machine Learning Fluent in PyTorch/TensorFlow Flair for programming Sense of teamwork

Contacts: ; ;

Avantages

Subsidized meals Partial reimbursement of public transport costs Leave: 7 weeks of annual leave + 10 extra days off due to RTT (statutory reduction in working hours) + possibility of exceptional leave (sick children, moving home, etc.) Possibility of teleworking and flexible organization of working hours Professional equipment available (videoconferencing, loan of computer equipment, etc.) Social, cultural and sports events and activities Access to vocational training Social security coverage

Rémunération

2788 € gross/month



  • Orsay, France INRIA Temps plein

    Contexte et atouts du poste The TAU/A&O team is an Inria joint team with LISN (Laboratoire Interdisciplinaire des Sciences du Numérique), working on Machine Learning and data-based modeling. ML for Numerical Simulation is one of the pillars of TAU research program. In the frame of this project, the team will collaborate with Lionel Mathelin (Dataflot...


  • Orsay, France INRIA Temps plein

    Contexte et atouts du poste The TAU/A&O team is an Inria joint team with LISN (Laboratoire Interdisciplinaire des Sciences du Numérique), working on Machine Learning and data-based modeling. ML for Numerical Simulation is one of the pillars of TAU research program. In the frame of this project, the team will collaborate with Lionel Mathelin (Dataflot...


  • Orsay, France Inria Temps plein

    Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Niveau de diplôme exigé **:Thèse ou équivalent **Fonction **:Post-Doctorant **Niveau d'expérience souhaité **:Jusqu'à 3 ans **A propos du centre ou de la direction fonctionnelle**: - The Inria Saclay-Île-de-France Research Centre was established in 2008. It has...


  • Orsay, Île-de-France France Life Imaging Temps plein

    Type de structure : A two-year post-doctoral position is opened in the ANR funded MultiRecon project, a collaboration between the LaTIM in Brest, CREATIS lab in Lyon, BioMaps in Orsay, and the Poitiers University Hospital.The recruited person will by employed by CEA and affiliated to BioMaps (Orsay).Contexte et mission : Contexte et mission :Positron...


  • Orsay, France Institut Curie Temps plein

    The Institut Curie is a major player in the research and fight against cancer. It consists of a hospital and a Research Center of more than 1000 employees with a strong international representativeness. The objective of the Curie Institute Research Center is to develop basic research and to use the knowledge produced to improve the diagnosis, prognosis, and...


  • Orsay, France Université Paris-Saclay GS Chimie Temps plein

    **RECHERCHE DE PEPTIDES BIOMARQUEURS DE L'ARTHROSE DANS LES LIQUIDES BIOLOGIQUES // RESEARCH FOR OSTEOARTHRITIS BIOMARKER PEPTIDES IN BIOLOGICAL FLUIDS**: - Réf **ABG-120081** **ADUM-52025** - Sujet de Thèse- 08/02/2024- Université Paris-Saclay GS Chimie- Lieu de travail- ORSAY Cedex - France- Intitulé du sujet- RECHERCHE DE PEPTIDES BIOMARQUEURS DE...

  • Méthodologie Mac

    il y a 6 jours


    Orsay, France Université Paris-Saclay GS Chimie Temps plein

    **Méthodologie MAC : synthèse stéréosélective de dérivés d'acides aminés complexes // MAC Methodology: Stereoselective Synthesis of Complex Amino Acid Derivatives**: - Réf **ABG-120116** **ADUM-52898** - Sujet de Thèse- 08/02/2024- Université Paris-Saclay GS Chimie- Lieu de travail- Orsay cedex - France- Intitulé du sujet- Méthodologie MAC :...


  • Orsay, France Université Paris-Saclay GS Chimie Temps plein

    **Nouvelles réactions de chimie bioorthogonale basées sur la cyclisation intramoléculaire // New bioorthogonal chemistry reactions based on intramolecular cyclization**: - Réf **ABG-120090** **ADUM-52676** - Sujet de Thèse- 08/02/2024- Université Paris-Saclay GS Chimie- Lieu de travail- Orsay cedex - France- Intitulé du sujet- Nouvelles réactions de...


  • Orsay, France CNES - Centre National d'Etudes Spatiales Temps plein

    Doctorat, 36 mois - Temps plein - Aucune expérience exigée - Maitrise, IEP, IUP, Bac+4 - Sun, Heliosphere, Magnetosphere, Space weather **Mission**: The Solar Orbiter space mission was launched from Cape Canaveral in February 2020. It embarks a comprehensive suite of remote sensing and in-situ instruments dedicated to the observation of the Sun, with the...


  • Orsay, Île-de-France Université Paris-Saclay GS Physique Temps plein

    **Développements cryogéniques pour futurs projets de cosmologie. // Sub-K cryogenic developments for future CMB projects**:- Réf- **ABG-110666****ADUM-46082**- Sujet de Thèse- 01/02/2023- Université Paris-Saclay GS Physique- Lieu de travail- Orsay cedex - France- Intitulé du sujet- Développements cryogéniques pour futurs projets de cosmologie. //...

  • Phd Machine Learning

    il y a 2 semaines


    Orsay, Île-de-France France Life Imaging Temps plein

    A two-year post-doctoral position is opened in the ANR funded MultiRecon project, a collaboration between the LaTIM in Brest, CREATIS lab in Lyon, BioMaps in Orsay, and the Poitiers University Hospital.Positron Emission Tomography (PET) is a medical imaging modality that measures in vivo biochemical processes that play a key role in the onset and progression...


  • Orsay, France CNRS Temps plein

    Cette offre est disponible dans les langues suivantes: - Français - Anglais Date Limite Candidature : mardi 25 juin 2024 **Informations générales**: **Intitulé de l'offre **:Chercheur post-doctoral en biologie (H/F)** Référence : UMR3348-PASLEO-009 Nombre de Postes : 1 Lieu de travail : ORSAY Date de publication : mardi 4 juin 2024 Type de contrat :...


  • Orsay, France CNRS Temps plein

    Cette offre est disponible dans les langues suivantes: - Français - Anglais Date Limite Candidature : vendredi 31 mai 2024 **Informations générales**: **Intitulé de l'offre **:Chercheur post-doctoral en biologie (H/F)** Référence : UMR3348-SOPBEI-001 Nombre de Postes : 1 Lieu de travail : ORSAY Date de publication : mardi 7 mai 2024 Type de contrat...


  • Orsay, France CNRS Temps plein

    Cette offre est disponible dans les langues suivantes: - Français - Anglais Date Limite Candidature : mardi 25 juin 2024 **Informations générales**: **Intitulé de l'offre **:Chercheur post-doctoral en biologie (H/F)** Référence : UMR3348-PASLEO-009 Nombre de Postes : 1 Lieu de travail : ORSAY Date de publication : mardi 4 juin 2024 Type de contrat :...


  • Orsay, France CNRS Temps plein

    Cette offre est disponible dans les langues suivantes: - Français - Anglais Date Limite Candidature : vendredi 31 mai 2024 **Informations générales**: **Intitulé de l'offre **:Chercheur post-doctoral en biologie (H/F)** Référence : UMR3348-SOPBEI-001 Nombre de Postes : 1 Lieu de travail : ORSAY Date de publication : mardi 7 mai 2024 Type de contrat...


  • Orsay, France Université Paris-Saclay GS Chimie Temps plein

    **Activation d'énamines pour la synthèse de composés spiraniques // Synthesis of spirocyclic compounds through enamines activation**: - Réf **ABG-120082** **ADUM-52029** - Sujet de Thèse- 08/02/2024- Université Paris-Saclay GS Chimie- Lieu de travail- Orsay cedex - France- Intitulé du sujet- Activation d'énamines pour la synthèse de composés...


  • Orsay, France Westinghouse Electric Company Temps plein

    Are you interested in being part of an innovative team that supports Westinghouse’s mission to provide clean energy solutions? At Westinghouse, we recognize that our employees are our most valuable asset and we seek to identify, attract and recruit the most qualified talent while recognizing and encouraging the value of diversity in the global...


  • Orsay, France Westinghouse Electric Company LLC. Temps plein

    At Westinghouse Electric Company, we are pioneers in nuclear technology and our technology is the basis for nearly half of the world's commercial nuclear power plants in operation. Today, we are also building several new reactors that contribute to more fossil-free energy. Globally, we have over 10,000 employees in 19 countries, of which 1,000 are at our...


  • Orsay, France CNRS Temps plein

    Informations générales Intitulé de l'offre : Chercheur post-doctoral en biologie (H/F) Référence : UMR3348-PASLEO-009 Nombre de Postes : 1 Lieu de travail : ORSAY Date de publication : mardi 4 juin 2024 Type de contrat : CDD Scientifique Durée du contrat : 24 mois Date d'embauche prévue : 1 septembre 2024 Quotité de travail : Temps complet...


  • Orsay, Île-de-France Université Paris-Saclay GS Chimie Temps plein

    **Relation microstructure-resistance mécanique des couches fragiles // Microstructure-mechanical strength of brittle layers**:- Réf- **ABG-110791****ADUM-45651**- Sujet de Thèse- 04/02/2023- Université Paris-Saclay GS Chimie- Lieu de travail- Orsay cedex - France- Intitulé du sujet- Relation microstructure-resistance mécanique des couches fragiles //...