Post-Doctoral Research Visit F/M Interpretable Classifier based on Multi-Modal Embeddings for rare classes: Application to identification of marine ecosystems

Il y a 6 mois


Orsay, France INRIA Temps plein

Contexte et atouts du poste

The success of supervised machine learning has given rise to a new priority, that of being able to interpret the models learned (explainable artificial intelligence, or XAI). The main directions investigated in XAI for computer vision include: building saliency maps (for example by exploiting the gradient of the classifier); the identification of relevant sub-concepts for the classes under consideration, based on examples and/or the exploitation of sub-images of labelled images. New approaches based on the exploitation of multimodal embeddings, such as those integrated into CLIP, avoid the main limitations of the above guidelines (see [1] and references therein). However, multimodal embeddings reflect common concepts, which hinders their use in specific domains (ranging from biology to industrial environments) where classes involve rare sub-concepts (e.g., "protists"; "planktonic larvae"). Another challenge is to define *frugal* interpretable classifiers, supporting the interaction with researchers and end-users.

The target applications is the characterization of marine ecosystems from the wealth of data collected within the Inria Challenge OcéanIA [2] (see also This project involves Inria teams in Chile, Paris, Saclay, and Sophia-Antipolis, and the Fondation Tara Océans, the Center of Mathematical Modeling (CMM, U.Chile), the Pontificia Universidad Católica de Chile (PUC), the GO-SEE CNRS Federation, and the Laboratoire des Sciences du Numérique de Nantes (LS2N).

This application is at the heart of the "AI for the Planet" initiative, where new tools are needed to exploit the mass of data collected by multidisciplinary teams to record current marine ecosystems and how they are changing under the impact of climate change.

[1] Nicolas Atienza, Roman Bresson, Cyriaque Rousselot, Philippe Caillou, Johanne Cohen, Christophe Labreuche, Michele Sebag Cutting the Black Box: Conceptual Interpretation of a Deep Neural Network with Multi-Modal Embeddings and Multi-criteria Decision Aid. IJCAI 2024.

[2] Sanchez-Pi, N., Martí, L., Abreu, A., Bernard, O., de Vargas, C., Eveillard, D., Maass, A., Marquet, P. A., Sainte-Marie, J., Salomon, J., Schoenauer, M., & Sebag, M. . OcéanIA: AI, Data, and Models for Understanding the Ocean and Climate Change. (N. Sanchez-Pi & L. Martí, Eds.). Lille, Paris, Saclay, Santiago, Sophia-Antipolis: Inria – Institut national de recherche en sciences et technologies du numérique.

Mission confiée

We seek a postdoctoral researcher interested in interpretable supervised learning and in AI for good. The data are available; they include large collections of images (4 to 400 million images) collected during the Tara Oceans expeditions.

The challenge is to extend XAI approaches (including the "Cutting the Black Box" one) to semi-supervised learning (circa 1\% of the images are annotated), to rare domains, where the available multi-modal embeddings and/or LLM resources are hardly effective. Creativity is required to leverage the domain knowledge (diatomea, larvae ontologies) and ground the relevant sub-concepts in the classifier latent space.

Principales activités

The tasks of the successful candidate will be to:

Define a manageable corpus, supporting a sufficiently efficient classifier (current systems exist). Define a dictionary of possibly relevant sub-concepts, based on plankton ontologies and hierarchical classifications, and leveraging existing resources (Wikipedia). Work in collaboration with researchers from other OceanIA teams, including visits to teams in France and Chile;  Co-develop software/functionalities with Inria project teams and participate in their dissemination through Oceania meetings and ML conferences. Participate in the production of scientific articles and reports, in collaboration with other project members

Compétences

Good knowledge of Machine Learning Fluent in PyTorch/TensorFlow Flair for programming Sense of teamwork

Contacts: ; ;

Avantages

Subsidized meals Partial reimbursement of public transport costs Leave: 7 weeks of annual leave + 10 extra days off due to RTT (statutory reduction in working hours) + possibility of exceptional leave (sick children, moving home, etc.) Possibility of teleworking and flexible organization of working hours Professional equipment available (videoconferencing, loan of computer equipment, etc.) Social, cultural and sports events and activities Access to vocational training Social security coverage

Rémunération

2788 € gross/month



  • Orsay, France INRIA Temps plein

    Contexte et atouts du poste The TAU/A&O team is an Inria joint team with LISN (Laboratoire Interdisciplinaire des Sciences du Numérique), working on Machine Learning and data-based modeling. ML for Numerical Simulation is one of the pillars of TAU research program. In the frame of this project, the team will collaborate with Lionel Mathelin (Dataflot...


  • Orsay, France France Life Imaging Temps plein

    Type de structure : A two-year post-doctoral position is opened in the ANR funded MultiRecon project, a collaboration between the LaTIM in Brest, CREATIS lab in Lyon, BioMaps in Orsay, and the Poitiers University Hospital.The recruited person will be employed by CEA and affiliated to BioMaps (Orsay).Contexte et mission :Positron Emission Tomography (PET) is...


  • Orsay, France Institut Curie Temps plein

    The Institut Curie is a major player in the research and fight against cancer. It consists of a hospital and a Research Center of more than 1000 employees with a strong international representativeness. The objective of the Curie Institute Research Center is to develop basic research and to use the knowledge produced to improve the diagnosis, prognosis, and...


  • Orsay, France Institut Curie Temps plein

    The Institut Curie is a major player in the research and fight against cancer. It consists of a hospital and a Research Center of more than 1000 employees with a strong international representativeness. The objective of the Curie Institute Research Center is to develop basic research and to use the knowledge produced to improve the diagnosis, prognosis, and...

  • Chercheur Post-doctoral

    Il y a 3 mois


    Orsay, France CNRS Temps plein

    Cette offre est disponible dans les langues suivantes: - Français - Anglais Date Limite Candidature : mardi 22 octobre 2024 23:59:00 heure de Paris **Informations générales**: **Intitulé de l'offre **:Chercheur post-doctoral : Optimisation et mise en place de nouvelles méthodologies en nanospectroscopie infrarouge pour les astromatériaux...


  • Orsay, France Université Paris-Saclay GS Physique Temps plein

    **Etude systématique des théories EFT nucléaires à différentes résolutions // Mapping the tower of nuclear effective field theories**: - Réf **ABG-127017** **ADUM-59764** - Sujet de Thèse- 20/11/2024- Financement public/privé- Université Paris-Saclay GS Physique- Lieu de travail- Orsay - France- Intitulé du sujet- Etude systématique des...


  • Orsay, Île-de-France INRIA Temps plein

    Job OpportunityWe are seeking a highly skilled postdoctoral researcher to contribute to the development of foundational large physics models for fluid simulations.About the RoleFamiliarize with existing solutions and state-of-the-art approaches for large models in science.Manage data generation, creating comprehensive training datasets from diverse CFD...

  • Research Scientist

    il y a 3 semaines


    Orsay, Île-de-France France Life Imaging Temps plein

    Company OverviewFrance Life Imaging is a leading institution in the field of biomedical imaging, dedicated to advancing medical research and improving patient care through innovative technologies.


  • Orsay, France CNRS Temps plein

    Cette offre est disponible dans les langues suivantes: - Français - Anglais Date Limite Candidature : lundi 11 novembre 2024 23:59:00 heure de Paris **Informations générales**: **Intitulé de l'offre **:Contrat post-doctoral: théorie géométrique, ergodique et mesurée des groupes, algèbres d'opérateurs (H/F)** Référence :...


  • Orsay, France Westinghouse Electric Company Temps plein

    Are you interested in being part of an innovative team that supports Westinghouse’s mission to provide clean energy solutions? At Westinghouse, we recognize that our employees are our most valuable asset and we seek to identify, attract and recruit the most qualified talent while recognizing and encouraging the value of diversity in the global...


  • Orsay, France Université Paris-Saclay Temps plein

    Née de la volonté conjuguée d’universités, de grandes écoles et d’organismes de recherche, l’Université Paris-Saclay compte parmi les grandes universités européennes et mondiales, couvrant les secteurs des Sciences et Ingénierie, des Sciences de la Vie et Santé, et des Sciences Humaines et Sociales. Sa politique scientifique associe...

  • Scientific Officer

    Il y a 3 mois


    Orsay, France IterOnco Temps plein

    IterOnco is an innovative French biotechnology start-up. Founded in July 2024 and located in the Paris-Saclay University Park, IterOnco is dedicated to advancing cancer treatment and enhancing clinical outcomes through innovation and quality services. Our internal R&D efforts are focused specifically on enhancing NK cell immunotherapy for solid cancer...


  • Orsay, France Institut Curie Temps plein

    Institut Curie is a major player in the research and fight against cancer. It consists of a Hospital group and a Research Center of more than 1000 employees with a strong international objective of the Research Center is to develop basic research and to use the knowledge produced to improve the diagnosis, prognosis, and therapeutics of cancers as part of...

  • Field engineer m/f/d

    il y a 1 jour


    Orsay, France ABB Temps plein

    Field Engineer m/f/dAt ABB, we are dedicated to addressing global challenges. Our core values: care, courage, curiosity, and collaboration - combined with a focus on diversity, inclusion, and equal opportunities - are key drivers in our aim to empower everyone to create sustainable solutions. That's our story. Make it your story.This position reports...


  • Orsay, France ABB Temps plein

    Local BA Trade Compliance Manager m/f/dAt ABB, we are dedicated to addressing global challenges. Our core values: care, courage, curiosity, and collaboration - combined with a focus on diversity, inclusion, and equal opportunities - are key drivers in our aim to empower everyone to create sustainable solutions. That's our story. Make it your story.This...

  • Post-doctoral Fellow

    Il y a 3 mois


    Orsay, France CNRS Temps plein

    Cette offre est disponible dans les langues suivantes: - Français - Anglais Date Limite Candidature : jeudi 17 octobre 2024 23:59:00 heure de Paris **Informations générales**: **Intitulé de l'offre **:Post-doctorant (H/F) - Nanospectroscopie Infrarouge en contexte** Référence : UMR8214-VERSAR-020 Nombre de Postes : 1 Lieu de travail : ORSAY Date de...


  • Orsay, Île-de-France ABB Temps plein

    Drive Sales Success in Energy IndustriesA global team at ABB Holdings Inc is energizing the transformation of society and industry for a more productive, sustainable future. We value diversity and inclusion, and individuals are welcome and celebrated for their differences.Job SummaryThis role focuses on driving sales growth for ABB's Process Automation...


  • Orsay, France CNRS Temps plein

    Informations générales Intitulé de l'offre : Contrat post-doctoral: théorie géométrique, ergodique et mesurée des groupes, algèbres d'opérateurs (H/F) Référence : UMR8628-CAMHOR-003 Nombre de Postes : 2 Lieu de travail : ORSAY Date de publication : vendredi 18 octobre 2024 Type de contrat : Chercheur en contrat CDD Durée du contrat : 24...


  • Orsay, France W Electrique France SAS Temps plein

    Are you interested in being part of an innovative team that supports Westinghouse’s mission to provide clean energy solutions? At Westinghouse, we recognize that our employees are our most valuable asset and we seek to identify, attract and recruit the most qualified talent while recognizing and encouraging the value of diversity in the global...

  • Sales Specialist

    Il y a 3 mois


    Orsay, France ABB Temps plein

    **Sales Specialist M/F/d**: **At ABB, we are dedicated to addressing global challenges. Our core values: care, courage, curiosity, and collaboration - combined with a focus on diversity, inclusion, and equal opportunities - are key drivers in our aim to empower everyone to create sustainable solutions. That's our story. Make it your story.**: **This position...