Stage - Out-of-distribution Detection for

il y a 5 jours


Grenoble, France CEA Temps plein

Description du poste

**Domaine**:

- Mathématiques, information scientifique, logiciel

**Contrat**:

- Stage

**Intitulé de l'offre**:

- STAGE - Out-of-distribution detection for adversarial attacks evasion H/F

**Sujet de stage**:

- During this internship, you will study the use of AISER's OOD-detection method, PARTICUL,
to identify whether new inputs were tampered with. You will work using the open-source
library CaBRNet(Xu-Darme et al. 2024), developped at CEA LIST, which provides an
implementation of PARTICUL.

**Durée du contrat (en mois)**:

- 5-6

**Description de l'offre**:

- Through the recent developments of AI, the use of models produced by machine learning has become widespread, even in industrial settings. However, studies are flourishing showing the dangers that such models can bring, in terms of safety, privacy or even fair-ness.- To mitigate these dangers and improve trust in AI, one possible avenue of research consists in designing methods for generating explanations of the model behaviour.- Such methods, regrouped under the umbrella term “eXplainable AI” (XAI), empower the user by providing them with relevant information to make an informed choice to trust the model (or not).- Another important topic is to assess the correct domain of operation of a neural network.
Indeed, inputs of a neural network are expected to be drawn from a distribution similar to the training set. To put it bluntly, a program trained to detect pedestrians on a road should not be expected to perform well when presented with pictures of planes.- As 1embedding such limitation in a neural network is unfeasible, there had been a lot of work on the field of “out-of-distribution detection” (OOD-detection).
Through several work Xu-Darme, Girard-Satabin, et al. (2023), the AISER team bridged XAI and OOD-detection together, using case-based reasoning techniques to detect distribution shift from an input. This ability can be used to other means, for instance monitoring the presence of maliciously modified samples (for instance, adversarial examples (Szegedy et al. 2014).During this internship, you will study the use of AISER’s OOD-detection method, PARTICUL, to identify whether new inputs were tampered with. You will work using the open-source library CaBRNet(Xu-Darme et al. 2024), developped at CEA LIST, which provides an implementation of PARTICUL.The broad internship goals are:

- familiarization with the state-of-the-art on XAI (Molnar 2022), OOD-detection Tajwar

et al. (2021) and adversarial examples Carlini and Wagner (2016);
- getting started with the PARTICUL implementation in CaBRNet;
- design and implementation of benchmarks involving the tampering of whole

datasets with adversarial examples;
- evaluation against other OOD-detection methods using for instance the Open-OOD

benchmark (Yang et al. 2022)**Moyens / Méthodes / Logiciels**:

- CaBRNetwe are doing our best to fight them. One of our team member is formally trained against
psychological harassment and sexual abuse.Minimal- master student or equivalent (2nd/3rd engineering school year) in computer science;
- ability to work in a team;
- some knowledge of version control.
- Preferred- formal training in machine learning and/or statistics;
- experience of machine learning theory.

Localisation du poste

**Site**:

- Grenoble

**Localisation du poste**:

- France, Auvergne-Rhône-Alpes, Isère (38)

**Ville**:

- Grenoble

**Langues**:

- Anglais (Courant)
- Français (Courant)

**Diplôme préparé**:

- Bac+5 - Master 2

**Formation recommandée**:

- Computer Science

**Possibilité de poursuite en thèse**:

- Oui

Demandeur

**Disponibilité du poste**:

- 03/03/2025

Informations générales

**Entité de rattachement**:
Le CEA est un acteur majeur de la recherche, au service des citoyens, de l'économie et de l'Etat.

Il apporte des solutions concrètes à leurs besoins dans quatre domaines principaux : transition énergétique, transition numérique, technologies pour la médecine du futur, défense et sécurité sur un socle de recherche fondamentale. Le CEA s'engage depuis plus de 75 ans au service de la souveraineté scientifique, technologique et industrielle de la France et de l'Europe pour un présent et un avenir mieux maîtrisés et plus sûrs.

Implanté au cœur des territoires équipés de très grandes infrastructures de recherche, le CEA dispose d'un large éventail de partenaires académiques et industriels en France, en Europe et à l'international.

Les 20 000 collaboratrices et collaborateurs du CEA partagent trois valeurs fondamentales:

- La conscience des responsabilités
- La coopération
- La curiosité

**Référence **:2024-32919**Description de l'unité**:

- The French Alternative Energies and Atomic Energy Commission (CEA) is a key player in
research, development, and innovation. Drawing on the widely acknowledged expertise
gained by its 16,000 staff spanned over 9 research centers with a budget of 4.1 bill



  • Grenoble, France CEA Temps plein

    Through the recent developments of AI, the use of models produced by machine learning has become widespread, even in industrial settings. However, studies are flourishing showing the dangers that such models can bring, in terms of safety, privacy or even fair-ness. To mitigate these dangers and improve trust in AI, one possible avenue of research consists in...


  • Grenoble, France Cea Temps plein

    Through the recent developments of AI, the use of models produced by machine learning has become widespread, even in industrial settings. However, studies are flourishing showing the dangers that such models can bring, in terms of safety, privacy or even fair-ness.To mitigate these dangers and improve trust in AI, one possible avenue of research consists in...

  • Head of Fit-Out Delivery

    il y a 4 semaines


    Grenoble, France IWG plc Temps plein

    Head of Fit-Out Delivery Location- Can be based anywhere in Europe Job Purpose  The Head of Delivery is a critical role within the Fit-Out team and IWG. The role is responsible for managing the process and ensuring we are opening the 1000+ centres a year we have in our pipeline. They will be responsible for managing the team of Project Managers...


  • Grenoble, France CEA Temps plein

    Through the recent developments of AI, the use of models produced by machine learning has become widespread, even in industrial settings. However, studies are flourishing showing the dangers that such models can bring, in terms of safety, privacy or even fairness. To mitigate these dangers and improve trust in AI, one possible avenue of research consists in...


  • Grenoble, France CEA Temps plein

    Position description **Category**: - Mathematics, information, scientific, software **Contract**: - Internship **Job title**: - STAGE: In-painting using generative AI for the evaluation of eXplainable AI (XAI) methods H/F **Subject**: - In-painting using generative AI for the correctness evaluation of eXplainable AI (XAI) methods H/F **Contract...


  • Grenoble, France Cea Temps plein

    Through the recent developments of AI, the use of models produced by machine learning has become widespread, even in industrial settings. However, studies are flourishing showing the dangers that such models can bring, in terms of safety, privacy or even fairness. To mitigate these dangers and improve trust in AI, one possible avenue of research consists in...

  • Detector Engineer

    il y a 5 jours


    Grenoble, Auvergne-Rhône-Alpes, France ESRF Temps plein

    Job SummaryWe are seeking a highly skilled Detector Engineer to join our team at the European Synchrotron Radiation Facility (ESRF). As a Detector Engineer, you will play a key role in the development and integration of X-ray detection systems.Key ResponsibilitiesContribute to the design, development, and testing of X-ray detection systems, including...

  • Detector Engineer

    il y a 1 jour


    Grenoble, Auvergne-Rhône-Alpes, France ESRF Temps plein

    About the RoleWe are seeking a highly skilled Detector Engineer to join our team at the European Synchrotron Radiation Facility (ESRF). As a key member of our team, you will play a crucial role in the development and integration of X-ray detection systems.Key ResponsibilitiesContribute to the design, development, and testing of X-ray detection systems,...


  • Grenoble, France CEA Temps plein

    Description du poste **Domaine**: - Mathématiques, information scientifique, logiciel **Contrat**: - Stage **Intitulé de l'offre**: - Explanations of Optimal Policies for Markov Decision Processes H/F **Sujet de stage**: - Explanations of Optimal Policies for Markov Decision Processes **Durée du contrat (en mois)**: - 5 to 6 **Description de...


  • Grenoble, France CEA Temps plein

    Position description **Category**: - Mathematics, information, scientific, software **Contract**: - Internship **Job title**: - STAGE: Self-explainable model for audio identification of bird species H/F **Subject**: - Self-explainable model for audio identification of bird species H/F **Contract duration (months)**: - 5-6 months **Job...

  • Firmware Engineer

    il y a 1 semaine


    Grenoble, France 5V Tech | Certified B Corp™ Temps plein

    Firmware Engineer 🌎 Grenoble - France ⌚ Full time - Permanent CDI 💵 Salary – Up to €60000 - Depending on experience Would you like to work in an environment dedicated to safer air quality?5VTech have recently started supporting a leader in the detection of environmental gases. They support several markets, including industrial safety, gas...

  • Firmware Engineer

    il y a 1 semaine


    Grenoble, France 5V Tech | Certified B Corp™ Temps plein

    Firmware Engineer 🌎 Grenoble - France ⌚ Full time - Permanent CDI 💵 Salary – Up to €60000 - Depending on experience Would you like to work in an environment dedicated to safer air quality?5VTech have recently started supporting a leader in the detection of environmental gases. They support several markets, including industrial safety, gas...

  • Firmware Engineer

    il y a 2 semaines


    Grenoble, France We Are 5 Values Temps plein

    Firmware Engineer Grenoble - FranceFull time - Permanent CDISalary – Up to €60000 - Depending on experience Would you like to work in an environment dedicated to safer air quality?5VTech have recently started supporting a leader in the detection of environmental gases. They support several markets, including industrial safety, gas distribution...


  • Grenoble, France ILL Temps plein

    **Head of the Instrumentation and Control Group** **Context** The Institut Laue-Langevin (ILL), situated in Grenoble, France, is Europe's leading research facility for fundamental research using neutrons. The ILL operates the brightest neutron source in the world and hosts over 2000 visits by scientists per year, who come to carry out world-class...

  • Firmware Engineer

    il y a 1 semaine


    Grenoble, France 5V Tech | Certified B Corp™ Temps plein

    Firmware Engineer Grenoble - France⌚ Full time - Permanent CDI Salary – Up to €60000 - Depending on experienceWould you like to work in an environment dedicated to safer air quality?5VTech have recently started supporting a leader in the detection of environmental gases. They support several markets, including industrial safety, gas distribution...

  • Firmware Engineer

    il y a 1 semaine


    Grenoble, Isère, France 5V Tech | Certified B Corp™ Temps plein

    Firmware Engineer Grenoble - France⌚ Full time - Permanent CDI Salary – Up to €60000 - Depending on experienceWould you like to work in an environment dedicated to safer air quality?5VTech have recently started supporting a leader in the detection of environmental gases. They support several markets, including industrial safety, gas distribution...

  • Firmware Engineer

    il y a 1 semaine


    Grenoble, France 5V Tech | Certified B Corp™ Temps plein

    Firmware Engineer Grenoble - France⌚ Full time - Permanent CDI Salary – Up to €60000 - Depending on experienceWould you like to work in an environment dedicated to safer air quality?5VTech have recently started supporting a leader in the detection of environmental gases. They support several markets, including industrial safety, gas distribution...


  • Grenoble, Auvergne-Rhône-Alpes, France IC Resources Temps plein

    Characterisation Engineer RoleWe are pleased to present an exceptional opportunity for a talented Characterisation Engineer to become part of an innovative start-up focused on GaN and power semiconductor technologies.Key Responsibilities:Develop detailed testing and characterisation strategies for GaN devices.Perform measurements on power and GaN...

  • BtoC Sales Consultant

    il y a 4 semaines


    Grenoble, Auvergne-Rhône-Alpes, France CIRCET DISTRIBUTION Temps plein

    Circet Distribution operates as a vital segment of the Circet group, recognized globally for its expertise in telecommunications infrastructure. We proudly serve as a primary partner for the leading telecom operators.Specializing in fiber optic and 5G service subscriptionsAccredited for Quality, Safety, and Environmental standards ISO 9001, ISO 14001, ISO...


  • Grenoble, France CEA Temps plein

    Through the recent developments of AI, the use of models produced by machine learning has become widespread, even in industrial settings. However, studies are flourishing showing the dangers that such models can bring, in terms of safety, privacy or even fairness. To mitigate these dangers and improve trust in AI, one possible avenue of research consists in...