Out-of-distribution detection for adversarial attacks evasion
il y a 3 jours
Through the recent developments of AI, the use of models produced by machine learning has become widespread, even in industrial settings. However, studies are flourishing showing the dangers that such models can bring, in terms of safety, privacy or even fair-ness.
To mitigate these dangers and improve trust in AI, one possible avenue of research consists in designing methods for generating explanations of the model behaviour.
Such methods, regrouped under the umbrella term “eXplainable AI” (XAI) , empower the user by providing them with relevant information to make an informed choice to trust the model (or not) .
Another important topic is to assess the correct domain of operation of a neural network.
Indeed, inputs of a neural network are expected to be drawn from a distribution similar to the training set. To put it bluntly, a program trained to detect pedestrians on a road should not be expected to perform well when presented with pictures of planes.
As 1embedding such limitation in a neural network is unfeasible, there had been a lot of work on the field of “out-of-distribution detection” (OOD-detection) .
Through several work Xu-Darme, Girard-Satabin, et al. (2023) , the AISER team bridged XAI and OOD-detection together, using case-based reasoning techniques to detect distribution shift from an input. This ability can be used to other means, for instance monitoring the presence of maliciously modified samples (for instance, adversarial examples (Szegedy et al. 2014) .
During this internship, you will study the use of AISER’s OOD-detection method, PARTICUL, to identify whether new inputs were tampered with. You will work using the open-source library CaBRNet(Xu-Darme et al. 2024) , developped at CEA LIST, which provides an implementation of PARTICUL.
The broad internship goals are:
- familiarization with the state-of-the-art on XAI (Molnar 2022) , OOD-detection Tajwar
- getting started with the PARTICUL implementation in CaBRNet;
- design and implementation of benchmarks involving the tampering of whole
- evaluation against other OOD-detection methods using for instance the Open-OOD
Profil recherché
The candidate will work at the confluence of numerous topics: artificial intelligence, machine learning and cybersecurity.
As it is not realistic to be expert in all fields, we encourage candidates that do not meet the full qualification requirements to apply nonetheless. We strive to provide an inclusive and enjoyable workplace. We are aware of discriminations based on gender (especially prevalent on our fields) , race or disability,
we are doing our best to fight them. One of our team member is formally trained against
psychological harassment and sexual abuse.
Minimal
- master student or equivalent (2nd/3rd engineering school year) in computer science;
- ability to work in a team;
- some knowledge of version control.
- formal training in machine learning and/or statistics;
- experience of machine learning theory.
Présentation de Cea
Le CEA est un acteur majeur de la recherche, au service des citoyens, de l'économie et de l'Etat.
Il apporte des solutions concrètes à leurs besoins dans quatre domaines principaux : transition énergétique, transition numérique, technologies pour la médecine du futur, défense et sécurité sur un socle de recherche fondamentale. Le CEA s'engage depuis plus de 75 ans au service de la souveraineté scientifique, technologique et industrielle de la France et de l'Europe pour un présent et un avenir mieux maîtrisés et plus sûrs.
Implanté au cœur des territoires équipés de très grandes infrastructures de recherche, le CEA dispose d'un large éventail de partenaires académiques et industriels en France, en Europe et à l'international.
Les 20 000 collaboratrices et collaborateurs du CEA partagent trois valeurs fondamentales :
• La conscience des responsabilités
• La coopération
• La curiosité
-
Grenoble, France CEA Temps pleinThrough the recent developments of AI, the use of models produced by machine learning has become widespread, even in industrial settings. However, studies are flourishing showing the dangers that such models can bring, in terms of safety, privacy or even fair-ness. To mitigate these dangers and improve trust in AI, one possible avenue of research consists in...
-
Stage - Out-of-distribution Detection for
il y a 5 jours
Grenoble, France CEA Temps pleinDescription du poste **Domaine**: - Mathématiques, information scientifique, logiciel **Contrat**: - Stage **Intitulé de l'offre**: - STAGE - Out-of-distribution detection for adversarial attacks evasion H/F **Sujet de stage**: - During this internship, you will study the use of AISER's OOD-detection method, PARTICUL, to identify whether new inputs...
-
Head of Fit-Out Delivery
il y a 4 semaines
Grenoble, France IWG plc Temps pleinHead of Fit-Out Delivery Location- Can be based anywhere in Europe Job Purpose The Head of Delivery is a critical role within the Fit-Out team and IWG. The role is responsible for managing the process and ensuring we are opening the 1000+ centres a year we have in our pipeline. They will be responsible for managing the team of Project Managers...
-
Grenoble, France CEA Temps pleinThrough the recent developments of AI, the use of models produced by machine learning has become widespread, even in industrial settings. However, studies are flourishing showing the dangers that such models can bring, in terms of safety, privacy or even fairness. To mitigate these dangers and improve trust in AI, one possible avenue of research consists in...
-
Detector Engineer
il y a 5 jours
Grenoble, Auvergne-Rhône-Alpes, France ESRF Temps pleinJob SummaryWe are seeking a highly skilled Detector Engineer to join our team at the European Synchrotron Radiation Facility (ESRF). As a Detector Engineer, you will play a key role in the development and integration of X-ray detection systems.Key ResponsibilitiesContribute to the design, development, and testing of X-ray detection systems, including...
-
Detector Engineer
il y a 1 jour
Grenoble, Auvergne-Rhône-Alpes, France ESRF Temps pleinAbout the RoleWe are seeking a highly skilled Detector Engineer to join our team at the European Synchrotron Radiation Facility (ESRF). As a key member of our team, you will play a crucial role in the development and integration of X-ray detection systems.Key ResponsibilitiesContribute to the design, development, and testing of X-ray detection systems,...
-
Grenoble, France Cea Temps pleinThrough the recent developments of AI, the use of models produced by machine learning has become widespread, even in industrial settings. However, studies are flourishing showing the dangers that such models can bring, in terms of safety, privacy or even fairness. To mitigate these dangers and improve trust in AI, one possible avenue of research consists in...
-
GNSS System Engineer and Jamming
Il y a 3 mois
Grenoble, France Cea Temps pleinOnce confined to very specific applications, satellite navigation systems, also known as GNSS (Global Navigation Satellite Systems) , are now widespread and can be found in numerous devices, including some sensitive systems such as autonomous vehicles and military applications. Alongside the rapid expansion of this technology, the frequency and complexity of...
-
Firmware Engineer
il y a 2 semaines
Grenoble, France We Are 5 Values Temps pleinFirmware Engineer Grenoble - FranceFull time - Permanent CDISalary – Up to €60000 - Depending on experience Would you like to work in an environment dedicated to safer air quality?5VTech have recently started supporting a leader in the detection of environmental gases. They support several markets, including industrial safety, gas distribution...
-
Firmware Engineer
il y a 1 semaine
Grenoble, France 5V Tech | Certified B Corp™ Temps pleinFirmware Engineer 🌎 Grenoble - France ⌚ Full time - Permanent CDI 💵 Salary – Up to €60000 - Depending on experience Would you like to work in an environment dedicated to safer air quality?5VTech have recently started supporting a leader in the detection of environmental gases. They support several markets, including industrial safety, gas...
-
Firmware Engineer
il y a 1 semaine
Grenoble, France 5V Tech | Certified B Corp™ Temps pleinFirmware Engineer 🌎 Grenoble - France ⌚ Full time - Permanent CDI 💵 Salary – Up to €60000 - Depending on experience Would you like to work in an environment dedicated to safer air quality?5VTech have recently started supporting a leader in the detection of environmental gases. They support several markets, including industrial safety, gas...
-
Head of The Instrumentation and Control Group
Il y a 3 mois
Grenoble, France ILL Temps plein**Head of the Instrumentation and Control Group** **Context** The Institut Laue-Langevin (ILL), situated in Grenoble, France, is Europe's leading research facility for fundamental research using neutrons. The ILL operates the brightest neutron source in the world and hosts over 2000 visits by scientists per year, who come to carry out world-class...
-
Firmware Engineer
il y a 1 semaine
Grenoble, France 5V Tech | Certified B Corp™ Temps pleinFirmware Engineer Grenoble - France⌚ Full time - Permanent CDI Salary – Up to €60000 - Depending on experienceWould you like to work in an environment dedicated to safer air quality?5VTech have recently started supporting a leader in the detection of environmental gases. They support several markets, including industrial safety, gas distribution...
-
Firmware Engineer
il y a 1 semaine
Grenoble, France 5V Tech | Certified B Corp™ Temps pleinFirmware Engineer Grenoble - France⌚ Full time - Permanent CDI Salary – Up to €60000 - Depending on experienceWould you like to work in an environment dedicated to safer air quality?5VTech have recently started supporting a leader in the detection of environmental gases. They support several markets, including industrial safety, gas distribution...
-
Firmware Engineer
il y a 1 semaine
Grenoble, Isère, France 5V Tech | Certified B Corp™ Temps pleinFirmware Engineer Grenoble - France⌚ Full time - Permanent CDI Salary – Up to €60000 - Depending on experienceWould you like to work in an environment dedicated to safer air quality?5VTech have recently started supporting a leader in the detection of environmental gases. They support several markets, including industrial safety, gas distribution...
-
Characterisation Engineer for GaN Technology
il y a 4 semaines
Grenoble, Auvergne-Rhône-Alpes, France IC Resources Temps pleinCharacterisation Engineer RoleWe are pleased to present an exceptional opportunity for a talented Characterisation Engineer to become part of an innovative start-up focused on GaN and power semiconductor technologies.Key Responsibilities:Develop detailed testing and characterisation strategies for GaN devices.Perform measurements on power and GaN...
-
Stage: In-painting Using Generative Ai for The
il y a 5 jours
Grenoble, France CEA Temps pleinPosition description **Category**: - Mathematics, information, scientific, software **Contract**: - Internship **Job title**: - STAGE: In-painting using generative AI for the evaluation of eXplainable AI (XAI) methods H/F **Subject**: - In-painting using generative AI for the correctness evaluation of eXplainable AI (XAI) methods H/F **Contract...
-
BtoC Sales Consultant
il y a 4 semaines
Grenoble, Auvergne-Rhône-Alpes, France CIRCET DISTRIBUTION Temps pleinCircet Distribution operates as a vital segment of the Circet group, recognized globally for its expertise in telecommunications infrastructure. We proudly serve as a primary partner for the leading telecom operators.Specializing in fiber optic and 5G service subscriptionsAccredited for Quality, Safety, and Environmental standards ISO 9001, ISO 14001, ISO...
-
Explanations of Optimal Policies for Markov
il y a 1 jour
Grenoble, France CEA Temps pleinDescription du poste **Domaine**: - Mathématiques, information scientifique, logiciel **Contrat**: - Stage **Intitulé de l'offre**: - Explanations of Optimal Policies for Markov Decision Processes H/F **Sujet de stage**: - Explanations of Optimal Policies for Markov Decision Processes **Durée du contrat (en mois)**: - 5 to 6 **Description de...
-
Mixed-Signal IC Testing Specialist
il y a 4 semaines
Grenoble, Auvergne-Rhône-Alpes, France IC Resources Temps pleinCompany OverviewIC Resources is collaborating with a prominent semiconductor organization seeking a skilled freelance Mixed-Signal IC Testing Specialist for a contract opportunity.Position OverviewLocated in GrenobleFull-time onsite commitmentContractual engagementKey ResponsibilitiesConduct validation and testing of mixed-signal integrated circuitsDebugging...