Explanations of Optimal Policies for Markov

Il y a 2 mois


Grenoble, France CEA Temps plein

Description du poste

**Domaine**:

- Mathématiques, information scientifique, logiciel

**Contrat**:

- Stage

**Intitulé de l'offre**:

- Explanations of Optimal Policies for Markov Decision Processes H/F

**Sujet de stage**:

- Explanations of Optimal Policies for Markov Decision Processes

**Durée du contrat (en mois)**:

- 5 to 6

**Description de l'offre**:

- Markov Decision Processes_ (MDPs) are a class of models used by intelligent agents to reason about their environment. MDPs describe the environment and the (stochastic) effects of the agent's actions. Given an MDP, an intelligent agent can determine it optimal course of actions (aka, _policy_) in order to reach their goal with mínimal cost / maximal reward.- The AI may propose actions that appear illogical to a human user in the current state. The irrationality of such decisions might an error in the MDP, a bug in the AI, or a superb strategy that the user did not anticipate (such as taking a back step to take a better jump). To distinguish between these scenarios, the AI needs to provide **explanations **that justify or illuminate the decisions.- There is no single definition of what an explanation is. In this work, we are interested in '_contrastive explanations_' that answer the question- 'What is the mínimal change to the MDP that would modify the optimal policy?'These answers allow the human user to better understand what aspects of the environment affect the decision.- Internship- During this internship, you will develop methods for contrastive explanations of MDPs. You will determine how queries from users about policies can be formalised: develop algorithms to solve these problems; and propose heuristics to tame the computational complexity of these problems. We expect that a Branch \& Bound procedure will be required and that clever evaluation procedures will be necessary to avoid exponential search spaces.- In practice, the internship will be split in several subtasks as follows:
- Review the existing scientific literature on explanations for MDPs.
- Formalise (= translate in mathematical language) natural queries that a user might want being answered.
- Build benchmarks for testing the algorithms.
- Propose algorithms and test their scalability.

Localisation du poste

**Site**:

- Grenoble

**Localisation du poste**:

- France, Auvergne-Rhône-Alpes, Isère (38)

**Ville**:

- Grenoble

**Diplôme préparé**:

- Bac+5 - Diplôme École d'ingénieurs

**Formation recommandée**:

- Computer Science

**Possibilité de poursuite en thèse**:

- Oui

Informations générales

**Entité de rattachement**:
Le CEA est un acteur majeur de la recherche, au service des citoyens, de l'économie et de l'Etat.

Il apporte des solutions concrètes à leurs besoins dans quatre domaines principaux : transition énergétique, transition numérique, technologies pour la médecine du futur, défense et sécurité sur un socle de recherche fondamentale. Le CEA s'engage depuis plus de 75 ans au service de la souveraineté scientifique, technologique et industrielle de la France et de l'Europe pour un présent et un avenir mieux maîtrisés et plus sûrs.

Implanté au cœur des territoires équipés de très grandes infrastructures de recherche, le CEA dispose d'un large éventail de partenaires académiques et industriels en France, en Europe et à l'international.

Les 20 000 collaboratrices et collaborateurs du CEA partagent trois valeurs fondamentales:

- La conscience des responsabilités
- La coopération
- La curiosité

**Référence **:2024-32924**Description de l'unité**:

- Among other activities, CEA LIST Software Safety and Security Laboratory (LSL) research teams
design and implement automated analysis in order to make software systems more trustworthy,
to exhaustively detect their vulnerabilities, to guarantee conformity to their specifications,
and to accelerate their certification.
The lab recently extended its activities on the topic of AI trustworthiness
and gave birth to a new research group: AISER (Artificial Intelligence Safety, Explainability and Robustness).


  • Research Intern

    il y a 4 semaines


    Grenoble, Auvergne-Rhône-Alpes, France CEA Temps plein

    Internship OpportunityWe are seeking a highly motivated and talented research intern to join our team at CEA List, a leading research institute in the field of artificial intelligence and cybersecurity. The successful candidate will have the opportunity to work on a cutting-edge project focused on out-of-distribution detection for adversarial attacks...


  • Grenoble, France CEA Temps plein

    Description du poste **Domaine**: - Mathématiques, information scientifique, logiciel **Contrat**: - Stage **Intitulé de l'offre**: - STAGE - Out-of-distribution detection for adversarial attacks evasion H/F **Sujet de stage**: - During this internship, you will study the use of AISER's OOD-detection method, PARTICUL, to identify whether new inputs...


  • Grenoble, France CEA Temps plein

    Position description **Category**: - Mathematics, information, scientific, software **Contract**: - Internship **Job title**: - STAGE: In-painting using generative AI for the evaluation of eXplainable AI (XAI) methods H/F **Subject**: - In-painting using generative AI for the correctness evaluation of eXplainable AI (XAI) methods H/F **Contract...


  • Grenoble, France CEA Temps plein

    Position description **Category**: - Mathematics, information, scientific, software **Contract**: - Internship **Job title**: - STAGE: Self-explainable model for audio identification of bird species H/F **Subject**: - Self-explainable model for audio identification of bird species H/F **Contract duration (months)**: - 5-6 months **Job...


  • Grenoble, Auvergne-Rhône-Alpes, France WASHINGTON INSTITUTE FOR COAGULATION Temps plein

    Washington Institute for Coagulation is seeking a skilled Market Development Manager for Europe to join our team. As a key member of our global market development team, you will be responsible for promoting our products and branding through visits and calls to customers and presentations in congresses and shows.You will provide technical support to...


  • Grenoble, Auvergne-Rhône-Alpes, France ESRF Temps plein

    Job DescriptionThe ESRF is a world-class research facility that relies heavily on IT systems and solutions to operate smoothly. As the Chief Information Security Officer, you will play a crucial role in protecting these systems from cyber threats.Reporting to the Experiments Division, Instrumentation Services and Development Division (ISDD), and Technical...


  • Grenoble, Auvergne-Rhône-Alpes, France WASHINGTON INSTITUTE FOR COAGULATION Temps plein

    Unlock a World of Opportunities in Specialty ChemistryEmbark on a thrilling, cross-disciplinary, and committed professional journey with a responsible company that prioritizes sustainable development.Vencorex is a world leader in specialty chemistry, developing and producing components for high-performance polyurethane coatings and adhesives used in various...

  • Cybersecurity Leader for ESRF

    il y a 2 semaines


    Grenoble, Auvergne-Rhône-Alpes, France ESRF Temps plein

    Job DescriptionThe ESRF is a world-class research facility that produces intense X-ray beams to explore matter at the nano-scale. IT systems and solutions are vital infrastructure for the smooth running of all ESRF Divisions. It is essential that all hardware and software solutions are properly protected against cyber-attacks.The Chief Information Security...


  • Grenoble, Auvergne-Rhône-Alpes, France WASHINGTON INSTITUTE FOR COAGULATION Temps plein

    Unlock Your Potential in Specialty ChemistryJoin a dynamic and responsible company that is committed to sustainable development and innovation. Vencorex is a world leader in specialty chemistry, developing and producing high-performance polyurethane coatings and adhesives for various industries.As a Market Development Manager for Europe, you will be the...


  • Grenoble, Auvergne-Rhône-Alpes, France Schneider Electric Temps plein

    Job Summary:We are seeking a highly skilled Principal Product Cybersecurity Architect to join our team at Schneider Electric. As a key member of the CTO office, you will be responsible for driving innovation and growth across various Lines of Business (LoBs) in the areas of energy efficiency and sustainability.The ideal candidate will have a strong expertise...

  • Modeling Expert

    il y a 4 semaines


    Grenoble, Auvergne-Rhône-Alpes, France CEA Temps plein

    Job Title: Modeling ExpertWe are seeking a highly skilled Modeling Expert to join our team at CEA. As a Modeling Expert, you will be responsible for developing and implementing self-explainable models for audio classification.Job Description:Our team is working on a project to develop a self-explainable model for audio classification, specifically for bird...


  • Grenoble, France CEA Temps plein

    Position description **Category**: - Engineering science **Contract**: - Internship **Job title**: - Development of a 1-6µm optical collection for cathodoluminescence H/F **Subject**: - The development of infrared imaging systems requires the creation of pixel arrays in structures based on small-gap materials (1-10µm) such as CdZnTe or HgCdTe...


  • Grenoble, Auvergne-Rhône-Alpes, France Schneider Electric Temps plein

    Job Description:The Principal Product Cybersecurity Architect will be responsible for ensuring the security and integrity of our EcoStruxure ecosystem of devices and services. This role will be hosted within the CTO office of the Energy Management Business Unit (EMBU), dedicated to spearheading strategic technology disruption programs.The CTO office is...


  • Grenoble, Auvergne-Rhône-Alpes, France WATTALPS Temps plein

    We are seeking an experienced B2B Sales Engineer to drive sales growth in France and Europe, primarily focusing on the decarbonisation of industry.This role involves:1. Business Development and Commercial Project Management:Identify and develop new clients in France and Europe.Maintain and enhance relationships with existing clients.Develop and execute sales...

  • Research Intern

    il y a 3 semaines


    Grenoble, Auvergne-Rhône-Alpes, France CEA Temps plein

    Internship Opportunity: Out-of-Distribution Detection for Adversarial Attacks EvasionThe CEA List institute is seeking a research intern to work on the development of out-of-distribution detection methods for adversarial attacks evasion. The successful candidate will have the opportunity to work on a project that aims to improve the trustworthiness of...


  • Grenoble, Auvergne-Rhône-Alpes, France Adoc Talent Management Temps plein

    Job Title: Senior Engineer for TelecommunicationsDescription:Adoc Talent Management is seeking a Senior Engineer for Telecommunications to support the development of next-generation high-speed systems. The ideal candidate will have a Master's degree or above in Electrical Engineering, Information Technology, or a related field, with 10+ years of experience...


  • Grenoble, France Département de Chimie Moléculaire, CNRS - Université Grenoble Alpes Temps plein

    **Diaziridines synthesis for chemoselective methionine bioconjugation**: - Réf **ABG-126696** - Stage master 2 / Ingénieur- Durée 6 mois- Salaire net mensuel approximately 600 euros- 06/11/2024- Département de Chimie Moléculaire, CNRS - Université Grenoble Alpes- Lieu de travail- Grenoble Auvergne-Rhône-Alpes France- Champs scientifiques- Chimie -...

  • Head of Payroll Management

    il y a 2 semaines


    Grenoble, Auvergne-Rhône-Alpes, France ESRF Temps plein

    Job DescriptionThe Head Payroll will be responsible for managing the payroll and time management team at ESRF. This includes ensuring the reliability of the payroll and social charges every month, managing and coordinating the activities of the unit team, and guaranteeing compliance with laws and agreements.Main ResponsibilitiesManage and guarantee the...


  • Grenoble, Auvergne-Rhône-Alpes, France CEA Temps plein

    Job DescriptionThe CEA List institute is seeking a research intern to work on a project related to AI safety and explainability. The successful candidate will have the opportunity to work on a cutting-edge project that aims to develop methods for generating explanations of AI model behavior.The internship will involve studying the use of AISER's...


  • Grenoble, Auvergne-Rhône-Alpes, France ESRF Temps plein

    Job Title: Business Development Engineer for NanotechnologyJob Summary:The Business Development Engineer for Nanotechnology will lead the establishment and implementation of a comprehensive business development strategy within the realm of nanotechnology and nanoscience. This will involve promoting the Consortium's technical solutions to the industrial...