Explanations of Optimal Policies for Markov

Il y a 3 mois


Grenoble, France CEA Temps plein

Description du poste

**Domaine**:

- Mathématiques, information scientifique, logiciel

**Contrat**:

- Stage

**Intitulé de l'offre**:

- Explanations of Optimal Policies for Markov Decision Processes H/F

**Sujet de stage**:

- Explanations of Optimal Policies for Markov Decision Processes

**Durée du contrat (en mois)**:

- 5 to 6

**Description de l'offre**:

- Markov Decision Processes_ (MDPs) are a class of models used by intelligent agents to reason about their environment. MDPs describe the environment and the (stochastic) effects of the agent's actions. Given an MDP, an intelligent agent can determine it optimal course of actions (aka, _policy_) in order to reach their goal with mínimal cost / maximal reward.- The AI may propose actions that appear illogical to a human user in the current state. The irrationality of such decisions might an error in the MDP, a bug in the AI, or a superb strategy that the user did not anticipate (such as taking a back step to take a better jump). To distinguish between these scenarios, the AI needs to provide **explanations **that justify or illuminate the decisions.- There is no single definition of what an explanation is. In this work, we are interested in '_contrastive explanations_' that answer the question- 'What is the mínimal change to the MDP that would modify the optimal policy?'These answers allow the human user to better understand what aspects of the environment affect the decision.- Internship- During this internship, you will develop methods for contrastive explanations of MDPs. You will determine how queries from users about policies can be formalised: develop algorithms to solve these problems; and propose heuristics to tame the computational complexity of these problems. We expect that a Branch \& Bound procedure will be required and that clever evaluation procedures will be necessary to avoid exponential search spaces.- In practice, the internship will be split in several subtasks as follows:
- Review the existing scientific literature on explanations for MDPs.
- Formalise (= translate in mathematical language) natural queries that a user might want being answered.
- Build benchmarks for testing the algorithms.
- Propose algorithms and test their scalability.

Localisation du poste

**Site**:

- Grenoble

**Localisation du poste**:

- France, Auvergne-Rhône-Alpes, Isère (38)

**Ville**:

- Grenoble

**Diplôme préparé**:

- Bac+5 - Diplôme École d'ingénieurs

**Formation recommandée**:

- Computer Science

**Possibilité de poursuite en thèse**:

- Oui

Informations générales

**Entité de rattachement**:
Le CEA est un acteur majeur de la recherche, au service des citoyens, de l'économie et de l'Etat.

Il apporte des solutions concrètes à leurs besoins dans quatre domaines principaux : transition énergétique, transition numérique, technologies pour la médecine du futur, défense et sécurité sur un socle de recherche fondamentale. Le CEA s'engage depuis plus de 75 ans au service de la souveraineté scientifique, technologique et industrielle de la France et de l'Europe pour un présent et un avenir mieux maîtrisés et plus sûrs.

Implanté au cœur des territoires équipés de très grandes infrastructures de recherche, le CEA dispose d'un large éventail de partenaires académiques et industriels en France, en Europe et à l'international.

Les 20 000 collaboratrices et collaborateurs du CEA partagent trois valeurs fondamentales:

- La conscience des responsabilités
- La coopération
- La curiosité

**Référence **:2024-32924**Description de l'unité**:

- Among other activities, CEA LIST Software Safety and Security Laboratory (LSL) research teams
design and implement automated analysis in order to make software systems more trustworthy,
to exhaustively detect their vulnerabilities, to guarantee conformity to their specifications,
and to accelerate their certification.
The lab recently extended its activities on the topic of AI trustworthiness
and gave birth to a new research group: AISER (Artificial Intelligence Safety, Explainability and Robustness).



  • Grenoble, France CEA Temps plein

    Description du poste **Domaine**: - Mathématiques, information scientifique, logiciel **Contrat**: - Stage **Intitulé de l'offre**: - STAGE - Out-of-distribution detection for adversarial attacks evasion H/F **Sujet de stage**: - During this internship, you will study the use of AISER's OOD-detection method, PARTICUL, to identify whether new inputs...


  • Grenoble, France CEA Temps plein

    Position description **Category**: - Mathematics, information, scientific, software **Contract**: - Internship **Job title**: - STAGE: In-painting using generative AI for the evaluation of eXplainable AI (XAI) methods H/F **Subject**: - In-painting using generative AI for the correctness evaluation of eXplainable AI (XAI) methods H/F **Contract...


  • Grenoble, France CEA Temps plein

    Position description **Category**: - Mathematics, information, scientific, software **Contract**: - Internship **Job title**: - STAGE: Self-explainable model for audio identification of bird species H/F **Subject**: - Self-explainable model for audio identification of bird species H/F **Contract duration (months)**: - 5-6 months **Job...


  • Grenoble, France CEA Temps plein

    Position description **Category**: - Engineering science **Contract**: - Internship **Job title**: - Development of a 1-6µm optical collection for cathodoluminescence H/F **Subject**: - The development of infrared imaging systems requires the creation of pixel arrays in structures based on small-gap materials (1-10µm) such as CdZnTe or HgCdTe...


  • Grenoble, Auvergne-Rhône-Alpes, France ESRF Temps plein

    Company OverviewThe ESRF, a leading international research institute, is at the forefront of advancing science and addressing societal challenges.We are seeking a talented Research Scientist to join our team and contribute to the development and application of cutting-edge spectroscopic imaging techniques.Job DescriptionThis PhD position offers the...


  • Grenoble, Auvergne-Rhône-Alpes, France WATTALPS Temps plein

    We are seeking an experienced B2B Sales Engineer to drive sales growth in France and Europe, primarily focusing on the decarbonisation of industry.This role involves:1. Business Development and Commercial Project Management:Identify and develop new clients in France and Europe.Maintain and enhance relationships with existing clients.Develop and execute sales...


  • Grenoble, Auvergne-Rhône-Alpes, France ESRF Temps plein

    About ESRFThe ESRF is a world-class research facility that produces intense X-ray beams to explore matter at the nano-scale. Our IT systems and solutions are vital infrastructure for the smooth running of all ESRF Divisions.As a global leader in research, we require strong cybersecurity measures to protect our infrastructure against cyber-attacks.Job...


  • Grenoble, France CEA Temps plein

    Position description Category Engineering science Contract Internship Job title Development of a 1-6µm optical collection for cathodoluminescence H/F Subject The development of infrared imaging systems requires the creation of pixel arrays in structures based on small-gap materials (1-10µm) such as CdZnTe or HgCdTe alloys....


  • Grenoble, France Département de Chimie Moléculaire, CNRS - Université Grenoble Alpes Temps plein

    **Diaziridines synthesis for chemoselective methionine bioconjugation**: - Réf **ABG-126696** - Stage master 2 / Ingénieur- Durée 6 mois- Salaire net mensuel approximately 600 euros- 06/11/2024- Département de Chimie Moléculaire, CNRS - Université Grenoble Alpes- Lieu de travail- Grenoble Auvergne-Rhône-Alpes France- Champs scientifiques- Chimie -...


  • Grenoble, France CEA Temps plein

    Description du poste **Domaine**: - Electromagnétisme, génie électrique **Contrat**: - Stage **Intitulé de l'offre**: - STAGE - Contrôle optimal du refroidissement du détecteurs d'un futur télescope spatial H/F **Sujet de stage**: - Le travail demandé sera décomposé en 4 phases: 1°) A partir d'une bibliothèque existante sous...


  • Grenoble, Auvergne-Rhône-Alpes, France ESRF Temps plein

    Job DescriptionThe Head Payroll will be responsible for managing the payroll and time management team at ESRF. This includes ensuring the reliability of the payroll and social charges every month, managing and coordinating the activities of the unit team, and guaranteeing compliance with laws and agreements.Main ResponsibilitiesManage and guarantee the...


  • Grenoble, France ILL Temps plein

    **Core mission** Do you dream of working in a dynamic and supportive team? Then look no further - we have the perfect apprenticeship position for you! Come and join our (5-person) Recruitment and Integration group, responsible for the recruitment and onboarding of new staff in an international environment. You will have the opportunity to work on innovative...


  • Grenoble, France ILL Temps plein

    **Apprentice - Junior Officer for Recruitment and HR Projects** **Core Mission** Do you dream of working in a dynamic and supportive team? Then look no further - we have the perfect apprenticeship position for you! Come and join our (5-person) Recruitment and Integration group, responsible for the recruitment and onboarding of new staff in an international...


  • Grenoble, Auvergne-Rhône-Alpes, France ESRF Temps plein

    Job OverviewThe ESRF is a leading research facility that conducts cutting-edge experiments requiring precise positioning of machine and beamline components. To support this effort, we are seeking an experienced expert in alignment and metrology to join our Survey & Alignment Group.Main ResponsibilitiesProvide expert assistance for all positioning and...


  • Grenoble, France Centre de Recherches sur les Macromolécule Végétales (CERMAV-CNRS) Temps plein

    **Ionic membrane for blue energy**: - Réf **ABG-125816** - Stage master 2 / Ingénieur- Durée 6 mois- Salaire net mensuel 610 euros- 16/09/2024- Centre de Recherches sur les Macromolécule Végétales (CERMAV-CNRS)- Lieu de travail- Grenoble Auvergne-Rhône-Alpes France- Champs scientifiques- Chimie - Matériaux - Mots clés- membrane, blue energy,...


  • Grenoble, Auvergne-Rhône-Alpes, France CYTOO SA Temps plein

    Sales and Business Development Representative for Cosmetic IndustryCytoo SA is looking for a skilled Sales Manager to join their team and help drive sales of innovative skin-based assays to the cosmetic industry.Main Responsibilities:Maintain and develop existing accounts with key clients in the cosmetic industryIdentify, qualify, pursue, and close new...


  • Grenoble, France Inria Temps plein

    Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Niveau de diplôme exigé **:Thèse ou équivalent **Fonction **:Post-Doctorant **A propos du centre ou de la direction fonctionnelle**: The Centre Inria de l’Université de Grenoble groups together almost 600 people in 22 research teams and 7 research support...


  • Grenoble, Auvergne-Rhône-Alpes, France APPLIED MATERIALS Temps plein

    At Applied Materials, we are seeking a highly skilled professional to fill the role of Director, Field Service Operations. This strategic position involves managing the business of field service operations for key customers in France, with a focus on leading a team of approximately 180 highly specialized maintenance engineers based in Grenoble.The successful...


  • Grenoble, Auvergne-Rhône-Alpes, France ESRF Temps plein

    About the JobAs a Research Scientist, you will join the Nuclear Resonance Scattering (ID14) beamline team at the European Synchrotron Radiation Facility (ESRF) and contribute to the ERC-funded LECOR project. Your primary responsibility will be to conduct experiments to determine the elastic and plastic properties of iron-bearing alloys and compounds at deep...


  • Grenoble, France Applied Materials Temps plein

    **Key Responsibilities** Develops code and documentation for a variety of difficult software projects, and design and implement bug fixes. Designs a variety of difficult software projects. Defines software specifications. Interfaces with internal customers for requirements analysis and schedule. Troubleshoots a variety of difficult software problems....