Ultra-low Power Evolutionary Reinforcement Learning

Il y a 2 mois


Rennes, France INSA RENNES Temps plein

**Ultra-low Power Evolutionary Reinforcement Learning PhDs**

**Abstract**
This project will recruit 2 PhDs in the domain of frugal Machine Learning (ML). The aim of the PhDs is to propose full-stack methods and open-source tools to train and infer ultra-lightweight AIs, by extending, implementing, and optimizing a new ML technique that relies on the light-by-construction and adaptive Tangled Program Graph (TPG) model. The two PhD students will work in tandem to optimize energy during the whole life cycle, from training to inference.

**Context : Reinforcement Learning with Tangled Program Graphs**

Reinforcement Learning (RL) is a branch of Machine Learning (ML) techniques where an autonomous artificial intelligence learns how to interact with its environment. As depicted in the figure below, using a trial and error mechanism, the artificial intelligence learns from its own experience, by interacting with the environment, and by getting rewards for each attempt. The purpose of the artificial intelligence is to maximize this reward.

Proposed in 2017, Tangled Program Graphs (TPGs) are a new way to power reinforcement learning AI, based on evolutionary concepts. The main strength of TPGs, compared to state-of-the-art deep learning-based techniques, is the lightweightness of their model, which confers them a low computational complexity, and very high performance on regular desktop CPU. Compared to deep-learning at equivalent accuracy, TPGs execute 1000x faster with 100x less memory.

**GEGELATI (**_Generic Evolvable Graphs for Efficient Learning of Artificial Tangled Intelligence)_

GEGELATI [dʒedʒelati] is a fresh open-source reinforcement learning framework for training artificial intelligence based on TPGs. The purpose of this framework, developed as a C++ shared library, is to make it as easy and as fast as possible and to train an agent on a new learning environment. The C++ library is developed to be portable, fully documented, and thoroughly unit tested to ensure its maintainability. GEGELATI is developed at the Institut d'Electronique et des Technologies du numéRique (IETR).

**Objectives**
The main scientific objectives pursued by the PhD students are to:

- Integrate energy optimizations at the core of the TPG training process: overall energy optimization will minimize the energy consumption of the computing system for TPG training and inference, as well as, when relevant, the energy consumption of physical actuators of the controlled cyber-physical systems.
- Extend the TPG learning capabilities: on top of improving the TPG efficiency on existing environments, model extensions will unlock new types of learning environments like continuous action spaces or non-reinforcement learning environments required for extending TPGs to real-world use cases.
- Propose highly-efficient implementation techniques: in order to find the most suited hardware plarform for TPGs, implementation will be pursued and compared on multiple state-of-the-art hardware. Implementation will be studied for both efficient training, and inference on battery-powered ULP devices and reconfigurable devices for nanoseconds reaction time on the factory floor.

The foreseen focus of the two PhDs are:

- PhD 1: Energy-aware low-complexity reinforcement learning.
- PhD 2: HW-SW co-optimization for ultra-low power reinforcement learning.

**Characteristics**
- Duration: 3 years
- Start: Oct. 2023
- Stipend: 2300€ per month before tax Funded by: ANR FOUTICS Research Project

**Location **:VAADER team, IETR laboratory - INSA Rennes, 20 Avenue des Buttes de Coësmes, 35700 Rennes - France

**Supervisors**
Karol Desnos (IETR, Equipe Vaader, Rennes) - kdesnos[at]insa-rennes.fr
Mickaël Dardaillon (IETR, Equipe Vaader, Rennes) - mdardail[at]insa-rennes.fr

Status: Cadre
Contract length: 24 months

**Salary**: 2,300.00€ per month

**Education**:

- Master's (required)

Work Location: One location

Application Deadline: 31/05/2023
Expected Start Date: 02/10/2023



  • RENNES, 35000, Bretagne, France Initia. Temps plein

    SI VOUS NOUS REJOIGNEZ :Nous recherchons un Consultant Power Plateform Senior pour mettre en oeuvre notre projet de transformation digitale, via l'utilisation de technologies Low Code. Vous serez rattaché à un manager de proximité.Chez INITIA, cabinet de conseil et d'expertise-comptable, nous sommes constamment à la recherche de gains de...


  • Rennes, France Inria Temps plein

    Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Niveau de diplôme exigé **:Bac + 5 ou équivalent **Autre diplôme apprécié **:Computer Science, Neuroscience, Math, Statistic **Fonction **:Doctorant **A propos du centre ou de la direction fonctionnelle**: The Inria Rennes - Bretagne Atlantique Centre is one of...


  • Rennes, France INRIA Temps plein

    Contexte et atouts du poste Context This PhD will occur in the context of the project Adapting ( from the PEPR AI ( This project focuses on designing adaptive embedded hardware architectures for AI. In this context, our team wants to design new incremental machine learning algorithms that could serve as use cases in the Adapting project for other...


  • Rennes, France INRIA Temps plein

    Contexte et atouts du poste The research group belongs to a joint research center of Inria, CNRS, and Université de Rennes. Mission confiée We are looking to hire a post-doc for 12 months in the area of formal methods at Inria, Université de Rennes. The research project will be about formal verification and testing of real-time systems...


  • Rennes, Ille-et-Vilaine, France Mitsubishi Electric R&D Centre Europe - France Temps plein

    Context and description:MITSUBISHI ELECTRIC is one of the leading manufacturers of power electronics related products from components such as semiconductor power devices to systems such as HVDC systems. As MITSUBISHI ELECTRIC Group’s subsidiary, MITSUBISHI ELECTRIC R&D CENTRE EUROPE includes a research division specialised in Power Electronics, in...


  • Rennes, France Mitsubishi Electric R&D Centre Europe - France Temps plein

    Context and description:MITSUBISHI ELECTRIC is one of the leading manufacturers of power electronics related products from components such as semiconductor power devices to systems such as HVDC systems. As MITSUBISHI ELECTRIC Group’s subsidiary, MITSUBISHI ELECTRIC R&D CENTRE EUROPE includes a research division specialised in Power Electronics, in...


  • Rennes, France Mitsubishi Electric R&D Centre Europe - France Temps plein

    Context and description:MITSUBISHI ELECTRIC is one of the leading manufacturers of power electronics related products from components such as semiconductor power devices to systems such as HVDC systems. As MITSUBISHI ELECTRIC Group’s subsidiary, MITSUBISHI ELECTRIC R&D CENTRE EUROPE includes a research division specialised in Power Electronics, in...


  • Rennes, France Inria Temps plein

    Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Niveau de diplôme exigé **:Bac + 5 ou équivalent **Fonction **:Doctorant **A propos du centre ou de la direction fonctionnelle**: The Inria Centre at Rennes University is one of Inria's eight centres and has more than thirty research teams. The Inria Centre is a major and...


  • Rennes, France Silicon Labs Temps plein

    We are Silicon Labs. We are a leader in secure, intelligent wireless technology for a more connected world. Our integrated hardware and software platform, intuitive development tools, unmatched ecosystem and robust support make us the ideal long-term partner in building advanced industrial, commercial, home and life applications. We make it easy for...


  • Rennes, France Inria Temps plein

    Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Contrat renouvelable **:Oui **Niveau de diplôme exigé **:Thèse ou équivalent **Fonction **:Post-Doctorant **A propos du centre ou de la direction fonctionnelle**: The Inria Centre at Rennes University is one of Inria's eight centres and has more than thirty research...


  • Rennes, France Inria Temps plein

    Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD**Contrat renouvelable **:Oui**Niveau de diplôme exigé **:Thèse ou équivalent**Fonction **:Post-DoctorantA propos du centre ou de la direction fonctionnelle The Inria Centre at Rennes University is one of Inria's eight centres and has more than thirty research teams. The...


  • Rennes, France Inria Temps plein

    Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Niveau de diplôme exigé **:Bac + 5 ou équivalent **Fonction **:Doctorant **A propos du centre ou de la direction fonctionnelle**: The Inria Rennes - Bretagne Atlantique Centre is one of Inria's eight centres and has more than thirty research teams. The Inria Center is a...


  • Rennes, France Silicon Labs Temps plein

    We are Silicon Labs. We are a leader in secure, intelligent wireless technology for a more connected world. Our integrated hardware and software platform, intuitive development tools, unmatched ecosystem and robust support make us the ideal long-term partner in building advanced industrial, commercial, home and life applications. We make it easy for...


  • Rennes, France Inria Temps plein

    Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Niveau de diplôme exigé **:Bac + 5 ou équivalent **Fonction **:Doctorant **A propos du centre ou de la direction fonctionnelle**: The Inria Centre at Rennes University is one of Inria's eight centres and has more than thirty research teams. The Inria Centre is a major and...


  • Rennes, France UMR 6553 Ecobio CNRS Université de Rennes Temps plein

    **PolluClim : Effects of residual chemical pollution on plant responses to climate change**: - Réf - **ABG-112779** - Sujet de Thèse- 31/03/2023- Contrat doctoral- UMR 6553 Ecobio CNRS Université de Rennes- Lieu de travail- Rennes - Bretagne - France- Intitulé du sujet- PolluClim : Effects of residual chemical pollution on plant responses to climate...


  • Rennes, France Silicon Labs Careers Temps plein

    - More about Silicon Labs: We are Silicon Labs. We are the leading provider of silicon, software and solutions for a smarter, more connected world. We hire the most innovative talent in the world to solve the industry’s toughest problems, providing our customers with significant advantages in performance, energy savings, connectivity and design...


  • Rennes, France INRIA Temps plein

    Contexte et atouts du poste Context and background: Nowadays, there is a growing and irreversible need to distribute Artificial Intelligence (AI) applications from the cloud to edge devices, where computation is largely or completely performed on distributed Internet of Things (IoT) devices. This trend aims to address issues related to data...


  • Rennes, France Silicon Labs Temps plein

    We are Silicon Labs. We are a leader in secure, intelligent wireless technology for a more connected world. Our integrated hardware and software platform, intuitive development tools, unmatched ecosystem and robust support make us the ideal long-term partner in building advanced industrial, commercial, home and life applications. We make it easy for...

  • Apprentice

    il y a 2 jours


    Rennes, France Avnet Temps plein

    Avnet Abacus Avnet Abacus is a pan-European distributor committed to supporting customers from design to fulfilment. Avnet Abacus’ exceptional linecard features globally recognized manufacturers and an extensive product range that includes interconnect, passive, electromechanical, power supply, energy storage, wireless & sensor products and solutions....

  • Data Engineer

    il y a 1 mois


    Rennes, France CNAF Temps plein

    **Contexte**: Vous souhaitez vous engager dans une entreprise aux valeurs humaines, sociales et solidaires ? Vous souhaitez prendre part à la construction d’un SI de premier plan en France ? Pour vous, le travail d'équipe et le partage de compétences sont sources d'émulation ? Les nouvelles technologies vous inspirent ? Vous avez répondu « Oui »...