Ultra-low Power Evolutionary Reinforcement Learning
il y a 3 semaines
**Ultra-low Power Evolutionary Reinforcement Learning PhDs**:
- Réf
- **ABG-113376**
- Sujet de Thèse- 14/04/2023- Financement public/privé- INSTITUT NATIONAL DES SCIENCES APPLIQUEES- Lieu de travail- Rennes - Bretagne - France- Intitulé du sujet- Ultra-low Power Evolutionary Reinforcement Learning PhDs- Champs scientifiques- Energie
- Matériaux
- Mots clés- Artificial Intelligence, Reinforcement Learning, Ultra Low Power, Tangled Program Graphs, Open-Source**Description du sujet**:
Abstract
This project will recruit 2 PhDs in the domain of frugal Machine Learning (ML). The aim of the PhDs is to propose
full-stack methods and open-source tools to train and infer ultra-lightweight AIs, by extending, implementing, and
optimizing a new ML technique that relies on the light-by-construction and adaptive Tangled Program Graph (TPG)
model. The two PhD students will work in tandem to optimize energy during the whole life cycle, from training to
inference.
Keywords: Artificial Intelligence, Reinforcement Learning, Ultra Low Power, Tangled Program Graphs ,
Open-Source.
Context
Reinforcement Learning with Tangled Program Graphs
Reinforcement Learning (RL) is a branch of Machine Learning (ML) techniques where an autonomous artificial
intelligence learns how to interact with its environment. As depicted in the figure below, using a trial and error
mechanism, the artificial intelligence learns from its own experience, by interacting with the environment, and by
getting rewards for each attempt. The purpose of the artificial intelligence is to maximize this reward.
Proposed in 2017, Tangled Program Graphs (TPGs) are a new way to power reinforcement learning AI, based on
evolutionary concepts. The main strength of TPGs, compared to state-of-the-art deep learning-based techniques, is the lightweightness of their model, which confers them a low computational complexity, and very high performance on regular desktop CPU. Compared to deep-learning at equivalent accuracy, TPGs execute 1000x faster with 100x less memory.
GEGELATI
Generic Evolvable Graphs for Efficient Learning of Artificial Tangled Intelligence
GEGELATI [dʒedʒelati] is a fresh open-source reinforcement learning framework for training artificial intelligence based on TPGs. The purpose of this framework, developed as a C++ shared library, is to make it as easy and as fast as possible and to train an agent on a new learning environment. The C++ library is developed to be portable, fully documented, and thoroughly unit tested to ensure its maintainability. GEGELATI is developed at the Institut d'Electronique et des Technologies du numéRique (IETR).
Objectives
The main scientific objectives pursued by the PhD students are to:
Integrate energy optimizations at the core of the TPG training process: overall energy optimization will minimize
the energy consumption of the computing system for TPG training and inference, as well as, when relevant, the
energy consumption of physical actuators of the controlled cyber-physical systems.
Extend the TPG learning capabilities: on top of improving the TPG efficiency on existing environments, model
extensions will unlock new types of learning environments like continuous action spaces or non-reinforcement
learning environments required for extending TPGs to real-world use cases.
Propose highly-efficient implementation techniques: in order to find the most suited hardware plarform for TPGs,
implementation will be pursued and compared on multiple state-of-the-art hardware. Implementation will be
studied for both efficient training, and inference on battery-powered ULP devices and reconfigurable devices for
nanoseconds reaction time on the factory floor.
The foreseen focus of the two PhDs are:
PhD 1: Energy-aware low-complexity reinforcement learning.
PhD 2: HW-SW co-optimization for ultra-low power reinforcement learning.
**Prise de fonction**:
- 02/10/2023**Nature du financement**:
- Financement public/privé**Précisions sur le financement**:
- ANR FOUTICS Research Project**Présentation établissement et labo d'accueil**:
- INSTITUT NATIONAL DES SCIENCES APPLIQUEESIETR : UMR CNRS 6164
Cette Unité Mixte de Recherche regroupe les équipes de recherche de l'INSA Rennes, l'Université de Rennes, Supélec, l’Université de Nantes et le CNRS.
Laboratoire IETR (Institut d’Electronique et des Technologies du numéRique),
Unité Mixte de Recherche CNRS 6164.
Établissements tutelles du laboratoire : CentraleSupélec / CNRS / INSA Rennes / Université de Nantes / Université de Rennes
Effectifs du site INSA Rennes de l'IETR : 100 personnes au sein de 6 équipes de recherche:
ASIC : Architecture, Systems, Infrastructure and electroniCs
SIGNAL : SIgnal processinG aNd ALgorithm
eWAVES : Electromagnetic WAVES in complex media
SurfWave : Periodic and quasi-periodic SURFaces fo WAVE control
POLARIS : Propagation Localisation Radar: instrumentation & signal
VAADER : Video Algorithms and Architecture Design for Embe
-
Consultant Power Plateform Senior H/F
il y a 9 heures
RENNES, 35000, Bretagne, France Initia. Temps pleinSI VOUS NOUS REJOIGNEZ :Nous recherchons un Consultant Power Plateform Senior pour mettre en oeuvre notre projet de transformation digitale, via l'utilisation de technologies Low Code. Vous serez rattaché à un manager de proximité.Chez INITIA, cabinet de conseil et d'expertise-comptable, nous sommes constamment à la recherche de gains de...
-
Phd Position F/m Incremental Deep Learning for
il y a 4 jours
Rennes, France Inria Temps pleinLe descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Niveau de diplôme exigé **:Bac + 5 ou équivalent **Autre diplôme apprécié **:Computer Science, Neuroscience, Math, Statistic **Fonction **:Doctorant **A propos du centre ou de la direction fonctionnelle**: The Inria Rennes - Bretagne Atlantique Centre is one of...
-
Rennes, France INRIA Temps pleinContexte et atouts du poste Context This PhD will occur in the context of the project Adapting ( from the PEPR AI ( This project focuses on designing adaptive embedded hardware architectures for AI. In this context, our team wants to design new incremental machine learning algorithms that could serve as use cases in the Adapting project for other...
-
Rennes, France INRIA Temps pleinContexte et atouts du poste The research group belongs to a joint research center of Inria, CNRS, and Université de Rennes. Mission confiée We are looking to hire a post-doc for 12 months in the area of formal methods at Inria, Université de Rennes. The research project will be about formal verification and testing of real-time systems...
-
Researcher in the field of Power Electronics – Magnetic components
il y a 3 semaines
Rennes, France Mitsubishi Electric R&D Centre Europe - France Temps pleinContext and description:MITSUBISHI ELECTRIC is one of the leading manufacturers of power electronics related products from components such as semiconductor power devices to systems such as HVDC systems. As MITSUBISHI ELECTRIC Group’s subsidiary, MITSUBISHI ELECTRIC R&D CENTRE EUROPE includes a research division specialised in Power Electronics, in...
-
Researcher in the field of Power Electronics – Magnetic components
il y a 3 semaines
Rennes, Ille-et-Vilaine, France Mitsubishi Electric R&D Centre Europe - France Temps pleinContext and description:MITSUBISHI ELECTRIC is one of the leading manufacturers of power electronics related products from components such as semiconductor power devices to systems such as HVDC systems. As MITSUBISHI ELECTRIC Group’s subsidiary, MITSUBISHI ELECTRIC R&D CENTRE EUROPE includes a research division specialised in Power Electronics, in...
-
Rennes, France Mitsubishi Electric R&D Centre Europe - France Temps pleinContext and description:MITSUBISHI ELECTRIC is one of the leading manufacturers of power electronics related products from components such as semiconductor power devices to systems such as HVDC systems. As MITSUBISHI ELECTRIC Group’s subsidiary, MITSUBISHI ELECTRIC R&D CENTRE EUROPE includes a research division specialised in Power Electronics, in...
-
Phd Position F/m Learning-based Control of An
il y a 1 mois
Rennes, France Inria Temps pleinLe descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Niveau de diplôme exigé **:Bac + 5 ou équivalent **Fonction **:Doctorant **A propos du centre ou de la direction fonctionnelle**: The Inria Centre at Rennes University is one of Inria's eight centres and has more than thirty research teams. The Inria Centre is a major and...
-
Senior RF IC Design Engineer
il y a 1 mois
Rennes, France Silicon Labs Temps pleinWe are Silicon Labs. We are a leader in secure, intelligent wireless technology for a more connected world. Our integrated hardware and software platform, intuitive development tools, unmatched ecosystem and robust support make us the ideal long-term partner in building advanced industrial, commercial, home and life applications. We make it easy for...
-
Post-doctoral Research Visit F/m Post-doc in Formal
il y a 4 jours
Rennes, France Inria Temps pleinLe descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Contrat renouvelable **:Oui **Niveau de diplôme exigé **:Thèse ou équivalent **Fonction **:Post-Doctorant **A propos du centre ou de la direction fonctionnelle**: The Inria Centre at Rennes University is one of Inria's eight centres and has more than thirty research...
-
Post-doctoral Research Visit F/m Post-doc in Formal
il y a 1 mois
Rennes, France Inria Temps pleinLe descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD**Contrat renouvelable **:Oui**Niveau de diplôme exigé **:Thèse ou équivalent**Fonction **:Post-DoctorantA propos du centre ou de la direction fonctionnelle The Inria Centre at Rennes University is one of Inria's eight centres and has more than thirty research teams. The...
-
Phd Position F/m Reliable Deep Neural Network
il y a 1 mois
Rennes, France Inria Temps pleinLe descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Niveau de diplôme exigé **:Bac + 5 ou équivalent **Fonction **:Doctorant **A propos du centre ou de la direction fonctionnelle**: The Inria Rennes - Bretagne Atlantique Centre is one of Inria's eight centres and has more than thirty research teams. The Inria Center is a...
-
Senior Digital Design and Verification Engineer
il y a 1 mois
Rennes, France Silicon Labs Temps pleinWe are Silicon Labs. We are a leader in secure, intelligent wireless technology for a more connected world. Our integrated hardware and software platform, intuitive development tools, unmatched ecosystem and robust support make us the ideal long-term partner in building advanced industrial, commercial, home and life applications. We make it easy for...
-
Phd Position F/m Constructing Cyber Security
il y a 1 mois
Rennes, France Inria Temps pleinLe descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Niveau de diplôme exigé **:Bac + 5 ou équivalent **Fonction **:Doctorant **A propos du centre ou de la direction fonctionnelle**: The Inria Centre at Rennes University is one of Inria's eight centres and has more than thirty research teams. The Inria Centre is a major and...
-
Polluclim : Effects of Residual Chemical Pollution
il y a 1 mois
Rennes, France UMR 6553 Ecobio CNRS Université de Rennes Temps plein**PolluClim : Effects of residual chemical pollution on plant responses to climate change**: - Réf - **ABG-112779** - Sujet de Thèse- 31/03/2023- Contrat doctoral- UMR 6553 Ecobio CNRS Université de Rennes- Lieu de travail- Rennes - Bretagne - France- Intitulé du sujet- PolluClim : Effects of residual chemical pollution on plant responses to climate...
-
Design Engineering Manager
il y a 1 mois
Rennes, France Silicon Labs Careers Temps plein- More about Silicon Labs: We are Silicon Labs. We are the leading provider of silicon, software and solutions for a smarter, more connected world. We hire the most innovative talent in the world to solve the industry’s toughest problems, providing our customers with significant advantages in performance, energy savings, connectivity and design...
-
PhD Position F/M Trustworthy AI hardware architectures
il y a 5 jours
Rennes, France INRIA Temps pleinContexte et atouts du poste Context and background: Nowadays, there is a growing and irreversible need to distribute Artificial Intelligence (AI) applications from the cloud to edge devices, where computation is largely or completely performed on distributed Internet of Things (IoT) devices. This trend aims to address issues related to data...
-
Digital Design Engineering Manager
il y a 4 semaines
Rennes, France Silicon Labs Temps pleinWe are Silicon Labs. We are a leader in secure, intelligent wireless technology for a more connected world. Our integrated hardware and software platform, intuitive development tools, unmatched ecosystem and robust support make us the ideal long-term partner in building advanced industrial, commercial, home and life applications. We make it easy for...
-
Apprentice
il y a 2 jours
Rennes, France Avnet Temps pleinAvnet Abacus Avnet Abacus is a pan-European distributor committed to supporting customers from design to fulfilment. Avnet Abacus’ exceptional linecard features globally recognized manufacturers and an extensive product range that includes interconnect, passive, electromechanical, power supply, energy storage, wireless & sensor products and solutions....
-
Data Engineer
il y a 1 mois
Rennes, France CNAF Temps plein**Contexte**: Vous souhaitez vous engager dans une entreprise aux valeurs humaines, sociales et solidaires ? Vous souhaitez prendre part à la construction d’un SI de premier plan en France ? Pour vous, le travail d'équipe et le partage de compétences sont sources d'émulation ? Les nouvelles technologies vous inspirent ? Vous avez répondu « Oui »...
