Phd Position F/m Reliable Deep Neural Network
Il y a 3 mois
Le descriptif de l’offre ci-dessous est en Anglais_
**Type de contrat **:CDD
**Niveau de diplôme exigé **:Bac + 5 ou équivalent
**Fonction **:Doctorant
**A propos du centre ou de la direction fonctionnelle**:
The Inria Rennes - Bretagne Atlantique Centre is one of Inria's eight centres and has more than thirty research teams. The Inria Center is a major and recognized player in the field of digital sciences. It is at the heart of a rich R&D and innovation ecosystem: highly innovative PMEs, large industrial groups, competitiveness clusters, research and higher education players, laboratories of excellence, technological research institute, etc.
**Contexte et atouts du poste**:
Context & background:
- increasing internet-connected IoTs, and also to alleviate the communication latency, especially for real-time safety-critical decisions, e.g., in autonomous driving.
References:
- [1] Y. LeCun, et al., “Deep learning,” Nature, vol. 521, no. 7553, pp. 436-444, May 2015, doi: 10.1038/nature14539.
[2] B. Moons, et al, “14.5 Envision: A 0.26-to-10TOPS/W subword-parallel dynamic-voltage-accuracy
- frequency
- scalable Convolutional Neural Network processor in 28nm FDSOI,” in IEEE ISSCC, 2017.
[3] C. Torres-Huitzil and B. Girau, “Fault and Error Tolerance in Neural Networks: A Review,” IEEE Access, 2017. [4] A. Lotfi et al., “Resiliency of automotive object detection networks on GPU architectures,” in IEEE ITC, 2019 [5] A. Ruospo, et al., “Investigating data representation for efficient and reliable Convolutional Neural Networks,” in Microprocessors and Microsystems, 2020
[6] F. K. Dosilovic, et al, “Explainable artificial intelligence: A survey,” in MIPRO, 2018.
[7] N. Srivastava et al., “Dropout: A simple way to prevent neural networks from overfitting,” Journal of Machine Learning Research, vol. 15, no. 1, pp. 1929-1958, 2014.
**Mission confiée**:
Ph.D. thesis goal:
- cost selective fault-tolerance strategies; (ii) designing selective fault-tolerance approaches for DNN HW accelerators by using the analysis provided by the fault injection method. The reliability improvements obtained with the above-described methodology will be measured and a design space exploration will be carried out to obtain different DNN HW accelerator implementations providing different trade-offs between fault tolerance and energy efficiency.
**Principales activités**:
More in detail, the Ph.D. student will design and develop a methodology to perform large-scale fault analysis on state-of-the-art DNN hardware architectures. The fault analysis will determine the set of malignant HW faults that mostly impact the accuracy of classification (or other DNN objectives, such as image segmentation) during the inference phase.
DNN inference is known to be very complex, especially on large models and for large datasets. Moreover, in order to obtain statistically relevant metrics about the fault impacts, a large number of faults have to be injected. Since the complexity of fault injection grows linearly with DNN inference complexity and the number of injected faults, the biggest challenge of this task will be to reduce such complexity by proposing statistical or analytical methods to prune the fault space. A first approach is profiling DNN hyper-parameters (e.g. distributions of weight values, neuron activations, arithmetic kernel computations) to determine their sensitivity to the final DNN accuracy. In general, a divide and conquer approach will be designed to reduce the fault injection complexity. “Local” (i.e. at layer/kernel levels) fault injections will be performed, to avoid running the full inference. Then, solid and efficient approaches to link the local sensitivity the global accuracy will be designed and developed.
This will allow realizing an optimized accelerated fault injector framework, enabling large-scale fault simulations. In order to further push the performances and reduce injection time, direct execution of the network (or a portion) on FPGA accelerators can also be leveraged. The enhanced fault-injection framework will allow performing several reliability assessments, such as: (a) training a faulty network to find the fault density beyond which the learning capacity starts degrading; (b) performing inference on a faulty network to be able to identify the set of malignant faults; (c) fault injection during training for passive fault tolerance; (d) fault injection attacks during the inference to evaluate the security fault tolerance can offer.
Finally, error correction mechanisms will be designed, e.g. selective low-precision triplication using checkers/voters, most-significant bits reinforcement, standby sparing and correcting codes; alternatively, if a detection mechanism is available, the re-execution of the task of a faulty component or the dynamic rescheduling/mapping of the DNN to the HW-AI (bypassing faulty components) are viable options. A design space exploration will help
-
PhD Researcher: Reliable Deep Neural Network Hardware
il y a 1 mois
Rennes, Bretagne, France INRIA Temps pleinINRIA is seeking a highly motivated PhD candidate to contribute to cutting-edge research in the field of reliable deep neural network hardware accelerators. Deep learning models are revolutionizing various industries, from healthcare and robotics to finance and entertainment. However, the increasing complexity and deployment of these models on edge devices...
-
PhD Position F/M Reliable Deep Neural Network Hardware Accelerators
il y a 1 semaine
Rennes, Bretagne, France INRIA Temps pleinContext and ObjectivesDeep Neural Networks (DNNs) are widely used in machine learning applications, but they are prone to hardware faults that can impact their accuracy and reliability. This PhD position aims to design and develop an optimized algorithm-level fault injection framework to assess the resiliency of DNN hardware accelerators to hardware faults,...
-
Rennes, Bretagne, France INRIA Temps pleinContext and ObjectivesDeep Neural Networks (DNNs) are widely used predictive models in machine learning, but they require significant energy and resources. To address this, custom Artificial Intelligence (AI) hardware accelerators are being designed to support DNNs. However, these accelerators are prone to hardware faults (HW faults) that can cause...
-
PhD Position F/M Reliable Deep Neural Network Hardware Accelerators
il y a 1 semaine
Rennes, Bretagne, France INRIA Temps pleinContext and ObjectivesDeep Neural Networks (DNNs) are widely used predictive models in machine learning, but they require significant energy and resources. To address this, custom Artificial Intelligence (AI) hardware accelerators are being designed to support DNNs. However, these accelerators are prone to hardware faults (HW faults) that can cause...
-
Rennes, Bretagne, France INRIA Temps pleinContext and ObjectivesDeep Neural Networks (DNNs) are widely used predictive models in machine learning, but they require significant energy and resources. To address this, custom Artificial Intelligence (AI) hardware accelerators are being designed to support DNNs. However, these accelerators are prone to hardware faults (HW faults) that can cause...
-
PhD Position F/M Reliable Deep Neural Network Hardware Accelerators
il y a 2 semaines
Rennes, Bretagne, France INRIA Temps pleinJob DescriptionContext and ObjectivesWe are seeking a highly motivated PhD student to join our research team at INRIA. The goal of this PhD project is to design and develop an optimized algorithm-level fault injection framework to assess the resiliency of Deep Neural Network (DNN) hardware accelerators to hardware faults. This framework will enable the...
-
PhD Position F/M Reliable Deep Neural Network Hardware Accelerators
il y a 2 semaines
Rennes, Bretagne, France INRIA Temps pleinJob DescriptionContext and ObjectivesWe are seeking a highly motivated PhD student to join our research team at INRIA. The goal of this PhD project is to design and develop an optimized algorithm-level fault injection framework to assess the resiliency of Deep Neural Network (DNN) hardware accelerators to hardware faults. The successful candidate will work...
-
Rennes, Bretagne, France INRIA Temps pleinContext and ObjectivesDeep Neural Networks (DNNs) are widely used predictive models in machine learning, but they require significant energy and resources. To address this, custom Artificial Intelligence (AI) hardware accelerators are being designed to support DNNs. However, these accelerators are prone to hardware faults that can impact their reliability...
-
Rennes, Bretagne, France INRIA Temps pleinJob DescriptionResearch ContextINRIA is seeking a highly motivated PhD student to contribute to the design and development of fault-tolerant architectures for Deep Neural Network (DNN) hardware accelerators. The goal of this project is to ensure the reliability of DNN hardware accelerators, which are critical components in various applications, including...
-
Postdoctoral Researcher in Neural-Network-Based Control
il y a 2 semaines
Rennes, Bretagne, France Mitsubishi Electric R&D Centre Europe - France Temps pleinJob Title: Postdoctoral Researcher in Neural-Network-Based ControlWe are seeking a highly motivated postdoctoral researcher to join our team at Mitsubishi Electric R&D Centre Europe - France. The successful candidate will work on a research project focused on the stability analysis of neural-network-based controllers for nonlinear time-varying dynamical...
-
Post-doctoral Researcher in Neural-Network-Based Control
il y a 4 jours
Rennes, Bretagne, France Mitsubishi Electric R&D Centre Europe - France Temps pleinJob DescriptionWe are seeking a highly motivated and experienced researcher to join our team at Mitsubishi Electric R&D Centre Europe - France. The successful candidate will work on a research project focused on the stability analysis of nonlinear systems, including neural-network-based controllers.Research Project:The goal of this project is to develop a...
-
Post-doctoral Researcher in Neural-Network-Based Control Systems
il y a 3 semaines
Rennes, Bretagne, France Mitsubishi Electric R&D Centre Europe - France Temps pleinAbout the RoleMitsubishi Electric R&D Centre Europe - France is seeking a highly skilled Post-doctoral Researcher to join our Wireless Communication Systems team. As a key member of our research team, you will be responsible for designing and developing novel neural-network-based control systems for nonlinear time-varying dynamical systems.Key...
-
Postdoctoral Researcher in Neural-Network-Based Control
il y a 3 jours
Rennes, Bretagne, France Mitsubishi Electric R&D Centre Europe - France Temps pleinJob DescriptionMitsubishi Electric R&D Centre Europe - France is seeking a highly skilled researcher to join our Wireless Communication Systems team. As a postdoctoral researcher, you will contribute to the development of novel control methods for nonlinear time-varying dynamical systems.Key ResponsibilitiesDesign and propose a generic method to design...
-
Post-doctoral Researcher in Neural-Network-Based Control Systems
il y a 3 semaines
Rennes, Bretagne, France Mitsubishi Electric R&D Centre Europe - France Temps pleinResearch Context:Mitsubishi Electric R&D Centre Europe - France is a leading research and development centre that provides advanced support to the Japanese R&D centres and business units of Mitsubishi Electric Corporation. Our Wireless Communication Systems team focuses on wireless communications for various fields, including factory automation, automotive,...
-
Rennes, France Mitsubishi Electric R&D Centre Europe - France Temps pleinSet up in the middle of the scientific campus of Rennes, the capital of Brittany, the French branch of Mitsubishi Electric R&D Centre Europe provides advanced R&D support to the Japanese R&D centres and to the business units of Mitsubishi Electric Corporation. Within the Communications and Information Systems division, our Wireless Communication Systems team...
-
Rennes, France Mitsubishi Electric R&D Centre Europe - France Temps pleinSet up in the middle of the scientific campus of Rennes, the capital of Brittany, the French branch of Mitsubishi Electric R&D Centre Europe provides advanced R&D support to the Japanese R&D centres and to the business units of Mitsubishi Electric Corporation. Within the Communications and Information Systems division, our Wireless Communication Systems team...
-
Postdoctoral Researcher in Neural-Network-Based Control Systems
il y a 2 semaines
Rennes, Bretagne, France Mitsubishi Electric R&D Centre Europe - France Temps pleinJob Opportunity at Mitsubishi Electric R&D Centre Europe - FranceWe are seeking a highly skilled Postdoctoral Researcher to join our Wireless Communication Systems team at Mitsubishi Electric R&D Centre Europe - France. The successful candidate will contribute to the development of novel control systems for nonlinear time-varying dynamical systems.Key...
-
Rennes, France Mitsubishi Electric R&D Centre Europe - France Temps pleinOverall context: Set up in the middle of the scientific campus of Rennes, the capital of Brittany, the French branch of Mitsubishi Electric R&D Centre Europe provides advanced R&D support to the Japanese R&D centres and to the business units of Mitsubishi Electric Corporation. Within the Communications and Information Systems division, our Wireless...
-
Rennes, France Mitsubishi Electric R&D Centre Europe - France Temps pleinOverall context: Set up in the middle of the scientific campus of Rennes, the capital of Brittany, the French branch of Mitsubishi Electric R&D Centre Europe provides advanced R&D support to the Japanese R&D centres and to the business units of Mitsubishi Electric Corporation. Within the Communications and Information Systems division, our Wireless...
-
Rennes, France Mitsubishi Electric R&D Centre Europe - France Temps pleinOverall context:Set up in the middle of the scientific campus of Rennes, the capital of Brittany, the French branch of Mitsubishi Electric R&D Centre Europe provides advanced R&D support to the Japanese R&D centres and to the business units of Mitsubishi Electric Corporation. Within the Communications and Information Systems division, our Wireless...
