Postdoctoral Research Visit F/M Deep Generative Models for Robust and Generalizable Audio-Visual Speech Enhancement
il y a 2 semaines
Context and Key Features
This postdoctoral research position is part of the REAVISE project, a collaborative effort between INRIA and the University of Lorraine, funded by the French National Research Agency (ANR). The project aims to develop a unified audio-visual speech enhancement (AVSE) framework, leveraging recent breakthroughs in statistical signal processing, machine learning, and deep neural networks.
The postdoctoral researcher will be supervised by an associate professor at the University of Lorraine and will be part of the INRIA Grenoble team.
Background
Audio-visual speech enhancement (AVSE) aims to improve the intelligibility and quality of noisy speech signals by utilizing complementary visual information, such as lip movements. This technique is particularly useful in highly noisy environments. The advent of deep neural network (DNN) architectures has led to significant advancements in AVSE, prompting extensive research into the area.
Existing DNN-based AVSE methods are divided into supervised and unsupervised approaches. Supervised approaches involve training a DNN on a large audiovisual corpus, while unsupervised methods employ statistical modeling combined with DNNs.
Objectives
In this project, we aim to develop a robust and efficient AVSE framework by thoroughly exploring the integration of recent deep-learning architectures designed for speech enhancement. Our goal is to leverage the strengths of both supervised and unsupervised approaches, alongside cutting-edge generative modeling techniques, to bridge their gap.
The main objectives of the project are:
- Develop a neural architecture that assesses the reliability of lip images, providing a normalized reliability score at the output.
- Design deep generative models that efficiently exploit the sequential nature of data and effectively fuse audio-visual features.
- Integrate the visual reliability analysis network within the deep generative model to selectively use visual data, enabling a flexible and robust framework for audio-visual fusion and enhancement.
Requirements
The preferred profile is described below:
- Master's degree, or equivalent, in the field of speech/audio processing, computer vision, machine learning, or a related field.
- Ability to work independently as well as in a team.
- Solid programming skills (Python, PyTorch) and deep learning knowledge.
- Good level of written and spoken English.
Benefits
The position offers:
- Subsidized meals.
- Partial reimbursement of public transport costs.
- Leave: 7 weeks of annual leave + 10 extra days off due to RTT (statutory reduction in working hours) + possibility of exceptional leave.
- Possibility of teleworking (after 6 months of employment) and flexible organization of working hours.
- Professional equipment available (videoconferencing, loan of computer equipment, etc.).
- Social, cultural, and sports events and activities.
- Access to vocational training.
- Social security coverage.
Salary
2788€ gross/month.
-
Villers-lès-Nancy, Grand Est, France INRIA Temps pleinJob DescriptionContext and Key FeaturesThis postdoctoral research position is part of the REAVISE project, a collaborative effort between INRIA and the University of Lorraine to develop a unified audio-visual speech enhancement framework. The project aims to leverage recent breakthroughs in statistical signal processing, machine learning, and deep neural...
-
Villers-lès-Nancy, Grand Est, France INRIA Temps pleinJob DescriptionContext and Advantages of the PositionThis postdoctoral research position is part of the REAVISE project, a collaborative effort between INRIA and the University of Lorraine, funded by the French National Research Agency (ANR). The project aims to develop a unified audio-visual speech enhancement (AVSE) framework, leveraging recent...
-
Villers-lès-Nancy, Grand Est, France INRIA Temps pleinJob DescriptionContext and Key Features of the PositionThis postdoctoral research position is part of the REAVISE project, a collaborative effort between INRIA and the University of Lorraine, funded by the French National Research Agency (ANR). The project aims to develop a unified audio-visual speech enhancement (AVSE) framework, leveraging recent...
-
Villers-lès-Nancy, Grand Est, France INRIA Temps pleinContext and ObjectivesThis postdoctoral research position is part of the REAVISE project, a collaborative effort between INRIA and the University of Lorraine to develop a unified audio-visual speech enhancement framework. The project aims to leverage recent breakthroughs in statistical signal processing, machine learning, and deep neural networks to create a...
-
Villers-lès-Nancy, Grand Est, France INRIA Temps pleinJob DescriptionContext and Key FeaturesThis postdoctoral research position is part of the REAVISE project, a collaborative effort between INRIA and the University of Lorraine, focusing on the development of a unified audio-visual speech enhancement framework. The project aims to leverage recent breakthroughs in statistical signal processing, machine...
-
Villers-lès-Nancy, Grand Est, France INRIA Temps pleinJob DescriptionContext and Advantages of the PositionThis postdoctoral research position is part of the REAVISE project, a collaborative effort between INRIA and the University of Lorraine, funded by the French National Research Agency (ANR). The project aims to develop a unified audio-visual speech enhancement (AVSE) framework, leveraging recent...
-
Villers-lès-Nancy, Grand Est, France INRIA Temps pleinContext and strengths of the positionThis postdoctoral research is part of the REAVISE project: "Robust and Efficient Deep Learning based Audiovisual Speech Enhancement" funded by the French National Research Agency (ANR). The general objective of REAVISE is to develop a unified audio-visual speech enhancement (AVSE) framework. This will leverage recent...
-
Villers-lès-Nancy, Grand Est, France INRIA Temps pleinContext and advantages of the positionThis postdoctoral research is part of the REAVISE project: "Robust and Efficient Deep Learning based Audiovisual Speech Enhancement" funded by the French National Research Agency (ANR). The general objective of REAVISE is to develop a unified audio-visual speech enhancement (AVSE) framework. This will leverage recent...
-
Villers-lès-Nancy, Grand Est, France INRIA Temps pleinJob Context and RequirementsThis postdoctoral research position is part of the REAVISE project, a collaborative effort between INRIA and the University of Lorraine, focusing on the development of a unified audio-visual speech enhancement framework. The project aims to leverage recent breakthroughs in statistical signal processing, machine learning, and deep...
-
Villers-lès-Nancy, Grand Est, France INRIA Temps pleinJob DescriptionContext and Advantages of the PositionThis postdoctoral research position is part of the REAVISE project, a collaborative effort between INRIA and the University of Lorraine, aimed at developing a unified audio-visual speech enhancement framework. The project focuses on leveraging recent breakthroughs in statistical signal processing, machine...
-
Villers-lès-Nancy, Grand Est, France INRIA Temps pleinJob DescriptionAs a postdoctoral researcher at INRIA, you will be part of the REAVISE project, which aims to develop a unified audio-visual speech enhancement framework. This project leverages recent breakthroughs in statistical signal processing, machine learning, and deep neural networks to create a robust and efficient AVSE system.Key...
-
Villers-lès-Nancy, Grand Est, France INRIA Temps pleinJob DescriptionContext and Key FeaturesThis postdoctoral research position is part of the REAVISE project, a 3-year research initiative funded by the French National Research Agency (ANR). The project aims to develop a unified audio-visual speech enhancement framework, leveraging recent breakthroughs in statistical signal processing, machine learning, and...
-
Villers-lès-Nancy, Grand Est, France INRIA Temps pleinJob DescriptionContext and Key FeaturesThis postdoctoral research position is part of the REAVISE project, a 3-year research initiative funded by the French National Research Agency (ANR). The project aims to develop a unified audio-visual speech enhancement framework, leveraging recent breakthroughs in statistical signal processing, machine learning, and...
-
Postdoctoral Researcher in Distributed Voronoi Diagrams
il y a 3 semaines
Nancy, Grand Est, France INRIA Temps pleinJob Title: Postdoctoral Research Visit F/M Distributed Voronoi Diagrams for Large-Scale Optimal TransportWithin the framework of the COSMOGRAM project, in the PARAM project-team at INRIA, we are seeking a highly motivated postdoctoral researcher to work on developing novel algorithms for computing large-scale Voronoi diagrams on PC clusters.Context and...
-
Postdoctoral Researcher in Polymer Synthesis and Characterization
il y a 4 semaines
Nancy, Grand Est, France Université de Lorraine Temps pleinJob DescriptionThe Université de Lorraine is seeking a highly motivated Postdoctoral Researcher to join our team in the field of polymer synthesis and characterization. The successful candidate will be part of the ANR NoToBAlz project, which aims to develop nanobody thermogels for the treatment of Alzheimer's disease.Main ResponsibilitiesCharacterize...
-
Postdoctoral Researcher in Polymer Synthesis and Characterization
il y a 4 semaines
Nancy, Grand Est, France Université de Lorraine Temps pleinJob DescriptionThe Université de Lorraine is seeking a highly motivated Postdoctoral Researcher to join our team in the field of polymer synthesis and characterization. The successful candidate will be part of the ANR NoToBAlz project, which aims to develop nanobody thermogels for the treatment of Alzheimer's disease.Main ResponsibilitiesCharacterize...
-
Postdoctoral Researcher in Thermal Modeling
il y a 4 semaines
Nancy, Grand Est, France CNRS Temps pleinJob SummaryWe are seeking a highly motivated Postdoctoral Researcher to join our team at CNRS. The successful candidate will work on a project focused on thermal modeling and simulation of battery modules. The goal is to develop a precise and systemic thermal model of a battery module incorporating new materials, as well as to create virtual tools for...
-
Postdoctoral Researcher
il y a 7 jours
Nancy, Grand Est, France INRIA Temps pleinResearch PositionWithin the framework of the COSMOGRAM project, we are seeking a highly motivated Postdoctoral Researcher to join our team at INRIA. The successful candidate will be responsible for developing a novel algorithm to compute large-scale Voronoi diagrams on PC clusters, in collaboration with Bruno Lévy.Key ResponsibilitiesDesign and implement a...
-
Nancy, Grand Est, France INRIA Temps pleinJob DescriptionWithin the framework of the COSMOGRAM project, we are seeking a highly motivated Postdoctoral Researcher to join our team at INRIA. The successful candidate will be part of the PARAM project-team and will work closely with Dr. Bruno Lévy to develop a novel algorithm for computing large-scale Voronoi diagrams on PC clusters.Key...
-
Postdoctoral Researcher
il y a 4 jours
Nancy, Grand Est, France INRIA Temps pleinJob Opportunity at INRIAProject OverviewThe COSMOGRAM project, currently funded by an Inria exploratory action, aims to develop new geometric methods for computational cosmology. As part of this project, we are seeking a postdoctoral researcher to work on developing a novel algorithm for computing large-scale Voronoi diagrams on PC...
