Post-Doctoral Research Visit F/M Event detection for Large-Scale Physical Simulations
Il y a 5 mois
Contexte et atouts du poste
While artificial intelligence is growing at a fast pace, the bulk of the world’s computing power remains targeted at modeling and predicting physical phenomena, such as climate models, weather forecasting, or nuclear physics. These simulations are run on highly parallel supercomputers on which both the hardware and the software are optimized for the task at hand. While the computing power of each processing unit is still increasing, the communication networks and the storage capabilities in these clusters do not follow such fast trends. As a result, computing nodes produce outputs faster than what can be stored or sent to process elsewhere: These simulations are IO-bound .
To reduce the communication burden, a promising venue is in situ computations , meaning that most of the data is processed locally by the nodes, and only meaningful aggregates are stored or sent over the network. However, this is a difficult problem in general since to detect meaningful information for the global simulation, one often needs to detect particular events, requiring non-local information that depends on the other nodes’ output. The goal of this postdoc is to leverage machine learning techniques to bypass IO bottlenecks in the context of physics simulation on high-performance computing (HPC) clusters and help steer them optimally. This work is thus placed in a broader “Machine Learning for Science” context, which aims at using ML to solve key problems arising in traditional sciences. More specifically, we will focus on distributed event detection techniques, which critically inform where the communication and storage budget needs to be spent to retain most of the information.
Environment. The postdoc will take place in Inria Saclay, in the MIND team. This is a large team working focused on mathematical methods for statistical modeling of brain function using neuroimaging data (fMRI, MEG, EEG). Particular topics of interest include machine learning techniques, numerical and parallel optimization, applications to human cognitive neuroscience, event detection, and scientific software development. A particular emphasis is put on interdisciplinary projects. The postdoc will include frequent interaction with Virginie Grandgirard and Julien Bigot, from the CEA, who are experts in the Gysela code, a fusion plasma simulation code used in the ITER project. The supervisors are dynamic researchers, with a strong track record in machine learning, HPC and physical simulation.
This project also takes place in the PEPR NumPEx, an initiative to improve the use of supercomputers for physical simulations. The results from the postdoc will thus be integrated into the software stack for these applications. This position thus provides the unique opportunity to discuss with scientists from other fields and to improve their workflows through IA research. Interaction with scientists developing computational simulations in various fields will be encouraged.
Mission confiée
This postdoc intends to provide efficient statistical modeling tools for large distributed HPC outputs. The goal of these tools will be to help identify anomalies or errors in the data, which can indicate problems with the HPC system or the underlying algorithms. This information can then be used to adjust the computations and ensure that the HPC system is running smoothly and efficiently. Moreover, statistical processing can also be used to analyze the outputs and detect events of interest to select the right snapshots of the simulation to allow post-processing of the results. By properly selecting the information to save, we can ensure that the HPC system is able to handle large volumes of output without running into storage or bandwidth limitations.
As specified above, the project will first focus on event and anomaly detection techniques for large scale simulation. The two main objectives are the following:
• Benchmark existing methods: This will require a thorough state-of-the-art review, as well as defining the relevant metrics for evaluating event detection in physics simulations (precision/recall, distance to the event, distribution of the events...). The benchmark will be realized with benchopt [5] and will benefit from the event detection expertise of the supervisors, and from their expert knowledge in the simulations.
• Designing efficient implementation for existing methods: To account for the structure of physic simulations, we propose to investigate how to efficiently leverage the distributed in-situ framework to efficiently leverage existing event detection methods [3, 4, 8, 1].
• Looking for events with self-supervised learning: Finally, the postdoc will consider developing novel unsupervised event detection algorithms, either based on recurring patterns for common events or based on anomaly detection for rare events. Methods based both on optimization –such as convolutional dictionary learning [2] and event modeling [9]– and on deep learning –such as self-supervised object detection [7]– will be considered.
These event detection methods will be evaluated on the previously defined benchmarks, to test their efficiency in highlighting known events. They will then be integrated into the in-situ framework to test their efficiency in a real-world setting. A strong emphasis will be put on the interpretability of the detected events, to ensure that the detected events are meaningful for the scientists. To fit the requirements imposed by the HPC setting, we will consider distributed methods, that work with streaming data split over many computing nodes. An important consideration in our context is that, unlike classical data stream, the data is not i.i.d. on the nodes, but stems from the domain partitioning imposed by the physic of the problem. These considerations will benefit from the supervisors expertise in distributed optimization, for instance from the DICODILE algorithm used to scale up dictionary learning [6].
Principales activités
Main activities :
- Read papers and state of the art
- Benchmark existing algorithms
- Write problem formulation and proofs of convergence.
- Adapt the formulation to the target scenario.
- Propose a new dedicated algorithm.
- Program, run, and analyze simulation results.
Complementary activities
- Participate to the teams activities : scientific meetings, seminars, scientific presentations.
Compétences
Strong mathematical background. Knowledge in machine learning is a plus.Good programming skills in Python. Knowledge of a deep learning framework is a plus.
The candidate should be proficient in English. Knowing French is not necessary, as daily communication in the team is mostly in English due to the strong international environment.
Avantages
Subsidized meals Partial reimbursement of public transport costs Leave: 7 weeks of annual leave + 10 extra days off due to RTT (statutory reduction in working hours) + possibility of exceptional leave (sick children, moving home, etc.) Possibility of teleworking and flexible organization of working hours Professional equipment available (videoconferencing, loan of computer equipment, etc.) Social, cultural and sports events and activities Access to vocational training Social security coverage
Rémunération
2788 € gross/month
-
Palaiseau, Île-de-France INRIA Temps pleinJob Context and RequirementsThe successful candidate will be part of the MIND team at Inria Saclay, working on mathematical methods for statistical modeling of brain function using neuroimaging data. The team focuses on machine learning techniques, numerical and parallel optimization, applications to human cognitive neuroscience, event detection, and...
-
Palaiseau, Île-de-France INRIA Temps pleinContextArtificial intelligence is rapidly advancing, yet the majority of computing power remains focused on modeling and predicting physical phenomena, such as climate models, weather forecasting, or nuclear physics. These simulations are run on highly parallel supercomputers that are optimized for the task at hand. However, the communication networks and...
-
Post-doctoral Research Visit F/m Event Detection in
Il y a 3 mois
Palaiseau, France Inria Temps pleinLe descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Contrat renouvelable **:Oui **Niveau de diplôme exigé **:Thèse ou équivalent **Fonction **:Post-Doctorant **A propos du centre ou de la direction fonctionnelle**: - The Inria Saclay-Île-de-France Research Centre was established in 2008. It has developed as part of the...
-
Palaiseau, Île-de-France INRIA Temps pleinCompany OverviewINRIA, a leading French research institute, is seeking a highly skilled Post-Doctoral Researcher to join our team. We are committed to pushing the boundaries of innovation and excellence in the field of Artificial Intelligence.Job DescriptionWe are looking for a talented researcher to conduct cutting-edge research at the intersection of...
-
Palaiseau, France Institut Mines-Télécom Temps pleinWho we are ?Télécom Paris, part of the IMT (Institut Mines-Télécom) and a founding member of the Institut Polytechnique de Paris, is one of France's top 5 general engineering schools.The mainspring of Télécom Paris is to train, imagine and undertake to design digital models, technologies and solutions for a society and economy that respect people and...
-
Palaiseau, France INRIA Temps pleinContexte et atouts du poste Inria is the French national institute for research in computer science, control, and applied mathematics promoting scientific excellence and technology transfer. The research topics of pour group are at the intersection of mathematical biology, statistics, control engineering, and statistical physics applied to problems in...
-
Post-doctoral Research Visit F/m Mobility-aware
il y a 3 semaines
Palaiseau, France Inria Temps pleinLe descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Niveau de diplôme exigé **:Thèse ou équivalent **Fonction **:Post-Doctorant **A propos du centre ou de la direction fonctionnelle**: The Inria Saclay-Île-de-France Research Centre was established in 2008. It has developed as part of the Saclay site in partnership with...
-
Palaiseau, France INRIA Temps pleinContexte et atouts du poste As part of a national project on quantum computing, the aim is to develop a model for quantum computing, using graphical and categorical structures in particular. Travel is financed by the project. Mission confiée Assignments : With the help of Renaud Vilmard and Vladimir Zamdzhiev, the recruited person will be...
-
Palaiseau, France INRIA Temps pleinContexte et atouts du poste Inria is the French national institute for research in computer science, control, and applied mathematics promoting scientific excellence and technology transfer. The research topics of pour group are at the intersection of mathematical biology, statistics, control engineering, and statistical physics applied to problems in...
-
Palaiseau, France Institut Mines-Télécom Temps pleinWho we are ?Télécom Paris, part of the IMT (Institut Mines-Télécom) and a founding member of the Institut Polytechnique de Paris, is one of France's top 5 general engineering schools.The mainspring of Télécom Paris is to train, imagine and undertake to design digital models, technologies and solutions for a society and economy that respect people and...
-
Palaiseau, France Institut Mines-Télécom Temps pleinWho we are ?Télécom Paris, part of the IMT (Institut Mines-Télécom) and a founding member of the Institut Polytechnique de Paris, is one of France's top 5 general engineering schools.The mainspring of Télécom Paris is to train, imagine and undertake to design digital models, technologies and solutions for a society and economy that respect people and...
-
Palaiseau, Île-de-France INRIA Temps pleinContext and Advantages of the PositionInria, the French national institute for research in computer science, control, and applied mathematics, is seeking a postdoctoral researcher to join its team. The research topics of our group are at the intersection of mathematical biology, statistics, control engineering, and statistical physics applied to problems in...
-
Palaiseau, Île-de-France CEA Temps pleinJob Title: Research Engineer in AI-assisted Methods for Model Generation and Simulation of SoC DesignsJob Description:We are seeking a highly skilled Research Engineer to develop cutting-edge technology in the field of Electronic Design Automation (EDA). The successful candidate will be responsible for developing a simulation environment for chiplet-based...
-
S05 - Video Anomaly Detection and Understanding
Il y a 2 mois
Palaiseau, France CEA Temps pleinDescription du poste **Domaine**: - Autre **Contrat**: - Stage **Intitulé de l'offre**: - S05 - Video Anomaly Detection and Understanding H/F **Sujet de stage**: Unlike One-Class approaches, we will assume some abnormal samples can be used in training (Weakly-Supervised, Few-Shot methods). Beyond detecting anomalies, we will also address the...
-
Object Detection By Parametrization Using
Il y a 2 mois
Palaiseau, France CEA Temps pleinPosition description **Category**: - Mathematics, information, scientific, software **Contract**: - Internship **Job title**: - Object detection by parametrization using elementary 3D shapes H/F **Subject**: - Developing an object detector in images that can be parametrized with a 3D prompt made of an orchestration of elementary shapes. This detector...
-
Palaiseau, France CEA Temps pleinPosition description Category Electronics components and equipments Contract Fixed-term contract Job title Research Engineer in AI-assisted Methods for Model Generation and Simulation of SoC Designs H/F Socio-professional category Executive Contract duration (months) 24 Job description We are looking for a...
-
Palaiseau, Île-de-France INRIA Temps pleinInria, the French national institute for research in computer science, control, and applied mathematics, is seeking a highly skilled scientist to join our team. The successful candidate will be responsible for developing and applying sensitivity estimation methods for continuous-time Markov chain models of biochemical reactions inside cells that are coupled...
-
Post-doc Researcher in Formal Methods for Interference Management
il y a 3 semaines
Palaiseau, Île-de-France CEA Temps pleinJob Opportunity At CEA, we are seeking a highly skilled Post-doc Researcher to join our multidisciplinary technological research team. Job Title Post-doc Researcher in Formal Methods for Interference Management Job Description We are looking for a talented researcher to work on a national research project focused on developing an environment to...
-
Palaiseau, France Institut Mines-Télécom Temps pleinWho we are ?Télécom Paris, part of the IMT (Institut Mines-Télécom) and a founding member of the Institut Polytechnique de Paris, is one of France's top 5 general engineering schools.The mainspring of Télécom Paris is to train, imagine and undertake to design digital models, technologies and solutions for a society and economy that respect people and...
-
S05 – Video Anomaly Detection and Understanding H/F
il y a 21 heures
Palaiseau, France CEA Temps pleinDescription de l'offre S05 – Video Anomaly Detection and Understanding Internship context Based in Saclay (Essonne), the LIST is one of the two institutes of CEA Tech, the Technological Research Division of the CEA. Dedicated to intelligent digital systems, its mission is to carry out technological developments of excellence on behalf of...
