Internship: Python Data Processing On

Il y a 2 mois

SaintMartind'Hères, France Inria Temps plein

Le descriptif de l’offre ci-dessous est en Anglais_

**Type de contrat **:Convention de stage

**Niveau de diplôme exigé **:Bac + 4 ou équivalent

**Fonction **:Stagiaire de la recherche

**A propos du centre ou de la direction fonctionnelle**:
The Centre Inria de l’Université de Grenoble groups together almost 600 people in 23 research teams and 9 research support departments.

Staff is present on three campuses in Grenoble, in close collaboration with other research and higher education institutions (Université Grenoble Alpes, CNRS, CEA, INRAE,), but also with key economic players in the area.

The Centre Inria de l’Université Grenoble Alpe is active in the fields of high-performance computing, verification and embedded systems, modeling of the environment at multiple levels, and data science and artificial intelligence. The center is a top-level scientific institute with an extensive network of international collaborations in Europe and the rest of the world.

**Contexte et atouts du poste**:
The length of the internship is _4 months minimum_ and the start date is flexible, but need a 2 month delay before starting the interhsip due to administrative constraints. The DataMove team is a friendly and stimulating environment that gathers Professors, Researchers, PhD and Master students all leading research on High-Performance Computing. The city of Grenoble is a student-friendly city surrounded by the Alps mountains, offering a high quality of life and where you can experience all kinds of mountain-related outdoor activities.

**Mission confiée**:
Without a significant change in practices, the increased computing capacity of the next generation of computers will lead to an explosion in the volume of data produced by numerical simulations. Managing this data, from production to analysis, is a major challenge.

The use of simulation results is based on a well-established calculation-storage-calculation protocol. The difference in capacity between computers and file systems makes it inevitable that the latter will be clogged. For instance, the Gysela code in production mode can produce up to 5TB of data per iteration. It is obvious that storing 5TB of data is not feasible at high frequency. What's more, loading this quantity of data for later analysis and visualization is also a difficult task. To bypass this difficulty, we choose to rely on the in situ data analysis approach.

In situ consists in coupling the parallel simulation code, Gysela for instance, with a data analytics code that processes the data online, as soon as produced. In situ enables reducing the amount of data to write to disk, limiting the pressure on the file system. This is a mandatory approach to run massive simulations like Gysela on the latest Exascale supercomputers.

We developed an in situ data processing approach, called Deisa, relying on Dask, a Python environment for distributed tasks. Dask defines tasks that are executed asynchronously on workers once their input data are available. The user defines a graph of tasks to be executed. This graph is then forwarded to the Dask scheduler. The scheduler is in charge of (1) optimizing the task graph and (2) distributing the tasks for execution on the different workers according to a scheduling algorithm aiming at minimizing the graph execution time.

Deisa extends Dask so it becomes possible to couple a MPI-based parallel simulation code with Dask. Deisa enables the simulation code to directly send newly produced data into the worker memories, notify the Dask scheduler that these data are available for analysis and that associated tasks can then be scheduled for execution.

Compared to previous in situ approaches that are mainly MPI-based, our approach relying on Python tasks makes for a good tradeoff between programming ease and runtime performance.

The goal of this internship is to investigate solutions to improve task placement and thus performance enabling tasks to be scheduled in process (into the simulation processes), in situ (running on external processes but on the same compute nodes that also run the simulation code), in transit (on dedicated nodes different from the simulation nodes). Running closer to the simulation reduces the need for data movements, but can potentially steal resources (CPU, GPU, network, memory, cache) from the simulation and slow it down. Dask task graph optimization is a good starting point to develop such approaches.

**References**

**Principales activités**:
**Compétences**:
Expected skills include
- Knowledge on distributed, parallel computing and numerical simulations.
- Python, Numpy, Parallel programming (MPI)
- English (working language)

**Avantages**:

- Subsidized meals
- Partial reimbursement of public transport costs
- Leave: 7 weeks of annual leave + 10 extra days off due to RTT (statutory reduction in working hours) + possibility of exceptional leave (sick children, moving home, etc.)
- Possibility of teleworking (90 days /

  • Internship: Combining Transformers and Normalizing

    Il y a 2 mois

    Saint-Martin-d'Hères (38), France Inria Temps plein

    Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:Convention de stage **Niveau de diplôme exigé **:Bac + 4 ou équivalent **Fonction **:Stagiaire de la recherche **A propos du centre ou de la direction fonctionnelle**: The Centre Inria de l’Université de Grenoble groups together almost 600 people in 23 research teams and 9...

  • Development & Research Engineer @ Alpes-Grenoble: Deep and Shallow Parallel Data Processing on Supercomputers

    il y a 6 jours

    Saint-Martin-d'Hères, Isère, France Inria Temps plein

    A propos du centre ou de la direction fonctionnelle The Centre Inria de l'Université de Grenoble groups together almost 600 people in 22 research teams and 7 research support departments. Staff is present on three campuses in Grenoble, in close collaboration with other research and higher education institutions (Université Grenoble Alpes, CNRS,...

  • Internship: Adaptive Sampling for Training Deep

    Il y a 2 mois

    Saint-Martin-d'Hères (38), France Inria Temps plein

    Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:Convention de stage **Niveau de diplôme exigé **:Bac + 4 ou équivalent **Fonction **:Stagiaire de la recherche **A propos du centre ou de la direction fonctionnelle**: The Centre Inria de l’Université de Grenoble groups together almost 600 people in 23 research teams and 9...

  • Internship : Indoor Visual Positioning

    Il y a 6 mois

    Montbonnot-Saint-Martin, France Inria Temps plein

    Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:Stage**Niveau de diplôme exigé **:Bac + 3 ou équivalent**Fonction **:Stagiaire de la rechercheA propos du centre ou de la direction fonctionnelle The Centre Inria de l’Université de Grenoble groups together almost 600 people in 22 research teams and 7 research support...

  • Fba Data Service Internship

    Il y a 3 mois

    Saint-Michel-sur-Orge, France ING Temps plein

    Your role & work environment Within the Finance Business Advice (FBA) department, FBA Data Services team is a pro-active partner empowering the business with valuable and reconciled Management Information concerning P&L and Balance Sheet at overall bank or product and client segment level. As an internship in FBA Data Service you will help to interact with...

  • Ai Internship

    Il y a 6 mois

    Saint-Ouen, France ALSTOM Temps plein

    Req ID:458209 At Alstom, we understand transport networks and what moves people. From high-speed trains, metros, monorails, and trams, to turnkey systems, services, infrastructure, signalling and digital mobility, we offer our diverse customers the broadest portfolio in the industry. Every day, more than 80 000 colleagues lead the way to greener and smarter...

  • Python Software Engineer, Internship

    il y a 3 jours

    Saint-Denis, France AQEMIA Temps plein

    Our unique approach leverages quantum-inspired physics algorithms to power generative AI in designing novel drug candidates—without relying on experimental data. We are looking for a Scientific Software Developer to strengthen our computational capabilities, enabling the development and optimization of drug candidates. Our team is composed of skilled...

  • Research & Development Engineer H/F

    il y a 6 jours

    Saint-Martin-d'Hères, Isère, France Inria Temps plein

    A propos du centre ou de la direction fonctionnelle The Centre Inria de l'Université de Grenoble groups together almost 600 people in 22 research teams and 7 research support departments. Staff is present on three campuses in Grenoble, in close collaboration with other research and higher education institutions (Université Grenoble Alpes, CNRS,...

  • Internship - Data Acculturation

    Il y a 3 mois

    Saint-Ouen, France Allianz Temps plein

    Internship - Data Acculturation **Key responsibilities** As an Intern in Data Acculturation you will contribute to the definition and implementation of the data acculturation plan, in collaboration with the Data & Analytics team and the organization's various stakeholders. Also, you will identify the specific needs of the different types of people involved...

  • Internship@grenoble: The Ai Pac-man

    il y a 5 heures

    Saint-Martin-d'Hères, France Inria Temps plein

    _Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat**: Convention de stage **Niveau de diplôme exigé**: Bac + 4 ou équivalent **Fonction**: Stagiaire de la recherche **A propos du centre ou de la direction fonctionnelle**: The Centre Inria de l’Université de Grenoble groups together almost 600 people in 23 research teams and 9...

  • Data Scientist Llm

    il y a 3 jours

    Saint-Jean, 31240, France MP DATA Temps plein

    Dans un contexte de croissance de nos activités, nous recherchons un(e) **Data Scientist LLM** pour rejoindre notre équipe toulousaine et intervenir sur un projet autour de l'IA Générative.Votre rôle sera notamment de : * Intégrer des solutions d'IA et développer des systèmes RAG (Retrieval Augmented Generation) * Intervenir sur la mise en...

  • 2 Internship Opportunities for Enhanced

    il y a 1 mois

    Montbonnot-Saint-Martin, France Unity Semiconductor Temps plein

    **Internship Opportunities: Advanced Computational Imaging for Enhanced Semiconductor Metrology***: At Unity SC, we offer a six-month internship within our Optical Research and Development team. This role is an exciting chance to dive into cutting-edge optical and computational imaging techniques applied to semiconductor metrology. As an intern, you will...

  • Lead data engineer

    il y a 6 jours

    Saint-Herblain, Loire-Atlantique, France RCA Temps plein

    Description de l'entreprise Editeur de logiciels 100% autonome, basé en périphérie de Nantes, RCA développe deux gammes de logiciels : Une gamme de 13 logiciels à destination des cabinets d'expertise comptable et une plateforme digitale collaborative en mode SaaS destinée aux experts-comptables ainsi qu'à leurs clients (TPE/PME). Depuis 15 ans, la...

  • High Performance Data Engineer for Advanced Computing Projects

    il y a 3 jours

    Saint-Martin-d’Hères, Auvergne-Rhône-Alpes, France Inria Temps plein

    The Centre Inria de l'Université de Grenoble is a leading scientific institute with a strong network of international collaborations in Europe and the world.We are seeking an experienced High Performance Data Engineer to join our team and contribute to the development of advanced analysis scenarios, including performance improvement, novel features...

  • Spécialiste en Intelligence Artificielle pour MP DATA

    il y a 1 semaine

    Saint-Jean-de-Védas, Occitanie, France MP DATA Temps plein

    ContexteNous sommes une équipe de data science composée d'experts qui mettent au point des modèles performants et qui communique efficacement avec les parties prenantes.SalaireEntre 60 000 € et 80 000 € par anDescription du posteNous recherchons un(e) Data Scientist capable de s'intégrer dans notre équipe toulousaine.Compétences...

  • Data Analyst

    Il y a 6 mois

    Saint-Ouen, France Samsung Electronics Temps plein

    Position Summary 6 months from now (ASAP) Saint-Ouen, 93 Samsung, an international company You're probably familiar with our TVs, our Smartphones and even our household appliances, but did you know that Samsung has become one of the 10 largest and most profitable companies in the world, with activities ranging from cutting-edge technology,...

  • Internship - Data Acculturation (Saint-ouen

    Il y a 2 mois

    Saint-Ouen, France Allianz Temps plein

    Internship - Data Acculturation (Saint-Ouen (Paris), 93, FR, 93400) **Key responsibilities** As an Intern in Data Acculturation you will contribute to the definition and implementation of the data acculturation plan, in collaboration with the Data & Analytics team and the organization's various stakeholders. Also, you will identify the specific needs of...

  • Data Engineer SPA Vue.js, Node.js Python Flask

    Il y a 3 mois

    Saint-Denis, France WorldWide People Temps plein

    Data Engineer SPA vue.js, node.js Python Flask ? Pandas ? Plotly POO Big Data Maîtrise des langages de développement front-end (SPA vue.js, node.js) Pratiques de développement et déploiement continue (Gitlab, Docker, SonarQube, CheckMarx, ?) Maîtrise des langages d?analyse et de traitement de données (Python Flask ? Pandas ? Plotly?etc) en POO...

  • Backend Software Engineering Intern

    il y a 1 mois

    Montbonnot-Saint-Martin, France Moody's Temps plein

    **Location(s)**: - 20 Rue Lavoisier, Montbonnot Saint Martin, 38330, FR **Line Of Business**: Banking OU(BANKING OU) **Entity**: Moody's Analytics(MA) **Job Category**: - Students & Early Careers **Experience Level**: Early Career Backend Software Engineer Job ID 5995 - Banking OU, Risk and Finance Solutions - Grenoble - Full Time At Moody's, we...

  • Stage - Data Scientist / Data Engineer

    il y a 5 jours

    Saint-Denis, France Generali France Temps plein

    **Date**:11 déc. 2024 **Lieu de travail**: ST DENIS, FR, 93210 **Entreprise**:GENERALI VIE **STAGE - DATA SCIENTIST / DATA ENGINEER** - **F/H** Référence : 11818 STAGIAIRE Saint Denis ou Nantes **Generali** Avec plus de 70 millions de clients et un chiffre d’affaires de 82,5 milliards d’euros en 2023, Generali est l’un des leaders de...