R&D Engineer in Exascale High-Performance Computing

il y a 3 semaines


Rennes, France INRIA Temps plein

Contexte et atouts du poste

About Inria, the team and the position

Inria is the only French public research body fully dedicated to computational sciences. Inria's missions are to produce outstanding research in the computing and mathematical fields of digital sciences and to ensure its impact on the economy and society through technology transfer and innovation. Throughout its research centers and its approximately 200 project teams, Inria has a workforce of 3 400 scientists with an annual budget of 265 million euros, 29% of which coming from its own resources. The Inria Research Center at Rennes University is one of the ten sites of Inria. This publicly funded research center has a workforce of about 620 people, including full-time research scientists, faculty staff, engineers and support staff, distributed in 33 teams and support services.

The hired engineer will be a member of the KerData Inria team ( style="font-weight: 400;"> ) led by Gabriel Antoniu. KerData is a joint research team of Inria’s Research Centre at Rennes University and INSA Rennes, and also a team of the IRISA lab. KerData's main research activities address the area of distributed data management at challenging scales, with a current focus on pre-Exascale/Exascale HPC supercomputers, clouds and edge-based systems and on hybrid combinations of those. In particular, we address the needs of data-intensive high-performance applications. For this position, the engineer will be working on projects associated with Damaris, a library developed by the KerData research team as a result of a collaboration within JLESC (Joint INRIA-ANL-UIUC-BSC Lab for Extreme Scale Computing: style="font-weight: 400;"> . Damaris is a middleware for managing I/O and in situ processing of Big Data on HPC infrastructures.

The position is made available in the context of the Exa-DoST project (Data-oriented Software and Tools for the Exascale) of the NumPEx National Programme: style="font-weight: 400;"> . NumPEX aims to build the software infrastructure for the first Exascale supercomputer expected to be installed in France in 2025 (Jules Verne project).

Mission confiée

  Mission overview

By joining our team you will participate in a dynamic work environment with exceptionally talented and friendly coworkers who are committed to high-quality research and development practices. You will collaborate with esteemed researchers from around the world by taking the technical responsibility for the development of the Damaris software, with the following global missions:  

Maintain Damaris as a distributable, professional-quality software (continuous integration, technical support, documentation, management of the web site); Contribute to the design of new and improved features for Damaris. This may include enabling new and improved data processing server-side plugins, designing a Python client-side library, designing and testing improved process placement capabilities, support for dynamically triggered in situ analysis, support for GPU-based analytics, etc. Contribute to project work and dissemination actions by interacting with potential users, in particular in the context of the NumPEx National programme ( style="font-weight: 400;"> ) and the EUPEx EuroHPC JU project ( style="font-weight: 400;"> ) commitments.  Perform large-scale experiments with Damaris (while making the necessary extensions) to support its efficient execution on emerging pre-Exascale/Exascale platforms (such as EUPEX or Jules Verne, the first Exascale supercomputer expected to be installed in France).

Principales activités

Detailed missions

Improve and extend the Damaris code, perform robustness and performance tests, maintain a continuous code integration process; Create a unified data processing framework combining Damaris (as in situ/in transit data processing framework) with Big Data analytics plugins to support batch-based or stream-based data processing (e.g., currently based on components from the Python Dask ecosystem, however adding capabilities with other big-data ecosystems is of interest); Adapt Damaris to use recent advanced communication and multithreading technologies (examples: MPI_Sessions, ANL Mercury, Argobots); Develop and enhance software connectors allowing Damaris to use state-of-the-art visualization tools such as VisIt, ParaView and Ascent, and interface with other in situ libraries, such as PDI and Melissa. Extend Damaris to support other programming languages (e.g. creation of Python and/or Julia bindings). Facilitate the dissemination of Damaris and of the unified data processing framework through the following means: Design and implementation of software demonstrators in collaboration with users and project work packages;  Extend existing example codes to facilitate learning of the interface by new users;  Maintain a professional-quality website facilitating the distribution of the code and of its documentation (reference manual, user manual); Make demos at forums such as the Supercomputing conference, the main international forum of the HPC community; Create and animate a user community around the library (maintain a mailing list, a mechanism for bug report and solving, user support, etc.).

Compétences

Required qualifications

Excellent, demonstrated programming skills in C, C++, Python; Knowledge of hardware and software technologies in the area of HPC including MPI (which is a must), resource managers such as SLURM/PBS/OAR/etc., module system, multi-core and GPU based libraries and programming interfaces, use of parallel debuggers; Experience with Linux operating system, software code repository and build systems (git, GitLab/GitHub/Bitbucket, CMake, Spack); Some familiarity with big-data tools (Dask, Spark, Flink) Knowledge of methodologies for managing software projects;  Ability to analyze and synthesize user requirements; Ability to develop benchmarking suites, analyze and present results. Ability to communicate and work in collaboration with experts in the same area and in other areas, in English; Taste for transmitting and sharing knowledge, results, progress with the facility to present results in written and oral form. Autonomy in leading and performing the tasks; Sense of partnership and team spirit.

Avantages

Subsidised catering service Partially-reimbursed public transport

Rémunération

monthly gross salary from 2695 euros according to diploma and experience



  • Rennes, France Inria Temps plein

    Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Contrat renouvelable **:Oui **Niveau de diplôme exigé **:Thèse ou équivalent **Fonction **:Ingénieur scientifique contractuel **A propos du centre ou de la direction fonctionnelle**: Inria, the French national research institute for the digital sciences, promotes...


  • Rennes, Bretagne, France INRIA Temps plein

    Contexte et atouts du poste Contexte Le domaine du calcul hautes-performances vient d'atteindre une nouvelle étape, avec le dépassement du seuil exaflopique par les supercalculateurs les plus puissants du monde. Ces machines permettront de traiter de quantités de données à une échelle sans précédent, pouvant alimenter des simulations de...


  • Rennes, France INRIA Temps plein

    Contexte et atouts du poste Contexte Le domaine du calcul hautes-performances vient d’atteindre une nouvelle étape, avec le dépassement du seuil exaflopique par les supercalculateurs les plus puissants du monde. Ces machines permettront de traiter de quantités de données à une échelle sans précédent, pouvant alimenter des simulations de...


  • Rennes, France INRIA Temps plein

    Contexte et atouts du poste Contexte Le domaine du calcul hautes-performances vient d’atteindre une nouvelle étape, avec le dépassement du seuil exaflopique par les supercalculateurs les plus puissants du monde. Ces machines permettront de traiter de quantités de données à une échelle sans précédent, pouvant alimenter des simulations de...


  • Rennes, France InPixal Temps plein

    **Type of** CDI contract **Salary** From 30 k€ gross annual **As soon as** possible **Experience** All levels of experience welcome **Position status** Private sector executive **Job description**: As part of its development, INPIXAL is recruiting an engineer or technician with high versatility and capable of working within the R&D and product...


  • Rennes, Bretagne, France Mitsubishi Electric R&D Centre Europe - France Temps plein

    Context and description: MITSUBISHI ELECTRIC is one of the leading manufacturers of power electronics related products from components such as semiconductor power devices to systems such as HVDC systems. As MITSUBISHI ELECTRIC Group's subsidiary, MITSUBISHI ELECTRIC R&D CENTRE EUROPE includes a research division specialised in Power Electronics, in...

  • R&d Engineer

    il y a 3 semaines


    Rennes, France Taste RH Temps plein

    TASTE is an innovative, independent and friendly recruitment consultancy positioned since 2004 in the market of expert executives (middle-top management). _ The CEO is looking at integrating a doctoral engineer in research and with a focus in waste heat, to work alongside him to bring their current technology to the next level, through innovation and...


  • Rennes, Bretagne, France InPixal Temps plein

    Type ofCDI contractSalaryFrom 30 k€ gross annualAs soon aspossibleExperienceAll levels of experience welcomePosition statusPrivate sector executiveJob description:As part of its development, INPIXAL is recruiting an engineer or technician with high versatility and capable of working within the R&D and product development team.The position to be filled is...

  • R&D Optical Engineer

    il y a 4 jours


    Rennes, Bretagne, France CAILabs Temps plein

    Do you want to apply and enhance your optical skills through innovative technical projects in areas such as free-space laser communications? Join the R&D department at Cailabs After experience in research and development in industry or academic research, come join a dynamic team of engineers and Ph.D. holders who share your desire to apply their skills to...

  • R&D Engineer

    il y a 1 mois


    Rennes, France TASTE Temps plein

    TASTE is an innovative, independent and friendly recruitment consultancy positioned since 2004 in the market of expert executives (middle-top management).The CEO is looking at integrating a doctoral engineer in research and with a focus in waste heat, to work alongside him to bring their current technology to the next level, through innovation and...

  • R&D Engineer

    il y a 1 mois


    Rennes, Ille-et-Vilaine, France TASTE Temps plein

    TASTE is an innovative, independent and friendly recruitment consultancy positioned since 2004 in the market of expert executives (middle-top management).The CEO is looking at integrating a doctoral engineer in research and with a focus in waste heat, to work alongside him to bring their current technology to the next level, through innovation and...

  • R&D Engineer

    il y a 1 mois


    Rennes, France TASTE Temps plein

    TASTE is an innovative, independent and friendly recruitment consultancy positioned since 2004 in the market of expert executives (middle-top management).The CEO is looking at integrating a doctoral engineer in research and with a focus in waste heat, to work alongside him to bring their current technology to the next level, through innovation and...

  • R&D Engineer

    il y a 6 jours


    Rennes, France TASTE Temps plein

    TASTE is an innovative, independent and friendly recruitment consultancy positioned since 2004 in the market of expert executives (middle-top management).The CEO is looking at integrating a doctoral engineer in research and with a focus in waste heat, to work alongside him to bring their current technology to the next level, through innovation and...

  • R&d Engineer

    il y a 2 semaines


    Rennes, France Inria Temps plein

    Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD**Contrat renouvelable **:Oui**Niveau de diplôme exigé **:Thèse ou équivalent**Fonction **:Ingénieur scientifique contractuelA propos du centre ou de la direction fonctionnelle Inria, the French national research institute for the digital sciences, promotes scientific...


  • Rennes, Bretagne, France Sweetch Energy Temps plein

    About usSweetch Energy is a renewable energy player specialising in osmotic energy, committed to a carbon neutral world. Based in Rennes, our journey started in 2015 and we are proud to build a net zero future by exploiting a massively available, yet untapped, natural source of energy: osmotic power.Thanks to our INOD technology, osmotic power will become a...


  • Rennes, France Mitsubishi Electric R&D Centre Europe - France Temps plein

    Context and description:MITSUBISHI ELECTRIC is one of the leading manufacturers of power electronics related products from components such as semiconductor power devices to systems such as HVDC systems. As MITSUBISHI ELECTRIC Group’s subsidiary, MITSUBISHI ELECTRIC R&D CENTRE EUROPE includes a research division specialised in Power Electronics, in...


  • Rennes, Ille-et-Vilaine, France Mitsubishi Electric R&D Centre Europe - France Temps plein

    Context and description:MITSUBISHI ELECTRIC is one of the leading manufacturers of power electronics related products from components such as semiconductor power devices to systems such as HVDC systems. As MITSUBISHI ELECTRIC Group’s subsidiary, MITSUBISHI ELECTRIC R&D CENTRE EUROPE includes a research division specialised in Power Electronics, in...


  • Rennes, France Mitsubishi Electric R&D Centre Europe - France Temps plein

    Context and description:MITSUBISHI ELECTRIC is one of the leading manufacturers of power electronics related products from components such as semiconductor power devices to systems such as HVDC systems. As MITSUBISHI ELECTRIC Group’s subsidiary, MITSUBISHI ELECTRIC R&D CENTRE EUROPE includes a research division specialised in Power Electronics, in...


  • Rennes, France Mitsubishi Electric R&D Centre Europe - France Temps plein

    Context and description:MITSUBISHI ELECTRIC is one of the leading manufacturers of power electronics related products from components such as semiconductor power devices to systems such as HVDC systems. As MITSUBISHI ELECTRIC Group’s subsidiary, MITSUBISHI ELECTRIC R&D CENTRE EUROPE includes a research division specialised in Power Electronics, in...

  • R&d Engineer

    Il y a 2 mois


    Rennes, France Taste RH Temps plein

    TASTE is an innovative, independent and friendly recruitment consultancy positioned since 2004 in the market of expert executives (middle-top management)._ The CEO is looking at integrating a doctoral engineer in research to work alongside him to bring their current technology to the next level through innovation and experimentation in order to have a...