Devops Engineer M/F Distributed Storage/Processing Ar-Chitecture For Ska Data H/F

Irfu and DEDIP are leading the PEPR (Priority Research Programme and Equipment) NumPEx (High-Performance Computing for Exascale) programme, funded by the French government's PIA (Investment Plan for the Future) and headed by the CEA, INRIA and the CNRS. Its scientific objectives are to develop innovative methods and software tools for future exascale machines and to support application domains that use HPC resources.

 In this context, DEDIP is recruiting an engineer specialising in development operations and systems (DevOps) as part of the deployment of a distributed storage and processing infrastructure for data from the  Square Kilometer Array (SKA) radio telescope, currently under construction in Australia and South Africa. This is a national infrastructure (SKA Regional Center)  that will be part of an international network (SRC Network) of data centres responsible for providing the international scientific community with access to and processing capabilities for data observed by the SKA radio telescope. The scientific challenges are significant in a variety of fields, ranging from cosmology and the origin of cosmic magnetic fields to the interstellar medium, star formation at different stages of the universe, and gravitational waves. This network will have to manage an annual data volume of around 700PB, relying not only on proven technologies but also on the implementation of innovative and high-performance technologies.

You will join a multidisciplinary team of computer engineers and physicists working within the PEPR NumPEx programme. This team, in partnership with several processing  mésocentres, national computing centres and laboratories of the CNRS and INRIA, is responsible for deploying the FRSRC (French SKA Regional Centre) infrastructure, the French node of the SRC Network. This French contribution is part of an international collaboration whose objective is to set up the SRC Network within the member countries of the  SKAO international organisation.

Your main task will be to deploy the software stack provided by SRCNet, making technological choices suited to the distributed and heterogeneous hardware infrastructure in the various data centres in France, as well as continuing to monitor and maintain the operational conditions of the services deployed by the FRSRC. The first step will be to set up a functional demonstrator at the Paris-Saclay mesocentre (in collaboration with IJCLab), before considering scaling up the architecture to other data centres.

You will also be a driving force in proposing improvements to existing processes.

LET'S TALK ABOUT YOU

• You have a master's degree or engineering degree in software engineering.
• You have in-depth knowledge of the Kubernetes container orchestration and automatic deployment system and its ecosystem (ArgoCD, Gateway API, cilium, RKE2, for example).
• You have expertise in DevOps, configuration management with Git, and continuous integration/deployment (CI/CD, GitLab)
• You have solid experience in application containerisation following best security practices.
• You have experience with tools for monitoring applications deployed in Kubernetes (Prometheus, Grafana, etc.).

Additional Assets:

• Proficiency in Linux.
• In-depth understanding of functional and integration testing
• Experience in deploying infrastructure as code (Terraform/Ansible or similar tools).
• Experience deploying in cloud environments (OpenStack).
• Knowledge of Kubernetes application packaging (Helm).Knowledge of network issues, network monitoring, security constraints, and identity and authorisation management (Indigo-IAM).
• Experience with Rucio storage virtualisation tools and the XRootD protocol.
• Proficiency in one or two scripting languages (bash, python).

You enjoy working in a multidisciplinary team and know how to be proactive.

You are pragmatic and know how to take initiative. Your analytical skills, rigour and ability to take a step back allow you to calmly tackle complex problems under multiple constraints (deadlines to meet, major technical challenges).

You are curious, adaptable and autonomous, and have good interpersonal skills.

You have excellent written and oral communication skills in both French and English and are proficient in technical English (comprehension and written and oral expression).

LET'S TALK ABOUT US

Joining the CEA means joining a public research organisation whose mission is to provide the state, businesses and local authorities with the means to meet the major challenges of our time: energy transition, climate change, the energies of tomorrow, the medicine of the future, digital technologies and defence.

Joining the CEA means becoming part of a research, development and innovation framework with a unique culture, heritage and facilities. We are also the leading French research organisation in terms of the number of patents filed

Joining the CEA also means joining a company that is committed to work-life balance (company agreement on quality of life at work, the possibility of teleworking up to three days a week, numerous sports and cultural associations thanks to our works council, CEA bus routes available to employees).

Come and be part of the CEA adventure

In accordance with the CEA's commitment to the integration of people with disabilities, this position is open to all. The CEA offers accommodations and/or organisational options to facilitate the inclusion of workers with disabilities.