Senior DataOps Engineer: Data Mesh
Il y a 5 heures
Paris, Île-de-France
EngineersOfAI
Temps plein
Gratuit avec email ou Google
Enregistrez cette offre et organisez votre recherche
Créez un compte gratuit pour enregistrer des offres d'emploi, créer des alertes et revenir à cette liste depuis votre tableau de bord.
Gratuit avec email ou Google
En continuant, vous acceptez nos Conditions d’utilisation & Politique de confidentialité.
We are looking for a Senior DataOps Engineer to join the Data and AI Platform team.Your mission will be to improve and maintain an efficient, reliable and scalable platform that enables Data Product developers and owners to develop, deploy and maintain their data products autonomously, at scale, with clear and maintained interfaces and full observability — ensuring seamless data flow across the organisation and enabling data-driven decision-making.Working in the tech team at Doctolib means building innovative products and features to improve the daily lives of care teams and patients.What you'll doYour responsibilities include but are not limited to:
- Maintain the Data Product Controller to give stakeholders full responsibility for managing their data products in an automated way (via CI/CD and infrastructure as code) — securely, reliably, and with full ownership
- Maintain the Data and AI Platform orchestrator (Dagster) to enable Data Product developers to orchestrate their data products in a decentralised way (Data Mesh), with ownership over their release process and job pipelines
- Monitor the data platform for performance and reliability, identify and troubleshoot issues, and implement proactive solutions to ensure availability
- Offer observability components to empower developer teams and data product consumers with the right level of insight into costs, data quality, and data lineage
- Monitor platform costs, identify optimisation and saving opportunities, and collaborate with data engineers, data scientists, and other stakeholders
- Contribute to the continuous improvement of platform architecture, scalability, and developer experience across teams
- Have more than 5 years of experience as a DataOps Engineer or in a similar role, with a proven track record of building and maintaining complex data infrastructures
- Have strong proficiency in data engineering and infrastructure tools and technologies (Kubernetes, ArgoCD, Crossplane)
- Have expertise in programming languages like Python
- Are familiar with cloud infrastructure and services, pre