Lead Data Engineer
Il y a 24 heures
Fresnes, Ile-de-France
EPEX SPOT
Temps plein
Gratuit avec email ou Google
Enregistrez cette offre et organisez votre recherche
Créez un compte gratuit pour enregistrer des offres d'emploi, créer des alertes et revenir à cette liste depuis votre tableau de bord.
Gratuit avec email ou Google
En continuant, vous acceptez nos Conditions d’utilisation & Politique de confidentialité.
Join the EPEX SPOT Team: Innovate, Collaborate, Thrive
Job Summary:
As a Lead Data Engineer, you will play a pivotal role in designing, developing, and evolving EPEX SPOT's cloud-native Data Platform on Google Cloud Platform (GCP). You will combine hands-on engineering expertise with technical leadership, helping deliver trusted, scalable, and AI-ready data products that support business operations, analytics, and innovation initiatives.
Acting as a technical leader within the Data Platform team, you will coach and mentor Data Engineers, drive engineering excellence, and contribute to the adoption of modern data platform capabilities such as BigQuery, Dataform, Dataplex, Dataflow, BigLake, and Vertex AI.
Working in a highly collaborative Agile environment, you will partner closely with Product Owners, Architects, Data Analysts, Data Scientists, Security teams, and other platform teams to deliver business value while ensuring platform reliability, governance, and scalability.
Your scope will include:
• Enterprise Data Platform development and operations
• Data ingestion, processing, and analytics enablement
• Data Governance and Data Product implementation
• AI and Machine Learning enablement
• Coaching and technical leadership within the Data Engineering team
• Cross-team collaboration and alignment in an Agile environment
Key Responsibilities
1. Lead Data Engineering Delivery
• Drive the design, development, deployment, and continuous improvement of enterprise-scale data solutions by:
• Designing and implementing scalable data pipelines and data products
• Building robust batch and streaming data processing solutions
• Ensuring platform reliability, performance, security, and cost efficiency
• Supporting architecture decisions and technical roadmap execution
• Acting as the technical escalation point for complex engineering challenges 2. Coach and Develop Data Engineers
• Promote engineering excellence across the Data Platform team by:
• Coaching and mentoring Data Engineers in technical and professional growth
• Conducting code reviews and design reviews
• Encouraging knowledge sharing and continuous learning
• Supporting onboarding and development of new team members
• Driving adoption of engineering standards and best practices 3. Enable Data Governance and Self-Service Data Products
• Support the delivery of trusted and governed data assets by:
• Implementing governance capabilities using Google Dataplex
• Supporting metadata management, lineage, cataloguing, and data quality initiatives
• Ensuring compliance with security, privacy, and regulatory requirements
• Enabling self-service analytics through reusable and governed data products 4. Foster Agile Collaboration and Platform Alignment
• Collaborate effectively within Agile product teams and across the technology landscape:
• Promoting DevOps and DataOps practices
• Supporting a culture of transparency, ownership, and continuous improvement 5. Contribute to EPEX SPOT's AI and Data innovation ambitions by:
• Building data foundations for analytics and AI use cases
• Supporting the integration of Vertex AI and related AI services
• Collaborating with Data Scientists to operationalize Machine Learning solutions Key Requirements Hard Skills Google Cloud Data Platform Expertise
• Strong hands-on experience with:
• BigQuery
• Dataform
• Dataplex (catalog, lineage, data quality, tag application)
• Data lake and Lakehouse implementation on GCP: Cloud Storage, external tables, BigLake, and the trade-offs between external and materialized data
• Cloud Composer /Cloud Workflows
• Cloud Run /Functions
• IAM and Security Services
• Cloud Monitoring and observability
• Dataflow Data Engineering
• ELT/ETL architecture and implementation
• API-based data integration
• Data Contract implementation in the pipeline (assertions, quality checks, validation at build time)
• Real-time and streaming architecture
• Metadata management and data lineage
• Data quality management
• Event-driven architectures Engineering Practices
• AI-assisted engineering: proficient with GCP AI assistance (Gemini in BigQuery, Gemini Code Assist) and able to coach the data engineers on using it productively and safely
• Python
• SQL
• Infrastructure as Code (Terraform preferred)
• CI/CD pipelines
• Git and version control
• DevOps and DataOps practices
• Platform monitoring and observability
• Performance optimization and cost management Agile Delivery
• Proven experience working in Agile environments Soft Skills
• Strong technical leader who drives results through expertise, influence, and a passion for developing engineering talent.
• Excellent communicator and collaborator, able to engage effectively with both technical and non-technical stakeholders in international environments.
• Combines a proactive, analytical, and continuous improvement mindset with a strong sense of ownership, accountability, and a commitment to delivering high-quality business value. Education & Experience
• Bachelor's or Master's degree in Computer Science, Software Engineering, Information Technology, Data Engineering, or a related field.
• Minimum 7 years of experience in Data Engineering, Software Engineering, or a related discipline.
• Proven experience building and operating cloud-native data platforms.
• Strong hands-on experience with Google Cloud Platform data services.
• Demonstrated experience coaching and mentoring Data Engineers.
• Experience implementing data governance and data quality frameworks.
• Experience working in Agile teams and collaborating across multiple product and platform teams.
• Preferred certifications: -Google Professional Data Engineer -Google Professional Cloud Architect -Google Professional Machine Learning Engineer -Terraform Associate
Location:
Your work location will preferably be Paris, with no specific restriction amongst other EPEX office locations and an attractive hybrid work policy. Who Are We? The European Power Exchange EPEX SPOT SE operates physical short-term electricity markets in Central Western Europe, the United Kingdom, Switzerland, the Nordics and in Poland. Furthermore, EPEX SPOT newly offers local flexibility markets solution and Guarantees of Origin auctions, to foster the integration of renewable energy sources and to enhance the engagement of consumers and producers in the power market. The heart of our business is to bring together electricity supply and demand across Europe. We shape the future of the European power market by supporting decarbonization, decentralization, digitalization and contributing to the global energy transition toward a sustainable future. At EPEX SPOT, we believe in fostering a vibrant and inclusive culture where every team member can thrive. Our core values— trustful teams, innovation & agility, and customer centricity— are the foundation of everything we do. Diversity is the cornerstone of our way of working, reflected in how we face challenges and work together as unique individuals to build a stronger organization. Our DNA is embedded in continuous improvement via constructive feedback, collaboration among colleagues and transparency culture. We believe in true leadership, supporting our vision towards the energy transition, as well as the development of our People. Why join EPEX SPOT? At EPEX SPOT, you'll be part of a passionate, talented, and international team dedicated to shaping the future of the European power market. Our offices and inclusive workplaces throughout Europe celebrate diversity and support our employees to unfold their full potential.
We offer
a decentralized working system with an appealing Home Office and Hybrid Working setup, serving individuals’ self-determination of working conditions. Our goal-oriented, trustworthy, and flexible approach, given our multicultural environment, allows our employees’ to find a suited work-life balance. We strive for leadership development and provide the right support through an active and modern remote and hybrid teamwork. We provide numerous career opportunities within the company and within EEX Group, granting a platform for continuous growth that puts you in the driver’s seat of your career. We are proud of our commitment to gender equality, demonstrated by our strong performance in the gender-equality-index-at-epex-spot. Our HR strategy focuses on our People and Organization, enhancing both motivation and employability, while equally developing individuals’ skills. Join us at EPEX SPOT and become part of a forward-thinking company where your contributions will make a significant impact, for the energy transition as well as for your career Discover more
about us
and explore career opportunities at https://www.epexspot.com/en Benefits of working with Us:
• Hybrid Working
Conditions:
We offer
you the flexibility of working from home or other locations for the best possible work-life balance.
• Training Opportunities: We invest in your continuous development with a dedicated annual training budget to enhance your skills through various upskilling programs and initiatives.
• Career Path: We support your career aspirations with clear pathways for advancement within the company and the EEX Group.
• Internal Mobility:
We offer
and support the possibility to explore new roles within the company to expand your skills and experience.
• Leadership Journey: We promote a culture of recognition and reward with the EPEX SPOT leadership journey that encourages everyone’s progression and development.
• Enterprise Data Platform development and operations
• Data ingestion, processing, and analytics enablement
• Data Governance and Data Product implementation
• AI and Machine Learning enablement
• Coaching and technical leadership within the Data Engineering team
• Cross-team collaboration and alignment in an Agile environment
Key Responsibilities
1. Lead Data Engineering Delivery
• Drive the design, development, deployment, and continuous improvement of enterprise-scale data solutions by:
• Designing and implementing scalable data pipelines and data products
• Building robust batch and streaming data processing solutions
• Ensuring platform reliability, performance, security, and cost efficiency
• Supporting architecture decisions and technical roadmap execution
• Acting as the technical escalation point for complex engineering challenges 2. Coach and Develop Data Engineers
• Promote engineering excellence across the Data Platform team by:
• Coaching and mentoring Data Engineers in technical and professional growth
• Conducting code reviews and design reviews
• Encouraging knowledge sharing and continuous learning
• Supporting onboarding and development of new team members
• Driving adoption of engineering standards and best practices 3. Enable Data Governance and Self-Service Data Products
• Support the delivery of trusted and governed data assets by:
• Implementing governance capabilities using Google Dataplex
• Supporting metadata management, lineage, cataloguing, and data quality initiatives
• Ensuring compliance with security, privacy, and regulatory requirements
• Enabling self-service analytics through reusable and governed data products 4. Foster Agile Collaboration and Platform Alignment
• Collaborate effectively within Agile product teams and across the technology landscape:
• Promoting DevOps and DataOps practices
• Supporting a culture of transparency, ownership, and continuous improvement 5. Contribute to EPEX SPOT's AI and Data innovation ambitions by:
• Building data foundations for analytics and AI use cases
• Supporting the integration of Vertex AI and related AI services
• Collaborating with Data Scientists to operationalize Machine Learning solutions Key Requirements Hard Skills Google Cloud Data Platform Expertise
• Strong hands-on experience with:
• BigQuery
• Dataform
• Dataplex (catalog, lineage, data quality, tag application)
• Data lake and Lakehouse implementation on GCP: Cloud Storage, external tables, BigLake, and the trade-offs between external and materialized data
• Cloud Composer /Cloud Workflows
• Cloud Run /Functions
• IAM and Security Services
• Cloud Monitoring and observability
• Dataflow Data Engineering
• ELT/ETL architecture and implementation
• API-based data integration
• Data Contract implementation in the pipeline (assertions, quality checks, validation at build time)
• Real-time and streaming architecture
• Metadata management and data lineage
• Data quality management
• Event-driven architectures Engineering Practices
• AI-assisted engineering: proficient with GCP AI assistance (Gemini in BigQuery, Gemini Code Assist) and able to coach the data engineers on using it productively and safely
• Python
• SQL
• Infrastructure as Code (Terraform preferred)
• CI/CD pipelines
• Git and version control
• DevOps and DataOps practices
• Platform monitoring and observability
• Performance optimization and cost management Agile Delivery
• Proven experience working in Agile environments Soft Skills
• Strong technical leader who drives results through expertise, influence, and a passion for developing engineering talent.
• Excellent communicator and collaborator, able to engage effectively with both technical and non-technical stakeholders in international environments.
• Combines a proactive, analytical, and continuous improvement mindset with a strong sense of ownership, accountability, and a commitment to delivering high-quality business value. Education & Experience
• Bachelor's or Master's degree in Computer Science, Software Engineering, Information Technology, Data Engineering, or a related field.
• Minimum 7 years of experience in Data Engineering, Software Engineering, or a related discipline.
• Proven experience building and operating cloud-native data platforms.
• Strong hands-on experience with Google Cloud Platform data services.
• Demonstrated experience coaching and mentoring Data Engineers.
• Experience implementing data governance and data quality frameworks.
• Experience working in Agile teams and collaborating across multiple product and platform teams.
• Preferred certifications: -Google Professional Data Engineer -Google Professional Cloud Architect -Google Professional Machine Learning Engineer -Terraform Associate
Location:
Your work location will preferably be Paris, with no specific restriction amongst other EPEX office locations and an attractive hybrid work policy. Who Are We? The European Power Exchange EPEX SPOT SE operates physical short-term electricity markets in Central Western Europe, the United Kingdom, Switzerland, the Nordics and in Poland. Furthermore, EPEX SPOT newly offers local flexibility markets solution and Guarantees of Origin auctions, to foster the integration of renewable energy sources and to enhance the engagement of consumers and producers in the power market. The heart of our business is to bring together electricity supply and demand across Europe. We shape the future of the European power market by supporting decarbonization, decentralization, digitalization and contributing to the global energy transition toward a sustainable future. At EPEX SPOT, we believe in fostering a vibrant and inclusive culture where every team member can thrive. Our core values— trustful teams, innovation & agility, and customer centricity— are the foundation of everything we do. Diversity is the cornerstone of our way of working, reflected in how we face challenges and work together as unique individuals to build a stronger organization. Our DNA is embedded in continuous improvement via constructive feedback, collaboration among colleagues and transparency culture. We believe in true leadership, supporting our vision towards the energy transition, as well as the development of our People. Why join EPEX SPOT? At EPEX SPOT, you'll be part of a passionate, talented, and international team dedicated to shaping the future of the European power market. Our offices and inclusive workplaces throughout Europe celebrate diversity and support our employees to unfold their full potential.
We offer
a decentralized working system with an appealing Home Office and Hybrid Working setup, serving individuals’ self-determination of working conditions. Our goal-oriented, trustworthy, and flexible approach, given our multicultural environment, allows our employees’ to find a suited work-life balance. We strive for leadership development and provide the right support through an active and modern remote and hybrid teamwork. We provide numerous career opportunities within the company and within EEX Group, granting a platform for continuous growth that puts you in the driver’s seat of your career. We are proud of our commitment to gender equality, demonstrated by our strong performance in the gender-equality-index-at-epex-spot. Our HR strategy focuses on our People and Organization, enhancing both motivation and employability, while equally developing individuals’ skills. Join us at EPEX SPOT and become part of a forward-thinking company where your contributions will make a significant impact, for the energy transition as well as for your career Discover more
about us
and explore career opportunities at https://www.epexspot.com/en Benefits of working with Us:
• Hybrid Working
Conditions:
We offer
you the flexibility of working from home or other locations for the best possible work-life balance.
• Training Opportunities: We invest in your continuous development with a dedicated annual training budget to enhance your skills through various upskilling programs and initiatives.
• Career Path: We support your career aspirations with clear pathways for advancement within the company and the EEX Group.
• Internal Mobility:
We offer
and support the possibility to explore new roles within the company to expand your skills and experience.
• Leadership Journey: We promote a culture of recognition and reward with the EPEX SPOT leadership journey that encourages everyone’s progression and development.