Lead Data Engineer

**Open in all locations: France, Germany, the Netherlands, and the United Kingdom**

Instapro Group is actively seeking a seasoned, full stack and proactive Lead Data Engineer to bolster our dynamic team. As a Lead Data Engineer, you will spearhead the design, construction, and maintenance of our data platform, data models, analytics tools and data infrastructure. Your pivotal role involves not only developing and optimizing data pipelines but also leading one of our data engineering teams, providing technical leadership and guidance, and driving innovation in our data processes.

Your role includes the following:

- Leading and mentoring the data engineering team, ensuring best practices through technical leadership and fostering a culture of continuous improvement.
- Collaborating with cross-functional teams including Product Analysts, Data Scientists, and Product Managers to discern and address their intricate data needs, translating them into scalable and efficient data solutions.
- Architecting, developing, and implementing cutting-edge data pipelines and ELT workflows utilizing technologies such as Stitch or Fivetran, AWS Redshift, Airflow, and DBT to facilitate streamlined data processing and analysis.
- Crafting and upholding robust data models and transformations through DBT, ensuring data integrity, coherence, and quality for downstream analysis.
- Implementing and managing event tracking systems to capture user interactions and system events, facilitating real-time data analysis and insights.
- Designing and maintaining stream processing solutions using technologies such as Apache Kafka or AWS Kinesis or Apache Spark to handle real-time to near real-time data flows and processing.
- Spearheading the optimization efforts of data processes for enhanced performance, scalability, and cost efficiency, fostering rapid and dependable access to critical data.
- Engaging closely with Product Managers to assimilate data requirements into the overarching data platform design, aligning seamlessly with the product roadmap.
- Providing comprehensive support to Product Analysts and Data Scientists by furnishing them with pristine and organized datasets, thus facilitating their modeling and analysis endeavors.
- Vigilantly monitoring and rectifying data pipeline anomalies, swiftly identifying and resolving issues to mitigate disruptions to data accessibility.
- Staying abreast of industry trends and emerging technologies in data engineering, proactively recommending enhancements to our data platform.
- Driving innovation in data engineering practices, identifying opportunities for improvement, and implementing new technologies and methodologies to enhance the data platform.
- Conducting code reviews and pair programming sessions to ensure high-quality code, knowledge sharing, and adherence to best practices within the team.
- Bachelor's degree in Computer Science, Data Engineering, or a cognate field.
- Demonstrable expertise with over 7 years of hands-on experience in data engineering, with a profound focus on AWS Redshift, Airflow, DBT, Python, and SQL.
- A solid grasp of data engineering principles, ELT processes, and adeptness in data modeling techniques.
- Proven track record in crafting and optimizing data pipelines for large-scale data processing and transformation.
- Proficiency in Python and SQL scripting and programming, coupled with familiarity with Gitlab or similar version control systems.
- Exceptional problem-solving acumen and adeptness in troubleshooting and resolving data-related issues.
- Outstanding communication and collaboration skills, coupled with the ability to work harmoniously within a team and collaborate effectively with stakeholders.
- Proven experience in providing technical leadership, including setting technical standards, mentoring team members, and leading technical initiatives.
- Experience with code reviews and pair programming, promoting knowledge sharing and maintaining high code quality within the team.
- Familiarity with event tracking systems and stream processing technologies such as Apache Kafka or AWS Kinesis or Apache Spark.

Preferred Qualifications:

- Hands-on experience with cloud-based environments such as AWS, Azure, or Google Cloud Platform.
- Proficiency in data architecture and data modeling principles and best practices.
- A deep understanding of data platforms and machine learning platforms.
- Experience with data infrastructure and infrastructure-as-code tools like Terraform, ensuring scalable and maintainable data environments.
- Experience in implementing and managing CI/CD pipelines using Gitlab, ensuring efficient and reliable deployment of data engineering solutions.

**Why you’ll enjoy working at the Instapro Group**:
**You can make an Impact. **Joining Instapro Group is an opportunity to help crack the code in one of the last big industries to become digital-first. We’re leaders in our markets, yet small enough for everyone to make a real diffe