Staff Data Engineer

il y a 1 jour


Paris, Île-de-France Kpler Temps plein
About the Role

We are seeking a highly skilled Staff Engineer to join our Market Data team at Kpler. As a Staff Engineer, you will play a key role in upgrading our data pipelines to the next level of quality and reliability, designing and implementing APIs, pipelines, and read models to publish our datasets, and maintaining and optimizing our datasets and their schemas.

Key Responsibilities
  • Contribute to the roadmap in collaboration with Product Owners and Engineering Managers to upgrade our data pipelines to the next level of quality and reliability.
  • Design and implement RESTful APIs to publish our datasets.
  • Maintain and optimize our datasets and their schemas to ensure data integrity and availability to our consumers.
  • Provide state-of-the-art environments and tools to support the development team.
  • Share expertise with team members, bringing help and guidance when needed, and connect to other engineers to bring insights to help re-architect existing systems for scale and extensibility.
Requirements
  • At least 8 years of experience as a Software Engineer / Data Engineer, including significant hands-on experience with using Kafka and Scala in a production environment, especially with Cats or Spark.
  • Experience with DevOps and Infrastructure as Code practices, especially on AWS.
  • Experience with Data Processing Orchestration (Airflow).
  • Fluency in English and experience working in an international environment.
Preferred Qualifications
  • Experience with Functional Programming frameworks such as fs2.
  • Big Data Management: DeltaLake, Medallion, Lineage.
  • Terraform, gitops, Kubernetes.
  • Machine learning, OCR, NLP.
  • ElasticSearch, GraphQL.
  • Python.
  • SQL schema and PostgreSQL optimizations.
  • AWS WAF principles.
About Kpler

We are a dynamic company dedicated to nurturing connections and innovating solutions to tackle market challenges head-on. We believe that different perspectives lead to better ideas, and better ideas allow us to better understand the needs and interests of our diverse, global community. We welcome people of different backgrounds, experiences, abilities, and perspectives and are an equal opportunity employer.

We are committed to providing a fair, inclusive, and diverse work environment. If you thrive on customer satisfaction and turning ideas into reality, then you've found your ideal destination. Are you ready to embark on this exciting journey with us?


  • Lead Data Engineer

    il y a 2 semaines


    Paris, Île-de-France Data Engineer - Lead - Data Platforms Temps plein

    About the RoleWe are seeking a highly skilled Data Engineer - Lead to join our team and lead the development of our data platforms.Key ResponsibilitiesDesign and implement scalable data architecturesLead a team of data engineers to develop and maintain data platformsCollaborate with cross-functional teams to integrate data platforms with business...

  • Data Engineer

    il y a 2 semaines


    Paris, Île-de-France Data Engineer - Lead - Data Platforms Temps plein

    About the RoleWe are seeking a highly motivated and experienced Data Architect to join our team as a Data Engineer - Lead - Data Platforms. As a key member of our team, you will be responsible for shaping our clients' data platform roadmaps and providing expertise in data architectures and data platforms to assist stakeholders in adhering to the data...

  • Data Engineer

    il y a 5 jours


    Paris, Île-de-France Kpler Temps plein

    About KplerKpler is a dynamic company dedicated to helping clients navigate complex markets with ease. We simplify global trade information and provide valuable insights to empower organizations to make informed decisions in commodities, energy, and maritime sectors.Job DescriptionWe are seeking a Staff Data Engineer to participate in the evolution of our...

  • Data Engineer

    il y a 4 jours


    Paris, Île-de-France Kpler Temps plein

    About KplerKpler is a dynamic company dedicated to helping clients navigate complex markets with ease. We simplify global trade information and provide valuable insights to empower organizations to make informed decisions in commodities, energy, and maritime sectors.Job DescriptionWe are seeking a Staff Data Engineer to participate in the evolution of our...

  • Data Engineer

    il y a 6 jours


    Paris, Île-de-France Kpler Temps plein

    About KplerKpler is a dynamic company dedicated to helping clients navigate complex markets with ease. We simplify global trade information and provide valuable insights to empower organizations to make informed decisions in commodities, energy, and maritime sectors.Job DescriptionWe are seeking a Staff Data Engineer to participate in the evolution of our...

  • Data Engineer

    il y a 2 jours


    Paris, Île-de-France Kpler Temps plein

    About KplerKpler is a dynamic company dedicated to helping clients navigate complex markets with ease. We simplify global trade information and provide valuable insights to empower organizations to make informed decisions in commodities, energy, and maritime sectors.Job DescriptionWe are seeking a Staff Data Engineer to participate in the evolution of our...

  • Data Engineering Lead

    il y a 1 semaine


    Paris, Île-de-France Data Engineer - Lead - Data Platforms Temps plein

    Data Engineer - Lead - Data Platforms **About the Role** We are seeking a highly skilled Data Engineering Lead to join our team. As a key member of our data platforms team, you will be responsible for designing, developing, and maintaining large-scale data systems. **Key Responsibilities** * Collaborate with cross-functional teams to identify and...

  • Data Engineering Lead

    il y a 1 semaine


    Paris, Île-de-France Data Engineer - Lead - Data Platforms Temps plein

    Data Engineer - Lead - Data Platforms **About the Role** We are seeking a highly skilled Data Engineering Lead to join our team. As a key member of our data platforms team, you will be responsible for designing, developing, and maintaining large-scale data systems. Your expertise will be crucial in shaping the foundations of our IT infrastructure. **Key...

  • Staff Data Engineer

    il y a 1 jour


    Paris, Île-de-France Kpler Temps plein

    About KplerKpler is a dynamic company dedicated to helping clients navigate complex markets with ease. We simplify global trade information and provide valuable insights to empower organizations to make informed decisions in commodities, energy, and maritime sectors.Job DescriptionWe are seeking a Staff Data Engineer to participate in the evolution of our...

  • Data Engineering Lead

    il y a 1 semaine


    Paris, Île-de-France Data Engineer - Lead - Data Platforms Temps plein

    Data Engineer - Lead - Data Platforms **About the Role** We are seeking a highly skilled Data Engineering Lead to join our team. As a key member of our data platforms team, you will be responsible for designing, developing, and maintaining our data infrastructure. Your expertise will be crucial in shaping the foundations of our IT systems. **Key...

  • Staff Engineer

    il y a 7 jours


    Paris, Île-de-France Kpler Temps plein

    About the RoleWe are seeking a highly skilled Staff Engineer to join our Market Data team at Kpler. As a key member of our team, you will be responsible for designing and implementing data pipelines to publish our datasets, ensuring data integrity and availability to our consumers.Key ResponsibilitiesContribute to the roadmap in collaboration with Product...

  • Data Engineer

    il y a 5 jours


    Paris, Île-de-France ECF Data, LLC Temps plein

    Cloud Data EngineerECF Data, LLC is seeking a highly skilled Cloud Data Engineer to join their team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems on the cloud.Key Responsibilities:Participate in technical design workshops to provide expertise and solution...

  • Data Engineer

    il y a 1 jour


    Paris, Île-de-France ECF Data, LLC Temps plein

    Cloud Data EngineerECF Data, LLC is seeking a highly skilled Cloud Data Engineer to join their team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems on the cloud.Key Responsibilities:Design and implement data pipelines using Azure Data Factory and Azure Data...

  • Data Engineer

    il y a 7 jours


    Paris, Île-de-France ECF Data, LLC Temps plein

    Cloud Data EngineerECF Data, LLC is seeking a highly skilled Cloud Data Engineer to join their team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems on cloud platforms.Key Responsibilities:Design and implement data pipelines using Azure Data Factory and Azure...

  • Data Architect F/H

    il y a 2 jours


    Paris, Île-de-France Data Engineer - Lead - Data Platforms Temps plein

    About LenstraLenstra is a company that specializes in delivering top-quality solutions to its clients. Our team of engineers is passionate about computer science and has a proven track record of success.Role OverviewWe are currently helping multiple major companies set up their self-service data platforms. As a data architect, you will play a crucial role in...

  • Staff Data Engineer

    il y a 3 semaines


    Paris, Ile-de-France Kpler Temps plein

    At Kpler, we are dedicated to helping our clients navigate complex markets with ease. By simplifying global trade information and providing valuable insights, we empower organisations to make informed decisions in commodities, energy, and maritime sectors. Since our founding in 2014, we have focused on delivering top-tier intelligence through user-friendly...

  • Data Architect F/H

    il y a 2 jours


    Paris, Île-de-France Data Engineer - Lead - Data Platforms Temps plein

    About LenstraLenstra is a company that specializes in delivering top-quality solutions to its clients. Our team of engineers is passionate about computer science and has a proven track record of success.Role OverviewWe are currently looking for a Data Architect to join our team. As a Data Architect, you will play a crucial role in shaping our clients' data...

  • Data Architect F/H

    il y a 2 jours


    Paris, Île-de-France Data Engineer - Lead - Data Platforms Temps plein

    About LenstraLenstra is a company that specializes in delivering top-quality solutions to its clients. Our team of engineers is passionate about computer science and has a proven track record of success.Role OverviewWe are currently helping multiple major companies set up their self-service data platforms. As a data architect, you will play a crucial role in...

  • Staff Data Architect

    il y a 2 semaines


    Paris, Île-de-France Kpler Temps plein

    About KplerKpler is a leading provider of global trade information and insights, empowering organizations to make informed decisions in commodities, energy, and maritime sectors.Job SummaryWe are seeking a highly skilled Staff Data Engineer to join our team. As a Staff Data Engineer, you will play a key role in the evolution of our data platform and related...

  • Data Consultant

    il y a 6 jours


    Paris, Île-de-France ECF Data, LLC Temps plein

    Join Our Team as a Data Consultant / Azure Data EngineerWe are seeking a highly skilled Data Consultant / Azure Data Engineer to strengthen our team. As a key member of our data engineering team, you will be responsible for developing end-to-end data pipelines in collaboration with our architects.Key Responsibilities:Design and implement data pipelines using...