Data Engineer

il y a 4 semaines


Paris, Île-de-France Pathway Genomics Corp. Temps plein
About Pathway

Pathway is a deeptech start-up founded in March 2020, offering an ultra-performant Data Processing Framework with a Python API, distributed Rust engine, and capabilities for data source integration & transformation at scale.

We are searching for a Data Engineer with a strong background in distributed data processing and stream dataflow frameworks to join our team. As a Data Engineer at Pathway, you will be responsible for implementing data flows from client warehouses to our ingress, setting up CDC interfaces, designing ETL pipelines, and contributing to benchmark framework design.

Key Responsibilities
  • Implement data flows from client warehouses to our ingress
  • Set up CDC interfaces for change streams between client data stores and i/o data processed by Pathway
  • Design ETL pipelines within Pathway
  • Contribute to benchmark framework design, including throughput, latency, and memory footprint
Requirements
  • Inside-out understanding of at least one major distributed data processing framework (e.g. Spark, Dask, Ray)
  • 6+ months experience working with a streaming dataflow framework (e.g. Flink, Kafka Streams, Spark in streaming mode, Beam/Dataflow)
  • Ability to set up distributed dataflows independently
  • Experience with data streams, message queues, and message brokers (Kafka)
  • Working familiarity with data schema and schema versioning concepts (Avro, Protobuf)
  • Familiarity with Kubernetes and cloud deployments (Azure, AWS)
  • Good working knowledge of Python and SQL
Bonus Points
  • Experience with Rust and machine learning pipelines
  • Familiarity with modern data transformation workflow tooling (dbt, Airflow, Dagster, Prefect)
  • Familiarity with Databricks Data Lakehouse architecture and Snowflake's data product vision
Why Join Us
  • Intellectually stimulating work environment with a new type of stream processing framework
  • Work in one of the hottest data startups in France with exciting career prospects
  • Responsibilities and ability to make significant contributions to the company's success
  • Competitive compensation package, including annual salary and employee stock option plan

  • Data Architect

    il y a 4 semaines


    Paris, Île-de-France Data Engineer - Lead - Data Platforms Temps plein

    About the RoleWe are seeking a highly motivated and experienced Data Architect to join our team at Lenstra. As a Data Architect, you will play a crucial role in shaping the data platform roadmap for our clients and providing expertise in data architectures and data platforms to assist stakeholders in adhering to the data strategy.Key...

  • Data Engineer

    il y a 4 semaines


    Paris, Île-de-France ECF Data, LLC Temps plein

    ECF Data, LLC is seeking a highly skilled Data Engineer to contribute to the development of a client-focused data project platform. As a key member of our Lyon-based expert team, you will be responsible for participating in technical and functional design workshops, developing functionalities, and collaborating with other Data Engineers and developers on...


  • Paris, Île-de-France Data Privacy Temps plein

    Dassault Aviation: A Leader in Aerospace InnovationWe are seeking an ambitious and detail-oriented Data Analyst/Engineer to join our team in Mérignac. As a key member of our 7-person information systems team, you will play a crucial role in developing Business Intelligence (BI) reports to support operational decision-making.Key Responsibilities:Coordinate...

  • Data Solutions Engineer

    il y a 4 semaines


    Paris, Île-de-France ECF Data, LLC Temps plein

    ECF Data, LLC is a leading consulting firm specializing in Digital Transformation. We're on a mission to drive innovation and excellence in the industry, with a community of experts based in Paris and Montreal.Founded in 2021, our company emphasizes a strong commitment to our customers and teams. To support our customers' projects, we've developed three key...

  • Cloud Data Engineer

    il y a 4 semaines


    Paris, Île-de-France ECF Data, LLC Temps plein

    ECF Data, LLC is seeking a Cloud Data Engineer to join our Lyon-based expert team and contribute to the development of a client-focused data project platform. As a key member of our team, you will be responsible for designing and implementing data pipelines, developing and integrating data processing solutions, and collaborating with cross-functional teams...

  • Senior Data Engineer

    il y a 4 semaines


    Paris, Île-de-France ECF Data, LLC Temps plein

    We are seeking a Senior Data Engineer to join our Lyon-based expert team and contribute to the development of a client-focused data project platform. As a key member of our team, you will be responsible for designing and implementing data pipelines, developing and integrating data processing solutions, and collaborating with cross-functional teams to ensure...

  • Senior Data Engineer

    il y a 4 semaines


    Paris, Île-de-France ECF Data, LLC Temps plein

    ECF Data, LLC is seeking a highly skilled Data Engineer to join our team and work on innovative projects in the Banking, Insurance, Transport, Energy, Telecoms, and Retail sectors.The successful candidate will have a strong background in data processing, cloud computing, and software development. Responsibilities will include designing and implementing data...

  • Data Engineer

    il y a 4 semaines


    Paris, Île-de-France ECF Data, LLC Temps plein

    Twyce is a consulting firm specializing in Digital Transformation, with a strong focus on innovation and customer satisfaction. We are looking for a talented Data Engineer to join our team and work on large-scale projects in various sectors, including Banking, Insurance, Transport, Energy, Telecoms, and Retail.The ideal candidate will have a strong...


  • Paris, Île-de-France ECF Data, LLC Temps plein

    We are looking for a talented Data Engineer to join our team and work on large-scale projects in various sectors, including Banking, Insurance, Transport, Energy, Telecoms, and Retail.The ideal candidate will have a strong background in data processing, cloud computing, and software development. Responsibilities will include designing and implementing data...

  • Data Engineer

    il y a 4 semaines


    Paris, Île-de-France Sia Partners Temps plein

    Poste de Data Engineer Nous recrutons un(e) Data Engineer pour accompagner le développement des activités de la Business Unit Data Science chez Sia Partners.Mission Vous serez amenéà participer aux missions Data Science de Sia Partners chez nos clients, ainsi qu'à développer nos produits Software-as-a-Service Heka.ai. Vous accompagnerez des Data...

  • Senior Data Engineer

    il y a 4 semaines


    Paris, Île-de-France Balt USA Temps plein

    Data Engineer for Data-Driven GrowthWe're looking for a Data Engineer to join our Information Systems department and contribute to our Group's data-driven growth. As a Senior Data Engineer, you'll be responsible for providing data management solutions to support our rapid growth, including data collection and processing, data quality and governance, and data...

  • Senior Data Engineer

    il y a 4 semaines


    Paris, Île-de-France Dashlane Temps plein

    We're seeking a Senior Data Engineer to lead our data infrastructure efforts and ensure our data pipeline is optimized for scalability and performance.As a Senior Data Engineer, you will design and build our next-generation ETL pipelines and data products using AWS data tools and open-source technologies like Airflow, Airbyte, and dbt.You will work with a...

  • Data Engineer

    il y a 4 semaines


    Paris, Île-de-France Descartes Underwriting Temps plein

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Descartes Underwriting. As a Data Engineer, you will be responsible for creating, improving, and maintaining data pipelines used to train our climate risk assessment model.You will work closely with data scientists and software engineers to develop and deploy our models, and...

  • Data Engineer

    il y a 4 semaines


    Paris, Île-de-France DNA Script Temps plein

    About DNA ScriptAt DNA Script, we're accelerating innovation in life science and technology through the decentralization of rapid, on-demand, and high-quality DNA synthesis. Our approach leverages nature's billions of years of evolution in synthesizing DNA, setting a new standard for customizing nucleic acid synthesis and accelerating discovery in genetics,...

  • Data Engineer

    il y a 4 semaines


    Paris, Île-de-France Dashlane Temps plein

    About the RoleDashlane is seeking a talented Data Engineer to optimize our data infrastructure and enable our company to scale in the coming years. As a key member of our international team, you will design and build our next-generation ETL pipelines and data products using AWS data tools and open-source technologies such as Airflow, Airbyte, and dbt.You...

  • Data Engineer

    il y a 4 semaines


    Paris, Île-de-France 2K Temps plein

    Amplitude Studios: Data EngineerAmplitude Studios is a renowned video game development company that creates engaging strategy games with the help of its passionate community. As a Data Engineer, you will play a crucial role in shaping the future of our games by leveraging data-driven insights to inform our development process.Key Responsibilities:Maintain...

  • Senior Data Engineer

    il y a 4 semaines


    Paris, Île-de-France DoubleVerify Temps plein

    Join Our Team as a Senior Data EngineerAt DoubleVerify, we're pushing the boundaries of digital marketing with our innovative AI-powered technology. As a Senior Data Engineer, you'll play a crucial role in developing and maintaining our data infrastructure, ensuring seamless communication between our platform and partners.Key Responsibilities:Design and...

  • Senior Data Engineer

    il y a 4 semaines


    Paris, Île-de-France DoubleVerify Temps plein

    Join Our Team as a Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at DoubleVerify. As a Senior Data Engineer, you will play a critical role in the development and maintenance of our data infrastructure, ensuring the accuracy and reliability of our data.Key Responsibilities:Design and implement data pipelines to...

  • Senior Data Engineer

    il y a 4 semaines


    Paris, Île-de-France Sparteo Temps plein

    Job DescriptionSparteo is seeking a highly skilled Data Engineer to lead the design, implementation, and optimization of data architectures. The ideal candidate will have a strong understanding of distributed data systems, proficiency in clustering, and expertise in database technologies.The successful candidate will be responsible for:Designing and...

  • **Data Engineer**

    il y a 3 semaines


    Paris, Île-de-France Numerys Temps plein

    We are looking for a skilled Data Engineer to join our team at "{company}". The ideal candidate will have expertise in designing and developing large-scale data systems. Key responsibilities include:Designing and implementing data pipelinesDeveloping data warehousesEnsuring data quality and integrityOur team values collaboration, innovation, and continuous...