Data Engineer

il y a 2 semaines

Paris, Île-de-France Pathway Genomics Corp. Temps plein
About Pathway

Pathway is a deeptech start-up founded in March 2020, offering an ultra-performant Data Processing Framework with a Python API, distributed Rust engine, and capabilities for data source integration & transformation at scale.

We are searching for a Data Engineer with a strong background in distributed data processing and stream dataflow frameworks to join our team. As a Data Engineer at Pathway, you will be responsible for implementing data flows from client warehouses to our ingress, setting up CDC interfaces, designing ETL pipelines, and contributing to benchmark framework design.

Key Responsibilities
  • Implement data flows from client warehouses to our ingress
  • Set up CDC interfaces for change streams between client data stores and i/o data processed by Pathway
  • Design ETL pipelines within Pathway
  • Contribute to benchmark framework design, including throughput, latency, and memory footprint
Requirements
  • Inside-out understanding of at least one major distributed data processing framework (e.g. Spark, Dask, Ray)
  • 6+ months experience working with a streaming dataflow framework (e.g. Flink, Kafka Streams, Spark in streaming mode, Beam/Dataflow)
  • Ability to set up distributed dataflows independently
  • Experience with data streams, message queues, and message brokers (Kafka)
  • Working familiarity with data schema and schema versioning concepts (Avro, Protobuf)
  • Familiarity with Kubernetes and cloud deployments (Azure, AWS)
  • Good working knowledge of Python and SQL
Bonus Points
  • Experience with Rust and machine learning pipelines
  • Familiarity with modern data transformation workflow tooling (dbt, Airflow, Dagster, Prefect)
  • Familiarity with Databricks Data Lakehouse architecture and Snowflake's data product vision
Why Join Us
  • Intellectually stimulating work environment with a new type of stream processing framework
  • Work in one of the hottest data startups in France with exciting career prospects
  • Responsibilities and ability to make significant contributions to the company's success
  • Competitive compensation package, including annual salary and employee stock option plan

  • Data Engineer

    il y a 2 semaines

    Paris, Île-de-France ECF Data, LLC Temps plein

    Expert Data Engineer WantedECF Data, LLC is seeking a seasoned Data Engineer to bolster their Lyon-based team. The ideal candidate will contribute to a cutting-edge data project platform, leveraging their expertise in Microsoft Azure ecosystem.Key Responsibilities:Collaborate with fellow Data Engineers and developers on technical issues and best...

  • Data Engineer

    il y a 2 semaines

    Paris, Île-de-France ECF Data, LLC Temps plein

    Job Title: Data Engineer - LyonECF Data, LLC is seeking a skilled Data Engineer to join our Lyon-based team. As a Data Engineer, you will play a crucial role in contributing to our client-focused data project platform.About the RoleWe are looking for a highly motivated and experienced Data Engineer to join our team. The ideal candidate will have a strong...

  • Data Engineer

    il y a 1 mois

    Paris, Île-de-France ECF Data, LLC Temps plein

    Job Title: Data EngineerECF Data, LLC is seeking a highly skilled Data Engineer to join their team. The ideal candidate will have expertise in Microsoft Azure ecosystem and experience in development and integration in Azure Data Lake Store.Responsibilities:Design and develop data pipelines using Azure Data FactoryImplement data flows using Spark and...

  • Data Engineer

    il y a 2 semaines

    Paris, Île-de-France ECF Data, LLC Temps plein

    ECF Data, LLC is seeking a highly skilled Data Engineer to contribute to the development of a client-focused data project platform. As a key member of our Lyon-based expert team, you will be responsible for participating in technical and functional design workshops, developing functionalities, and collaborating with other Data Engineers and developers on...

  • Data Architect

    il y a 1 mois

    Paris, Île-de-France Data Engineer - Lead - Data Platforms Temps plein

    About the RoleWe are seeking a highly skilled Data Architect to join our team at Lenstra. As a Data Architect, you will play a crucial role in shaping the data platform roadmap for our clients and providing expertise in data architectures and data platforms to assist stakeholders in adhering to the data strategy.Key ResponsibilitiesParticipate in shaping our...

  • Data Architect

    il y a 2 semaines

    Paris, Île-de-France Data Engineer - Lead - Data Platforms Temps plein

    About the RoleWe are seeking a highly motivated and experienced Data Architect to join our team at Lenstra. As a Data Architect, you will play a crucial role in shaping the data platform roadmap for our clients and providing expertise in data architectures and data platforms to assist stakeholders in adhering to the data strategy.Key...

  • Data Engineer

    il y a 1 mois

    Paris, Île-de-France ECF Data, LLC Temps plein

    Twyce is a consulting firm that specializes in digital transformation, but above all, it's an exciting human adventure with a community of over 50 collaborators based mainly in Paris and Montreal.Founded in 2021, Twyce emphasizes a strong commitment to its customers and teams, built around the principles of intrapreneurship, collective intelligence, and...

  • Data Engineer

    il y a 2 semaines

    Paris, Île-de-France ECF Data, LLC Temps plein

    Twyce is a consulting firm that specializes in digital transformation, but above all, it's an exciting human adventure with a community of over 50 collaborators based mainly in Paris and Montreal.Founded in 2021, Twyce emphasizes a strong commitment to its customers and teams, built around the principles of intrapreneurship, collective intelligence, and...

  • Consultant Data Engineer H/F/N

    il y a 1 mois

    Paris, Île-de-France Data Recrutement Temps plein

    L'entreprise : Cabinet de conseil en Architecture management SICabinet de conseil en architecture de l'information créé en 2009, avec une équipe de 50 collaborateurs travaillant en mode agile.Le cabinet a un chiffre d'affaires de 8 millions d'euros et travaille avec une grande diversité de clients.La mission : Accompagner les clients dans leurs...

  • Apprentice Data Analyst/Engineer

    il y a 2 semaines

    Paris, Île-de-France Data Privacy Temps plein

    Dassault Aviation: A Leader in Aerospace InnovationWe are seeking an ambitious and detail-oriented Data Analyst/Engineer to join our team in Mérignac. As a key member of our 7-person information systems team, you will play a crucial role in developing Business Intelligence (BI) reports to support operational decision-making.Key Responsibilities:Coordinate...

  • Data Architect

    il y a 4 semaines

    Paris, Île-de-France Data Engineer - Lead - Data Platforms Temps plein

    About the RoleWe are seeking a highly motivated and experienced Data Architect to join our team. As a Data Architect, you will play a crucial role in shaping our clients' data platforms and ensuring that their data is properly modeled and integrated.Key ResponsibilitiesParticipate in shaping our clients' data platform roadmapsProvide expertise in data...

  • Data Solutions Engineer

    il y a 2 semaines

    Paris, Île-de-France ECF Data, LLC Temps plein

    ECF Data, LLC is a leading consulting firm specializing in Digital Transformation. We're on a mission to drive innovation and excellence in the industry, with a community of experts based in Paris and Montreal.Founded in 2021, our company emphasizes a strong commitment to our customers and teams. To support our customers' projects, we've developed three key...

  • Cloud Data Engineer

    il y a 2 semaines

    Paris, Île-de-France ECF Data, LLC Temps plein

    ECF Data, LLC is seeking a Cloud Data Engineer to join our Lyon-based expert team and contribute to the development of a client-focused data project platform. As a key member of our team, you will be responsible for designing and implementing data pipelines, developing and integrating data processing solutions, and collaborating with cross-functional teams...

  • Senior Data Engineer

    il y a 2 semaines

    Paris, Île-de-France ECF Data, LLC Temps plein

    We are seeking a Senior Data Engineer to join our Lyon-based expert team and contribute to the development of a client-focused data project platform. As a key member of our team, you will be responsible for designing and implementing data pipelines, developing and integrating data processing solutions, and collaborating with cross-functional teams to ensure...

  • Senior Data Engineer

    il y a 2 semaines

    Paris, Île-de-France ECF Data, LLC Temps plein

    ECF Data, LLC is seeking a highly skilled Data Engineer to join our team and work on innovative projects in the Banking, Insurance, Transport, Energy, Telecoms, and Retail sectors.The successful candidate will have a strong background in data processing, cloud computing, and software development. Responsibilities will include designing and implementing data...

  • Data Engineering Lead

    il y a 1 mois

    Paris, Île-de-France Data Engineer - Lead - Data Platforms Temps plein

    Unlock Your Potential as a Data Engineering LeadAt Lenstra, we're committed to fostering a culture of innovation and growth. As a Data Engineering Lead, you'll have the opportunity to collaborate with a talented team of professionals who share your passion for problem-solving and technical excellence.Our TeamWe're a dynamic group of individuals who thrive in...

  • Data Engineering Lead

    il y a 1 mois

    Paris, Île-de-France Data Engineer - Lead - Data Platforms Temps plein

    Unlock Your Potential as a Data Engineering LeadAt Lenstra, we're committed to fostering a culture of innovation and growth. As a Data Engineering Lead, you'll have the opportunity to collaborate with a talented team of professionals who share your passion for problem-solving and technical excellence.Our TeamWe're a dynamic group of individuals who thrive in...

  • Data Engineering Lead

    il y a 1 mois

    Paris, Île-de-France Data Engineer - Lead - Data Platforms Temps plein

    Unlock Your Potential as a Data Engineering LeadAt Lenstra, we're committed to fostering a culture of innovation and growth. As a Data Engineering Lead, you'll have the opportunity to collaborate with a talented team of professionals who share your passion for problem-solving and technical excellence.Our TeamWe're a dynamic group of individuals who thrive in...

  • Data Engineer

    il y a 2 semaines

    Paris, Île-de-France ECF Data, LLC Temps plein

    Twyce is a consulting firm specializing in Digital Transformation, with a strong focus on innovation and customer satisfaction. We are looking for a talented Data Engineer to join our team and work on large-scale projects in various sectors, including Banking, Insurance, Transport, Energy, Telecoms, and Retail.The ideal candidate will have a strong...

  • Data Engineering Lead

    il y a 1 mois

    Paris, Île-de-France Data Engineer - Lead - Data Platforms Temps plein

    Unlock Your Potential as a Data Engineering LeadAt Lenstra, we're committed to fostering a culture of innovation and growth. As a Data Engineering Lead, you'll have the opportunity to collaborate with a talented team of professionals who share your passion for problem-solving and technical excellence.Our Approach to GrowthWe believe that growth is a...