Data Engineer

il y a 1 mois


Paris, Île-de-France Pathway Temps plein
About Pathway

We are a deeptech start-up founded in March 2020, offering an ultra-performant Data Processing Framework with a Python API, distributed Rust engine, and capabilities for data source integration & transformation at scale.

Our primary developer offering is a unified streaming + batch framework, with a free-to-use license available through pip install pathway.

We are working with leaders of the logistics industry, such as DB Schenker or La Poste, and have been featured in Gartner's market guide for Event Stream Processing.

Learn more at http://pathway.com/ and https://github.com/pathwaycom/.

The Team

We are built by and for overachievers, with co-founders and employees who have worked in the best AI labs in the world, worked at Google, and graduated from top universities.

Our CTO is a co-author with Goeff Hinton and Yoshua Bengio, and our management team includes the co-founder of Spoj.com and NK.pl.

The Opportunity

We are searching for a Data Engineer to work with live client datasets, test, benchmark, and showcase our brand-new stream data processing technology.

The end-user of our product are mostly developers and data engineers working in a corporate environment, and our development framework is expected to become a part of their preferred development stack for analytics projects.

Responsibilities

You will be working closely with our CTO, Head of Product, and key developers to:

  • Implement the flow of data from client's warehouses to Pathway's ingress.
  • Set up CDC interfaces for change streams between client data stores and i/o data processed by Pathway.
  • Design ETL pipelines within Pathway.
  • Contribute to benchmark framework design, including throughput, latency, and memory footprint.
  • Contribute to building open-source test frameworks for simulated streaming data scenarios on public datasets.
Requirements

We are looking for someone with:

  • Inside-out understanding of a major distributed data processing framework.
  • 6 months+ experience working with a streaming dataflow framework.
  • Ability to set up distributed dataflows independently.
  • Experience with data streams, message queues, and message brokers.
  • Working familiarity with data schema and schema versioning concepts.
  • Familiarities with Kubernetes and cloud deployments.
  • Good working knowledge of Python and SQL.
  • Experienced in working for an innovative tech company with a long-term vision.
Bonus Points
  • Knowledge of developers in a corporate environment.
  • Passionate about trends in data.
  • Proficiency in Rust.
  • Experience with Machine Learning pipelines or MLOps.
  • Familiarity with modern data transformation workflow tooling.
Why You Should Apply
  • Intellectually stimulating work environment.
  • Work in one of the hottest data startups in France, with exciting career prospects.
  • Responsibilities and ability to make significant contribution to the company's success.
  • Compensation: annual salary of €60K-€100K + Employee stock option plan.

  • Senior Data Engineer

    il y a 1 mois


    Paris, Île-de-France ECF Data, LLC Temps plein

    ECF Data, LLC is seeking a highly skilled Data Engineer to join our team and work on innovative projects in the Banking, Insurance, Transport, Energy, Telecoms, and Retail sectors.The successful candidate will have a strong background in data processing, cloud computing, and software development. Responsibilities will include designing and implementing data...

  • Data Engineer

    il y a 4 semaines


    Paris, Île-de-France ECF Data, LLC Temps plein

    Twyce is a consulting firm specializing in Digital Transformation, with a strong focus on innovation and customer satisfaction. We are looking for a talented Data Engineer to join our team and work on large-scale projects in various sectors, including Banking, Insurance, Transport, Energy, Telecoms, and Retail.The ideal candidate will have a strong...

  • Data Engineer

    il y a 1 mois


    Paris, Île-de-France Sia Partners Temps plein

    Poste de Data Engineer Nous recrutons un(e) Data Engineer pour accompagner le développement des activités de la Business Unit Data Science chez Sia Partners.Mission Vous serez amenéà participer aux missions Data Science de Sia Partners chez nos clients, ainsi qu'à développer nos produits Software-as-a-Service Heka.ai. Vous accompagnerez des Data...

  • Senior Data Engineer

    il y a 4 semaines


    Paris, Île-de-France Balt USA Temps plein

    Data Engineer for Data-Driven GrowthWe're looking for a Data Engineer to join our Information Systems department and contribute to our Group's data-driven growth. As a Senior Data Engineer, you'll be responsible for providing data management solutions to support our rapid growth, including data collection and processing, data quality and governance, and data...

  • Senior Data Engineer

    il y a 1 mois


    Paris, Île-de-France Dashlane Temps plein

    We're seeking a Senior Data Engineer to lead our data infrastructure efforts and ensure our data pipeline is optimized for scalability and performance.As a Senior Data Engineer, you will design and build our next-generation ETL pipelines and data products using AWS data tools and open-source technologies like Airflow, Airbyte, and dbt.You will work with a...

  • Data Engineer

    il y a 4 semaines


    Paris, Île-de-France Descartes Underwriting Temps plein

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Descartes Underwriting. As a Data Engineer, you will be responsible for creating, improving, and maintaining data pipelines used to train our climate risk assessment model.You will work closely with data scientists and software engineers to develop and deploy our models, and...

  • Data Engineer

    il y a 4 semaines


    Paris, Île-de-France Dashlane Temps plein

    About the RoleDashlane is seeking a talented Data Engineer to optimize our data infrastructure and enable our company to scale in the coming years. As a key member of our international team, you will design and build our next-generation ETL pipelines and data products using AWS data tools and open-source technologies such as Airflow, Airbyte, and dbt.You...

  • Senior Data Engineer

    il y a 4 semaines


    Paris, Île-de-France Sparteo Temps plein

    Job DescriptionSparteo is seeking a highly skilled Data Engineer to lead the design, implementation, and optimization of data architectures. The ideal candidate will have a strong understanding of distributed data systems, proficiency in clustering, and expertise in database technologies.The successful candidate will be responsible for:Designing and...

  • **Data Engineer**

    il y a 3 semaines


    Paris, Île-de-France Numerys Temps plein

    We are looking for a skilled Data Engineer to join our team at "{company}". The ideal candidate will have expertise in designing and developing large-scale data systems. Key responsibilities include:Designing and implementing data pipelinesDeveloping data warehousesEnsuring data quality and integrityOur team values collaboration, innovation, and continuous...


  • Paris, Île-de-France Avanci Temps plein

    Poste de Data EngineerNous recherchons un Data Engineer expérimenté pour rejoindre notre équipe à Tours. En tant que Data Engineer, vous serez responsable de la conception, de la gestion et de l'administration des infrastructures de données pour nos clients.ResponsabilitésDévelopper des architectures de données robustes pour les clients de...

  • Data Science Engineer

    il y a 4 semaines


    Paris, Île-de-France 2K Temps plein

    Amplitude Analytics TeamWe are seeking a skilled Data Engineer to join our analytics team at Amplitude Studios. As a Data Engineer, you will be responsible for maintaining and ensuring the operation of our video game telemetry pipeline. Your main responsibilities will be:Maintain and ensure the operation of our video game telemetry pipeline.Set up and manage...

  • Analytics Data Engineer

    il y a 1 mois


    Paris, Île-de-France Dailymotion Exchange Temps plein

    About the RoleDailymotion Exchange is seeking an experienced Analytics Engineer to join our Data Engineering team. As an Analytics Engineer, you will be responsible for designing, building, and maintaining our data pipelines, ensuring the accuracy and reliability of our data. You will work closely with our data scientists and engineers to develop and...

  • Data Engineer

    il y a 1 mois


    Paris, Île-de-France Dailymotion Exchange Temps plein

    About the RoleDailymotion Exchange is seeking an experienced Data Engineer to join our Analytics team. As an Analytics Engineer, you will be responsible for designing, building, and maintaining our data pipelines, ensuring the accuracy and reliability of our data. You will work closely with our data scientists and engineers to develop and implement...

  • Data Engineer

    il y a 1 mois


    Paris, Île-de-France Audensiel Temps plein

    Audensiel: A Leader in Digital TransformationWe are seeking a highly skilled Data Engineer to join our team at Audensiel, a multi-specialist player in digital transformation, business consulting, and technology consulting.About the RoleAs a Data Engineer, you will be responsible for managing and maintaining data pipelines for data acquisition, processing,...

  • Data Engineer

    il y a 1 mois


    Paris, Île-de-France BlaBlaCar Temps plein

    Job Summary We are seeking a highly skilled Data Engineer to join our Data Mesh team at BlaBlaCar. As a Data Engineer, you will be responsible for designing and implementing a data warehouse on Google BigQuery, Airflow, and DBT. You will work closely with Data Analysts, Data Scientists, and Software Engineers to provide data products to enable...


  • Paris, Île-de-France Dashlane Temps plein

    We're looking for a talented Data Engineer to join our team at Dashlane. As a key member of our international team, you'll be responsible for designing and building our next-generation ETL pipelines and data products. You'll work closely with our Analytics Engineers, Machine Learning Engineers, Data Scientists, Product Managers, and Engineers to ensure data...


  • Paris, Île-de-France NTT DATA Temps plein

    About the Role We are seeking a highly skilled Network Infrastructure Engineer to join our team at NTT DATA. As a key member of our team, you will be responsible for ensuring the smooth operation and optimization of our clients' application infrastructure and services. Responsibilities: Proactively monitor, identify, investigate, and resolve...

  • Senior Data Engineer

    il y a 4 semaines


    Paris, Île-de-France Adikteev Temps plein

    About the RoleWe are seeking a highly skilled Data Engineer to join our Engineering team at Adikteev. As a Data Engineer, you will be responsible for designing, building, and maintaining our data infrastructure, ensuring that our data systems are scalable, efficient, and reliable.Key Responsibilities:Design and implement data pipelines to collect, process,...

  • Data Engineer

    il y a 1 mois


    Paris, Île-de-France Dashlane Temps plein

    At Dashlane, we're on a mission to make security simple for millions of organizations and their people. As a Data Engineer, you'll play a key role in optimizing our data to enable our company to scale in the coming years. You'll design pipelines and warehouses to model data from multiple sources, allowing analysts to derive business and product insights....

  • Senior Data Engineer

    il y a 4 semaines


    Paris, Île-de-France Dashlane Temps plein

    About the PositionWe are looking for a skilled Data Engineer to join our team and help us build and maintain our data pipeline. As a Data Engineer, you will be responsible for designing and building scalable data infrastructure on AWS using Terraform, developing and maintaining ETL pipelines using Airflow, Airbyte, and dbt, and collaborating with...