Data Engineer

il y a 1 mois

Paris, Île-de-France Pathway Temps plein

About Pathway

We are a deeptech start-up founded in 2020, offering an ultra-performant Data Processing Framework with a Python API, distributed Rust engine, and capabilities for data source integration & transformation at scale.

Our primary developer offering is a unified streaming + batch framework, with a free-to-use license available for single-machine versions.

Major data use cases are around event-stream data, including real-world data such as IoT, and graph data that changes over time.

Our enterprise offering is currently used by leaders of the logistics industry, such as DB Schenker or La Poste, and tested across multiple industries.

Learn more at http://pathway.com/ and https://github.com/pathwaycom/.

The Team

Pathway is built by and for overachievers, with co-founders and employees having worked in the best AI labs in the world, Google, and top universities.

Our CTO is a co-author with Goeff Hinton and Yoshua Bengio, and the management team includes the co-founder of Spoj.com and NK.pl.

The Opportunity

We are searching for a Data Processing or Data Engineering professional to work with live client datasets, test, benchmark, and showcase our brand-new stream data processing technology.

The end-user of our product are mostly developers and data engineers working in a corporate environment.

Responsibilities

  1. Implement the flow of data from client warehouses to Pathway's ingress.
  2. Set up CDC interfaces for change streams between client data stores and i/o data processed by Pathway.
  3. Design ETL pipelines within Pathway.
  4. Contribute to benchmark framework design, including throughput, latency, and memory footprint.
  5. Contribute to building open-source test frameworks for simulated streaming data scenarios on public datasets.

Requirements

  1. Inside-out understanding of a major distributed data processing framework.
  2. 6 months+ experience working with a streaming dataflow framework.
  3. Ability to set up distributed dataflows independently.
  4. Experience with data streams, message queues, and message brokers.
  5. Working familiarity with data schema and schema versioning concepts.
  6. Familiarities with Kubernetes and cloud deployments.
  7. Good working knowledge of Python and SQL.
  8. Experienced in working for an innovative tech company with a long-term vision.

Bonus Points

  1. Know the ways of developers in a corporate environment.
  2. Passionate about trends in data.
  3. Proficiency in Rust.
  4. Experience with Machine Learning pipelines or MLOps.
  5. Familiarity with modern data transformation workflow tooling.

Why You Should Apply

  • Intellectually stimulating work environment.
  • Work in one of the hottest data startups in France, with exciting career prospects.
  • Responsibilities and ability to make significant contribution to the company's success.
  • Compensation: annual salary of €60K-€100K + Employee stock option plan.
  • Inclusive workplace culture.

  • **Data Engineer**

    il y a 3 semaines

    Paris, Île-de-France Numerys Temps plein

    We are looking for a skilled Data Engineer to join our team at "{company}". The ideal candidate will have expertise in designing and developing large-scale data systems. Key responsibilities include:Designing and implementing data pipelinesDeveloping data warehousesEnsuring data quality and integrityOur team values collaboration, innovation, and continuous...

  • Network Infrastructure Engineer

    il y a 2 semaines

    Paris, Île-de-France NTT DATA Temps plein

    About the Role We are seeking a highly skilled Network Infrastructure Engineer to join our team at NTT DATA. As a key member of our team, you will be responsible for ensuring the smooth operation and optimization of our clients' application infrastructure and services. Responsibilities: Proactively monitor, identify, investigate, and resolve...

  • Data Engineer Apprentice

    il y a 1 mois

    Paris, Île-de-France Faurecia Temps plein

    About the Data Engineer Apprentice RoleFORVIA is looking for a talented Data Engineer Apprentice to join our Data Program Team at our Bercy site in Paris. As a Data Engineer Apprentice, you will be responsible for collecting, storing, processing, analyzing, and documenting huge sets of data.Your Key ResponsibilitiesDocument the ingestion process in our Data...

  • Data Engineer Flink

    il y a 4 semaines

    Paris, Ile-de-France Harnham Temps plein

    DATA ENGINEER – FLINKPARIS (75)UP TO 60K EURRejoignez un cabinet de conseil spécialisée Data en tant que Data Engineer Flink ! VOTRE MISSION : Intégration et traitement des données Cadrage des besoins techniques avec les equipes ITDéploiement, test et maintenance d’environnement Data Développement d’architecture et migration vers le cloud VOTRE...

  • Data Engineer

    il y a 4 semaines

    Paris, Ile-de-France Harnham Temps plein

    DATA ENGINEER – NIFI PARIS (75)UP TO 60K EURRejoignez un cabinet de conseil spécialisée Data en tant que Data Engineer Nifi ! VOTRE MISSION : Intégration et traitement des données Cadrage des besoins techniques avec les equipes ITDéploiement, test et maintenance d’environnement Data Développement d’architecture et migration vers le cloud VOTRE...

  • Data Engineer en apprentissage

    il y a 4 semaines

    Paris, Île-de-France Iscod Temps plein

    Formation professionnelle en Data EngineerL'Iscod propose une formation professionnelle en Data Engineer pour les entreprises spécialisées dans le traitement de données. Ce programme vous permettra de développer des compétences clés tout en préparant l'une de nos formations diplômantes, reconnues par l'État, de niveau 5 à niveau...

  • Data Scientist

    il y a 2 semaines

    Paris, Île-de-France Canon Temps plein

    Join Our CompanyAs a Data Scientist - AI Engineer at {company}, you will be responsible for developing and deploying artificial intelligence and machine learning models to drive business growth and improve customer experience. Your duties will include designing and implementing data pipelines, training and testing machine learning models, and working with...

  • Senior Data Engineer

    il y a 4 semaines

    Paris, Île-de-France Datadog Temps plein

    About the Role:The Data Science team at Datadog is seeking a highly skilled Senior Software Engineer to design, build, and scale our backend systems. As a key member of our team, you will work on large-scale distributed systems, horizontally-scalable datastores, and data-processing frameworks to build our next-generation platform and capabilities for Data...

  • Data Engineer

    il y a 4 semaines

    Paris, Île-de-France Dailymotion Temps plein

    About the RoleDailymotion is seeking an experienced Analytics Engineer to join its Data Engineering Teams. As an Analytics Engineer, you will play a key role in creating and maintaining data products that drive business decisions across the company.Key ResponsibilitiesIngest and process large volumes of raw data from internal and external sources using batch...

  • Data Engineer

    il y a 4 semaines

    Paris, Ile-de-France Dataworks Temps plein

    Data EngineerParis – France55-65K€TECH STACK : Python, SQL, AWSLA SOCIÉTÉ :Venez rejoindre une société internationale qui fournit à des leaders mondiaux une plateforme SaaS qui améliore leur efficacité opérationnelle de transport. Que ce soit pour anticiper des retards, qualifier la performance et améliorer l'expérience client, la...

  • Data Engineer

    il y a 4 semaines

    Paris, Île-de-France Descartes Underwriting Temps plein

    About Descartes UnderwritingDescartes Underwriting is a leading provider of parametric insurance solutions for weather and climate-related risks. We harness the power of machine learning and real-time monitoring from satellite imagery and IoT data to deliver innovative risk management solutions.Your RoleWe are seeking a skilled Data Engineer to join our team...

  • Senior Data Engineer

    il y a 4 semaines

    Paris, Île-de-France DoubleVerify Temps plein

    At DoubleVerify, we're seeking a highly skilled Senior Data Engineer to join our team. As a key member of our Data Engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines and systems that enable our business to make data-driven decisions.Key Responsibilities:Design and develop scalable data pipelines...

  • Data Engineer Apprentice

    il y a 4 semaines

    Paris, Île-de-France Faurecia Temps plein

    About the Data ProgramThe Data Program is the trusted partner for advanced analytics and machine learning solutions. Its mission is to create business value at scale by leveraging data at the core of decision-making across the value chain. The program empowers people to gain valuable insights from data, working in close alignment with business groups,...

  • Senior Cloud Data Engineer

    il y a 4 semaines

    Paris, Île-de-France RED Global Temps plein

    We are seeking a Senior Cloud Data Engineer to join our team at RED Global.Key responsibilities include:Providing technical leadership in the design and implementation of cloud-based data solutionsCollaborating with cross-functional teams to ensure seamless integration with existing systemsDeveloping and maintaining high-quality, scalable, and secure...

  • Senior Data Engineer

    il y a 4 semaines

    Paris, Île-de-France Singulier Temps plein

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Singulier. As a key member of our engineering team, you will be responsible for designing, building, and maintaining our data infrastructure to support our analytics team and clients.Key ResponsibilitiesDesign and implement data pipelines to collect, process, and transform...

  • Senior Data Engineer

    il y a 4 semaines

    Paris, Île-de-France DoubleVerify Temps plein

    Data Engineers at DoubleVerify play a vital role in ensuring the seamless communication between our product and its partners.The team is responsible for ingesting diverse and volumetric data, managing outbound communications with partners, and using partner APIs cross-referenced with business rules to upload models generated by our product.As a Senior Data...

  • **Cloud Data Engineer**

    il y a 4 semaines

    Paris, Île-de-France FED ENGINEERING Temps plein

    We are looking for a Cloud Data Engineer to join our Cloud Data Team at {company}. The ideal candidate will have experience with cloud-based data storage and processing, and will be able to design, implement, and maintain scalable and secure data systems.Key responsibilities will include:Designing and implementing cloud-based data architecturesDeveloping and...

  • Data Engineer IA

    il y a 4 semaines

    Paris, Ile-de-France Harnham Temps plein

    DATA ENGINEER IA PARIS (75) - REMOTE (+4 jours de présence sur site/mois)UP TO 65K€ FIXEPython - SQL - LLM - DockerL'ENTREPRISEUne entreprise qui développe un logiciel pour l'opinion massif recherche un(e) Data Engineer Senior expérimenté(e) et surtout motivé(e) à rejoindre son équipe data et IA ! L'entreprise mets au coeur de son offre...

  • Senior Data Engineer Consultant

    il y a 4 semaines

    Paris, Île-de-France Delta Consulting Company Temps plein

    Delta Consulting Company is seeking a highly skilled Senior Data Engineer Consultant to support one of our clients in the fund industry.The ideal candidate will have at least +5 years of experience as a data engineer with a data-oriented mindset and proven experience in development and maintenance of data pipelines in Palantir Foundry.Key responsibilities...

  • Senior Data Engineer M/F

    il y a 4 semaines

    Paris, Île-de-France Kayrros Temps plein

    Job Title: Senior Data Engineer M/FAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team at Kayrros. As a Senior Data Engineer, you will be responsible for designing, implementing, and operating large-scale imagery and data pipelines on Kubernetes. You will work closely with remote sensing, geospatial, and machine learning...