Data Engineer Azure Retail

il y a 4 semaines

Paris, Île-de-France LINCOLN Temps plein
Job Title: Tech Lead / Senior Data Engineer Azure Retail

At Lincoln, we are a Pure Player Data company, reinventing data analysis for over 30 years. As experts in Modern BI, Big Data, and Data Science, we transform your data into powerful solutions for major accounts in sectors such as banking, retail, telecommunications, industrial, healthcare, and more. Our team is dedicated to delivering high-impact data solutions, empowering our clients to make data-driven decisions that drive their success.

Purpose of the Job

The Tech Lead / Senior Data Engineer will lead and contribute to the design, development, maintenance, and evolution of AI and Data Products. This highly technical role aligns with delivering business value as you will be working within an AI and Data Product team. From day one, you will participate in the design, development, and evolution of data pipelines, aiming at serving data to data consumers within the product team.

Key Responsibilities
  • Lead the design, implementation, and optimization of batch and real-time data ingestion pipelines using tools like Databricks (with PySpark) and DBT.
  • Ensure that raw data is cleansed, transformed, and enriched to be analytics-ready while optimizing data processing for speed and cost-efficiency.
  • Design and implement robust database schemas, tables, and views.
  • Optimize storage formats such as Parquet or Delta Lake, enforce data quality checks, and document data lineage.
  • Implement partitioning, bucketing, and indexing strategies to ensure efficient data retrieval.
  • Work closely with data scientists to provide data in the right formats for machine learning and advanced analytics.
  • Collaborate with platform engineers to follow best practices and escalate common needs.
  • Support data analysts with SQL queries, views, and report generation, and assist in deploying machine learning models to production.
  • Implement role-based access controls, data encryption (both at-rest and in-transit), and adhere to industry and organizational data standards.
  • Regularly audit data access and usage to ensure compliance with privacy regulations and best practices.
  • Set up and maintain Azure cloud infrastructure, including configuring Azure Data Lake Storage, Blob Storage, and deploying Databricks clusters.
  • Implement and manage data pipelines using Azure Data Factory and troubleshoot infrastructure-related issues as they arise.
  • Onboard new team members by providing access and initial training on tools.
  • Create comprehensive documentation and knowledge bases for data pipelines, best practices, and tooling.
  • Stay updated with the latest advancements in data engineering technologies.
  • Propose and implement workflow and system optimizations, and proactively identify areas for improvement and automation.
  • Keep the team informed on new features or changes in Azure, Databricks, or related technologies.
Requirements
  • Software Engineering & SQL: Python, SQL, software engineering practices, Python ecosystem, and SQL optimization.
  • Data Architecture: Design, integration, and cloud platform expertise, particularly with Azure and Databricks.
  • Data Processing with Big Data Frameworks: Mastery of PySpark and understanding of Delta Lake.
  • Data Storage & Data Management: Database management, data formats, and storage optimization.
  • Data Integration Tools: Proficiency with Azure Data Factory and DBT for data transformation.
  • Performance Optimization: Query tuning and pipeline optimization.
  • Security & Compliance: Data security, access control, and compliance with regulations.
  • DevOps & Automation: CI/CD, infrastructure as code, and basic knowledge of containerization.
  • Monitoring & Troubleshooting: Familiarity with logging, monitoring tools, and debugging skills.
Benefits
  • Collaborative and Innovative Environment: Work in a team that values creativity and teamwork.
  • Certified Training and Personalized Support: Access to professional development and mentoring to enhance your skills.
  • Remote Work and Flexible Hours: Balance your work and personal life with our flexible working arrangements.
  • Competitive Compensation and Attractive Benefits: Enjoy a rewarding salary package with comprehensive benefits.
  • Mobility Opportunities: Possibility of relocation to Lille, Lyon, or Aix-en-Provence.

  • Data Engineer Azure Retail

    il y a 4 semaines

    Paris, Île-de-France LINCOLN Temps plein

    Job Title: Tech Lead / Senior Data Engineer Azure RetailJob Summary:We are seeking a highly skilled Tech Lead / Senior Data Engineer to join our team at Lincoln. As a key member of our AI and Data Product team, you will be responsible for leading the design, development, and maintenance of AI and Data Products.Key Responsibilities:Lead the design,...

  • Data Engineer Azure Retail

    il y a 4 semaines

    Paris, Île-de-France LINCOLN Temps plein

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Lincoln, a leading data-driven company. As a Tech Lead / Senior Data Engineer, you will play a key role in designing, developing, and maintaining AI and Data Products.Key ResponsibilitiesLead Design and DevelopmentDesign, implement, and optimize batch and real-time data ingestion...

  • Azure Data Engineer

    il y a 4 semaines

    Paris, Île-de-France NES Fircroft Temps plein

    Azure Data EngineerWe are seeking an experienced Azure Data Engineer to join our team at NES Fircroft. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data architectures on the Azure Cloud platform.Key Responsibilities:Design and implement data pipelines using Azure Functions,...

  • Azure Data Engineer

    il y a 4 semaines

    Paris, Île-de-France Glocomms Temps plein

    Job Opportunity: Freelance Azure Data EngineerGloComms, a leading IT Service provider, is seeking an experienced Azure Data Engineer to join their team on a 6-month freelance contract. The successful candidate will be based in either Paris or Lyon and will work on strengthening the company's data team.Key Responsibilities:Design and develop data pipelines...

  • Senior Data Engineer

    il y a 6 jours

    Paris, Île-de-France ECF Data, LLC Temps plein

    We are seeking a Senior Data Engineer to join our Lyon-based expert team and contribute to the development of a client-focused data project platform. As a key member of our team, you will be responsible for designing and implementing data pipelines, developing and integrating data processing solutions, and collaborating with cross-functional teams to ensure...

  • Data Engineer Azure F/H

    il y a 5 jours

    Paris, Île-de-France Valoway Temps plein

    Poste de Data Engineer chez ValowayNous recherchons un Data Engineer expert pour rejoindre notre équipe de Data Engineers et Data Architects au cœur de notre pôle d'excellence Data Platform. Vous serez chargé de développer et de déployer des pipelines de données sécurisés et performants, ainsi que de designer, d'auditer et d'industrialiser des...

  • Azure Data Engineer Position

    il y a 4 semaines

    Paris, Île-de-France Glocomms Temps plein

    Job Title: Azure Data EngineerWe are seeking an experienced Azure Data Engineer to join our team at GloComms. The successful candidate will be responsible for designing and developing data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.Key Responsibilities:Contribute to the design and development of data pipelines using...

  • Azure Data Engineer

    il y a 4 semaines

    Paris, Île-de-France NES Fircroft Temps plein

    Azure Data Engineer – 12 Months ContractAs a key member of our team, you will be responsible for designing, developing, and implementing data architectures on the Azure Cloud platform.Key responsibilities include:Collecting business and user requirements to inform data architecture designDesigning and implementing data pipelines to meet business...

  • Data Engineer

    il y a 1 semaine

    Paris, Île-de-France ECF Data, LLC Temps plein

    Expert Data Engineer WantedECF Data, LLC is seeking a seasoned Data Engineer to bolster their Lyon-based team. The ideal candidate will contribute to a cutting-edge data project platform, leveraging their expertise in Microsoft Azure ecosystem.Key Responsibilities:Collaborate with fellow Data Engineers and developers on technical issues and best...

  • Azure Data Engineer Position

    il y a 4 semaines

    Paris, Île-de-France Glocomms Temps plein

    Job Title: Freelance Azure Data EngineerGlocomms is seeking a highly skilled Freelance Azure Data Engineer to join their team on a 6-month contract. The ideal candidate will have a strong background in data engineering, experience with Azure technologies, and excellent problem-solving skills.Key Responsibilities:Design and develop data pipelines using Azure...

  • Data Engineer

    il y a 4 semaines

    Paris, Île-de-France ECF Data, LLC Temps plein

    Cloud Data EngineerECF Data, LLC is seeking a highly skilled Cloud Data Engineer to join their team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems on the cloud.Key Responsibilities:Design and implement data pipelines using Azure Data Factory and Azure Data...

  • Data Engineer

    il y a 2 semaines

    Paris, Île-de-France ECF Data, LLC Temps plein

    Job Title: Data Engineer - LyonECF Data, LLC is seeking a skilled Data Engineer to join our Lyon-based team. As a Data Engineer, you will play a crucial role in contributing to our client-focused data project platform.About the RoleWe are looking for a highly motivated and experienced Data Engineer to join our team. The ideal candidate will have a strong...

  • Azure Data Engineer

    il y a 1 mois

    Paris, Île-de-France emagine Consulting Temps plein

    Job Title: Azure Data EngineerJob Summary:We are seeking an experienced Azure Data Engineer to join our team at emagine Consulting. As a key member of our team, you will be responsible for designing, building, and maintaining data ingestion pipelines, particularly focusing on non-tabular data such as images and documents.Responsibilities:Design and implement...

  • Data Engineer Azure F/H

    il y a 2 jours

    Paris, Île-de-France Valoway Temps plein

    Poste de Data Engineer chez ValowayNous recherchons un Data Engineer expert pour rejoindre notre équipe de Data Engineers et Data Architects au coeur de notre pôle d'excellence Data Platform. Vous serez chargé de développer et de déployer des pipelines de données sécurisés et performants, ainsi que de designer, d'auditer et d'industrialiser des...

  • Data Engineer Azure

    il y a 2 semaines

    Paris, Île-de-France NSI France Temps plein

    MissionDans le cadre du programme de transformation du SI, l'équipe Data intervient sur les périmètres Data du projet. La mission consiste à intégrer l'équipe Projets en charge de l'intégration des données de l'entreprise au sein de la plateforme Data sous le Cloud Azure afin de couvrir les besoins Big Data et BI de nos...

  • Data Engineer

    Il y a 2 mois

    Paris, Île-de-France emagine Consulting Temps plein

    We are seeking a talented Azure Data Engineer to join our team working on cutting-edge Medical AI & Analytics projects. This role involves building and maintaining data ingestion pipelines, optimizing platform efficiency, and collaborating with agile teams to drive ongoing development. Key responsibilities include: Designing and implementing scalable data...

  • Ingénieur Data Azure

    il y a 4 semaines

    Paris, Île-de-France SQLI Temps plein

    Rejoignez notre équipe Data à SQLINous sommes à la recherche d'un Ingénieur Data Azure passionné pour rejoindre notre équipe dynamique de +40 passionnés au sein du pôle Data de SQLI.ContexteNous travaillons avec des clients grands comptes dans les secteurs des services financiers, de l'industrie et du retail. Nous sommes orientés vers le delivery et...

  • Data Engineer

    il y a 4 semaines

    Paris, Île-de-France ECF Data, LLC Temps plein

    Job Title: Data EngineerECF Data, LLC is seeking a highly skilled Data Engineer to join their team. The ideal candidate will have expertise in Microsoft Azure ecosystem and experience in development and integration in Azure Data Lake Store.Responsibilities:Design and develop data pipelines using Azure Data FactoryImplement data flows using Spark and...

  • Ingénieur Data Azure

    il y a 2 semaines

    Paris, Île-de-France SQLI Temps plein

    Rejoignez notre équipe Data à SQLINous sommes à la recherche d'un Ingénieur Data Azure passionné pour rejoindre notre équipe dynamique de +40 passionnés au sein du pôle Data de SQLI.ContexteNous travaillons avec des clients grands comptes dans les secteurs des services financiers, de l'industrie et du retail. Nous sommes orientés vers le delivery et...

  • Senior Azure Data Engineer

    il y a 3 semaines

    Paris, Île-de-France emagine Consulting Temps plein

    Project Overview:We are seeking a highly skilled Senior Azure Data Engineer to join our team at emagine Consulting. The successful candidate will be responsible for designing and implementing a new data platform based on Azure, with a focus on data modeling, data ingestion, and data quality solutions.Key Responsibilities:Design and implement a data platform...