Data Engineer Azure Retail

il y a 2 semaines


IledeFrance, France LINCOLN Temps plein

CDI : Tech Lead / Senior Data Engineer Azrue Retail - H/F🚀

At Lincoln , we are a Pure Player Data company, reinventing data analysis for over 30 years. As experts in Modern BI, Big Data, and Data Science 💡, we transform your data into powerful solutions for major accounts in sectors such as banking, retail, telecommunications, industrial, healthcare, and more. Our team is dedicated to delivering high-impact data solutions, empowering our clients to make data-driven decisions that drive their success. Join us and contribute to shaping the future of data analytics with our dynamic and innovative team.

Purpose of the Job

The Tech Lead / Senior Data Engineer will lead and contribute to the design, development, maintenance, and evolution of AI and Data Products. This highly technical role aligns with delivering business value as you will be working within an AI and Data Product team. From day one, you will participate in the design, development, and evolution of data pipelines, aiming at serving data to data consumers within the product team.

What You’ll Do

As a Tech Lead / Senior Data Engineer , your key responsibilities will include:

Lead Design and Development 💻

  • Spearhead the design, implementation, and optimization of batch and real-time data ingestion pipelines using tools like Databricks (with PySpark) and DBT.
  • Ensure that raw data is cleansed, transformed, and enriched to be analytics-ready while optimizing data processing for speed and cost-efficiency.

Architect & Manage Data Systems 🛠️

  • Design and implement robust database schemas, tables, and views.
  • Optimize storage formats such as Parquet or Delta Lake, enforce data quality checks, and document data lineage.
  • Implement partitioning, bucketing, and indexing strategies to ensure efficient data retrieval.

Collaborate with Data Experts 🤝

  • Work closely with data scientists to provide data in the right formats for machine learning and advanced analytics.
  • Collaborate with platform engineers to follow best practices and escalate common needs.
  • Support data analysts with SQL queries, views, and report generation, and assist in deploying machine learning models to production.

Ensure Security & Compliance 🔒

  • Implement role-based access controls, data encryption (both at-rest and in-transit), and adhere to industry and organizational data standards.
  • Regularly audit data access and usage to ensure compliance with privacy regulations and best practices.

Manage Infrastructure & Configuration 🏗️

  • Set up and maintain Azure cloud infrastructure, including configuring Azure Data Lake Storage, Blob Storage, and deploying Databricks clusters.
  • Implement and manage data pipelines using Azure Data Factory and troubleshoot infrastructure-related issues as they arise.

Document & Train 📝

  • Onboard new team members by providing access and initial training on tools.
  • Create comprehensive documentation and knowledge bases for data pipelines, best practices, and tooling.

Drive Continuous Improvement 🔄

  • Stay updated with the latest advancements in data engineering technologies.
  • Propose and implement workflow and system optimizations, and proactively identify areas for improvement and automation.
  • Keep the team informed on new features or changes in Azure, Databricks, or related technologies.

Hard Skills 💼

  • Software Engineering & SQL: Python, SQL, software engineering practices, Python ecosystem, and SQL optimization.
  • Data Architecture: Design, integration, and cloud platform expertise, particularly with Azure and Databricks.
  • Data Processing with Big Data Frameworks: Mastery of PySpark and understanding of Delta Lake.
  • Data Storage & Data Management: Database management, data formats, and storage optimization.
  • Data Integration Tools: Proficiency with Azure Data Factory and DBT for data transformation.
  • Performance Optimization: Query tuning and pipeline optimization.
  • Security & Compliance: Data security, access control, and compliance with regulations.
  • DevOps & Automation: CI/CD, infrastructure as code, and basic knowledge of containerization.
  • Monitoring & Troubleshooting: Familiarity with logging, monitoring tools, and debugging skills.

🌟 Benefits

  • Collaborative and Innovative Environment: Work in a team that values creativity and teamwork.
  • Certified Training and Personalized Support: Access to professional development and mentoring to enhance your skills.
  • Remote Work and Flexible Hours: Balance your work and personal life with our flexible working arrangements.
  • Competitive Compensation and Attractive Benefits: Enjoy a rewarding salary package with comprehensive benefits.
  • Mobility Opportunities: Possibility of relocation to Lille, Lyon, or Aix-en-Provence.

Recruitment Process

  • Two Interviews: A streamlined process with a Human Resources interview followed by a technical interview.

If you're passionate about data challenges and eager to join a dynamic and innovative team, apply now and help redefine the future of data analytics at Lincoln 😉


  • Data Engineer Azure Retail

    il y a 2 semaines


    Ile-de-France LINCOLN Temps plein

    CDI : Tech Lead / Senior Data Engineer Azrue Retail - H/F🚀 At Lincoln , we are a Pure Player Data company, reinventing data analysis for over 30 years. As experts in Modern BI, Big Data, and Data Science 💡, we transform your data into powerful solutions for major accounts in sectors such as banking, retail, telecommunications, industrial,...

  • Azure Data Engineer

    il y a 3 jours


    Ile-de-France Glocomms Temps plein

    An IT Service client of GloComms are looking to strengthen their current Data team with an experienced Azure Data Engineer on a 6 month initial freelance contract for either one of their Paris or Lyon offices. Role: Freelance Azure Data Engineer Duration: 6 months confirmed Location: Paris / Lyon offices Hybrid Working: 3 days remote per week Start...

  • Azure Data Engineer

    il y a 2 jours


    Ile-de-France Glocomms Temps plein

    An IT Service client of GloComms are looking to strengthen their current Data team with an experienced Azure Data Engineer on a 6 month initial freelance contract for either one of their Paris or Lyon offices. Role: Freelance Azure Data Engineer Duration: 6 months confirmed Location: Paris / Lyon offices Hybrid Working: 3 days remote per week Start...

  • Data Engineer Azure Retail

    il y a 2 semaines


    Île-de-France LINCOLN Temps plein

    CDI : Tech Lead / Senior Data Engineer Azrue Retail - H/FAt Lincoln, we are a Pure Player Data company, reinventing data analysis for over 30 years. As experts in Modern BI, Big Data, and Data Science , we transform your data into powerful solutions for major accounts in sectors such as banking, retail, telecommunications, industrial, healthcare, and more....

  • Data Engineer Azure Retail

    il y a 2 semaines


    Île-de-France, France LINCOLN Temps plein

    CDI : Tech Lead / Senior Data Engineer Azrue Retail - H/FAt Lincoln, we are a Pure Player Data company, reinventing data analysis for over 30 years. As experts in Modern BI, Big Data, and Data Science , we transform your data into powerful solutions for major accounts in sectors such as banking, retail, telecommunications, industrial, healthcare, and more....

  • Azure Data Engineer

    il y a 2 jours


    Île-de-France Glocomms Temps plein

    An IT Service client of GloComms are looking to strengthen their current Data team with an experienced Azure Data Engineer on a 6 month initial freelance contract for either one of their Paris or Lyon offices.Role: Freelance Azure Data EngineerDuration: 6 months confirmedLocation: Paris / Lyon officesHybrid Working: 3 days remote per weekStart Date: Start of...

  • Azure Data Engineer

    il y a 3 jours


    Île-de-France, France Glocomms Temps plein

    An IT Service client of GloComms are looking to strengthen their current Data team with an experienced Azure Data Engineer on a 6 month initial freelance contract for either one of their Paris or Lyon offices.Role: Freelance Azure Data EngineerDuration: 6 months confirmedLocation: Paris / Lyon officesHybrid Working: 3 days remote per weekStart Date: Start of...

  • Data engineer

    il y a 6 jours


    Ile-de-France MP DATA Temps plein

    MP DATA recrute un(e) Data Engineer (H/F). Dans le cadre de la transformation digitale industrielle, l’équipe de data engineering en charge de l’exploitation du Cluster Big Data cherche à se développer : afin de répondre aux attentes des départements opérationnels en termes de : Valorisation et d'exploitation des données de...

  • Data engineer

    il y a 7 jours


    Ile-de-France MP DATA Temps plein

    MP DATA recrute un(e) Data Engineer (H/F). Dans le cadre de la transformation digitale industrielle, l’équipe de data engineering en charge de l’exploitation du Cluster Big Data cherche à se développer : afin de répondre aux attentes des départements opérationnels en termes de : Valorisation et d'exploitation des données de...

  • Senior Data Science Engineer

    il y a 2 semaines


    Ile-de-France LINCOLN Temps plein

    CDI : Tech Lead / Senior Data Engineer Azrue Retail - H/F&##128640; At Lincoln , we are a Pure Player Data company, reinventing data analysis for over 30 years. As experts in Modern BI, Big Data, and Data Science &##128161;, we transform your data into powerful solutions for major accounts in sectors such as banking, retail, telecommunications,...

  • Senior Data Science Engineer

    il y a 2 semaines


    Ile-de-France LINCOLN Temps plein

    CDI : Tech Lead / Senior Data Engineer Azrue Retail - H/F&##128640; At Lincoln , we are a Pure Player Data company, reinventing data analysis for over 30 years. As experts in Modern BI, Big Data, and Data Science &##128161;, we transform your data into powerful solutions for major accounts in sectors such as banking, retail, telecommunications,...

  • Data Engineer

    il y a 1 mois


    Paris, 75001, Ile-de-France, Paris Hanson Regan Limited Temps plein

    Hanson Reganis recherche actuellement un Data Engineer (Python Azure) pour travailler avec une équipe de données existante sur une gamme de nouveaux projets passionnants et essentiels à l'entreprise. 2 jours par semaine sur site à Paris sont requis pour ce poste. Les candidats devront maîtriser Python (Spark), SQL et les requêtes SQL, les...

  • Data Engineer

    il y a 3 semaines


    Île-de-France Oceane consulting Temps plein

    Description du poste :Nous recherchons un Data Engineer talentueux et motivé pour rejoindre notre équipe dynamique. En tant que Data Engineer, vous jouerez un rôle clé dans la conception, le développement et la maintenance de notre infrastructure de données, en exploitant les technologies Cloud Azure et Databricks. Votre expertise sera essentielle pour...

  • Data Engineer Databricks

    il y a 3 semaines


    Ile-de-France LINCOLN Temps plein

    Lincoln Pure Player Data 💡: Réinventant l'analyse depuis 30 ans . Experts en Modern BI, Big Data et Science des données 📊. Nous transformons vos données en solutions pour les grands comptes, des secteurs bancaire, retail, télécoms, industriel, santé, et plus encore 💼. Description du poste : 🔍 Rejoignez notre équipe en tant que...

  • Data Engineer Databricks

    il y a 2 semaines


    Ile-de-France LINCOLN Temps plein

    Lincoln Pure Player Data 💡: Réinventant l'analyse depuis 30 ans . Experts en Modern BI, Big Data et Science des données 📊. Nous transformons vos données en solutions pour les grands comptes, des secteurs bancaire, retail, télécoms, industriel, santé, et plus encore 💼. Description du poste : 🔍 Rejoignez notre équipe en tant que...

  • consultant informatique

    il y a 1 mois


    Montreuil, 93100, Ile-de-France, Bobigny Hoxton Partners Temps plein

    Nous recherchons un Data Engineer autonome et réactif, capable d'interagir efficacement avec le Product Owner et les équipes métier. Le candidat idéal doit avoir une excellente capacité de communication et une expérience solide en tant que Data Engineer, notamment sur les technologies Databricks et Python dans Azure. Contexte : Après la...

  • Data engineer

    il y a 6 jours


    Île-de-France MP DATA Temps plein

    MP DATA recrute un(e) Data Engineer (H/F).Dans le cadre de la transformation digitale industrielle, l’équipe de data engineering en charge de l’exploitation du Cluster Big Data cherche à se développer : afin de répondre aux attentes des départements opérationnels en termes de :Valorisation et d'exploitation des données de...

  • Data engineer

    il y a 6 jours


    Île-de-France, France MP DATA Temps plein

    MP DATA recrute un(e) Data Engineer (H/F).Dans le cadre de la transformation digitale industrielle, l’équipe de data engineering en charge de l’exploitation du Cluster Big Data cherche à se développer : afin de répondre aux attentes des départements opérationnels en termes de :Valorisation et d'exploitation des données de...

  • Data Engineer

    il y a 1 mois


    France, FR Dataworks Temps plein

    Data Engineer (Cloud Azure)Paris, France45k€-55k€TECH STACK : Environnement Microsoft, Azure Cloud, PythonLA SOCIÉTÉ :Cette agence data a été créée il y a 5 ans et est arrivée aujourd’hui à un beau stade de maturité et de succès : elle est reconnue comme une des agences data de référence, et a développé une expertise R&D sur les outils...

  • Data Engineer

    il y a 1 mois


    France Dataworks Temps plein

    Data Engineer (Cloud Azure)Paris, France45k€-55k€TECH STACK : Environnement Microsoft, Azure Cloud, PythonLA SOCIÉTÉ :Cette agence data a été créée il y a 5 ans et est arrivée aujourd’hui à un beau stade de maturité et de succès : elle est reconnue comme une des agences data de référence, et a développé une expertise R&D sur les outils...