Senior Software Data Engineer

il y a 5 jours


Paris, France HG Insights Temps plein

HG Insights is the global leader in technology intelligence, delivering actionable AI‑driven insights through advanced data science and scalable big data solutions. Our Big Data Insights Platform processes billions of unstructured documents and powers a vast data lake, enabling enterprises to make strategic, data‑driven decisions. Join our team to solve complex data challenges at scale and shape the future of B2B intelligence. What You’ll Do: Design, build, and optimize large‑scale distributed data pipelines for processing billions of unstructured documents using Databricks, Apache Spark, and cloud‑native big data tools. Architect and scale enterprise‑grade big‑data systems, including data lakes, ETL/ELT workflows, and syndication platforms for customer‑facing Insights‑as‑a‑Service (InaaS) products. Collaborate with product teams to develop features across databases, backend services, and frontend UIs that expose actionable intelligence from complex datasets. Implement cutting‑edge solutions for data ingestion, transformation, and analytics using Hadoop/Spark ecosystems, Elasticsearch, and cloud services (AWS EC2, S3, EMR). Drive system reliability through automation, CI/CD pipelines (Docker, Kubernetes, Terraform), and infrastructure‑as‑code practices. What You’ll Be Responsible For Leading the development of our Big Data Insights Platform, ensuring scalability, performance, and cost‑efficiency across distributed systems. Mentoring engineers, conducting code reviews, and establishing best practices for Spark optimization, data modeling, and cluster resource management. Building & troubleshooting complex data pipeline issues, including performance tuning of Spark jobs, query optimization, and data quality enforcement. Collaborating in agile workflows (daily stand‑ups, sprint planning) to deliver features rapidly while maintaining system stability. Ensuring security and compliance across data workflows, including access controls, encryption, and governance policies. What You’ll Need BS/MS/Ph.D. in Computer Science or related field, with 5+ years of experience building production‑grade big data systems. Expertise in Scala/Java for Spark development, including optimization of batch/streaming jobs and debugging distributed workflows. Proven track record with Databricks, Hadoop/Spark ecosystems, and SQL/NoSQL databases (MySQL, Elasticsearch). Cloud platforms (AWS EC2, S3, EMR) and infrastructure‑as‑code tools (Terraform, Kubernetes). RESTful APIs, microservices architectures, and CI/CD automation. Leadership experience as a technical lead, including mentoring engineers and driving architectural decisions. Strong understanding of agile practices, distributed computing principles, and data lake architectures. Airflow orchestration (DAGs, operators, sensors) and integration with Spark/Databricks. 7+ years of designing, modeling and building big data pipelines in an enterprise work setting. Nice‑to‑Haves Experience with machine learning pipelines (Spark MLlib, Databricks ML) for predictive analytics. Knowledge of data governance frameworks and compliance standards (GDPR, CCPA). Contributions to open‑source big data projects or published technical blogs/papers. DevOps proficiency in monitoring tools (Prometheus, Grafana) and serverless architectures. Seniority level Mid‑Senior level Employment type Full‑time Job function Information Technology Industries Software Development Lille, Hauts‑de‑France, France #J-18808-Ljbffr


  • Senior Software Engineer

    il y a 1 semaine


    Paris, Île-de-France CAST Software Inc. Temps plein

    We're developing innovative solutions that leverage our Software Intelligence products (CAST Highlight and CAST Imaging) to enhance AI's capabilities in software engineering contexts.As a Senior Software Engineer on this initiative, you will:Design and implement integrations between our Software Intelligence products and modern LLM frameworksDevelop APIs and...


  • Paris, France Criteo Temps plein

    Senior Software Development - Data EngineerJoin to apply for the Senior Software Development - Data Engineer role at CriteoSenior Software Development - Data Engineer3 weeks ago Be among the first 25 applicantsJoin to apply for the Senior Software Development - Data Engineer role at CriteoGet AI-powered advice on this job and more exclusive features.What if,...

  • Senior Software Engineer AI

    il y a 2 semaines


    Paris, France CAST Software Temps plein

    We're developing innovative solutions that leverage our Software Intelligence products (CAST Highlight and CAST Imaging) to enhance AI's capabilities in software engineering contexts. As a Senior Software Engineer on this initiative you will : Design and implement integrations between our Software Intelligence products and modern LLM frameworks Develop APIs...

  • Senior Software Engineer

    il y a 5 jours


    Paris, France Artefact Temps plein

    Artefact is a new generation of data consulting firm with more than 1,200 employees in 19 countries dedicated to supporting our clients' transformation.We offer a wide range of data-driven solutions, which we adapt to our clients' specific needs, from AI projects to automate internal processes at every stage of their value chain, to the creation of...

  • Senior Software Engineer

    il y a 5 jours


    Paris, France LinkedIn Job Wrapping Temps plein

    Artefact is a leading global consulting company dedicated to accelerating the adoption of data and AI to positively impact people and organizations.We specialize in data & AI transformation and data-driven marketing to drive tangible business results across the entire enterprise value chain. Artefact offers the most comprehensive set of data-driven solutions...

  • Senior Software Engineer

    il y a 2 jours


    Paris, France the Jungle Temps plein

    9th arrondissement of Paris, 75009, Paris, France Who are we Artefact is a leading global consulting company dedicated to accelerating the adoption of data and AI to positively impact people and organizations. We specialize in data & AI transformation and data-driven marketing to drive tangible business results across the entire enterprise value chain....


  • Paris, France Qonto Temps plein

    **Our mission**? Creating the freedom for SMEs to succeed in business and beyond, by delivering Europe’s leading finance workspace. We combine business-class tools (seamless invoicing, spend management, and pre-accounting) with unwaveringly attentive 24/7 support, designed to help businesses breeze through all things finance. **Our journey**: Founded by...


  • Paris, France Pigment Temps plein

    Join to apply for the Senior Frontend Software Engineer role at PigmentJoin to apply for the Senior Frontend Software Engineer role at PigmentGet AI-powered advice on this job and more exclusive features.This range is provided by Pigment. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Base pay rangeJoin...


  • Paris, France CAST Software Temps plein

    A software solution company in Paris is seeking a Senior Software Engineer to work on innovative solutions utilizing AI in software engineering. The role involves designing integrations between products and modern LLM frameworks, as well as developing APIs that convert code insights into formats that AI can use. Candidates should have strong full-stack...

  • Senior Software Engineer

    il y a 5 jours


    Paris, France Swile Temps plein

    Join to apply for the Senior Software Engineer - Paris role at SwileContinue with Google Continue with Google1 year ago Be among the first 25 applicantsJoin to apply for the Senior Software Engineer - Paris role at SwileAt Swile, we believe that good products can help reduce friction in daily professional life and boost employee satisfaction. Today, we...