Senior Software Engineer

il y a 4 jours

Paris France Sophia Antipolis France Datadog Temps plein

At Datadog, we're building an AI Platform that powers ML and LLM features across our observability and security products. The Serving team plays a mission-critical role in this platform: ensuring that trained models can be reliably deployed and served at scale in production, across multiple data centers and compute environments.

Our goal is to enable self-serve, performant, and observable model inference workflows. This includes building Ray-based serving infrastructure, deploying inference endpoints on both CPU and GPU, supporting rollback strategies, and enabling shadow traffic, A/B testing, and continuous improvement of deployed models.

We're looking for a Senior Software Engineer to lead the design and development of our high-scale model serving systems. This role will work across infrastructure, observability, and ML engineering domains to deliver production-ready inference capabilities used by applied scientists and product teams across Datadog.

At Datadog, we place value in our office culture - the relationships that it builds, the creativity it brings to the table, and the collaboration of being together. We operate as a hybrid workplace to ensure our employees can create a work-life harmony that best fits them.

What You'll Do:

  • Architect and build systems for serving ML and LLM models across all data centers with strong SLAs, observability, and reliability.
  • Design and optimize Ray-based inference infrastructure to handle both low- and high-throughput workloads.
  • Enable applied scientists to deploy and test models via self-service tools, CI/CD pipelines, and rollback mechanisms.
  • Implement A/B testing and shadow deployment capabilities to evaluate new model versions in production.
  • Collaborate with platform teams to improve GPU provisioning, traffic routing, and runtime performance.
  • Instrument inference workflows with rich telemetry (latency, token counts, errors) to drive performance and safety analysis.

Who You Are:

  • You have 6+ years of backend or infrastructure engineering experience, including 2+ years working on ML/AI platforms.
  • You have experience building distributed systems, ideally in model serving, realtime inference, or large-scale APIs.
  • You are proficient in Python, Go, or another systems language and understand performance tuning in high-throughput environments.
  • You are familiar with Ray or other inference-serving frameworks (e.g., TorchServe, Triton, BentoML).
  • You've worked with GPUs and understand how to build infrastructure that supports heterogeneous compute workloads.
  • Bonus points: experience with AI observability, rollback strategies, or in-house deployment proxies.

Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you're passionate about technology and want to grow your skills, we encourage you to apply.

Benefits and Growth:

  • New hire stock equity (RSUs) and employee stock purchase plan (ESPP)
  • Continuous professional development, product training, and career pathing
  • Intradepartmental mentor and buddy program for in-house networking
  • An inclusive company culture, ability to join our Community Guilds (Datadog employee resource groups)
  • Access to Inclusion Talks, our internal panel discussions
  • Free, global mental health benefits for employees and dependents age 6+
  • Competitive global benefits

Benefits and Growth listed above may vary based on the country of your employment and the nature of your employment with Datadog.

  • Senior Staff Software Engineer

    il y a 5 jours

    Sophia Antipolis, France Arteris IP Temps plein

    **Do you want to contribute to the backbone of some of the world’s most popular S**ystem **o**n **C**hip**s?** As a **Senior Staff Software Engineer** at Arteris, you will have a leading role in the development of next generation of Arteris IP solutions, enabling the design of extremely configurable digital logic blocks. We intend to revolutionize the...

  • Senior Software Engineer

    il y a 6 jours

    Paris, France; Sophia Antipolis, France Datadog Temps plein

    At Datadog, we are building an internal AI platform that empowers our teams to train, evaluate, and deploy models at scale. The Annotation & Evaluation team plays a foundational role in ensuring our models are reliable, safe, and production-ready. We design the infrastructure and tooling for dataset labeling, model benchmarking, trust & safety evaluation,...

  • Senior Software Engineer

    il y a 2 semaines

    Paris, France; Sophia Antipolis, France Datadog Temps plein

    The AI Platform owns Datadog's entire AI stack—everything from distributed training infrastructure (for our SOTA models) to the frameworks that power Bits AI, LLMObs, and the next wave of generative‑AI experiences. We're expanding beyond model creation to the tooling that lets engineers ship production‑grade GenAI systems: retrieval‑augmented...

  • Senior C++ Software Engineer – Hardware Prototyping

    il y a 17 heures

    Paris, France Siemens Digital Industries Software Temps plein

    A leading industrial software company is seeking a Senior Software Development Engineer to join their hardware prototyping team in Paris. This role involves developing competitive functionalities, supporting existing solutions, and ensuring quality through automated tests. The ideal candidate will possess a degree in electrical engineering or a related...

  • Senior/Staff Software Engineer

    il y a 2 semaines

    Sophia Antipolis, Provence-Alpes-Côte d'Azur, France Arm Temps plein

    Job OverviewWe are searching for a hardworking and experienced Software Engineer to join the Productivity Engineering Group at Arm, Sophia Antipolis As part of this team, you will collaborate with members of Arm's Central Engineering team to provide solutions that automate design, verification and documentation of next-generation Arm Products. This job will...

  • Senior Software Engineer

    il y a 2 semaines

    Paris, France Skywaves Rise Temps plein

    Hiring Senior Software Engineer Paris, France | Onsite- 5 days Build. Deploy. Scale.Photon is looking for senior engineers who can take cloud & ML solutions from idea to production — directly with clients. You should have:✔ 10+ years in Software / Infra / Applied ML✔ Strong Python / TypeScript / JavaScript✔ AWS | GCP | Azure + Kubernetes✔...

  • Sta Software Engineer

    il y a 5 jours

    Sophia Antipolis, France Menta Temps plein

    Full-time - Sophia-Antipolis, France or Yerevan, Armenia Software Engineer to contribute to the development and optimization of Static Timing Analysis (STA) tools **Missions**: **Responsabilities** - Develop and optimize Static Timing Analysis (STA) algorithms for EDA tools. - Collaborate closely with hardware engineers to translate STA concepts into...

  • Senior Software Engineer

    il y a 19 heures

    Paris, France RequireTech Resources Ltd Temps plein

    My Client in Paris, France is looking for a Senior Software Engineer.As a Senior Software Engineer, you will work closely with their Software engineers and field application engineers to deliver a powerful configuration and implementation tool for Network-on-Chip (NoC) systems.While no prior electronics experience is required, a background in this area is...

  • Senior Software Development Engineer(

    il y a 18 heures

    Paris, France Siemens Digital Industries Software Temps plein

    Senior Software Development Engineer (m/f/d, C++, hardware prototyping) 4 days ago – Be among the first 25 applicants. Siemens Digital Industries Software – Where today meets tomorrow. Let's make the difference together! Meet the team – Video. Siemens Digital Industries (DI) is an innovation leader in automation and digitalization, collaborating...

  • Senior Connectivity Software Engineer Iot

    il y a 6 jours

    Sophia Antipolis, France NXP Semiconductors Temps plein

    **Ready to join the future of innovation in connected microcontrollers for Edge Processing **?** As an embedded software engineer you will be addressing the challenges of integrating connectivity stacks on microcontroller like driver and OS integration, multiprotocol coexistence or low power optimization. **Your responsibilities** - Contribute to the...