Senior LLM Inference Engineer—Hybrid Work

Il y a 4 jours

LevalloisPerret, Île-de-France Doctolib Temps plein 110 000 € - 150 000 € Contrat

Doctolib is seeking a Senior Inference Engineer to lead the self-hosted LLM serving platform for AI-powered healthcare products. You will deploy, tune, and scale open-weight models across a GPU fleet, using Ray Serve/Anyscale and Kubernetes, while ensuring data residency and regulatory compliance within Doctolib's infrastructure across Europe.

You will own the model registry, performance benchmarking, and reliability, building observability dashboards and cost reporting to optimize latency and