Senior LLM Inference Engineer—Hybrid Work
Enregistrez cette offre et organisez votre recherche
Créez un compte gratuit pour enregistrer des offres d'emploi, créer des alertes et revenir à cette liste depuis votre tableau de bord.
En continuant, vous acceptez nos Conditions d’utilisation & Politique de confidentialité.
Doctolib is seeking a Senior Inference Engineer to lead the self-hosted LLM serving platform for AI-powered healthcare products. You will deploy, tune, and scale open-weight models across a GPU fleet, using Ray Serve/Anyscale and Kubernetes, while ensuring data residency and regulatory compliance within Doctolib's infrastructure across Europe.
You will own the model registry, performance benchmarking, and reliability, building observability dashboards and cost reporting to optimize latency and