Europe Arbeitnow ·
full-timeSenior IA Inference Engineer (x/f/m)
Doctolib · Paris, Paris
Set a new pulse for healthcare! We are looking for a Senior Inference Engineer to join the ML Platform (TIGER) team in AI & Machine Learning . Your mission will be to power Doctolib's AI-driven healthcare products — from Consultation Assistant to Phone Assistant and Health Companion — by owning the self-hosted LLM serving platform that keeps the most sensitive patient data within infrastructure Doctolib controls. You will build and operate the shared foundations that every AI feature team relies on: deploying, tuning, and scaling open-weight models across our GPU fleet, contributing directly to faster, safer, and more cost-efficient AI for care teams and patients across Europe. Working in the tech team at Doctolib means building innovative products and features to improve the daily lives of care teams and patients. What you'll do Your responsibilities include but are not limited to: Build the shared LLM serving foundations with MLOps engineers — define the serving stack, GPU capacity planning, and deployment automation for open-weight models (Gemma, Mistral, Llama, Qwen, and their fine-tuned variants) on Ray Serve / Anyscale, while shaping the evolution toward Kubernetes-based orchestration Own the model registry and promotion path — establish clear processes for versioning, validating, and promoting models into production, benchmark performance and output quality under realistic workloads, and maintain the curated model catalog together with the Agents Platform team Optimize inference performance and efficiency — operate and tune serving engines (vLLM, Triton Inference Server, TensorRT-LLM) to reduce time-to-first-token, inter-token latency, and cost per token through batching, caching, quantization, and parallelism strategies across our GPU fleet (L4 to H200) Own production reliability and disaster recovery — define SLOs, run load tests before launches, implement safe rollouts, rollbacks, and autoscaling, and participate in on-call and incident response Make serving performance and costs measurable — build Datadog dashboards, alerting, and cost reporting to track latency, GPU utilization, and inference spend, and identify opportunities to improve resource efficiency Keep the inference stack secure, compliant, and evolving — work with Security and Privacy on network isolation, data residency, and auditability, while continuously assessing new models, serving engines (such as SGLang), and GPU generations Who you are Before you read on: if you don't have the exact profile described below, but you feel this job description matches your skill set, we still encourage you to apply. <di
| Role | Senior IA Inference Engineer (x/f/m) |
|---|---|
| Company | Doctolib |
| Location | Paris, Paris |
| Type | full-time |
| Compensation | Not disclosed |
| Deadline | Rolling |
Typical process for this type of role
A general guide — the exact steps for this specific listing may vary; check the original posting for details.
- 1ApplicationSubmit your resume through the apply link.
- 2ScreeningRecruiter reviews your background against the role.
- 3AssessmentA technical test, assignment, or coding round, depending on the role.
- 4Interview(s)One or more rounds with the hiring team.
- 5OfferOffer letter with compensation and start date.
Before you apply
0/4More at Doctolib
Other jobs at Doctolib
- Account Executive - IDF (x/f/m) · Paris, Paris
- Senior Agents Platform Engineer (x/f/m) · Paris, Paris
- General Accountant Lead & Analyst (x/f/m) · Paris, Paris
- Product Design Director - Patient (x/f/m) · Paris, Paris
- Senior Software Engineer - Python (x/f/m) · Paris, Paris
Internships at Doctolib
- Software Engineer Intern - Fullstack (x/f/m) - Amsterdam · Amsterdam
- IA Engineer Intern (x/f/m) - Paris · Paris, Paris
- Data Quality Operations Intern (x/f/m) · Paris, Paris
Explore Related Placements
// similar opportunities
You might also like
Senior AI Data Engineer (x/f/m)
Doctolib
Your Impact We are looking for a Senior Data Engineer to join the AI Team working on our AI Medical Companion . Your mission will be to build and optimize the d...
Senior Software Engineer - Python (x/f/m)
Doctolib
We are looking for a Python Senior Software Engineer to join the ATP team in Application Platform Domain. As a Senior Software Engineer, your mission will be to...
Senior Agents Platform Engineer (x/f/m)
Doctolib
Set a new pulse for healthcare! We are looking for a Senior Agents Platform Engineer to join the ML Platform (TIGER) team in AI & Machine Learning . Your missio...
ML Inference Engineer
Spaitial
SpAItial is pioneering the next generation of World Models, pushing the boundaries of generative AI, computer vision, and the simulation of reality. We are movi...
Senior ML Ops (x/f/m)
Doctolib
Set a new pulse for healthcare! We are looking for a Senior MLOps Engineer to join the ML Platform team. Your mission will be to build and scale the infrastruct...
Senior Cost Engineer (m/f)
T.E.S
Technical Engineering Support ( TES ) is an engineering services company with over 30 years of experience, specializing in test coordination and industrial comm...