Europe Arbeitnow ·
full-timeSoftware Engineer, Inference
Lumaai · London, UK
You'll own how Luma's models get served — integrating new architectures into the inference engine, scaling deployments across thousands of machines, and keeping expensive GPU fleets busy while meeting internal SLOs. This is large-scale inference systems work: scheduling, fleet management, deployment pipelines, and reliability across clusters and hardware providers. It fits a strong systems engineer comfortable with model serving and Kubernetes at scale. If you want pure modeling rather than the systems that run models, this is firmly the systems side. What You'll Own Ship new model architectures by integrating them into the inference engine. Collaborate across research, engineering, and infrastructure to optimize model efficiency and deployments. Build internal tooling to measure, profile, and track the lifetime of inference jobs and workflows. Automate, test, and maintain inference services for maximum uptime and reliability. Manage and optimize inference workloads across clusters and hardware providers, and scale deployments across thousands of machines. Build scheduling systems that use expensive GPU resources optimally while meeting SLOs, and maintain CI/CD for model checkpoints and SDKs. First 90 Days One way the first 90 could unfold. Days 1–30 — Immerse & Diagnose: Learn the inference stack, the fleets, and where reliability or utilization break. Days 30–60 — Ship & Validate: Integrate a model or ship tooling/scheduling that improves uptime or GPU utilization. Days 60–90 — Scale & Systemize: Harden deployment pipelines and scheduling across clusters and providers. What You Bring Strong Python and system-architecture skills. Experience deploying models with PyTorch, Hugging Face, vLLM, SGLang, TensorRT-LLM, or similar. Experience with queues, scheduling, traffic control, and fleet management at scale. Experience with Linux, Docker, and Kubernetes, and with orchestration, deployment, and scheduling. Familiarity with Redis and S3-compatible storage. Nice to Have Modern networking stacks including RDMA (RoCE, InfiniBand, NVLink). High-performance large-scale ML systems (100+ GPUs). CUDA, and FFmpeg or multimedia processing. About Luma: Luma's mission is to build unified general intelligence that can generate, understand, and operate in the physical world. We believe multimodality is critical for intelligence — the next step beyond language models comes from vision. Luma is an equal opportunity employer. Find more English Speaking Jobs in United Kingdom on Arbeitnow
| Role | Software Engineer, Inference |
|---|---|
| Company | Lumaai |
| Location | London, UK |
| Type | full-time |
| Compensation | Not disclosed |
| Deadline | Rolling |
Typical process for this type of role
A general guide — the exact steps for this specific listing may vary; check the original posting for details.
- 1ApplicationSubmit your resume through the apply link.
- 2ScreeningRecruiter reviews your background against the role.
- 3AssessmentA technical test, assignment, or coding round, depending on the role.
- 4Interview(s)One or more rounds with the hiring team.
- 5OfferOffer letter with compensation and start date.
Before you apply
0/4More at Lumaai
Other jobs at Lumaai
Explore Related Placements
// similar opportunities
You might also like
Staff Software Engineer, Inference
Coreweaveu
CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators ...
Senior Software Engineer
Kraken
Help us use technology to make a big green dent in the universe! Kraken powers some of the most innovative global developments in energy. We create the technolo...
Staff Software Engineer, Inference
Anthropic
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for s...
Software Engineer I
Tripadvisor
About Tripadvisor The Tripadvisor Group connects people to experiences worth sharing, and aims to be the world’s most trusted source for travel and experiences....
Software Engineer
Benchmark
Ben jij een ervaren software engineer die complexe technische vraagstukken niet uit de weg gaat? Voor Benchmark zoeken we een Software Engineer met een diepgaan...
Software Engineer
Axle Careers
About Us At Axle Energy, we’re building the infrastructure that will underpin the decarbonised energy system. Our software moves energy usage to times when elec...