Europe Arbeitnow ·
full-timeAgentic Compiler Engineer
Kog · Paris, France
ABOUT KOG Kog builds a co-designed inference stack for real-time AI agents on standard datacenter GPUs, spanning model architecture, inference engine, compilers, and low-level GPU kernels. On the model side, we developed Laneformer 2B and Delayed Tensor Parallelism (DTP), a Transformer architecture that overlaps communication with useful computation and weight streaming. On the systems side, the Kog Inference Engine runs this stack on standard AMD and NVIDIA datacenter GPUs. Kog generates 3,500 tokens/s per request on 8 AMD MI300X GPUs and 2,100 tokens/s per request on 8 NVIDIA H200 GPUs, in FP16 at batch size 1, with quantization and speculative decoding disabled. Our next major project is AGCO, our agentic compiler. AGCO is designed to optimize LLMs across different GPUs and optimization targets, including very fast inference. The team has 10 people, including 9 engineers and researchers and 4 PhDs. Test it at playground.kog.ai. Read the technical details on the Kog Labs blog. WHAT YOU WILL WORK ON You will work directly on AGCO. The goal is to build a system that can explore ways to optimize LLM execution, generate changes, compile them, check correctness, run them on real hardware, measure the results, and use this feedback to guide the next optimization. You will contribute to areas such as: Compiler and IR design for representing and transforming LLM computations. Optimization passes, lowering, and code generation. Search methods for exploring different implementations and execution strategies. Verification and correctness checks for generated changes. GPU execution, profiling, and performance optimization. LLM inference across operators, memory, parallelism, and communication. Optimization loops that connect generated changes to measurements on real GPUs. One direction we are exploring combines an IR, a verifier, a compiler, and a search optimizer. We plan to start with focused problems, build working prototypes, and extend the system from what we learn. Your main area will depend on your experience, skills, and interests. You may focus more on compilers, GPU systems, or LLM inference while working closely with people across the full stack. WHAT WE LOOK FOR We look for engineers with deep technical expertise and original work in at least one area relevant to AGCO. Relevant experience includes: Compiler engineering, including optimization passes, IRs, lowering, code generation, LLVM, or MLIR. GPU programming with CUDA, HIP, Metal, Vulkan, or similar technologies. GPU performance work involving kernels, memory, synchronization, profiling, or hardware behavior. LLM inference engines and performance optimization. Attention, MoE, parallelism, communication, or other systems-level parts of LLM execution. Formal verification, equivalence checking, SAT/SMT, or related methods. Systems that generate, search, test, benchmark, or optimize code automatically. We care about what you personally built and the technical decisions behind it. Strong candidates can explain the problem, their approach, the alternatives they explored, and how they measured the result. We review technical work during the process. This can be public code, an upstream contribution, a paper, a thesis, a technical project, or a detailed write-up based on work you can share. WHAT WE OFFER You will join a small team building AGCO as a core part of Kog's technology. Work at the intersection of compilers, GPU systems, and LLM inference. Direct access to engineers working across the full inference stack. A fast loop from an optimization idea to compilation, execution, verification, and measurement on real GPUs. The opportunity to go deep in your strongest technical area while expanding into the other parts of the stack. High ownership over technical decisions and systems that will shape how Kog optimizes LLM inference. This role is based in Paris, and we are looking for candidates who can relocate to Paris and work closely with the team. Find more English Speaking Jobs in France on Arbeitnow
| Role | Agentic Compiler Engineer |
|---|---|
| Company | Kog |
| Location | Paris, France |
| Compensation | Not disclosed |
| Deadline | Rolling |
Typical process for this type of role
A general guide — the exact steps for this specific listing may vary; check the original posting for details.
- 1ApplicationSubmit your resume through the apply link.
- 2ScreeningRecruiter reviews your background against the role.
- 3AssessmentA technical test, assignment, or coding round, depending on the role.
- 4Interview(s)One or more rounds with the hiring team.
- 5OfferOffer letter with compensation and start date.
Before you apply
0/4Explore Related Placements
// similar opportunities
You might also like
Analytics Engineer
Ledger
We’re a team of experts pushing the limits of what’s possible, united by our common goal to unlock true freedom through digital ownership, making technology acc...
Software Engineer Apprentice
Mirakl - Labs
About Mirakl: Founded in 2012, Mirakl has been at the forefront of marketplace innovation, empowering every business to compete in the platform economy. Today, ...
Data Engineer
Alan
Health can’t wait . Not for symptoms to get worse. Not for a six‑month appointment. Not for a system to catch up. But that’s exactly how healthcare works today....
Senior IT Engineer
Alan
Health can’t wait . Not for symptoms to get worse. Not for a six‑month appointment. Not for a system to catch up. But that’s exactly how healthcare works today....
Applied AI Engineer, Startups (codex)
Openai
About the team The Applied AI Engineering team works closely with frontier startups. We are trusted advisors to, and thought partners with, startups to ensure t...
Backend Engineer (go)
Prelude
About Prelude Prelude is redefining how companies authenticate and onboard users - turning what's traditionally a cost center into a growth lever. Our flagship ...