Skip to main content
ResumeKart
← Back to Jobs

Staff Machine Learning Engineer, LLM Inference Optimization

Nebiusβ€’Berlin
Full-time7-15
πŸ‘οΈ 0 viewsβ€’πŸ“ 0 applicationsβ€’Posted 10/21/2026β€’Expires 11/21/2026
Tailor Resume for This JobCheck ATS Score

Get alerts for roles like this

More Staff Machine Learning Engineer, LLM Inference Optimization roles in Berlin β€” straight to your inbox. No account needed.

Applying to this role? Tailor your rΓ©sumΓ© to this job description in one click, then download it free β€” just a small ResumeKart footer, no subscription.

Job Description

About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure. Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI. Listed on Nasdaq (NBIS) and headquartered in Amsterdam, we have a global footprint with R&D hubs across Europe, the UK, North America and Israel. Our team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software and AI R&D. Role Summary Nebius Token Factory is building production-grade inference for open-source, customer, and internally optimized models. This role owns the path from model artifact to fast, reliable, cost-efficient endpoint. The work sits at the intersection of model internals, inference engines, serving architecture, benchmarking, and production deployment. What You Will Do Own a platform-level optimization pillar such as quantization, speculative decoding, <span data-highlight

Required Skills

GPU orchestrationInference optimizationModel internalsInference enginesServing architectureBenchmarkingProduction deploymentQuantizationSpeculative decoding

Partner picks for Staff Machine Learning Engineer, LLM Inference Optimization in Berlin

Matched to the skills this page calls for and the candidate's location.

Partner
  • edXVerified partner
    Partner course provider

    Courses and programmes from universities and institutions worldwide.

  • UdemyVerified partner
    Partner course provider

    A marketplace of instructor-created courses across technology, business and creative skills.

Partners are ResumeKart affiliates or institutes it works with; ResumeKart may earn a commission when a candidate enrols. Placement is decided by relevance, not payment. How ResumeKart earns

The best-paying roles in your field. Every week. Free.

Get job alerts and salary insights in your inbox

We respect your privacy. Unsubscribe anytime with one click.