Coding challenges, hackathons and developer assessments.
Head of AI Engineering (f/m/x)
Get alerts for roles like this
More Head of AI Engineering (f/m/x) roles in Frankfurt am Main — straight to your inbox. No account needed.
Applying to this role? Tailor your résumé to this job description in one click, then download it clean — no watermark, no subscription.
Job Description
Your mission Own and evolve our AI engineering function — transforming a 15–20 person ML team from research-heavy to a high-throughput, production-grade organization.
You’ll partner with the CTO on strategy, build the platform that unifies LLM access, RAG, and backend services, and ship reliable, scalable AI features that change how banks work.
Key responsibilities Team leadership and org build Hire, mentor, and develop a high-performing team; set the technical bar, operating rhythms, and code/research review practices Organize sub-teams (e. g.
, Core Modeling, AI Platform/Infra, Integrations) with clear ownership, SLOs, and on-call Manage roadmap, capacity planning, and delivery across parallel initiatives Architecture and platform Own the LLM gateway: unified APIs and proxy layers for multi-provider routing (OpenAI, Gemini, Bedrock), with rate limits, fallbacks, and cost tracking Build high-performance RAG pipelines (ingestion, embeddings, vector stores, caching) with robust observability and safety guardrails Partner with Java/ NestJS teams to define clean async contracts, schemas, and eventing patterns; drive low-latency, scalable inference Model lifecycle and operations Lead end-to-end model and prompt lifecycle: data curation, training/fine-tuning, evaluation, deployment, rollback Establish LLMOps / MLOps : model/prompt registries, CI/CD, canary/A/B tests, offline/online evals, drift and cost monitoring Optimize inference throughput and cost (autoscaling, batching, quantization/distillation, caching) Strategy and collaboration Translate company goals into an AI/ML roadmap with measurable outcomes; balance exploration with reliability and cost Own build-vs-buy/vendor strategy for models, infrastructure, and data services; manage budgets and SLAs Governance and security Implement data privacy, security, and compliance practices (RBAC, secrets, auditability); track prompt/model lineage and reproducibility Define incident response, runbooks, and postmortems for AI f
Required Skills
Partner picks for Head of AI Engineering (f/m/x) in Frankfurt am Main
Matched to the skills this page calls for and the candidate's location.
- Partner competitioncovers javaBengaluruVisit partner →
- Partner course provider
Structured programmes for software engineers, data science and DevOps.
covers javaBengaluruVisit partner → - edXVerified partnerPartner course provider
Courses and programmes from universities and institutions worldwide.
Partners are ResumeKart affiliates or institutes it works with; ResumeKart may earn a commission when a candidate enrols. Placement is decided by relevance, not payment. How ResumeKart earns
Prepare to Win This Role
Everything you need to ace the interview and negotiate top-of-band compensation.