Skip to main content
ResumeKart
← Back to Jobs

Head of AI Engineering (f/m/x)

neoshareFrankfurt am Main
Full-time7-15
👁️ 0 views📝 0 applicationsPosted 8/29/2026Expires 9/28/2026
Tailor Resume for This JobCheck ATS Score

Get alerts for roles like this

More Head of AI Engineering (f/m/x) roles in Frankfurt am Main — straight to your inbox. No account needed.

Applying to this role? Tailor your résumé to this job description in one click, then download it clean — no watermark, no subscription.

Job Description

Your mission Own and evolve our AI engineering function — transforming a 15–20 person ML team from research-heavy to a high-throughput, production-grade organization.

You’ll partner with the CTO on strategy, build the platform that unifies LLM access, RAG, and backend services, and ship reliable, scalable AI features that change how banks work.

Key responsibilities Team leadership and org build Hire, mentor, and develop a high-performing team; set the technical bar, operating rhythms, and code/research review practices Organize sub-teams (e. g.

, Core Modeling, AI Platform/Infra, Integrations) with clear ownership, SLOs, and on-call Manage roadmap, capacity planning, and delivery across parallel initiatives Architecture and platform Own the LLM gateway: unified APIs and proxy layers for multi-provider routing (OpenAI, Gemini, Bedrock), with rate limits, fallbacks, and cost tracking Build high-performance RAG pipelines (ingestion, embeddings, vector stores, caching) with robust observability and safety guardrails Partner with Java/ NestJS teams to define clean async contracts, schemas, and eventing patterns; drive low-latency, scalable inference Model lifecycle and operations Lead end-to-end model and prompt lifecycle: data curation, training/fine-tuning, evaluation, deployment, rollback Establish LLMOps / MLOps : model/prompt registries, CI/CD, canary/A/B tests, offline/online evals, drift and cost monitoring Optimize inference throughput and cost (autoscaling, batching, quantization/distillation, caching) Strategy and collaboration Translate company goals into an AI/ML roadmap with measurable outcomes; balance exploration with reliability and cost Own build-vs-buy/vendor strategy for models, infrastructure, and data services; manage budgets and SLAs Governance and security Implement data privacy, security, and compliance practices (RBAC, secrets, auditability); track prompt/model lineage and reproducibility Define incident response, runbooks, and postmortems for AI f

Required Skills

MLLLMJavaNestJSRAGCI/CDdata curationtrainingfine-tuningevaluationdeploymentrollbackautoscalingbatchingquantizationdistillationcachingRBACauditabilityOpenAIGeminiBedrockobservabilitysafety guardrailsasync contractsschemaseventing patternsmodel registriescanary testsA/B testsoffline evalsonline evalsdrift monitoringcost monitoring

Partner picks for Head of AI Engineering (f/m/x) in Frankfurt am Main

Matched to the skills this page calls for and the candidate's location.

Partner
  • Partner course provider

    Structured programmes for software engineers, data science and DevOps.

    covers java
  • edXVerified partner
    Partner course provider

    Courses and programmes from universities and institutions worldwide.

Partners are ResumeKart affiliates or institutes it works with; ResumeKart may earn a commission when a candidate enrols. Placement is decided by relevance, not payment. How ResumeKart earns

The best-paying roles in your field. Every week. Free.

Join 10,000+ professionals getting job alerts and salary insights in their inbox

We respect your privacy. Unsubscribe anytime with one click.