Sr Machine Learning Engineer - AI

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Sr Machine Learning Engineer - AI based in India. This role focuses on developing and deploying efficient small language models (SLMs) for real-world AI applications. You’ll work across model fine-tuning, optimization, evaluation, and production deployment. The position combines machine learning engineering with practical MLOps and performance engineering. You’ll help make models smaller, faster, and more efficient through techniques such as quantization, pruning, and knowledge distillation. Your work will extend to edge devices, mobile environments, and local infrastructure where latency and resource efficiency are critical. You’ll also build reliable pipelines and monitoring systems that support models throughout their production lifecycle. The role offers an opportunity to contribute to advanced AI systems while solving challenging performance and deployment problems. Accountabilities • Fine-tune and train small language models using Hugging Face, TRL, and adapter-based techniques such as LoRA, QLoRA, and PEFT. • Optimize models for efficient inference through quantization, pruning, knowledge distillation, and other model-compression approaches. • Deploy machine learning models to edge devices, mobile platforms, and local servers while meeting demanding latency and resource constraints. • Build end-to-end MLOps pipelines covering data ingestion, experimentation, model development, evaluation, deployment, and production operations. • Establish and maintain model evaluation frameworks, benchmarking processes, and custom test suites to measure model quality and performance. • Monitor production models for accuracy, inference latency, CPU/GPU utilization, and other relevant operational metrics. • Contribute to continuous improvements in AI deployment workflows, model efficiency, reliability, and scalability. Requirements • Hands-on experience developing, training, and fine-tuning small language models or other transformer-based models using Hugging Face and related tooling. • Strong knowledge of adapter-based fine-tuning methods, including LoRA, QLoRA, and PEFT. • Practical experience with model optimization techniques such as quantization, pruning, and knowledge distillation. • Experience deploying machine learning models to edge devices, mobile environments, or local/on-premises infrastructure. • Ability to design and implement end-to-end MLOps pipelines from data ingestion through production deployment. • Experience monitoring machine learning systems in production, including model accuracy, latency, and hardware utilization. • Strong understanding of model evaluation, benchmarking, and performance optimization. • Experience with experiment tracking, model registries, and ML-focused CI/CD practices is valuable. • Knowledge of ONNX export and cross-platform inference is an advantage. • Strong problem-solving skills and the ability to work effectively in a collaborative engineering environment. Benefits • Remote working opportunity in India. • Opportunity to work on applied AI, SLMs, model optimization, and production machine learning systems. • Exposure to edge, mobile, and resource-constrained AI deployment environments. • Opportunity to work with modern machine learning and MLOps technologies. • Inclusive and collaborative workplace culture that values diverse perspectives and backgrounds. • Professional growth opportunities through work on advanced AI engineering challenges. How Jobgether works: We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best! Why Apply Through Jobgether? Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time. #LI-CL1We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.