AI ML Ops Software Engineer (Bangalore Hybrid)

About this job

Smartsheet, a company with over two decades of experience helping teams scale solutions and manage work, is currently working on uniting human teams with AI agents. As an AI ML Ops Software Engineer based in Bangalore, your core mission involves designing, building, and maintaining robust AI and ML Ops platforms and pipelines. In this role, you will bridge the gap between model development and production by working alongside data scientists, data engineers, and fellow software engineers. A normal workday for you at Smartsheet involves packaging and deploying AI and ML services, building automated CI/CD pipelines, managing infrastructure, and implementing monitoring systems for model performance, latency, and data drift. You will also handle resource optimization to reduce cloud costs, manage version control, and support foundation model deployments like fine-tuning workflows and RAG stacks. By automating routine tasks and scaling reliable infrastructure, you contribute to creating space for people to focus on judgment and big thinking.

Responsibilities

• Design, develop, and maintain stable AI and ML Ops platforms and pipelines
• Package and deploy AI and ML services to production ensuring reproducibility
• Implement automated CI/CD pipelines to accelerate model deployment
• Provision and optimize infrastructure using tools like Docker and Kubernetes
• Monitor post-deployment model performance, data drift, and latency
• Manage deployments of foundation models, RAG stacks, and fine-tuning workflows
• Collaborate with data scientists, data engineers, and software engineers
• Optimize GPU and CPU resource utilization to minimize cloud costs

Requirements

• Minimum experience of 4 to 6 years in AI and ML Ops
• Experience with enterprise SaaS software solutions providing high availability and scalability
• Proficiency in AI/MLOps workflows using Databricks, MLFlow, and Mosaic AI Agent Framework
• Hands-on experience with at least one major cloud provider such as AWS, Azure, or GCP
• Proficiency in programming languages including Python and SQL
• Knowledge of modern software engineering practices like Kubernetes, CI/CD, and IAC tools
• Legal eligibility to work in India on an ongoing basis

Good to have

• Experience in Monte Carlo for monitoring
• Experience with AWS Bedrock
• Experience in an AWS hosted data platform
• Experience with Terraform for infrastructure as code

Who should apply

This role is well-suited for mid-to-senior software engineers who bring four to six years of dedicated experience in AI and ML Ops. Candidates should have a strong background in handling large-scale structured and unstructured data, managing cloud platforms, and working with tools like Databricks, MLFlow, and Kubernetes. Since the posting explicitly states a minimum requirement of 4 to 6 years of experience, absolute freshers are not eligible to apply. Professionals who thrive in collaborative environments and have expertise in cost optimization and building secure, scalable AI pipelines will find this position ideal.

Frequently asked questions