Product Manager On-Device & Edge AI

About this job

Sarvam AI is building India's full-stack sovereign AI platform, creating technology across research, models, infrastructure, and applications to make artificial intelligence work for the country. As a Product Manager for On-Device and Edge AI, you will lead the product roadmap for enterprise deployments where data sovereignty, low latency, and offline reliability are essential. In this role, you will work closely with engineering, sales, and customer success to understand enterprise IT requirements, procurement cycles, and compliance needs. A normal day involves collaborating with silicon partners, designing features for multi-tenant SaaS architectures, driving go-to-market alignment, and running experiments to ensure AI tools integrate smoothly into customer workflows across devices.

Responsibilities

• Own the product roadmap for on-device inference, enterprise deployment, and fleet management.
• Define and prioritize features for IT admin personas including MDM integration and enterprise authentication.
• Drive B2B go-to-market alignment by translating customer pain points into actionable product requirements.
• Run iterative experiments during enterprise deployments to boost workflow stickiness and user adoption.
• Design multi-tenant SaaS architecture features covering tenant isolation, access controls, and admin tooling.
• Specify requirements for human-in-the-loop and agentic workflows to guarantee reliability and auditability.
• Partner with engineering teams on API design and integration patterns for enterprise and partner ecosystems.

Requirements

• 4 to 8 years of product management experience with a focus on enterprise SaaS or B2B AI products.
• Demonstrated background working with on-device or edge AI, IT fleet management, or device management.
• Familiarity with enterprise authentication systems like the Microsoft ecosystem, SSO, SAML, or SCIM.
• Track record of running structured product experiments and using data to guide roadmap decisions.
• Ability to engage directly with enterprise buyers and IT administrators to understand their constraints.
• Comfort with technical concepts including APIs, security compliance, and multi-tenant SaaS platforms.
• Background in Computer Science or Electrical Engineering preferred.

Good to have

• Experience with human-in-the-loop workflows or agentic AI product design.
• Prior exposure to data residency, sovereign cloud, or on-premise enterprise AI deployments.
• Familiarity with mobile device management or unified endpoint management platforms like Jamf and Intune.
• Experience building AI products for regulated sectors such as BFSI, healthcare, or government.

Who should apply

This role is well-suited for experienced product professionals who have a strong background in enterprise SaaS, B2B AI, or edge computing. Candidates must understand complex enterprise IT requirements, security compliance, and buyer personas. If you have a technical foundation in computer science or electrical engineering and want to shape sovereign AI infrastructure for India at population scale, this position at Sarvam AI is an ideal fit.

Frequently asked questions