Principal Software Development Engineer - Agentic Systems

About this job

Zscaler is looking for a Principal Software Development Engineer - Agentic Systems to join the Exposure Management & Security Operations department in Bangalore. Zscaler operates the Zero Trust Exchange, a massive cloud security platform connecting users, devices, and applications worldwide to prevent cyberattacks and data loss. The company focuses on building an AI-native enterprise where human potential combines with machine intelligence. In this hybrid role, you will lead the architecture and delivery of large-scale AI/ML infrastructure and production pipelines. A normal day involves designing scalable AI/ML infrastructure, building LLM serving platforms and agentic workflows for cybersecurity, defining system reliability frameworks, and collaborating cross-functionally with product and security teams. You will also provide technical leadership and mentor team members while translating complex system designs into clear business strategies.

Responsibilities

• Lead architecture and development of scalable AI/ML infrastructure, LLM serving platforms, and agentic workflows.
• Architect reusable platform foundations including networking, security, authentication, and monitoring for AI/ML services.
• Define and implement system observability, evaluation, and reliability frameworks for production AI systems.
• Drive cross-functional architectural initiatives with product, security, and operations teams.
• Provide technical leadership and mentorship on distributed systems design.
• Translate complex architectures to non-technical stakeholders to foster organizational alignment.

Requirements

• Foundational understanding of AI/ML technologies and experience securing or positioning AI-driven solutions.
• Proven experience designing and operating large-scale, low-latency distributed systems with cloud-native microservices.
• Expertise in LLMs and production AI/ML infrastructure including orchestration frameworks and inference systems.
• Demonstrated track record of cross-organizational technical leadership and driving architectural decisions.
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field.

Good to have

• Proven ability to leverage AI technologies and workflows to drive operational efficiency.
• Track record with LLM observability, explainability, and evaluation frameworks in production.
• Experience with serverless architectures for data-intensive workloads.
• Deep foundation in core systems, networking, and security architecture for distributed systems.

Who should apply

This role suits experienced engineering professionals who thrive in ambiguous environments and possess a strong background in distributed systems and AI infrastructure. Candidates must have a proven track record of technical leadership, cross-functional collaboration, and shipping production-grade services. If you are an owner-driven problem solver with expertise in LLMs and cloud-native microservices who enjoys mentoring teams and driving strategic technical initiatives, you should apply. This posting does not state that freshers can apply.

Frequently asked questions