Software Engineer, Platform Infrastructure (Foundations)

About this job

Anyscale is on a mission to democratize distributed computing, making scalable machine learning accessible to developers of all skill levels through Ray, their popular open-source project. Backed by top investors, the company builds tools that allow developers to scale ML applications seamlessly from laptops to clusters. As a Software Engineer in the Platform Infrastructure (Foundations) team based in Bengaluru, you will work on building the scalable, secure, and robust backbone for Anyscale's cloud platform. A normal day involves designing and scaling services that orchestrate Ray clusters, optimizing control plane components for large-scale distributed AI workloads, building intelligent scheduling systems, developing features for reliability and performance, handling container image management, participating in code reviews and architecture discussions, and collaborating with leading distributed systems and machine learning experts.

Responsibilities

• Design, build, and scale services orchestrating Ray clusters across cloud and on-premises environments
• Optimize control plane components for large-scale distributed AI and ML workloads
• Build intelligent scheduling and resource management systems for heterogeneous compute clusters
• Develop features to enhance reliability, performance, scalability, and observability of Ray workloads
• Support and optimize accelerator integration such as GPUs and TPUs
• Handle container image management and dependency resolution for distributed workloads
• Participate in code reviews, design discussions, and provide on-call support to troubleshoot issues

Requirements

• Bachelor's degree in Computer Science, Engineering, or equivalent practical experience
• 3+ years of experience writing high-quality production code
• Hands-on experience in building and maintaining highly available, scalable, and performant distributed systems
• Expertise in cloud-native technologies including AWS, Azure, GCP, and Kubernetes-based deployments
• Deep understanding of networking, security, and authentication mechanisms in cloud environments
• Proficiency in Go and Python programming languages
• Knowledge of low-level operating system foundations like Linux kernel, file systems, and containers

Good to have

• Familiarity with observability stacks such as Prometheus and Grafana

Who should apply

This role suits software engineers with a strong background in control plane and data plane development, Kubernetes, and cloud-native infrastructure. Candidates should have at least 3 years of experience writing production code and a solid grasp of distributed systems, Go, and Python. If you are passionate about AI infrastructure, cloud orchestration, and working with open-source technologies like Ray, this position is ideal for you. Freshers are not mentioned for this role as 3+ years of experience is required.

Frequently asked questions