LeethubLeethub
JobsCompaniesBlog
Go to dashboard

Leethub

Curated tech jobs from FAANG and top companies worldwide.

Top Companies

  • Google Jobs
  • Meta Jobs
  • Amazon Jobs
  • Apple Jobs
  • Netflix Jobs
  • All Companies →

Job Categories

  • Software Engineering
  • Data, AI & Machine Learning
  • Product Management
  • Design & User Experience
  • Operations & Strategy
  • Remote Jobs
  • All Categories →

Browse by Type

  • Remote Jobs
  • Hybrid Jobs
  • Senior Positions
  • Entry Level
  • All Jobs →

Resources

  • Google Interview Guide
  • Salary Guide 2025
  • Salary Negotiation
  • LeetCode Study Plan
  • All Articles →

Company

  • Dashboard
  • Privacy Policy
  • Contact Us
© 2026 Leethub LLC. All rights reserved.
Home›Jobs›Anyscale›Infrastructure Services Engineer
Anyscale

About Anyscale

Effortless scalable computing for AI and Python

🏢 Tech👥 201-500 employees📅 Founded 2019📍 Yerba Buena, San Francisco, CA💰 $259.6m⭐ 3.9
B2BArtificial IntelligenceEnterpriseMachine LearningSaaS

Key Highlights

  • Founded by the creators of Ray, powering companies like Netflix & OpenAI
  • $259.6 million raised in Series C funding
  • Headquartered in Yerba Buena, San Francisco, CA
  • Serves customers like Canva, Recursion, and RunwayML

Anyscale, headquartered in Yerba Buena, San Francisco, CA, is a leader in scalable computing for AI and Python, providing an AI-native platform that seamlessly scales from a single machine to thousands of GPUs. Founded by the creators of Ray, Anyscale has raised $259.6 million in Series C funding an...

🎁 Benefits

Anyscale offers a comprehensive benefits package including a monthly learning and wellness stipend, paid volunteer time off, and 12 weeks of paid pare...

🌟 Culture

Anyscale fosters a culture focused on solving the challenges of AI infrastructure, leveraging the open-source Ray framework to enhance distributed AI ...

🌐 Website💼 LinkedIn𝕏 TwitterAll 38 jobs →
Anyscale

Infrastructure Services Engineer

Anyscale • Bengaluru, Karnataka

Posted 5 months ago🏛️ On-SiteMid-LevelInfrastructure engineer📍 Bengaluru
Apply Now →

Job Description

About Anyscale

At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.

With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.

Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.

About the role

The primary role is to serve as a technical advisor and champion for Anyscale customers with expertise in infrastructure, cloud management, K8, etc. In this function, you will play a crucial role in the customers’ post-sale journey - helping them to onboard, adopt and grow on Anyscale, troubleshooting and resolving open customer tickets and driving consumption.

Anyscale is an ever evolving platform and hence will require close co-ordination with our engineering teams to debug complex issues. This is an exciting role for those who are technically curious and passionate about ML/AI, LLM, vLLM and the role of AI in next generation applications. It’s an opportunity to make a significant impact in a collaborative, fast-paced environment while building a new segment in this space.

In this role, you’ll be able to

  • Be a solutions architect, technical advisor, and internal champion for our key customers; helping them to successfully onboard and adopt the Anyscale platform

  • Own customer issues end-to-end, from troubleshooting, escalations and eventual resolution

  • Participate in our follow-the-sun customer support model to ensure continuity in resolving high priority tickets

  • Keep track of open customer bugs and feature requests to influence prioritization and provide timely customer updates upon resolution

  • Manage current workload state of key customers and help to identify new workloads to drive account expansion

  • Contribute towards improvement of internal tools and documentation of playbooks, guides and best practices etc. based on observed patterns

  • Habitually provide feedback and collaborate cross-functionally with product and engineering teams to address customer issues with a focus on improving the product experience

  • Build and maintain strong relationships with technical stakeholders within customer accounts

Qualifications

  • 5+ years of experience in a customer-facing technical role with 2+ years in a dynamic, fast-paced, startup-like environment

  • Strong organizational skills and ability to manage multiple customer needs simultaneously

  • Proficient in deploying and resolving issues within container orchestration platforms (such as Kubernetes) and working with infrastructure as code tools (such as Terraform).

  • Hands-on experience with one or more of the major cloud platforms (AWS, GCP or Azure)

  • Knowledge in Observability tools (e.g. Grafana)

  • Excellent communication and interpersonal skills

  • Strong sense of ownership, self-motivation and eagerness to acquire new skills and do new things

  • Willingness to uplevel the knowledge and skills of your peers through mentorship, trainings and shadowing

Bonus

  • Experience with Ray

  • Knowledge of MLOps platforms in support of ML/AI, Data Engineering and Data Science teams

  • Familiarity with container orchestration platforms (e.g., Kubernetes), infrastructure as code (e.g. Terraform), CI/CD tools (e.g. Github Actions)

  • Knowledge of training, fine-tuning and inference/serving of LLMs

Compensation

At Anyscale, we take a market-based approach to compensation. We are data-driven, transparent, and consistent. As the market data changes over time, the target salary for this role may be adjusted.

Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.

Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish

Interested in this role?

Apply now or save it for later. Get alerts for similar jobs at Anyscale.

Apply Now →Get Job Alerts