LeethubLeethub
JobsCompaniesBlog
Go to dashboard

Leethub

Curated tech jobs from FAANG and top companies worldwide.

Top Companies

  • Google Jobs
  • Meta Jobs
  • Amazon Jobs
  • Apple Jobs
  • Netflix Jobs
  • All Companies →

Job Categories

  • Software Engineering
  • Data, AI & Machine Learning
  • Product Management
  • Design & User Experience
  • Operations & Strategy
  • Remote Jobs
  • All Categories →

Browse by Type

  • Remote Jobs
  • Hybrid Jobs
  • Senior Positions
  • Entry Level
  • All Jobs →

Resources

  • Google Interview Guide
  • Salary Guide 2025
  • Salary Negotiation
  • LeetCode Study Plan
  • All Articles →

Company

  • Dashboard
  • Privacy Policy
  • Contact Us
© 2026 Leethub LLC. All rights reserved.
Home›Jobs›Amazon›Software Development Engineer, GenAI/ML GPU Orchestration Service, Alloy Greenland
Amazon

About Amazon

The everything store and cloud computing leader

🏢 Tech👥 1001+ employees📅 Founded 1995📍 South Lake Union, Seattle, WA⭐ 3.7
B2CB2BMarketplaceCloud ComputingeCommerce

Key Highlights

  • Headquartered in South Lake Union, Seattle, WA
  • Over 1.5 million employees worldwide
  • Leading cloud services through Amazon Web Services (AWS)
  • Acquired Whole Foods, Twitch, and Ring

Amazon, headquartered in South Lake Union, Seattle, WA, is the world's largest online retailer and a leader in cloud computing through Amazon Web Services (AWS). With over 1.5 million employees globally, Amazon operates in various sectors, including AI with its Alexa devices and a vast marketplace k...

🎁 Benefits

Amazon offers competitive salaries, stock options, generous PTO policies, and comprehensive health benefits. Employees also have access to a learning ...

🌟 Culture

Amazon's culture is driven by customer obsession and a focus on innovation. The company encourages employees to think big and move fast, fostering an ...

🌐 Website💼 LinkedIn𝕏 TwitterAll 94518 jobs →
Amazon

Software Development Engineer, GenAI/ML GPU Orchestration Service, Alloy Greenland

Amazon • Seattle, Washington, USA

Posted 8 months ago🏛️ On-SiteMid-LevelSoftware development engineer📍 Seattle
Apply Now →

Job Description

GenAI is revolutionizing every industry in the world, yet we are still at the very beginning. As the appetite for GenAI continue to grow exponentially, the demand for GPU instances grows exponentially with that resulting in a biggest problem on our generation - how do we get more GPU capacity? In order to solve it as an industry we need to (1) tackle both the production scale of GPUs, and (2) optimize usage of existing scarce GPU resources to do more with less.

The second bucket is where our team comes in the picture. Large cloud providers are spending billions already on GPU resources and resources are distributed in a Silo fashion to teams where they are unable to utilize the resources to its fullest extent, whether due to peak/off-peak seasonality or workloads completely sooner than expected during vacation. As we looked at the data and saw 15-30% idle capacity across GPU allocation, this then presented a huge opportunity for us to tackle.

As part the Alloy Greenland team, we are a new team started beginning of the year operating startup style with true Day1 spirit on a mission to accelerate AI/ML innovations of all teams across Amazon and as an extension with our partnership with AWS SageMaker to the rest of the world.

If you love working backwards from customers, building 0-1, having exposure to senior leadership visibility, and ultimately making a dent in the world excites you, this is the right place for you!

Alloy Greenland team is part of the Alloy organization which is the central efficiency org which drives cost savings for all service teams within Amazon via efficient use of AWS resources as they build and operate their services. This team is special in 3 ways (1) business impact - we have proven records to save cost by hundred million dollars annually. We have earned trust and reputation from service teams, partner teams (business and technical), and senior leadership (2) technical complexity - our system is not a single product but the whole Amazon. We create central efficiency solutions which save costs for thousands of internal services with minimal or zero efforts from their engineers; (3) professional network - we work with a group of Principal Engineers and Distinguished Engineers closely. Working with brilliant people helps you grow your career.


In this role, you will:

* Build 0-1 products and service that delight our customers
* Work closely with AL/ML customers across Amazon and innovate on their behalf
* Solve performance and efficiency problems that manifest at scale.
* Design metrics and measure performance and cost efficiency of services in Amazon's ecosystem.
* Collaborate with service teams to identify inefficiencies, and design and implement solutions.
* Design and develop highly available components and profiling tools.
* Lead and mentor a team of engineers.

- 5+ years of non-internship professional software development experience
- 5+ years of programming with at least one software programming language experience
- 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience as a mentor, tech lead or leading an engineering team- 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $151,300/year in our lowest geographic market up to $261,500/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. This position will remain posted until filled. Applicants should apply via our internal or external career site.

Interested in this role?

Apply now or save it for later. Get alerts for similar jobs at Amazon.

Apply Now →Get Job Alerts