Would you like to build highly available, scalable and distributed engineering systems for one of the largest data lakes in Amazon? Does Petabyte scale excite you?
The Spektr Datalake team owns the central data lake for Advertising unifying Petabytes of data generated across the Ads pipeline such as campaigns, ad-serving, billing, clicks, impressions and more and into a single scalable repository. This is used across the organization to drive hundreds of thousands of complex queries for analysis, measurement and reporting decisions for our customers. The data lake enables customers such as data engineers, business analysts, ML engineers, research scientists, economists and data experts to collect what they need via world-class self-service tools.
Spektr Datalake team is building the next version of its data lake for 5x growth. An SDE on the ADM team has a unique opportunity to design and innovate solutions for this scale, delivering robust and scalable microservices built over Java and AWS as well as innovate with big data technologies like Spark, EMR, Athena and more. You will create value that materially impacts the speed and quality of decision making across the organization resulting in tangible business growth.
Key job responsibilities
- Engage with key decision makers such as Product & Program Managers to understand customer requirements and brainstorm on solutions
- Design, code and deploy components and micro-services for the core job management pipeline
- Ensure testability, maintanability and low operational footprint for your code
- Participate in operational responsibilities with your team
- Innovate on AWS technology to improve latency, reduce cost and operations
A day in the life
- Focus on core engineering opportunities to guarantee system availability that matches our data growth
- Work with a skilled team of engineers, managers and decision makers to consistently meet customer demand
- Automate monitoring of data availability, quality and usability via simplified metrics and drive innovations to improve guarantees for our customers
- Build frugal solutions that will help make Spektr data lake cost wise leanest datalake in Amazon
About the team
The mission of the Spektr Datalake team is to provide data that helps the advertising organization make informed analyses and decisions for our customers and to determine and deploy investments for future growth via a set of central and unified products and services.
Our team focuses on simplicity, usability, speed, compliance, cost efficiency and enabling high-velocity decision making so our customers can generate high quality insights faster.
We are a global team with presence across IN and NA.- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience programming with at least one software programming language- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit
https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
