Are you passionate about building and operating the world's largest real-time LLM inference systems? Are you a technical leader who thrives in high-ambiguity environments and wants to drive architectural decisions that impact millions of Alexa customers daily? If so, the Alexa LLM Inference, Capacity, & Efficiency (ALICE) team is looking for a Senior Software Development Engineer to join our new India team and own critical components of Alexa's LLM inference infrastructure.
Alexa is shaping the future of AI voice-based personal assistants. At ALICE, we are passionate about infrastructure efficiency, cost optimization, and capacity management to enable amazing customer experiences at scale. You will be a founding technical leader of our India presence, setting the bar for engineering excellence and driving high-impact work on one of Amazon's most critical AI services. Key job responsibilities - Serve as a technical leader for the ALICE India team, driving architecture decisions for the AlexaLLMInferenceService (LLMI) and related ALICE portfolio services - Design and implement scalable, high-availability systems for LLM inference serving, including multi-node distributed inference and multi-tenancy capabilities - Lead technical design reviews, set coding standards, and mentor junior SDEs on the team - Make technical trade-offs between short-term team needs and long-term business needs, with a focus on performance, cost, and reliability - Collaborate with ALICE teams in Seattle and partner teams across Alexa and AGI on cross-cutting infrastructure programs - Drive operational excellence for Tier-1 production services, including on-call ownership, incident response, and continuous improvement - Influence the broader ALICE software architecture and contribute to org-wide technical strategy A day in the life As a Senior SDE, you will be part of the technical leadership for the India team, owning architecture decisions for LLMI components and contributing to ALICE's broader portfolio of infrastructure optimization products. - 6+ years of non-internship professional software development experience - 5+ years of programming using a modern programming language such as Java, C++, or C#, including object-oriented design experience - 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience - Experience contributing to the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems - Experience building complex software systems that have been successfully delivered to customers - 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience - Bachelor's degree in computer science or equivalent Our inclusive culture empowers Amazonians to deliver the best results for our customers.
If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
Job description provided by Amazon.
View the original posting
