Software Development Engineer, AI Core Infra - AI Analytics and Insights

Amazon is a leading company in advertising solutions, and they are seeking a Software Development Engineer to contribute to their AI Core Infra team. The role involves designing and building scalable services for a conversational AI platform, integrating large language models, and developing systems for data retrieval and evaluation. Responsibilities: Design and build scalable services that power SpektrBot's conversational AI platform, including query orchestration, context management, session handling, and response generation pipelines; Engineer RAG architectures — build and optimize retrievers, vector stores, embedding pipelines, and metadata indexing systems to ensure accurate and contextually relevant data retrieval from our advertising data lake; Integrate and operationalize LLMs — build the infrastructure for prompt management, model routing, multi-agent orchestration, and chain-of-thought workflows that enable natural, multi-turn conversations; Build automated evaluation and feedback loops — design systems that continuously measure response accuracy, detect regressions, and feed corrections back into the system to drive improvement over time; Develop SQL generation and validation pipelines — engineer the end-to-end flow from natural language intent to generated SQL, including guardrails, query validation, and result verification to ensure trusted outputs; Build tooling for metadata auto-curation — create LLM-powered tools that automatically enrich, classify, and maintain the metadata catalog that underpins accurate data retrieval; Collaborate with applied scientists to productionize NLP/NLU models and integrate them into the bot's overall architecture; Own systems end-to-end — from design through deployment, monitoring, alarming, and operational excellence in a production environment serving internal customers at scale Qualifications: 3+ years of non-internship professional software development experience; 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience; 1+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience; 1+ years of Object Oriented Design experience; Experience programming with at least one software programming language Required Skills: Software Development, System Design, Architecture, C#, C++, Java, Perl, Object Oriented Design, Large-scale Distributed Systems, Multi-threaded Software, Embedded Software, SQL, Natural Language Processing (NLP), Natural Language Understanding (NLU), Generative AI, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Data Engineering