**This role requires fluency (speaking, reading, and writing) in one or more European languages — French, German, Dutch, Polish, Turkish, or Portuguese — as you'll drive quality across Alexa+'s multilingual experience in 100+ countries.**
Come join us to launch Alexa+ globally to millions of customers across 100+ countries, solving hard challenges in multilingual, conversational CX evaluation across multimodal experiences spanning text, voice, and visual across many device surfaces. We are solving hard challenges in validation across speech, visual, conversational quality, locale cultural, and linguistic dimensions -building agentic automation tooling that spans the full quality spectrum from synthetic test generation, to LLM-as-a-Judge evaluation, to visual validation using AI, to cultural relevancy classification powered by machine learning.
As a Sr. Quality Assurance Engineer in the Alexa Global Quality (AGQ) team, you will own the end-to-end quality of Alexa+ ensuring millions of customers receive a culturally relevant, high-quality experience spanning voice, text, and visual modalities.
You'll tackle complex challenges in multilingual conversational CX evaluation — building agentic automation tooling that spans the full quality spectrum from synthetic test generation, to LLM-as-a-Judge evaluation, to visual validation using AI, to cultural relevancy classification powered by machine learning. Our team focuses on expanding Alexa+ globally while maintaining the cultural and linguistic nuances that matter to our diverse customer base. You'll define global test strategies, architect AI-powered evaluation frameworks, and shape how quality is measured across multiple features, endpoints, and languages.
Key job responsibilities
You will own the end-to-end quality strategy for Alexa's multi-locale experience, defining and driving global test approaches that assess quality across multiple features, endpoints, and languages. Working closely with engineers, you'll architect the best technical design and testing approach for internationalisation (i18n), and drive the evolution of agentic quality evaluation frameworks — encompassing synthetic test case generation, multimodal response validation, and automated cultural and linguistic correctness assessment.
Your work will span both strategic and hands-on execution. You'll run end-to-end test suites autonomously and manually, monitor production trends, and take decisive action to improve the customer experience. You'll create metrics and reports on quality status, technical operations, and system performance across all locales, driving towards quality bars that are consistent yet culturally appropriate per market.
You'll also develop automation and quality tooling that improves test efficiency across a global organisation, and collaborate effectively with product managers, Country Product Managers, designers, engineering, locale experts, and business teams to deliver the best overall experience — factoring in financial goals, usability targets, and locale-specific customer expectations.
A day in the life
As a Sr. QAE on the AGQ team, your day will involve reviewing automated test results across multiple locales, triaging quality signals from production, and collaborating with engineers and locale experts to resolve issues. You'll balance strategic work — refining evaluation frameworks and driving tooling improvements — with hands-on testing of new Alexa+ features before they reach customers worldwide.
About the team
The Alexa Global Quality team ensures Alexa+ delivers an exceptional, culturally authentic experience to customers in every supported locale. We combine deep linguistic expertise with Niche AI-powered evaluation to scale quality at pace. Our culture values ownership, curiosity, and a genuine passion for delighting customers across cultures and languages.
- Knowledge of QA methodology and tools, with demonstrated experience in an QAE role
- Experience in delivering test frameworks, test tools, leading the QA projects and initiatives
- Experience in automation testing
- Experience in manual testing
- Experience working as a Quality Assurance Engineer
- Experience with Linux operating system, embedded systems, consumer devices, or mobile apps
- Experience programmatically testing products, measuring test coverage, developing the best automation, driving testability and diagnostic
- Knowledge of at least one modern object-oriented programming language such as C++, Java, Objective C
- Experience in UI Automation (preferably on mobile platforms)
- Fluently Speak, read and write in one or more of the following European languages (French, German, Dutch, Polish, Turkish, Portugese)
Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting decisions based on your experience and skills. We value your passion to discover, invent, simplify and build. Protecting your privacy and the security of your data is a longstanding top priority for Amazon. Please consult our Privacy Notice (https://www.amazon.jobs/en/privacy_page) to know more about how we collect, use and transfer the personal data of our candidates.
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
