Senior QA Engineer – UI Automation (Python)
We fuse together exceptional talent who deliver outstanding software solutions. Our approach has helped us grow 60% in 2021, 94% in 2022, while in 2023 we joined forces with Insight, a Fortune 500 company and a leading solutions and systems integrator. With exciting growth plans and cutting-edge projects, there has never been a better time to join our incredible team.
WE ARE AMDARIS
We are growing aggressively, and we are now looking for a Senior QA Engineer - UI Automation (Python).
The candidate should be capable of handling infrastructure, possess a solid understanding of software development, and be able to develop QA tools and automation frameworks also to embark on an international project and work with the latest testing tools alongside the brightest minds in a collaborative and energetic work environment.
We are offering stimulating salaries plus a great range of benefits, including the opportunity of building and enhancing yourself for a successful career within a highly reputable organisation. A great team mentality is essential, with the ability to lead by example and promote good team spirit and collaboration.
We are building production-grade agentic content workflows for a large-scale English Language Learning ecosystem. The platform uses AI agent architectures to generate and validate educational content at scale, serving multiple products across the organization. The team owns the end-to-end lifecycle: workflow design, LLM orchestration, evaluation, and production operations.
About the Role
We are looking for a QA engineer who thinks in systems, not just test cases. You will own the quality strategy for a platform where outputs are AI-generated, non-deterministic, and educationally consequential, designing evaluation frameworks, setting quality gates, and ensuring what reaches learners meets a consistent standard.
Key Responsibilities:
-
Define and execute test strategies across the full stack: backend APIs (FastAPI), frontend UIs, and agentic workflows.
-
Define testing standards and frameworks that enable developers to own unit and integration test coverage, in line with a shift-left quality model.
-
Design testing approaches for non-deterministic AI outputs: LLM evaluation benchmarks, regression datasets, and golden-set validation.
-
Enable and govern the automated testing strategy: owning E2E and system-level validation while supporting developers in writing their own unit and integration tests.
-
Implement workflow validation, ensuring holistic quality across text, audio, and generated content (not just individual outputs).
-
Collaborate with AI engineers to define quality gates for content generation pipelines.
-
Perform API testing, load testing, and performance validation for platform services.
-
Integrate automated testing into CI/CD pipelines (GitHub Actions) across Azure and AWS environments.
-
Track and report quality metrics across the platform.
-
Advocate for quality standards and best practices across the team.
Required Skills & Qualifications:
-
3–5+ years of QA experience with a full-stack focus (backend + frontend).
-
Strong experience with Python test frameworks (pytest). Familiarity with frontend testing tools (Playwright, Cypress, or equivalent).
-
Experience testing APIs (REST, WebSocket) and microservice architectures.
-
Ability to design test strategies for AI/ML systems with non-deterministic outputs.
-
Hands-on experience with CI/CD integration for automated testing.
-
Understanding of Docker, cloud environments (Azure/AWS), and deployment pipelines.
-
Experience with performance and load testing tools.
-
Familiarity with LLM evaluation and observability tools (Langfuse, etc.) is a strong plus.
-
Daily user of AI development tools (Cursor, Claude Code, Copilot).
-
Fluent English, spoken and written.
BENEFITS
-
Opportunities for certification and training
-
Dual monitor setup and high-spec workstations
-
English courses
-
Gym allowance
-
Medical Reimbursement
-
Full salary covered up to 20 days of sickness
-
Flexible working hours
-
Loyalty scheme
-
Team building activities, special events and conferences
-
UK/EU Travel opportunities
-
Snacks and drinks in the office
To see more roles, click here.
Create a Job Alert
Interested in building your career at Amdaris? Get future opportunities sent straight to your email.
Apply for this job
*
indicates a required field