Modern QA Lead - AI & Automation

DESCRIPTION:

We are seeking a Modern QA Lead – AI & Automation to lead and build the quality engineering and test automation capability for a modern technology platform. This is a senior, hands-on role responsible for defining the QA and automation strategy, building scalable automation frameworks across UI, APIs, and integrations, and embedding quality gates into CI/CD pipelines. The ideal candidate will bring strong automation expertise along with practical experience in AI-assisted testing and quality validation of AI/LLM-powered applications.

Key Responsibilities

• QA & Automation Strategy: Own the overall quality engineering and automation strategy and roadmap. Assess the platform, define the right testing approach and priorities, determine what should be automated, and lead implementation of the strategy from the ground up.
• Automation Architecture & Coverage: Design and build a scalable automation framework across UI, APIs and integrations, with the right balance of automated coverage across critical user journeys and system components.
• AI-Assisted Quality Engineering: Apply AI-assisted and agentic testing approaches to improve test design, generation, execution, maintenance, exploratory testing and defect analysis, using modern tools and frameworks (e.g., Mabl, Testim, QA Wolf, Playwright with AI agents).
• AI/LLM Quality Validation: Establish appropriate testing and evaluation approaches for AI/LLM-powered functionality, including prompt adherence, hallucination and groundedness checks, RAG validation, regression evaluation and prompt injection risks.
• Visual & Resilient UI Testing: Implement modern visual validation and resilient automation approaches (e.g., Applitools and self-healing techniques) to reduce maintenance as the platform evolves.
• CI/CD & Quality Gates: Embed automated testing and appropriate quality gates into CI/CD pipelines (e.g., GitHub Actions, GitLab), providing fast and reliable feedback throughout the delivery lifecycle.

Required Skills & Qualifications

• Experience: 5-8 years of hands-on experience in Quality Engineering and test automation, with demonstrated experience defining automation strategy, planning coverage and building automation frameworks. Experience with AI-assisted testing or QA for AI/LLM-powered products is strongly preferred.
• Automation & AI Tooling: Hands-on experience with modern automation and AI-assisted testing tools and frameworks such as Playwright, Mabl, Testim, Virtuoso, QA Wolf, Applitools, or equivalent.
• API, Integration & UI Automation: Strong practical experience designing and implementing automated testing across APIs, system integrations and web/UI layers.
• Programming & Scripting: Strong proficiency in JavaScript/TypeScript or Python for building and extending automation frameworks and AI-assisted testing workflows.
• AI/LLM Testing Knowledge: Working knowledge of approaches for evaluating LLM-powered functionality, including RAG validation, output quality benchmarks, regression evaluation and prompt testing. Experience embedding automated test suites and quality gates into CI/CD pipelines is also required.

Ideal Candidate

• Strategic & Hands-On: You can assess a platform, create a pragmatic quality and automation roadmap, prioritize where automation will deliver the most value, and remain hands-on in building the capability.
• AI Pragmatist: You use AI where it materially improves Quality Engineering - accelerating test creation, execution, maintenance and analysis - while applying the right engineering approach for each testing layer.
• Builder Mentality: You thrive in a "blank slate" environment, focus on high-impact user journeys and meaningful risk coverage, and are ready to establish a strong engineering quality culture from day one.

Lahore