Job Description
QA AI Lead
Responsibilities:- Define and implement enterprise-wide AI testing and quality assurance strategies.- Establish testing standards, governance, and best practices for AI/ML and Generative AI applications.- Lead QA activities across AI product lifecycle from development through production deployment.- Drive AI-powered quality engineering transformation initiatives.- Validate LLMs, Chatbots, Copilots, and GenAI applications.- Develop test scenarios for prompt validation, hallucination detection, bias and fairness testing, security and privacy testing, performance and scalability testing, and explainability validation.- Define AI model quality metrics and monitoring standards.- Design and implement automated testing frameworks.- Integrate automated testing into CI/CD pipelines.- Establish AI-assisted test generation and test optimization strategies.- Drive shift-left and continuous testing practices.- Lead and mentor QA Engineers, Automation Engineers, and AI Test Specialists.- Collaborate with Product Owners, Architects, Developers, Data Scientists, and Business Analysts.- Manage vendor and offshore QA teams.- Conduct test planning, effort estimation, and release readiness reviews.- Monitor quality KPIs and AI performance metrics.- Present quality status and risk assessments to leadership teams.- Ensure compliance with security, regulatory, and Responsible AI requirements.
Required Skills:- Bachelor’s degree in Computer Science, Information Technology, Engineering, or related field; Master’s degree preferred.- 10+ years of experience in Software Quality Assurance.- 5+ years of Test Automation experience.- 3+ years of experience testing AI/ML or Generative AI solutions.- Experience leading QA teams and enterprise testing programs.
