Job description
QA Analyst (AI)
BillingPlatform is an industry-leading, fast-growing SaaS company. Our award-winning, cloud-based revenue lifecycle management platform is leveraged by leading global enterprises to automate and streamline the entire quote-to-cash process. At BillingPlatform, our employees are our most valuable asset, and we believe deeply in a culture of collaboration, accountability, innovation, and transparency. We seek bright, enthusiastic, and creative professionals looking to be part of our incredible team focused on challenging the status quo and driving transformational value to customers.
Backed by leading private equity firms FTV Capital and Columbia Capital, we have achieved remarkable industry recognition for growth, including being listed for four consecutive years on Deloitte’s Technology Fast 500™ list of fastest-growing technology companies and ranked on the Inc 5000 list for three years running.
Our ability to innovate market-leading solutions has been validated by all major industry analyst firms, including being recognized as the Leader in Forrester’s “The Forrester Wave™: SaaS Recurring Billing Solutions,” earning the highest overall rating in the MGI 360™ Ratings Report for Agile Billing, ranked as the Overall Leader and an “Exemplary Vendor” in Ventana Research’s Subscription Management Value Index report, and positioned as the Leader in Quadrant Knowledge Solutions SPARK Matrix™ Report for Subscription and Billing Management. We were also honored by Best in Biz Awards for the fourth consecutive year and by SIIA as the Best Subscription Billing Solution in the 2023 CODiE awards. To learn more about us, visit billingplatform.com
We are seeking a seasoned Quality Assurance Analyst to join our AI-focused team. You will be responsible for ensuring that application updates, models, and platform components are robust, reliable, and production-ready. This role demands a strong foundation in test automation, a passion for continuous improvement, and the ability to work effectively in a fast-paced, globally distributed team developing advanced AI solutions.
Responsibilities:
Ensure the quality and compatibility of AI and software components across development, staging, and production environments.
Design, develop, and maintain automated test scripts for functional, regression, performance, and integration testing.
Execute end-to-end test cycles including component, system, integration, UAT, and performance testing based on defined test strategies and plans.
Track and report defects, working closely with developers and project stakeholders to ensure timely resolution.
Support the standardization of test processes and contribute to the evolution of testing best practices within the AI domain.
Identify, report, and escalate risks that may impact testing timelines or deliverables.
Collaborate closely with data scientists, AI engineers, developers, business analysts, and product managers to validate features and functionality.
Generate high-quality test documentation including test plans, strategies, test cases, execution reports, and defect logs.
Continuously assess and recommend improvements to testing strategies, particularly in the context of AI/ML feature validation and automation.
Apply critical thinking to simulate real-world scenarios from an end-user and data pipeline perspective.
6+ years of experience in Quality Assurance, with at least 3 years in test automation.
Solid grasp of modern software development and testing methodologies (Agile, Scrum, Waterfall).
Experience with automation testing frameworks (Selenium, Playwright, TestNG)
Proficiency in Java/Groovy or other object-oriented programming languages for test automation.
Strong understanding of defect triage, root cause analysis, and bug lifecycle using tools like JIRA.
Experience testing web-based platforms; AI or ML product testing experience is a strong plus.
Bachelor’s degree in Computer Science, Information Systems, Engineering, or related discipline.
Excellent English communication skills (verbal and written) with the ability to interface across technical and non-technical teams.
Experience working in global delivery environments or IT consulting settings.
Identify and report bugs using tools such as JIRA
Integrate testing procedures into CI/CD pipelines (e.g., Jenkins, GitLab CI)
Test and validate AI data pipelines (ETL), model explainability, and fairness
Perform adversarial, boundary, and robustness testing for AI applications
Must be fully available to operate within the MST UTC - (07:00) time zone.
Benefits
- Work in one of the fastest-growing companies in the United States
- Be a part of a friendly and professional team
- Ability to work fully remote
