Senior AI QA Engineer
full-time
About this role
Experience Required: 5–8 Years
Employment Type: Full-Time
Work Mode: Hybrid
Location: Lahore / Karachi / Islamabad – Pakistan
Job Summary
We are looking for a Senior AI QA Engineer with 5–8 years of experience in software quality assurance, test automation, and validation of AI/ML and data-driven systems. The role involves defining test strategies, building and maintaining automation frameworks, API testing, CI/CD integration, and end-to-end testing of AI and data pipelines.
The ideal candidate will work closely with Engineering, Data, ML, and DevOps teams to ensure high-quality, scalable, and reliable AI solutions in a fast-paced, collaborative environment.
Key Responsibilities
- Define and execute test plans, test strategies, and test cases for AI/ML and data-driven applications
- Design, develop, and maintain automated test frameworks using Selenium and Pytest
- Perform API testing for RESTful services
- Validate data pipelines, ETL workflows, and ML model outputs
- Conduct end-to-end testing across the AI/ML lifecycle, including data ingestion, model training, inference, and deployment
- Integrate automated test suites into CI/CD pipelines
- Perform regression, integration, system, and performance testing
- Identify, document, prioritize, and track defects through resolution
- Collaborate closely with Data Engineers, ML Engineers, and DevOps teams
- Ensure adherence to QA standards, best practices, and compliance requirements
- Provide guidance and mentorship to junior QA engineers when required
Required Skills
- Strong experience in Software Quality Assurance
- Test Planning and Test Strategy
- Test Automation
- Selenium
- Pytest
- Python
- API Testing (REST)
- CI/CD Integration
- Data Pipeline Testing
- AI/ML Pipeline Testing
- Regression and Integration Testing
- Defect Tracking and Reporting
- Git / Version Control
Preferred Skills
- ML model validation (accuracy, drift, bias)
- Experience with cloud platforms (AWS, Azure, or GCP)
- Docker and Kubernetes
- Performance and Load Testing
- Data Quality and Monitoring frameworks
What you'll do
- The Senior AI QA Engineer will define and execute test plans and strategies for AI/ML applications, and design and maintain automated test frameworks. The role also involves collaborating with various teams to ensure high-quality AI solutions.
About NorthBay Solutions
NorthBay is AWS Premier Consulting Partner and also partnered with AI21 Labs, VMware, CloudRail and SAP in support of our Customers’ AWS cloud journeys. NorthBay helps companies transform their business by unlocking the value of their data in the cloud so they can gain agility and speed in their decision making and innovation.
Our specialities include:
- Generative AI
- Managed Service Provider
- Cloud Migration and Modernization Services
- Cloud Application Development
- Data Lake/Data Warehouse
- Machine Learning & AI
- DevOps Enablement
- Staff Augmentation
- Performance & Optimization.
Ready to join NorthBay Solutions?
Take the next step in your career journey
Frequently Asked Questions
What does a Senior AI QA Engineer do at NorthBay Solutions?
As a Senior AI QA Engineer at NorthBay Solutions, you will: the Senior AI QA Engineer will define and execute test plans and strategies for AI/ML applications, and design and maintain automated test frameworks. The role also involves collaborating with various teams to ensure high-quality AI solutions..
How do I apply for the Senior AI QA Engineer position at NorthBay Solutions?
You can apply for the Senior AI QA Engineer position at NorthBay Solutionsdirectly through Clera. Click the "Apply Now" button above to start your application. Clera's AI-powered platform will help match your profile with this opportunity and guide you through the application process.