About this role
Area(s) of responsibility
AI QA Engineer – Agentic AI / GenAI
Role Overview
QA Engineer responsible for validating and automating testing for Agentic AI and GenAI systems with strong Python expertise.
Key Responsibilities
• Develop Python-based automation frameworks (Pytest)
• Test LLM outputs (accuracy, hallucination, relevance)
• Validate multi-agent workflows and pipelines
• Build evaluation metrics (F1, precision, recall)
• Perform API and integration testing
• Ensure high test coverage and CI/CD integration
Required Skills
• Strong Python programming
• Automation frameworks (Pytest/unittest)
• Understanding of GenAI/LLMs
• API testing and debugging
• CI/CD and version control
Experience
7 years or more in QA experience, exposure to GenAI/ML systems
Tired of cold applications?
Sign up with Clera and we'll reach out the moment a role actually fits you — no more spraying applications into the void.
Know someone who'd be great for this?