Senior Executive (Software Testing)

Responsibilities

• Design, maintain, and execute test plans, test scenarios, and test cases based on product and technical requirements to ensure comprehensive test coverage before release. 
• Perform functional, regression, integration, system, and end-to-end testing on application features and workflows to identify defects and confirm product quality. 
• Validate AI-driven workflows across different scenarios and edge cases to ensure consistent and expected system behavior. 
• Test conversational and agent-based applications, including multi-turn conversations, context handling, fallback scenarios, and business flows, to confirm the AI performs reliably in real-world usage conditions. 
• Validate AI responses for accuracy, relevance, consistency, and adherence to defined business rules to ensure outputs meet quality and compliance standards. 
• Perform API testing and validate integrations between AI services, backend systems, and third-party platforms to ensure seamless and reliable data exchange. 
• Perform basic performance and load testing on system components to identify potential bottlenecks and support system scalability. 
• Conduct root-cause analysis with development and AI engineering teams to resolve complex issues and prevent recurrence. 

Participate in requirement reviews, technical discussions, sprint planning, and release activities to align testing efforts with project goals and timelines.

Qualifications

• Testing: Functional, regression, integration, end-to-end, exploratory, negative testing; Jira/Azure DevOps 
• Automation: Playwright, Selenium, or Cypress with Python/JavaScript/TypeScript 
• API Testing: Postman, REST Assured, Pytest, Swagger/OpenAPI (REST, auth, JSON, Webhooks, WebSockets) 
• AI/LLM: Generative AI, Agentic AI, RAG, prompt engineering, tool/function calling, MCP, context & memory management 
• AI Evaluation: Accuracy, hallucination, grounding, guardrails, fallback behavior, multi-step agent workflows; LangSmith/ Langfuse/DeepEval/RAGAS (a plus) 
• Performance Testing: JMeter, k6, or Locust (latency, throughput, concurrency, bottlenecks) 
• Databases: SQL, PostgreSQL, MySQL; familiarity with MongoDB, Redis, vector databases 

DevOps/Infra: Git, GitHub/GitLab, CI/CD, Docker, Kubernetes, Linux, cloud environments, log troubleshooting

Experience: 2–4 years of experience in Software Quality Assurance and Testing.

Educational Background: Bachelor's degree in Computer Science, Software Engineering, Information Technology, or a related field.