Role Overview
Coditude is looking for an AI Agentic Studio QA professional with around 4 years of experience in quality assurance
and test automation. The successful candidate will develop robust test strategies, maintain automated coverage for
web applications and APIs, and help validate AI-enabled workflows involving large language models (LLMs),
multi-agent systems, retrieval-augmented generation (RAG), tool calling, MCP, embeddings, and vector databases.
Key Responsibilities
● Design test strategies and detailed test cases for complex features and workflows.
● Perform manual and automated testing to identify, document, track, and verify bugs and defects.
● Create, maintain, and improve automated test suites for functional, integration, web, and API testing.
● Participate in code reviews and provide constructive feedback on test automation code.
● Collaborate with developers and product managers to investigate issues, debug failures, and clarify
requirements.
● Participate in Agile/Scrum ceremonies, communicate testing progress, and discuss defects, risks, and open
issues.
● Validate AI-driven functionality, including prompt behavior, agent workflows, RAG, tool calling, and output quality.
Required Skills & Qualifications
● Proficiency in Java programming and Git version control.
● Hands-on experience with web test automation using Selenium WebDriver and Java.
● Experience in API testing and automation, with working knowledge of Postman and REST Assured.
● Experience with the TestNG testing framework.
● Working knowledge of Maven and IntelliJ IDEA.
● Experience with or knowledge of Jenkins and CI/CD workflows.
● Understanding of Docker and containerization concepts.
● Understanding of LLM testing concepts, including multi-agent systems, RAG, tool calling, and MCP.
● Knowledge of testing embeddings and vector databases.
● Experience with prompt engineering and prompt/output validation.
● Understanding of Agile/Scrum methodologies and familiarity with Jira and Wiki applications.
