QA Engineer - Automation & AI
Dhyati
9 hours ago
Full-time
Remote
Worldwide
Remote QA Jobs
About the job
QA Automation Engineer – AI
Role Description
We are looking for a strong QA Automation Engineer with hands-on experience in test automation and a solid understanding of AI/ML and AI-powered testing. The ideal candidate should be able to build reliable automation frameworks while leveraging AI tools and techniques to improve test coverage, efficiency, and quality.
Key Responsibilities
- Design, develop, and maintain automated test frameworks for web, API, and backend applications.
- Develop automated tests using Python/Java and Selenium, Playwright, Cypress, or similar tools.
- Build and maintain API, integration, regression, and end-to-end automation.
- Integrate automated testing into CI/CD pipelines and support continuous testing.
- Use AI/LLM tools for test generation, test-data creation, defect analysis, and automation optimization.
- Work with AI/ML-based applications and validate model outputs, APIs, workflows, and data.
- Analyze failures, identify root causes, and work closely with developers to resolve defects.
Core Qualifications
- 3–8 years of experience in QA Automation with strong hands-on automation experience.
- Strong programming skills in Python or Java.
- Experience with Selenium/Playwright/Cypress, API testing, and automation frameworks.
- Strong knowledge of SQL, Git, CI/CD, and test methodologies.
- Hands-on experience with AI/LLM tools, prompt engineering, or AI-assisted testing.
- Experience testing AI/ML applications, APIs, or data-driven systems is highly preferred.
- Perform manual and automated functional, regression, integration, API, and end-to-end testing, including test case creation, execution, and defect tracking.
- Develop and maintain automated test scripts/frameworks, troubleshoot defects, and collaborate with developers to ensure quality and timely delivery.
Preferred
- Experience with PyTest, REST Assured, Postman, Jenkins, GitHub Actions, or Azure DevOps.
- Exposure to LLM evaluation, RAG, chatbot testing, or AI agent testing.