Skip to main content
 Dhyati logo

QA Engineer - Automation & AI

Dhyati
9 hours ago
Full-time
Remote
Worldwide
Remote QA Jobs

About the job

QA Automation Engineer – AI

Role Description

We are looking for a strong QA Automation Engineer with hands-on experience in test automation and a solid understanding of AI/ML and AI-powered testing. The ideal candidate should be able to build reliable automation frameworks while leveraging AI tools and techniques to improve test coverage, efficiency, and quality.

Key Responsibilities

  • Design, develop, and maintain automated test frameworks for web, API, and backend applications.
  • Develop automated tests using Python/Java and Selenium, Playwright, Cypress, or similar tools.
  • Build and maintain API, integration, regression, and end-to-end automation.
  • Integrate automated testing into CI/CD pipelines and support continuous testing.
  • Use AI/LLM tools for test generation, test-data creation, defect analysis, and automation optimization.
  • Work with AI/ML-based applications and validate model outputs, APIs, workflows, and data.
  • Analyze failures, identify root causes, and work closely with developers to resolve defects.

Core Qualifications

  • 3–8 years of experience in QA Automation with strong hands-on automation experience.
  • Strong programming skills in Python or Java.
  • Experience with Selenium/Playwright/Cypress, API testing, and automation frameworks.
  • Strong knowledge of SQL, Git, CI/CD, and test methodologies.
  • Hands-on experience with AI/LLM tools, prompt engineering, or AI-assisted testing.
  • Experience testing AI/ML applications, APIs, or data-driven systems is highly preferred.
  • Perform manual and automated functional, regression, integration, API, and end-to-end testing, including test case creation, execution, and defect tracking.
  • Develop and maintain automated test scripts/frameworks, troubleshoot defects, and collaborate with developers to ensure quality and timely delivery.

Preferred

  • Experience with PyTest, REST Assured, Postman, Jenkins, GitHub Actions, or Azure DevOps.
  • Exposure to LLM evaluation, RAG, chatbot testing, or AI agent testing.