Quality Assurance Engineer

About the job

Company Description

Thread powers an AI-enhanced workspace to empower Managed Service Providers (MSPs) as strategic partners through its AI Service Desk. Integrating chat, inbox management, automations, and AI-driven solutions, Thread enables seamless and efficient support. It ensures customers receive responsive assistance without frustrating delays, while MSPs deliver high-value service without being overwhelmed by inefficient processes. Thread's innovative technology is designed to eliminate complexity and enhance service experiences for both MSPs and their clients.

What You'll Do

• Design and execute test plans and test cases for AI-driven features, including chat and voice AI agents powered by OpenAI.
• Perform manual testing to validate functionality, usability, and reliability across multiple devices, platforms, and environments.
• Collaborate closely with product managers, engineers, and designers to ensure AI features meet user expectations and business requirements.
• Identify, document, and track defects with clarity and precision, following through until resolution.
• Evaluate conversational AI outputs for accuracy, consistency, and alignment with expected behavior.
• Provide structured feedback on LLM (Large Language Model) responses, voice interactions, and user experience.
• Troubleshoot issues systematically, isolate root causes, and assist engineers in reproducing and fixing problems.
• Maintain detailed documentation of test results, edge cases, and reproducible scenarios.
• Stay current with AI and QA trends, suggesting improvements to test coverage and quality assurance practices.
• Communicate findings clearly to technical and non-technical stakeholders.

What You Should Have

• Proven QA experience, with a focus on manual testing of complex software applications.
• Strong interest in AI/LLMs (Large Language Models), with curiosity about their capabilities and limitations.
• English communication skills (written and spoken), with the ability to write clear bug reports and test documentation.
• Highly organized, detail-oriented, and methodical in test execution and defect tracking.
• Solid understanding of QA processes, test case design, regression testing, and defect lifecycle.
• Familiarity with tools like JIRA, Linear, or similar issue-tracking systems.
• Ability to troubleshoot issues effectively, including reproducing intermittent bugs and edge cases.
• Strong collaboration skills, comfortable working with cross-functional teams in fast-paced environments.

Bonus Points For

• Experience testing conversational AI systems, voice recognition, or speech synthesis applications.
• Exposure to APIs and basic scripting for test automation (e.g., Python, Postman).
• Familiarity with usability testing and evaluating user experience for interactive systems.
• Previous experience in Agile development environments.
• Passion for experimenting with AI tools and contributing feedback on their improvement.