Quality Assurance Manager

About the job

NodeShift is looking for a QA Manager who is both a leader and a hands-on QA expert. You will own quality across the platform end to end: strategy, process, KPIs, and people. You will also personally write automation, build LLM evaluation suites, and break things. You will start with a team of 2–3 QA engineers and grow it to 5–6 within a year, with roughly 60% hands-on and 40% leadership at the start.

Key Responsibilities

• Set KPIs and goals for the QA team, assign and prioritize work, and review test plans, automation code, and bug reports
• Run 1:1s, give feedback and grow engineers, and hire and onboard the next 2–3 QA engineers
• Define the QA process: entry/exit criteria, Definition of Done, release sign-off, and bug severity and triage SLAs
• Be the voice of quality in planning with engineering and product, and report quality status to the Founder
• Own the Playwright + TypeScript framework, covering architecture, fixtures, API and contract tests, test data, and parallel runs in CI (GitHub Actions)
• Build evaluation suites for agentic pipelines, including golden datasets, LLM-as-judge, regression testing on prompt and model changes, and cost and latency budgets
• Run load and stress testing, test on Kubernetes, and cover resilience and failover scenarios
• Test RBAC and multi-tenant access, verify that PII anonymization is correct, and red-team LLMs (prompt injection, jailbreaks, data leakage), and produce test evidence for SOC 2 and ISO 27001
• Use AI coding agents (Claude Code, Codex, Playwright MCP or similar) to write, maintain, and self-heal tests, and teach the team to do the same
• Bring AI into the QA workflow: generating test cases from Jira tickets, triaging and deduplicating bugs automatically, and AI-assisted PR review
• Track the fast-moving AI-in-QA landscape and adopt what actually works

Skills & Requirements

• AI Coding Agents
• API Testing
• FastAPI
• Kubernetes
• Langfuse
• LangGraph
• LLM Evaluation
• Performance Testing
• Playwright
• Python
• Security Testing
• TypeScript

Additional Information

Work Experience

• 1+ years leading a QA team (setting tasks, reviewing work, mentoring)
• Experience with LLM red-teaming (prompt injection, jailbreaks, PII and data leakage)
• Experience embedding AI into QA processes (generation, triage, review)
• Experience preparing test evidence for SOC 2 or ISO 27001 audits
• Experience with B2B, enterprise, or government/regulated products
• Experience building a QA team from scratch

Project Details

You will work on the NodeShift platform that runs agentic AI pipelines, document processing, and LLM gateways on Kubernetes for enterprise and government organizations in the GCC. You will own quality across the platform end to end, including web and API testing with Playwright and TypeScript, building LLM evaluation suites for agentic pipelines, performance and infrastructure testing on Kubernetes, and security and compliance testing including RBAC, multi-tenant access, PII anonymization, and LLM red-teaming. You will also produce test evidence for SOC 2 and ISO 27001 audits.

Perks & Benefits

• Health Insurance
• Remote Work
• Performance Bonus

Benefits found in job post

Medical insurance