[Remote] QA Engineer
Note: The job is a remote job and is open to candidates in USA. Svitla Systems Inc. is looking for a QA Middle/Senior Engineer for a part-time position with a path to full-time in the USA. The role involves creating a QA strategy, providing automated test suites, and validating AI/LLM features while collaborating with various teams.
Responsibilities
- Create a QA strategy across manual and automated testing
- Provide automated test suites and CI/CD quality checkpoints
- Perform AI/LLM feature validation, including hallucination detection
- Collaborate with ML, platform, and product teams
Skills
- 3+ years of experience in QA engineering or test automation (for SaaS platforms)
- Strong knowledge of Python or JavaScript for test scripting
- Hands-on experience with Pytest, Cypress, Karate, or similar frameworks
- Understanding of testing APIs and backend services
- Familiarity with CI/CD tools (GitHub Actions, CircleCI, etc.)
- Practical experience testing AI/ML systems, LLM applications, or conversational AI/agent workflows
- Be comfortable working independently in fast-paced, ambiguous environments
- Familiarity with prompt engineering and non-deterministic output validation
- Ability to design evaluation strategies for output correctness, stability, and relevance
- Exposure to LangChain, Temporal, Weaviate, or Pinecone
Company Overview
Company H1B Sponsorship