Desired Capabilities
- Leadership skills
- Mentoring and coaching abilities
- Strategic thinking and decision-making skills
- Project management skills
- Stakeholder management and collaboration skills
- Ability to motivate and inspire team members
- Continuous improvement mindset
- Familiarity with DevOps processes and tools.
- Proficiency in programming languages such as Java, Python, or Ruby.
Key Responsibilities
- Design comprehensive test architecture – plan unit, integration, E2E, and semantic validation test suites that cover the full pipeline from profile intake through roadmap generation; define coverage targets and acceptance criteria.
- Build semantic validation harnesses for AI outputs – design golden-set test cases (5–8 CISO-approved reference profiles) that measure AI stage precision/recall, rigor-tier correctness, floor-control invariants, traceability completeness, and run-to-run stability; a semantic regression blocks merge.
- Implement access-control testing – design automated probes at API and database layers that verify cross-tenant isolation; simulate compromised sessions and verify RLS policies enforce tenant boundaries.
- Design and maintain CI/CD quality gates – build automated test runners that execute on every commit: unit tests, integration tests, schema validation, migration guards, image scanning, access-control probes; red builds block merge.
- Lead test automation practices – expand automation frameworks and practices; identify opportunities for improving test processes; recommend tools and technologies for testing efficiency.
- Collaborate across the team – serve as the QA voice in technical design reviews; flag testability issues early; work with the AI/LLM Lead to define what "correct" means for each pipeline stage.
- Mentor junior test engineers – guide the team on test design, semantic validation, and CI/CD best practices; share knowledge on testing AI systems where reproducibility is critical.
- Own test documentation and reporting – maintain clear test plans, results, and traceability matrices; report test coverage and quality metrics to leadership; communicate blockers and risks transparently.
Minimum Qualifications
- 5+ years of hands-on software QA with a track record of:
- Test strategy, planning, execution, and maintenance.
- Comprehensive test documentation and traceability.
- Advanced test automation (custom frameworks, advanced scripting).
- 3+ years with automated testing tools – Selenium, Pytest, or equivalent; ability to write custom testing frameworks.
- Advanced proficiency in a programming language relevant to test automation:
- Python (primary for this engagement; Pytest, async testing)
- Or Java, C#, Go.
- Deep knowledge of databases and SQL – execute complex data validation, verify multi-tenant isolation at the DB layer, test RLS policies.
- CI/CD pipeline expertise – understand how tests integrate into automated deployment workflows; experience optimizing test execution for speed and reliability.
- Understanding of Agile/Scrum methodologies – ability to drive QA strategies in rapid, iterative development cycles.
- Proficiency in defect tracking (Jira or equivalent).
- Proven leadership – mentor junior engineers, advocate for quality standards, drive process improvements.
- Exceptional communication skills – articulate complex technical issues to engineers, product, and stakeholders.
- Self-motivated and detail-oriented – work independently under time pressure, manage multiple priorities.
- Exceptional English proficiency – work effectively with distributed, global teams.
Additional Experience Desired
- ISTQB Advanced Level, CSTE, or equivalent QA certification.
- Performance and load testing (JMeter, LoadRunner) – design and execute tests under various conditions.
- Security testing practices – knowledge of OWASP vulnerabilities, experience with security testing tools (OWASP ZAP, Fortify).
- Test-driven development (TDD) and behavior-driven development (BDD) – familiarity with Gherkin, Cucumber, or equivalent.
- Experience testing multi-tenant systems – understanding of isolation, RLS, and cross-tenant security validation.
- Experience with AI/ML systems – familiarity with testing LLM outputs, semantic validation, and consistency guarantees.
- API testing – REST/GraphQL endpoint validation, contract testing.
- Experience in regulated environments – audit logging, reproducibility, compliance testing.
- Demonstrated track record of process improvement – initiated and led projects that enhanced quality, reduced costs, or improved efficiency.
Benefits
- Medical Insurance benefits as per company policy.
- Life Insurance as per company policy.
- 15 days of paid vacation plus additional days based on tenure.
- Vacation bonus as per local law.
- Sick leave and paid holidays as per local law.
- Profit sharing as per local law.
- Paternity and maternity leave as per local law.
- Marriage, bereavement and graduation leaves as per company policy.
- Christmas bonuses as per local law.
- Work from home allowance as per company policy.
- Punctuality and attendance bonuses as per company policy.
- Food tickets as per company policy.
- Direct deposit of payroll.
- Paid professional certifications.
🇧🇷 Essa vaga exige inglês. Você está pronto?
A DevSpeak Academy prepara desenvolvedores brasileiros para conquistar vagas internacionais. Domine o inglês técnico com professores que entendem o mundo dev.
Conheça a DevSpeak Academy