hackajob is collaborating with Mercor to connect them with exceptional professionals for this role.

We're seeking experienced Software Engineers, QA Engineers, SDETs, and Test Automation Engineers to review browser-based evaluation workflows for AI-generated web applications. You'll validate whether browser tests are technically sound, deterministic, and capable of producing clear pass/fail outcomes before they become part of benchmark datasets. ### What You'll Do - Review browser-based testing workflows for AI-generated web applications. - Assess whether browser interactions are technically feasible and reliable. - Validate test isolation, fixtures, setup, and execution flow. - Ensure assertions produce deterministic, unambiguous pass/fail results. - Identify flaky tests, hidden dependencies, or ambiguous validation logic. - Provide structured technical feedback following project review rubrics. ### We're Looking For - 3+ years of experience in Software Engineering, QA Engineering, SDET, or Test Automation. - Strong experience testing modern web applications. - Familiarity with browser automation frameworks such as Playwright, Cypress, Selenium, or similar tools. - Experience writing automated UI and end-to-end tests. - Strong understanding of test isolation, fixtures, reproducibility, and reliable browser automation. - Excellent debugging skills and attention to detail. ### **Why Join?** - Contribute to the development of AI systems by ensuring browser-based evaluation workflows are technically robust and reliable. - Review realistic web application testing scenarios involving automation, test design, and software quality engineering. - Collaborate with a high-calibre team helping establish quality standards for AI-generated software evaluation.