{"html":"<p>Evaluate the quality, correctness, and reproducibility of software-engineering benchmark tasks used to train and evaluate a frontier AI lab&#39;s models. You&#39;ll assess repository-level tasks, reference patches, test harnesses, and grading integrity — and provide clear, rubric-based written feedback.</p>\n<p>Basic Qualifications\n• 3+ years professional software engineering\n• Real open-source contribution or maintainer experience (merged PRs, committer / maintainer roles)\n• Strong ability to audit reference patches, test runners, and Docker isolation, and to detect answer leakage / reward hacking\n• Fluency across common ecosystems (Python and at least one of Java / Go / TypeScript / C++)</p>\n<p>Preferred Qualifications\n• Familiarity with SWE-Bench (Verified) or similar repository benchmarks\n• Maintainer history on major Python OSS (Django, Flask, scikit-learn, sympy, pytest, etc.)\n• Prior code-review or task-grading experience</p>"}