AI Developer Trace Task Auditor
Evaluate the quality and correctness of AI-assisted software-development traces used to train and… Pay as listed: $70–$90/hr. Remote (United States).
- Pay (as listed on Mercor)
- $70–$90/hr · Hourly
- Commitment
- 40 hrs/week
- Location
- Remote · United States
- Languages
- English
- Category
- Coding
- Posted
- Aug 29, 2026
Job description
Evaluate the quality and correctness of AI-assisted software-development traces used to train and evaluate a frontier AI lab's models. You'll assess end-to-end coding sessions produced with AI-assisted developer tools — judging correctness, workflow soundness, and reasoning — and provide clear, rubric-based written feedback.
Basic Qualifications • 3+ years professional software development • Hands-on experience with AI-assisted coding tools and agentic / spec-driven workflows (Cursor, GitHub Copilot, Claude Code, or similar) • Strong code-reading and debugging skills across full-stack or backend systems • Ability to evaluate multi-step coding trajectories for correctness and best practice
Preferred Qualifications • Experience with Kiro or Amazon CodeCatalyst • Prior work evaluating or grading AI-generated code • Contributions to developer tooling
How this role compares
This role’s top listed rate is $90/hr, above the $75/hr median for the 172 open Coding roles that list hourly pay (8 in 10 top out between $35 and $140/hr).
Across Mercor’s 344 roles with hourly pay, the median is $90/hr, so this one is the same as it.
302 Coding roles are open on this board, from 10 platforms:
- Turing (104)
- SME Careers (57)
- Mercor (55)
- micro1 (39)
- AfterQuery (33)
- Terac (9)
- Ethos (2)
- Handshake AI (1)
- Meridial (1)
- Outlier (1)
Mercor’s listings were last checked on Nov 22, 2026.
Apply on Mercor — this is a referral link; we may receive a reward if you’re hired, at no cost to you.
Listed on Mercor. Details can change, so confirm on Mercor before applying.
Similar roles
- Kubernetes Task Auditor — Mercor · $70–$90/hr
- SWE-Bench Task Auditor — Mercor · $70–$90/hr
- Game Developer — micro1 · $25–$60/hr
- Software Developer Expert — AfterQuery · $75/hr