Jobs / Coding

AI Developer Trace Task Auditor

Evaluate the quality and correctness of AI-assisted software-development traces used to train and… Pay as listed: $70–$90/hr. Remote (United States).

Pay (as listed on Mercor)
$70–$90/hr · Hourly
Commitment
40 hrs/week
Location
Remote · United States
Languages
English
Category
Coding
Posted
Aug 29, 2026

Job description

Evaluate the quality and correctness of AI-assisted software-development traces used to train and evaluate a frontier AI lab's models. You'll assess end-to-end coding sessions produced with AI-assisted developer tools — judging correctness, workflow soundness, and reasoning — and provide clear, rubric-based written feedback.

Basic Qualifications • 3+ years professional software development • Hands-on experience with AI-assisted coding tools and agentic / spec-driven workflows (Cursor, GitHub Copilot, Claude Code, or similar) • Strong code-reading and debugging skills across full-stack or backend systems • Ability to evaluate multi-step coding trajectories for correctness and best practice

Preferred Qualifications • Experience with Kiro or Amazon CodeCatalyst • Prior work evaluating or grading AI-generated code • Contributions to developer tooling

How this role compares

This role’s top listed rate is $90/hr, above the $75/hr median for the 172 open Coding roles that list hourly pay (8 in 10 top out between $35 and $140/hr).

Across Mercor’s 344 roles with hourly pay, the median is $90/hr, so this one is the same as it.

302 Coding roles are open on this board, from 10 platforms:

Mercor’s listings were last checked on Nov 22, 2026.

Apply on Mercor — this is a referral link; we may receive a reward if you’re hired, at no cost to you.

Listed on Mercor. Details can change, so confirm on Mercor before applying.

Similar roles

See all Coding jobs

Related AI trainer jobs