Jobs / Coding

ML Challenge Task Auditor

Evaluate the quality, correctness, and methodological rigor of applied machine-learning tasks used to… Pay as listed: $70–$90/hr. Remote (United States).

Pay (as listed on Mercor)
$70–$90/hr · Hourly
Commitment
40 hrs/week
Location
Remote · United States
Languages
English
Category
Coding
Posted
Aug 29, 2026

Job description

Evaluate the quality, correctness, and methodological rigor of applied machine-learning tasks used to train and evaluate a frontier AI lab's models. You'll assess experiment design, model-selection reasoning, and evaluation methodology — and provide clear, rubric-based written feedback.

Basic Qualifications • 3+ years hands-on applied/experimental ML (experiment design, model selection, hyperparameter tuning, evaluation methodology) • Strong grasp of data-quality rigor: leakage detection, metric gaming, and train/test/CV hygiene • Proficiency with standard ML frameworks (PyTorch, TensorFlow, scikit-learn, XGBoost) • Ability to critique ML claims against evidence and reproduce results

Preferred Qualifications • Competition / benchmark experience (e.g., Kaggle) • Graduate research or publication record in applied ML • Prior task-grading or peer-review experience

Note: this role evaluates applied/experimental ML rigor — it is not an LLM-application-building or MLOps role.

How this role compares

This role’s top listed rate is $90/hr, above the $75/hr median for the 172 open Coding roles that list hourly pay (8 in 10 top out between $35 and $140/hr).

Across Mercor’s 344 roles with hourly pay, the median is $90/hr, so this one is the same as it.

302 Coding roles are open on this board, from 10 platforms:

Mercor’s listings were last checked on Nov 22, 2026.

Apply on Mercor — this is a referral link; we may receive a reward if you’re hired, at no cost to you.

Listed on Mercor. Details can change, so confirm on Mercor before applying.

Similar roles

See all Coding jobs

Related AI trainer jobs