{"html":"<p>We are seeking experienced technical experts to contribute to an independent contractor opportunity focused on auditing tasks used to train and evaluate AI systems.<br>Experts will be matched to one specialty based on their experience:<br></p><ul><li><p>GPU kernels</p></li><li><p>AWS Trainium and NKI</p></li><li><p>CVE and application security</p></li><li><p>Machine learning</p></li><li><p>AI-assisted developer workflows</p></li><li><p>AWS Serverless and Infrastructure as Code</p></li><li><p>Kubernetes</p></li><li><p>SWE-Bench</p></li></ul><p><br>Experts will assess whether technical tasks are accurate, realistic, solvable, reproducible, and supported by reliable tests and evaluation criteria. They will also provide clear, actionable feedback on any issues identified.<br>Expertise across all eight specialties is not required. Interested experts will complete a technical assessment related to their area of expertise as part of the selection process.</p>"}