{"html":"<h3>About Turing</h3><p>Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems. Turing helps leading AI labs improve the reasoning, problem-solving, and decision-making capabilities of large language models (LLMs) through high-quality human feedback, evaluation, and training data.</p><h3>Role Overview</h3><p>We are looking for experienced Software Engineers to help evaluate, benchmark, and improve the coding capabilities of frontier AI models. In this role, you will assess AI-generated code, validate solutions against real-world software engineering tasks, identify correctness and quality issues, and contribute to the development of high-quality evaluation datasets and benchmarks.</p><p>This position is ideal for engineers who enjoy code review, debugging, problem-solving, and applying strong software engineering judgment to complex technical scenarios. Your work will directly contribute to measuring and improving the performance of advanced AI coding systems.</p><h3>What Does Day-to-Day Look Like?</h3><ul> <li>Review and evaluate AI-generated code for correctness, efficiency, maintainability, and adherence to requirements.</li> <li>Analyze software engineering tasks and validate whether proposed solutions meet expected outcomes.</li> <li>Debug code, reproduce issues, and verify fixes across different programming environments.</li> <li>Assess model-generated explanations, reasoning, and implementation approaches for technical accuracy.</li> <li>Create, refine, and maintain evaluation datasets, benchmarks, and grading rubrics for coding tasks.</li> <li>Identify edge cases, failure modes, and areas where AI systems struggle with software engineering problems.</li> <li>Document findings clearly and provide structured feedback to improve evaluation quality and consistency.</li> <li>Collaborate with project teams to establish quality standards and evaluation methodologies.</li></ul><h3>Requirements</h3><ul> <li>Bachelor's or Master's degree in Computer Science, Software Engineering, or a related technical field.</li> <li>3+ years of professional software engineering experience.</li> <li>Strong proficiency in one or more of the following languages: <strong>Python, Java, C/C++, Go, Swift, Objective-C, PHP, or SQL</strong>.</li> <li>Strong understanding of data structures, algorithms, software design principles, and debugging methodologies.</li> <li>Experience performing code reviews and evaluating code quality in production or large-scale codebases.</li> <li>Ability to analyze complex technical problems and assess solution correctness with minimal supervision.</li> <li>Familiarity with version control systems (e.g., Git) and modern software development workflows.</li> <li>Strong written communication skills and attention to detail.</li> <li>Experience with AI/ML data annotation, NLP, prompt engineering, model evaluation, or LLM-related projects is a plus.</li> <li>Experience evaluating AI-generated code, benchmark creation, or software quality assessment is highly preferred.</li></ul><h3>Perks of Freelancing With Turing</h3><ul> <li>Work in a fully remote environment.</li> <li>Opportunity to work on cutting-edge AI projects with leading LLM companies.</li></ul><h3>Offer Details</h3><ul> <li><strong>Commitments Required:</strong> At least 4 hours per day and minimum 20 hours per week with overlap of 4 hours with PST.</li> <li><strong>Engagement type :</strong> Contractor assignment (no medical/paid leave)</li> <li><strong>Duration of contract</strong> : 1 month; [expected start date is next week]</li> <li><strong>Location</strong>: US only</li></ul><h3>Evaluation Process</h3><ol> <li>Online automated coding challenge for Python and Docker test (RHLF)</li></ol>"}