Software Engineer (Codebase Deep Reasoning & Evaluation)

Remote Full-time
This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description Mercor is seeking software engineers to support one of the world’s leading AI labs in advancing code understanding and reasoning capabilities for next-generation machine learning models. In this role, you’ll engage in real-world engineering work: Analyzing large, production-grade repositories to create and evaluate technically challenging coding questions. Systematically exploring multiple modules and connecting related functions across files. Assessing how advanced AI systems reason about architecture, data flow, and performance. Your ability to reason from evidence: citing specific files, functions, and line numbers will directly influence how these AI models learn to think like expert engineers. Qualifications 4+ years of elite software engineering experience at top-tier startups, quantitative trading firms, hedge funds, or similar high-performance environments. Experience using coding agents or LLMs as part of your engineering workflow (e.g., Copilot, Claude, GPT-4, or Replit Agents). Computer Science degree from a leading university or equivalent practical expertise. Fluent in Python and JavaScript/TypeScript, and can comfortably read Java, Go, or other modern languages (Rust, C++, C#). Demonstrate systematic exploration, examining multiple files and dependencies before forming conclusions. Practice evidence-based reasoning, grounding answers in specific code references rather than assumptions. Excel at cross-file synthesis, connecting distributed logic to explain how systems work end-to-end. Show strong architectural understanding, identifying patterns, abstractions, and design choices in complex codebases. Display intellectual honesty, acknowledging uncertainty when information is incomplete or ambiguous. Write clear, structured technical documentation, and communicate insights precisely and persuasively. Requirements Ability to work across diverse systems, including web APIs, backend services, CLI tools, data processing pipelines, frontend applications, and DevOps tooling. Experience with security, observability, and performance-critical architectures. Engagement Details This project will be a high-impact 24-hour sprint launching in the next 1–2 weeks. Compensation: Task-based pay (top performers previously earned $1,000+ during the sprint). Classification: Hourly contractor through Mercor. Payment: Weekly payouts via Stripe Connect. Company Description Mercor connects elite creative and technical talent with leading AI research labs, headquartered in San Francisco, CA. Our distinguished investors include Benchmark, General Catalyst, Peter Thiel, Adam D’Angelo, Larry Summers, and Jack Dorsey. and redefine digital creativity alongside the teams building the future of intelligent software.
Apply Now

Similar Opportunities

Physics Expert

Remote Full-time

Marketing Assistant

Remote Full-time

Senior Product Manager

Remote Full-time

Customer Service Representative – El Paso

Remote Full-time

Customer Service Specialist I – Remote Opportunity with blithequark's Healthcare Provider Network

Remote Full-time

Experienced Customer Service Representative and Administrative Assistant – Insurance and Financial Services

Remote Full-time

Experienced Administrative Assistant - Data Entry & Customer Service Representative (Part-Time Remote Opportunity)

Remote Full-time

Experienced Full Stack A.I. Integration Specialist – Web & Cloud Application Development

Remote Full-time

Experienced Full Stack Chatbot LLM Engineer – Conversational AI Development and Implementation

Remote Full-time

Experienced Full Stack Chatbot Trainer – AI Conversational Agent Development

Remote Full-time

Experienced Remote Data Entry Specialist – Refining Youngster Support Remittances with Exceptional Interpersonal Skills

Remote Full-time

Sr. Quality Lab Technician

Remote Full-time

Experienced Customer Delivery Driver – Ipswich Extra

Remote Full-time

Experienced Work-from-Home Customer Service Representative - Phone, Email, and Chat Support

Remote Full-time

Customer Service at Delta Airlines -

Remote Full-time

Remote Paralegal Jobs in Helena, Montana

Remote Full-time

Arts and Crafts - DIY Expert

Remote Full-time

Professor of Interior Design

Remote Full-time

Hiring Now: Graphic Design Intern, College Student

Remote Full-time

Experienced Full Stack Data Entry Specialist – Remote Work Opportunity with blithequark

Remote Full-time
← Back to Home