Join a dynamic team as a Software Engineer, where you'll build impactful applications and systems in AI-powered healthcare, taking ownership of your projects.
Software Engineer, C - Codebase Q&A
📜 Description
- Select tasks from validated C repositories pinned to specific commits.
- Investigate unfamiliar repositories, subsystems, and relevant pull request or issue history.
- Rewrite engineering questions to challenge coding agents while keeping them clear and answerable.
- Refine rubrics and foils to reward sound reasoning and reject plausible but incorrect answers.
- Run and iterate through the Studio validation workflow until each stage passes.
- Document tasks, submit them for expert review, and address reviewer feedback.
🛠️ Requirements
- 3+ years of professional software engineering experience, with substantial production C
- Demonstrated ability to navigate a large, unfamiliar C codebase and explain how it behaves at runtime — not just what the source says
- Comfort with the things that make C systems hard to read: preprocessor-heavy builds, platform conditionals, manual memory management, and autotools/CMake/Meson build graphs
- Experience with databases, cryptography, networking protocols, or systems programming is highly relevant — the task mix is weighted toward architecture and system design (39%) and code onboarding (34%), with a meaningful security slice
- Ability to use debuggers, sanitizers, tracing, and profilers to establish what the code actually does
- Precise written English: the questions and rubrics you write are the product
✨ Benefits
- Contract, task-based work paid at $130 per approved task , performed remotely in our Studio.
Full job description
This role is for one of our clients
Compensation: $130 per task
We are seeking experienced C engineers to build the dataset that teaches AI agents to reason about real codebases.
Codebase Q&A is a reinforcement-learning environment for training AI agents to explore and reason about software repositories they have never seen before. You will build difficult codebase-exploration tasks: high-level engineering questions about foundational C systems that cannot be answered by reading a single file, and that require runtime evidence to resolve — the kind of question a senior engineer answers by actually investigating the system.
This track works on some of the most consequential C codebases in production anywhere: PostgreSQL, Redis, git, OpenSSH, OpenSSL, curl, libuv, libgit2, libarchive, Open vSwitch, tcpdump, tmux and zstd.
Contract, task-based work paid at $130 per approved task, performed remotely in our Studio.
Requirements
Key Responsibilities
- Select tasks from a pre-validated pool of C repositories, each pinned to a specific git commit and arriving with an engineering question, positive and negative rubrics, foils, and a golden solution
- Explore the repository until you genuinely understand the subsystem in question, including the relevant PR or issue history
- Rewrite the task's question so it defeats frontier coding agents while remaining well-defined and fairly answerable
- Adjust rubrics and foils so they reward correct reasoning and reject plausible-but-wrong answers
- Run the full validation loop in Studio — Check, Golden, Run, Analyze — and iterate until every stage passes
- Document your work in the task README and submit for expert review, addressing reviewer feedback on returned tasks
Ideal Qualifications
- 3+ years of professional software engineering experience, with substantial production C
- Demonstrated ability to navigate a large, unfamiliar C codebase and explain how it behaves at runtime — not just what the source says
- Comfort with the things that make C systems hard to read: preprocessor-heavy builds, platform conditionals, manual memory management, and autotools/CMake/Meson build graphs
- Experience with databases, cryptography, networking protocols, or systems programming is highly relevant — the task mix is weighted toward architecture and system design (39%) and code onboarding (34%), with a meaningful security slice
- Ability to use debuggers, sanitizers, tracing, and profilers to establish what the code actually does
- Precise written English: the questions and rubrics you write are the product
Working Details
- Fully remote and asynchronous, with expert team leads across US, India, and Nigeria time zones
- Work is performed in our Studio; time is tracked with Insightful, and platform access is provisioned through Okta
- Onboarding requires identity verification, a background check, signed Terms of Work and CIIAA, a tax form, and passing a short calibration quiz before task access is granted
- Payment is per approved task; every task is reviewed by a second engineer and a super reviewer before acceptance
Application Process
- Submit your resume or relevant technical background to get started
- Qualified applicants may be asked to complete a brief technical assessment or provide additional information
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Similar jobs
Search more Software Engineer jobsDevelop and maintain data-focused engineering systems using Python, SQL, TensorFlow, Git, and cloud infrastructure to support data infrastructure and analytics projects.
Provides field-based engineering support to mining operations, translating mine plans into safe and efficient execution while optimizing production, monitoring performance, and identifying operational improvements.
Own consumer products end to end, from identifying user needs and shaping product scope to designing, building, launching, and iterating polished full-stack experiences using user feedback and product data.
Own end-to-end product improvements for a platform and marketplace for reinforcement learning environments, building clear workflows that help creators and research teams submit, discover, evaluate, and improve work.
