Remote Jobs RockRemote Jobs Rock

Software Engineer - Technical Advisor

๐Ÿ“… Aug 27
Production EngineeringAI Coding-agent EvaluationCode ReviewPython
Apply Now

๐Ÿ“œ Description

  • Analyze AI coding-agent sessions, tracking what agents investigate, verify, assume, and leave undone.
  • Review model-generated pull requests in production repositories and document issues with severity and technical rationale.
  • Design and build container-based engineering problems to benchmark frontier models.
  • Collaborate with AI researchers on frontier problems and explain root-cause failures and boundary-condition gaps.
  • Write original technical analyses independently; AI tools may be used for codebase exploration and running tests.

๐Ÿ› ๏ธ Requirements

  • 8+ years of production engineering experience preferred (exceptions only for clearly exceptional profiles).
  • Backgrounds including Senior, Staff, or Principal Software Engineers, Tech Leads, or Open-Source Maintainers.
  • Experience working in production codebases with a strict code review culture (startups, big tech, or open source are all acceptable).
  • Polyglot adaptability: Heavy experience with Python and TypeScript is common, but must be comfortable dropping into unfamiliar languages weekly.
  • Core Tooling: Demonstrated comfort using Docker, git, and the Command Line Interface (CLI) to reproduce, isolate, and debug results locally.
  • Cross-Layer Fluency: Comfort working across backend, frontend, APIs, data, testing, or developer tooling.
  • Strong written communication skillsโ€”able to articulate why code fails, not just how to fix it quickly.
Full job description

We are helping our client find exceptional Software Engineer - Technical Advisors who want to spend a focused period doing something most engineers never get to do: find out exactly where frontier models break on real engineering work.

You will take on hard problems across production-grade codebases, then work out precisely where and why model-generated solutions fall short. You will also build the hard problems those models are tested on. Your judgment about what separates good engineering from plausible engineering is the entire point of the role.

What you'll do

  • Evaluate Agent Sessions: Analyze how AI coding agents behave over entire coding sessionsโ€”tracking what the agent investigates, verifies, assumes, and leaves undone.
  • Review Model-Written Pull Requests: Audit model-generated pull requests against real production repositories, documenting every identified issue alongside its severity and detailed technical rationale.
  • Build Evaluation Benchmarks: Design and construct hard, container-based problems that serve as rigorous test benchmarks for frontier models.
  • Collaborate with AI Researchers: Work directly alongside AI researchers on frontier problems, producing clear written analyses that explain root-cause failures and boundary-condition gaps.
  • Maintain High Written Rationale Standards: Author original, clear technical rationale for all evaluations (all written deliverables must be independently authored without AI text generation, though AI tools are welcomed for codebase exploration and running test suites).

Requirements

Requirements:

  • 8+ years of production engineering experience preferred (exceptions only for clearly exceptional profiles).
  • Backgrounds including Senior, Staff, or Principal Software Engineers, Tech Leads, or Open-Source Maintainers.
  • Experience working in production codebases with a strict code review culture (startups, big tech, or open source are all acceptable).
  • Polyglot adaptability: Heavy experience with Python and TypeScript is common, but must be comfortable dropping into unfamiliar languages weekly.
  • Core Tooling: Demonstrated comfort using Docker, git, and the Command Line Interface (CLI) to reproduce, isolate, and debug results locally.
  • Cross-Layer Fluency: Comfort working across backend, frontend, APIs, data, testing, or developer tooling.
  • Strong written communication skillsโ€”able to articulate why code fails, not just how to fix it quickly.
Samsara

Senior Software Engineer II

๐Ÿ•’ yesterday
Samsara๐Ÿ‘ฅ 1001 - 5000 employees๐Ÿข Computer Software

Own and ship commercial navigation features across mobile, backend, and web, turning ambiguous customer needs into reliable driver and fleet experiences through production rollout and ongoing improvement.

Mobile Application DevelopmentReact NativeSwiftKotlin
1Password

Senior Developer, Trust Platforms

๐Ÿ•’ yesterday
1Password๐Ÿ‘ฅ 10,000+ employees๐Ÿข Computer And Network Security๐Ÿค B2B

Build reliable Rust and Go platform services and developer tools for Trust & Identity, contributing to secure, privacy-focused experiences across identity, public key verification, and confidential computing.

RustTokioRust TowerGo
AECOM

CADD/Software Tool Developer - Bridge Design

๐Ÿ•’ yesterday
AECOM๐Ÿ‘ฅ 10,000+ employees๐Ÿข Architecture And Engineering๐Ÿค B2B

Develops AI- and code-based tools for CADD and bridge design, contributing across the software development lifecycle from standards and visual design to testing, scheduling, and quality assurance.

AI Tool DevelopmentCode-based Tool DevelopmentCADDBridge Design
Withclutch

Senior Forward Deployed Engineer

๐Ÿ•’ yesterday
Withclutch๐Ÿ‘ฅ 201 - 500 employees๐Ÿข Fintech

As a Forward Deployed Engineer, you will lead the implementation of AI agents for credit unions, ensuring they go live and perform effectively while integrating with core banking systems.

TypeScriptNode.jsNestjsAPI Engineering
VetsEZ

Senior FHIR Data Platform Engineer (Remote Opportunity)

๐Ÿ•’ yesterday
VetsEZ๐Ÿ‘ฅ 201 - 500 employees๐Ÿข Information Technology And Services

Design and lead FHIR-based healthcare interoperability solutions, including standards-based APIs and complex integrations, while guiding implementation, documentation, testing, security, and production readiness.

FHIRHL7HAPI FHIRFHIR Resource Modeling

Trusted by Remote Workers