Remote Jobs RockRemote Jobs Rock

Software Engineer, Agentic AI Infrastructure

📅 Jun 8
Distributed SystemsFault-tolerant SystemsAI AgentsLLM-powered Systems
Apply Now

📜 Description

  • Design and build distributed, fault-tolerant infrastructure for AI agent memory, state management, and execution.
  • Own architecture decisions for agent infrastructure services from design through production deployment and iteration.
  • Build evaluation, observability, and reliability tooling for teams developing agents.
  • Partner with product engineers and the tax data team to turn compliance workflows into scalable agent primitives.
  • Improve code quality, testing, system design, operational health, and system performance.
  • Mentor engineers and contribute to the team's technical culture.

🛠️ Requirements

  • 3+ years of experience building and operating distributed, production-grade systems.
  • Experience designing scalable, resilient, fault-tolerant services.
  • Hands-on experience building and deploying AI agents or LLM-powered systems in production.
  • Familiarity with prompt engineering, evaluation frameworks, RAG pipelines, tool calling, and agent orchestration.
  • Experience across the software development lifecycle, including design, code review, testing, deployment, and on-call ownership.
  • Strong architectural judgment, comfort with ambiguity, and motivation to learn and experiment with AI tools.

✨ Benefits

  • The equity upside of an early-stage startup with the product-market fit of a later-stage company.
  • Daily lunch and snacks for those working out of our San Francisco office.
  • Medical
  • Dental
  • Vision insurance covered 100%
  • One Medical membership covered, flexible sick benefits and more.
  • Annual learning and development stipend for books, online courses, and conferences, as well as a curious team to share your learnings with.
  • Annual team offsites and in-person opportunities around our growing Anrok hubs.
  • Home office setup stipend to ensure you have the equipment you need to thrive at work.
  • For employees located outside of these hub cities, we offer a fully remote setup U.S only.
Full job description

Anrok is the leading tax automation platform enabling businesses to expand globally without compliance complexity.

As the digital economy has grown 6x over the last decade, software businesses have gone from not worrying about sales tax to needing to monitor exposure, calculate rates, and file returns across 50 US jurisdictions and 100+ countries. This creates a critical bottleneck for companies that should be able to transact with customers everywhere.

Anrok eliminates this complexity by connecting with billing and payment systems to automate tax monitoring, calculations, and filing end-to-end. Our unified platform handles the ever-changing maze of tax laws at municipal, state, and federal levels—so companies can focus on growth, not compliance.

Our customers include:

  • 40% of Forbes Top 50 AI companies

  • 20% of Forbes Top 100 Cloud companies

  • Top companies like Notion, Anthropic, and Cursor

We're making compliant digital commerce a reality for companies big and small, backed by over $100M from leading investors including Sequoia, Spark, Index, and Khosla Ventures.

We're building the agentic infrastructure layer at Anrok—the systems that let AI agents reason about tax data, take action across jurisdictions, and operate reliably at scale. This is early and foundational work: you'll be designing and shipping the primitives that the rest of the product builds on. We're looking for an engineer who pairs a strong distributed-systems background with real, hands-on experience building AI agent systems—someone who understands both how to make a service fault-tolerant and what it takes to make an LLM-powered agent reliable in production. If you want to work on distributed systems that sit at the intersection of AI and fintech, this role is for you.

In this role, you will

  • Design and build the distributed, fault-tolerant infrastructure that powers Anrok's AI agent capabilities—covering memory, state management, and execution for autonomous systems.

  • Own technical architecture decisions for new agent infrastructure services end-to-end, from initial design through production deployment and iteration.

  • Build the evaluation, observability, and reliability tooling that lets the rest of the team ship agents confidently on top of your infrastructure.

  • Collaborate closely with product engineers and our tax data team to translate real compliance workflows into reliable, scalable agent primitives.

  • Drive engineering best practices across the team: code quality, testing discipline, system design, and operational health.

  • Identify and fix performance, reliability, and scalability bottlenecks as our agent systems grow.

  • Help grow the team—mentoring engineers, contributing to technical culture, and raising the bar on how we build.

What excites us

  • You have a strong systems engineering background, with 3+ years of experience building and operating distributed, production-grade systems.

  • You've designed services that are scalable, resilient, and fault-tolerant—and you've done it more than once.

  • You've built and deployed AI agents or LLM-powered systems in production, and you understand firsthand what makes them reliable and maintainable at scale.

  • You're familiar with the modern AI stack—prompt engineering, eval frameworks, RAG pipelines, tool calling, and agent orchestration—and you have a point of view on what the infrastructure beneath it should look like.

  • You think carefully about architecture and tradeoffs, and you're comfortable leading technical decisions without a complete playbook.

  • You have experience with the full software development lifecycle: design, code review, testing, deployment, and on-call ownership.

  • You're energized by ambiguity—you can take a fuzzy problem, break it down, and ship something real.

  • You're curious and motivated to learn new tools—you've experimented with AI in your work or on your own, you're excited about what's possible, and you've built something with it (an application, a workflow, a creative solution to a real problem) that you can walk us through.


What we offer

  • The equity upside of an early-stage startup with the product-market fit of a later-stage company.

  • Daily lunch and snacks for those working out of our San Francisco office.

  • Medical, dental, and vision insurance covered 100%.

  • One Medical membership covered, flexible sick benefits and more.

  • Annual learning and development stipend for books, online courses, and conferences, as well as a curious team to share your learnings with.

  • Annual team offsites and in-person opportunities around our growing Anrok hubs.

  • Home office setup stipend to ensure you have the equipment you need to thrive at work.

At Anrok, we embrace a dynamic and flexible hybrid work environment based out of our growing office hubs - San Francisco, New York City, and Salt Lake City where we collaborate in-person 3 days per week.

For employees located outside of these hub cities, we offer a fully remote setup U.S only.

Please be aware that Anrok does not recruit via WhatsApp or any third-party messaging platforms. All official communication from our team comes exclusively from @Anrok.com email addresses. If you receive a suspicious message claiming to be from Anrok, please do not engage. All open roles are listed on this page.

Cloudflare

Software Engineer - Load Balancing

🕒 3 days ago
Cloudflare👥 10,000+ employees🏢 Computer And Network Security🤝 B2B

Design, build, and operate Cloudflare’s Load Balancing systems, developing reliable distributed services and improving production health while collaborating across engineering, security, SRE, and product teams.

GoRustC++Distributed Systems
Tanium

Software Engineer II, AI Security

🕒 3 days ago
Tanium👥 10,000+ employees🏢 IT Services And IT Consulting🤝 B2B

Build and evolve scalable backend systems and AI integrations that help enterprises secure AI agents and their endpoints, shaping product capabilities across visibility, control, and security.

Backend EngineeringDistributed SystemsAI SecurityLLM Integrations
Commerzbank-Poland

Software Developer - Market Data (m/f/d)

🔥 14 hours ago
Commerzbank-Poland👥 201 - 500 employees🏢 Information Technology And Services

Develop and enhance market data applications, support business partners with technical issues, and contribute to cloud migration, documentation, and spreadsheet automation across financial data systems.

ASP.NET Framework.NETC#Java
SpaceX

Process Safety Engineer

🕒 3 days ago
SpaceX👥 10,000+ employees🏢 Aviation And Aerospace Component Manufacturing🤝 B2B

Establish process safety parameters for advanced Terafab technologies and manufacturing processes, leading hazard analyses, equipment risk reviews, safety controls, and Process Safety Management compliance.

Process Hazard Analysis (pha)Process Safety Management (psm)Chemical EngineeringChemical Systems Design And Commissioning

Trusted by Remote Workers