Remote Jobs RockRemote Jobs Rock

AI Phone - Senior Agent Runtime Engineer

πŸ•’ 9 days ago
Backend EngineeringDistributed SystemsAsynchronous WorkflowsLLM Integration
Apply Now

πŸ“œ Description

  • Implement agent runtime and orchestration components.
  • Build tool-calling and execution interfaces for agents.
  • Support multi-step and long-running task execution.
  • Manage task state, execution history, and asynchronous workflows.
  • Implement error handling, retries, and recovery mechanisms.
  • Integrate model providers and build execution observability and tracing.

πŸ› οΈ Requirements

  • Strong backend engineering experience.
  • Experience with distributed systems and asynchronous workflows.
  • Experience integrating LLMs into production applications.
  • Strong API and service architecture knowledge.
  • Experience with queues, state management and observability.
  • Good understanding of tool calling and structured outputs.
  • Production agent framework or custom agent runtime experience.
  • Experience with Temporal or similar workflow orchestration systems.
  • Experience with model routing and inference optimization.
  • Experience with AI evaluation and tracing.
Full job description

About

We are reimagining the phone. AI phones need to be proactive, intuitive, intelligent and low cost. This is a mission critical for rest of the world to adopt intelligence.

There are over 5 billion people using everyday applications such as email, messaging, notes, tasks, and calendars, yet most are not AI-native. Our mission is to build proactive applications and devices that bring intelligence into daily conversations, coordination and workflows, with minimal prompting.

Focus: Building the actual execution infrastructure for AI agents.

Responsibilities

  • Implement agent runtime and orchestration components.

  • Build tool-calling and execution interfaces.

  • Support multi-step and long-running task execution.

  • Manage task state, execution history and asynchronous workflows.

  • Implement error handling, retries and recovery mechanisms.

  • Integrate multiple model providers.

  • Build observability and tracing for agent execution.

  • Optimize latency, reliability and inference costs.

  • Work with context and memory components to provide relevant information to agents.

Requirements

  • Strong backend engineering experience.

  • Experience with distributed systems and asynchronous workflows.

  • Experience integrating LLMs into production applications.

  • Strong API and service architecture knowledge.

  • Experience with queues, state management and observability.

  • Good understanding of tool calling and structured outputs.

Nice to have

  • Production agent framework or custom agent runtime experience.

  • Experience with Temporal or similar workflow orchestration systems.

  • Experience with model routing and inference optimization.

  • Experience with AI evaluation and tracing.

Ellipsis-Health

Senior AI Engineer

πŸ•’ 3 days ago
Ellipsis-Health🏒 Healthcare🀝 B2B🧠 AI-native

Build and deploy production-ready LLM applications and agentic systems for clinical use, owning architecture, evaluation, data pipelines, and collaboration with clinical and engineering teams.

PythonLLM ApplicationsAgentic SystemsMulti-agent Orchestration
Pebl

Senior Software Engineer, AI

πŸ•’ yesterday
Pebl🏒 Human Resources🀝 B2B

Build Alfie’s AI-native product end to end, from backend services, APIs, and data models to polished conversational interfaces, while improving agent behavior, reliability, and user experience.

πŸ“ πŸ‡¨πŸ‡¦ Toronto - HybridπŸ’° C$122.8k - C$180k / yearπŸ’Ό Full-Time🎸 SeniorπŸ€– AI EngineerπŸ“’ πŸ‡΅πŸ‡± Polish Required
TypeScriptPythonReactPostgres
Benevity

Senior AI Systems Engineer

πŸ•’ 2 days ago
Benevity🏒 Corporate Social Responsibility Software🀝 B2B

Build and operate production ML and GenAI systems, turning prototypes into reliable product features while owning system design, evaluation, monitoring, and delivery in collaboration with product and data science teams.

PythonPytorchTensorflowScikit-learn

Trusted by Remote Workers