Build and optimize backend services and APIs for AI-powered applications, including LLM inference orchestration, real-time interactions, and reliable production systems.
Backend Engineer, AI Systems
π Description
- Build and maintain backend services and APIs for AI-powered applications.
- Develop inference orchestration systems connecting LLMs, application services, and external tools.
- Design APIs for streaming responses, asynchronous processing, and real-time interactions.
- Improve performance through caching, batching, concurrency, and database optimisation.
- Implement monitoring, logging, alerting, and error handling for production services.
- Diagnose production issues involving latency, service failures, and high traffic.
π οΈ Requirements
- 3+ years of backend software engineering experience building production systems
- Strong programming skills in Python, Node.js or similar backend technologies
- Experience designing and maintaining REST or gRPC APIs, databases and distributed services
- Understanding of asynchronous processing, concurrency, caching and message queues
- Experience building scalable services and optimising latency, throughput and resource usage
- Experience with SQL or NoSQL databases, Docker and cloud infrastructure
- Ability to debug production issues using logs, metrics and distributed tracing
- Experience integrating LLM APIs, inference services or AI-powered applications
- Experience with model serving, streaming inference or orchestration frameworks
- Experience with Kubernetes and container orchestration
Full job description
About ActAI
There are over 5 billion users using basic applications today such email, notes, tasks, calendar and they're not AI-native. Our mission is to build proactive applications for anyone in the world, who are not used to complex prompting. We aim to bring intelligence to conversations, errands, organising and workflows, with minimal to no prompting.
Our first application is an agent-first mobile communication app. We believe building applications that users use daily for communication, coordination and collaboration needs will help integrate AI into their lives. The net effect is to eliminate misinformation, achieve low coordination costs, enable high quality tasks and collaboration at scale with minimal or little prompting.
Role
Build and maintain backend services and APIs for AI-powered applications
Develop inference orchestration systems that connect LLMs, application services and external tools
Design APIs for streaming responses, asynchronous processing and real-time interactions
Improve system performance through caching, batching, concurrency and database optimisation
Implement monitoring, logging, alerting and error handling for production services
Diagnose and resolve production issues involving latency, service failures and high traffic
Work with ML, frontend and mobile engineers on API design, system integration and deployment
Requirements
3+ years of backend software engineering experience building production systems
Strong programming skills in Python, Node.js or similar backend technologies
Experience designing and maintaining REST or gRPC APIs, databases and distributed services
Understanding of asynchronous processing, concurrency, caching and message queues
Experience building scalable services and optimising latency, throughput and resource usage
Experience with SQL or NoSQL databases, Docker and cloud infrastructure
Ability to debug production issues using logs, metrics and distributed tracing
Nice to Have
Experience integrating LLM APIs, inference services or AI-powered applications
Experience with model serving, streaming inference or orchestration frameworks
Experience with Kubernetes and container orchestration
Familiarity with PyTorch, vLLM or open-source model deployment
Experience building real-time communication, messaging or high-traffic
Similar jobs
Search more Backend Engineer jobsBuild and own backend features and services, integrate third-party vendors, and help a cross-functional team deliver tested, reliable products while improving technical quality, monitoring, and scalability.
AWS Integration Developer
Build and maintain AWS integration solutions, REST APIs, and MCP servers that connect enterprise data with applications and AI tools, with a focus on secure, scalable, and reliable services.
Design, build, and operate customer-facing distributed systems using Go, AWS, and Kafka, shaping event-driven services and APIs that deliver reliable, scalable experiences across a global platform.
Software Python Engineer (Billing)
Build and maintain Python backend features for a critical billing engine, improving performance and reliability while shaping REST APIs, distributed architecture, and delivery processes.
