Build and optimise backend services and APIs for AI-powered applications, including LLM inference orchestration, real-time interactions, production reliability, and scalable system performance.
Backend Engineer, AI Systems
π Description
- Build and maintain backend services and APIs for AI-powered applications.
- Develop inference orchestration connecting LLMs, application services, and external tools.
- Design APIs for streaming responses, asynchronous processing, and real-time interactions.
- Improve performance through caching, batching, concurrency, and database optimization.
- Implement production monitoring, logging, alerting, and error handling.
- Diagnose production issues and collaborate with ML, frontend, and mobile engineers on integration and deployment.
π οΈ Requirements
- 3+ years of backend software engineering experience building production systems
- Strong programming skills in Python, Node.js or similar backend technologies
- Experience designing and maintaining REST or gRPC APIs, databases and distributed services
- Understanding of asynchronous processing, concurrency, caching and message queues
- Experience building scalable services and optimising latency, throughput and resource usage
- Experience with SQL or NoSQL databases, Docker and cloud infrastructure
- Ability to debug production issues using logs, metrics and distributed tracing
- Experience integrating LLM APIs, inference services or AI-powered applications
- Experience with model serving, streaming inference or orchestration frameworks
- Experience with Kubernetes and container orchestration
Full job description
About ActAI
There are over 5 billion users using basic applications today such email, notes, tasks, calendar and they're not AI-native. Our mission is to build proactive applications for anyone in the world, who are not used to complex prompting. We aim to bring intelligence to conversations, errands, organising and workflows, with minimal to no prompting.
Our first application is an agent-first mobile communication app. We believe building applications that users use daily for communication, coordination and collaboration needs will help integrate AI into their lives. The net effect is to eliminate misinformation, achieve low coordination costs, enable high quality tasks and collaboration at scale with minimal or little prompting.
Role
Build and maintain backend services and APIs for AI-powered applications
Develop inference orchestration systems that connect LLMs, application services and external tools
Design APIs for streaming responses, asynchronous processing and real-time interactions
Improve system performance through caching, batching, concurrency and database optimisation
Implement monitoring, logging, alerting and error handling for production services
Diagnose and resolve production issues involving latency, service failures and high traffic
Work with ML, frontend and mobile engineers on API design, system integration and deployment
Requirements
3+ years of backend software engineering experience building production systems
Strong programming skills in Python, Node.js or similar backend technologies
Experience designing and maintaining REST or gRPC APIs, databases and distributed services
Understanding of asynchronous processing, concurrency, caching and message queues
Experience building scalable services and optimising latency, throughput and resource usage
Experience with SQL or NoSQL databases, Docker and cloud infrastructure
Ability to debug production issues using logs, metrics and distributed tracing
Nice to Have
Experience integrating LLM APIs, inference services or AI-powered applications
Experience with model serving, streaming inference or orchestration frameworks
Experience with Kubernetes and container orchestration
Familiarity with PyTorch, vLLM or open-source model deployment
Experience building real-time communication, messaging or high-traffic
Similar jobs
Search more Backend Engineer jobsSoftware Python Engineer (Billing)
Build and maintain Python backend features for a critical billing engine, improving performance and reliability while shaping REST APIs, distributed architecture, and delivery processes.
[MEX] Software Engineer β Go
Build Go services and developer tooling for a LiveOps plugin platform, integrating Kafka event flows and cloud infrastructure while supporting CI/CD, observability, testing, and production operations.
Python/Django Software Engineer (part-time, remote, with flexible schedule)
As a Python/Django Software Engineer, you will develop complex services to enhance healthcare solutions for patients and clinicians, collaborating with product teams.
[MEX] Software Engineer β Go
Build a Go-based LiveOps plugin platform for a video-game commerce product, implementing configurable reward mechanics, schema-driven interfaces, sandboxed execution, and Kafka event integrations.
