Design and own the evaluation, testing, and observability infrastructure for AI agents, building automated pipelines and statistical, adversarial, and regression tests to improve reliability, safety, and performance.
Staff / Senior Staff Software Engineer – AI Systems
📜 Description
- Lead architecture and technical direction for AI-powered systems from exploration through production.
- Design scalable systems and make decisions about APIs, service boundaries, reliability, performance, security, and cost.
- Turn product ideas into experiments, prototypes, and production-ready solutions.
- Build LLM integrations and establish practices for testing, evaluation, monitoring, and improving AI features.
- Write and review code, solve complex technical challenges, and mentor engineers.
- Influence engineering practices and help teams adopt AI development tools while maintaining code quality.
🛠️ Requirements
- Experience designing and delivering complex production systems at Staff, Senior Staff, Tech Lead, or equivalent level.
- Strong hands-on experience with TypeScript, Node.js, software architecture, and distributed systems.
- Experience building production LLM- or AI-powered features, including testing, evaluation, observability, and reliability.
- Strong architectural judgment and ability to balance simplicity, scalability, and long-term maintainability.
- End-to-end ownership of ambiguous technical challenges through production delivery.
- Ability to influence technical decisions, mentor engineers, and collaborate across teams without formal authority.
✨ Benefits
- Monthly remuneration of 32,000–40,000 PLN + VAT for B2B contracts, or equivalent on an employment contract.
- Flexible schedule.
- Possibility to work fully remotely.
- Up to 5 days of additional leave for professional development.
- 6,000 PLN yearly for professional development.
- LinkedIn Learning access.
- Extra leave for Tiugo Day and your birthday.
- English lessons with a native speaker and access to an online language platform for English, Spanish, and German.
Full job description
CKSource builds CKEditor, an open-source rich text editor used by millions worldwide. We're part of Tiugo Technologies, alongside TinyMCE, ButterCMS, and Uploadcare.
Your role:
We're looking for a hands-on Staff / Senior Staff Software Engineer to drive the architecture and technical direction of backend of AI-powered systems in CKEditor.
CKEditor AI is already in production, with features like AI Chat, Quick Actions, and Review. We're expanding our AI platform, integrating LLMs, contextual data, APIs, and external systems.
This is an individual contributor role, not an ML research or people-management position. You'll combine strong software engineering fundamentals with the challenges of building reliable, scalable AI-powered products.
Key Responsibilities:
Lead the architecture and technical direction of AI-powered systems, from early exploration to production and beyond.
Design scalable, maintainable systems, making sound decisions about APIs, service boundaries, reliability, performance, security, and cost.
Turn complex product ideas into experiments, prototypes, and production-ready solutions.
Build reliable LLM integrations and establish practices for testing, evaluation, monitoring, and improving AI features.
Stay hands-on by writing and reviewing code, solving complex technical challenges, and mentoring engineers.
Influence engineering practices and help teams adopt AI development tools without compromising code quality or maintainability.
Similar jobs
Search more AI Engineer jobsDesign and own the evaluation, testing, and observability infrastructure for AI agents, building automated pipelines and statistical, adversarial, and regression tests to improve reliability, safety, and performance.
Design and own the evaluation, testing, and observability infrastructure for AI agents, building automated pipelines and statistical, adversarial, and regression tests to improve reliability, safety, and performance.
Design and own automated evaluation, testing, and observability infrastructure for AI agents, measuring reliability, safety, performance, and security across complex interactions and deployment workflows.
Design and scale AI-powered go-to-market workflows, integrations, and internal tools across sales, marketing, and Customer Success to improve efficiency, intelligence, customer experience, and cost to serve.
