Remote Jobs RockRemote Jobs Rock

Senior AI Product Engineer (m/f/d)

πŸ“… Apr 23
LLM PipelinesPrompt DesignStructured Output ValidationLLM Evaluation
Apply Now

πŸ“œ Description

  • Design and operate production LLM pipelines, including structured-output validation, retries, fallbacks, monitoring, alerting, and cost tracking.
  • Choose between LLMs and deterministic approaches such as regexes, lookup tables, or code based on the problem.
  • Build evaluation infrastructure with test datasets, regression checks, and business-outcome quality metrics.
  • Select models across providers based on cost, latency, and quality tradeoffs.
  • Apply prompting techniques to solve complex extraction problems reliably.
  • Partner with Product to scope ambiguous problems and improve code quality, testing, and documentation.

πŸ› οΈ Requirements

  • Several years as a software engineer shipping production systems, with at least 3 years focused on LLM-powered features in production
  • Strong backend fundamentals: PostgreSQL, async workflows (we use Temporal), queues, observability, CI/CD
  • Comfort working in both Python (AI pipelines) and TypeScript/Node.js (our product stack)
  • Deep practical understanding of LLM behaviour: prompting, structured outputs, context window management, common failure modes, handling non-determinism and writing evals that catch regressions before users do
  • Pragmatic judgment about architecture and tradeoffs. You have seen complex systems get simpler over time

✨ Benefits

  • Competitive salary and equity options
  • A dynamic, fast-paced work environment with a mission-driven team
  • Flexible working arrangements (Hybrid)
  • 30 days of PTO
  • Regular team events and offsites
  • Monthly mobility budget via Navit
Full job description

Join Voyfai, a fast-growing Series A startup shaping the future of logistics and technology across Europe.

Headquartered in Berlin, we operate at the center of a broader group of companies active across several European markets. This is a unique opportunity to take ownership from day one, drive meaningful impact and grow within a dynamic, fast-paced environment. Whether you're shaping processes, building strategies or leading initiatives, your contributions will directly influence the success of Voyfai and the companies we support. If you're passionate about building from scratch and excited to be part of a company on the rise, we'd love to hear from you.

Your Role

As a Senior AI Product Engineer at Voyfai, you will own LLM pipelines that process real logistics documents and data in production, in multiple languages and formats. You will work closely with Product and Engineering to turn complex, unstructured problems into robust, production-ready AI solutions.

This role is hands-on and impact-driven. You will take end-to-end ownership from use case discovery and prompt design to deployment, monitoring and continuous improvement in production, with a strong focus on real-world reliability and business impact.

Key Responsibilities

  • Design and own LLM pipelines that process real logistics documents and data in production: prompt design, structured output validation, eval harnesses, retries, fallbacks, monitoring, alerting and cost tracking

  • Decide when to use an LLM and when not to. A lot of good engineering here is knowing when a regex, a lookup table, or deterministic code is the right answer

  • Build the evaluation infrastructure: test datasets, regression checks, quality metrics tied to business outcomes

  • Pick models pragmatically across providers (Claude, GPT, Gemini, open-weights) based on cost, latency and quality tradeoffs for each use case

  • Stay ahead of the curve on prompting techniques and apply them pragmatically to solve hard extraction problems

  • Collaborate with Product to scope ambiguous problems into something an AI pipeline can actually solve reliably

  • Raise the bar on code quality, testing and documentation across the team

What You Bring

  • Several years as a software engineer shipping production systems, with at least 3 years focused on LLM-powered features in production

  • Strong backend fundamentals: PostgreSQL, async workflows (we use Temporal), queues, observability, CI/CD

  • Comfort working in both Python (AI pipelines) and TypeScript/Node.js (our product stack)

  • Deep practical understanding of LLM behaviour: prompting, structured outputs, context window management, common failure modes, handling non-determinism and writing evals that catch regressions before users do

  • Pragmatic judgment about architecture and tradeoffs. You have seen complex systems get simpler over time

What We Offer

  • Competitive salary and equity options

  • A dynamic, fast-paced work environment with a mission-driven team

  • Flexible working arrangements (Hybrid)

  • 30 days of PTO

  • Regular team events and offsites

  • Monthly mobility budget via Navit

Doctolib

Senior Agents Platform Engineer (x/f/m)

πŸ•’ 3 days ago
DoctolibπŸ‘₯ 1001 - 5000 employees🏒 Computer Software

Build and operate a secure, reliable AI agents platform, owning its runtime, GenAI gateway, rollout controls, observability, and evaluation infrastructure for healthcare products.

PythonLitellmGoogle Agent Development Kit (adk)LLM-based Agent Systems
Sopra Steria

AI Engineer GΓΆteborg

πŸ•’ 3 days ago
Sopra SteriaπŸ‘₯ 10,000+ employees🏒 Information Technology And Services

Designs and implements generative AI solutions for customer environments, taking LLM, RAG, and agent-based systems from prototypes to scalable production integrations across cloud platforms and business processes.

πŸ“ πŸ‡ΈπŸ‡ͺ GΓΆteborg - HybridπŸ’Ό Full-Time🎸 SeniorπŸ€– AI EngineerπŸ“’ πŸ‡ΈπŸ‡ͺ Swedish RequiredπŸ“’ πŸ‡¬πŸ‡§ English Required
Generative AILarge Language Models (llms)Retrieval-augmented Generation (rag)AI Agents
Jobgether

AI Evaluation Engineer

πŸ•’ 3 days ago
JobgetherπŸ‘₯ 11 - 50 employees🏒 Staffing And Recruiting

Design and own automated evaluation, testing, and observability infrastructure for AI agents, measuring reliability, safety, performance, and security across complex interactions and production workflows.

PythonTypeScriptLLM EvaluationAutomated Testing
Jobgether

AI Evaluation Engineer

πŸ•’ 3 days ago
JobgetherπŸ‘₯ 11 - 50 employees🏒 Staffing And Recruiting

Design and own the evaluation, testing, and observability infrastructure for AI agents, building automated pipelines and statistical, adversarial, and regression tests to improve reliability, safety, and performance.

PythonTypeScriptLLM EvaluationCI/CD
Jobgether

AI Evaluation Engineer

πŸ•’ 3 days ago
JobgetherπŸ‘₯ 11 - 50 employees🏒 Staffing And Recruiting

Design and own the evaluation, testing, and observability infrastructure for AI agents, building scalable pipelines that measure reliability, safety, performance, and security across development and deployment.

PythonTypeScriptAPI TestingAsynchronous Programming

Trusted by Remote Workers