Design and own the evaluation, testing, and observability infrastructure for AI agents, building automated pipelines and statistical, regression, and adversarial tests to improve reliability, safety, and performance.
Forward Deployed Agile Software Engineer
📜 Description
- Work with clients and internal teams to turn business challenges into requirements, architectures, prototypes, and delivery plans.
- Design and deploy AI applications, agentic workflows, APIs, data pipelines, and full-stack products.
- Build agent orchestration, model harnesses, safeguards, and evaluation systems for reliable production performance.
- Integrate solutions with enterprise systems, data sources, cloud platforms, APIs, and databases.
- Prototype with users and evolve successful concepts into secure, scalable production systems.
- Instrument, troubleshoot, and improve systems while collaborating across product, engineering, data, security, and client teams.
🛠️ Requirements
- Professional software engineering experience: Demonstrated experience building and deploying production-grade software, ideally including AI-powered applications, autonomous agents, or agentic systems.
- Programming proficiency: Strong skills in Python, TypeScript, or another programming language commonly used for AI applications, platforms, and developer tooling.
- Harness engineering expertise: Practical understanding of how to design the infrastructure, context, tools, permissions, controls, and feedback mechanisms that enable AI agents to operate reliably in production.
- Agentic workflow development: Experience building or working with agent loops involving planning, tool selection, execution, observation, reflection, recovery, and termination.
- Workflow orchestration: Familiarity with graph-based orchestration, state machines, and multi-step workflows coordinating agents, tools, data, and human approvals.
- AI evaluation and testing: Experience designing evaluation systems for AI applications, including task-based benchmarks, regression suites, model-graded evaluations, human review, and production monitoring.
- Understanding of AI systems: Knowledge of prompt design, context management, memory, retrieval, tool use, structured outputs, and model selection, including the trade-offs affecting quality, reliability, latency, and cost.
- Observability and debugging: Experience instrumenting AI systems to trace decisions, inspect intermediate states, measure quality, and diagnose failures.
- Core technical foundations: Strong understanding of APIs, distributed systems, databases, cloud infrastructure, and modern software development practices.
- Problem-solving and adaptability: Ability to quickly understand unfamiliar technologies, business domains, and existing systems, then turn ambiguous customer problems into tested prototypes and production-ready solutions.
✨ Benefits
- Meaningful technical challenges: Work on high-impact problems across industries, technology platforms, and business domains.
- Hands-on product development: Build and deploy real-world software and production systems rather than limiting your work to recommendations
- Direct client collaboration: Work closely with customers, understand their needs, and see the tangible impact of your technical decisions.
- Exposure to emerging technologies: Explore AI-powered applications, agentic systems, harness engineering, modern software development
- Cross-functional collaboration: Partner with multidisciplinary teams that value experimentation, knowledge sharing, and continuous learning.
- Technical influence: Contribute to engineering standards, reusable solutions, and evolving technical practices across projects.
- Ownership and autonomy: Take responsibility for solving complex problems and helping promising ideas progress from discovery to production.
- Jobgether - Forward Deployed Agile Software Engineer
Full job description
This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Forward Deployed Agile Software Engineer based in Austria.
Join a forward-thinking engineering environment where software development, artificial intelligence, and product innovation come together to solve complex business challenges.
In this role, you will work directly with clients to transform ambiguous needs into practical, production-ready digital solutions.
You will design and build AI-powered applications, autonomous agents, intelligent workflows, and full-stack software tailored to real-world business requirements.
Beyond developing models and prompts, you will engineer the systems that make AI applications reliable, secure, observable, and scalable.
Collaborating with multidisciplinary teams, you will move seamlessly from technical discovery and rapid prototyping to deployment and continuous improvement.
You will have the opportunity to influence technical strategy, establish engineering best practices, and deliver measurable value across diverse industries.
This role is ideal for a hands-on engineer who thrives in dynamic environments, enjoys customer collaboration, and is passionate about bringing emerging AI technologies into production.
Accountabilities
Requirements
Nice to have:
Candidates do not need to meet every listed qualification to apply. Professionals with relevant adjacent experience and a strong interest in the role are encouraged to submit their applications.
Benefits
Similar jobs
Search more AI Engineer jobsDesign and own evaluation, testing, and observability infrastructure for AI agents, building automated pipelines and statistical and adversarial tests to improve reliability, safety, and performance.
Design and own the evaluation, testing, and observability infrastructure for AI agents, building automated pipelines and statistical, adversarial, and regression tests to improve reliability, safety, and performance.
Design and own the evaluation, testing, and observability infrastructure for AI agents, building automated pipelines and statistical, adversarial, and multi-turn tests to improve reliability, safety, and performance.
Design and own the evaluation, testing, and observability architecture for AI agents, building automated pipelines and statistical, adversarial, and regression tests to improve reliability, safety, and performance.
