Design and build production-ready generative AI solutions, focusing on cognitive engines and evaluation frameworks to enhance model performance and decision quality.
Engenheiro(a) de Prompts / Desenvolvedor(a) de Agentes de IA
📜 Description
- Design and configure system prompts, instructions, and conversational workflows for AI agents.
- Evaluate and benchmark multiple LLM families for response quality and performance.
- Build and refine AI agents within collaborative squads, managing orchestration and context-memory.
- Define response-quality criteria and conduct structured testing to improve AI outputs.
- Implement guardrails and mitigation strategies for risks like prompt injection.
- Establish prompt engineering standards and document best practices for team adoption.
🛠️ Requirements
- Proven hands-on experience with prompt engineering using multiple LLM families.
- Practical experience developing AI agents, including orchestration and tool integration.
- Experience defining metrics and evaluation approaches for AI-generated responses.
- Excellent Portuguese writing skills with clarity and precision.
- Familiarity with Git and CI/CD pipelines for version control.
- Strong adaptability to new AI platforms and technologies.
✨ Benefits
- 100% remote work.
- Meal or food allowance.
- Discounts on courses, universities, and language institutions.
- Access to an online learning academy with free, regularly updated courses and certificates.
- Mentoring opportunities.
- Healthcare benefits and discounts for consultations and medical exams.
- Dental assistance.
- Employee discounts and benefits at participating establishments.
Full job description
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Engenheiro(a) de Prompts / Desenvolvedor(a) de Agentes de IA based in Brazil.
This is a fully remote opportunity focused on building and optimizing AI agents and conversational experiences.
You will design prompts, instructions, and conversational flows across multiple leading LLM families.
The role combines prompt engineering, agent orchestration, model evaluation, testing, and AI quality assurance.
You will help establish practical standards for response quality, security, governance, and reusable AI patterns.
The position offers the opportunity to work with emerging AI technologies in a collaborative product and engineering environment.
You will also contribute to documentation, experimentation, and continuous improvement of AI-powered solutions.
Success in this role requires strong written communication, technical curiosity, and a hands-on approach to AI experimentation.
Accountabilities
-
Design and configure system prompts, instructions, and conversational workflows for AI agents, adapting them to different use cases and LLM capabilities.
-
Evaluate and benchmark multiple LLM families, balancing response quality, cost, latency, and model-specific characteristics.
-
Build and refine AI agents within collaborative squads, including orchestration, tool usage, and context-memory management.
-
Define response-quality criteria and conduct structured, iterative testing to evaluate and improve AI-generated outputs.
-
Implement guardrails, out-of-scope response handling, and mitigation strategies for risks such as prompt injection.
-
Establish and document prompt engineering standards, versioning practices, reusable patterns, and best practices for broader team adoption.
-
Collaborate with technical teams to publish and maintain solutions through existing Git and CI/CD workflows.
-
Continuously investigate new AI platforms and techniques and adapt quickly to proprietary tools and evolving project requirements.
-
Proven hands-on experience with prompt engineering in real-world projects using multiple LLM families, such as OpenAI/GPT, Anthropic/Claude, Google/Gemini, and Meta/Llama.
-
Practical experience developing AI agents within squads, including orchestration, tool integration, and context-memory management.
-
Experience defining metrics, test cases, and evaluation approaches for the quality and reliability of AI-generated responses.
-
Excellent Portuguese writing skills, with strong command of clarity, grammar, precision, tone, and the ability to create concise and effective instructions.
-
Familiarity with Git and existing CI/CD pipelines for version control and deployment.
-
Strong adaptability and willingness to learn and operate new proprietary AI platforms and technologies.
-
Ability to critically evaluate AI-generated content and iterate on prompts and workflows based on test results.
-
Strong collaboration, analytical thinking, attention to detail, and curiosity about emerging AI technologies.
-
Experience with RAG (Retrieval-Augmented Generation), particularly evaluating responses against documentary sources, is a plus.
-
Knowledge of Python for automating LLM testing and evaluation is a plus.
-
Experience handling sensitive data under LGPD requirements or working in healthcare environments is a plus.
-
100% remote work.
-
Meal or food allowance.
-
Discounts on courses, universities, and language institutions.
-
Access to an online learning academy with free, regularly updated courses and certificates.
-
Mentoring opportunities.
-
Healthcare benefits and discounts for consultations and medical exams.
-
Dental assistance.
-
Employee discounts and benefits at participating establishments.
-
Travel benefits and discounts.
-
Pet benefits and assistance.
Requirements
Benefits
Similar jobs
Search more AI Engineer jobsAs an AI Engineer, you'll own the engineering foundations for production AI capabilities, working hands-on to develop scalable systems and collaborate with a high-ownership team.
As a Forward Deployed Engineer, you'll build AI-powered solutions in collaboration with business users, focusing on full-stack development and cloud engineering.
AI Automation and Workflow Specialist
The AI Automation and Workflow Specialist will enhance business processes by implementing and improving AI-assisted workflows using Microsoft 365 and other automation tools.
This role involves designing and developing advanced AI agents that utilize Generative AI and LLMs to coordinate complex workflows and ensure secure decision-making.
