Remote Jobs RockRemote Jobs Rock

Prompt Engineer (LLM Systems, Evals & Safety)

๐Ÿ“… Jan 12
Prompt DesignLLM SystemsEvaluation HarnessesEvaluation Datasets
Apply Now

๐Ÿ“œ Description

  • Author, refactor, and chain system, tool, and policy prompts for varied tasks.
  • Build offline and online evaluation harnesses using rubrics, golden sets, and metrics.
  • Create versioned prompt libraries with A/B testing and telemetry.
  • Reduce hallucinations through verification, constrained decoding, and tool use.
  • Implement safety checks for jailbreaks, prompt injection, content policies, and PII handling.
  • Partner with engineers to integrate prompts into production features.

๐Ÿ› ๏ธ Requirements

  • Demonstrated prompt design across multiple task types and models.
  • Experience building eval datasets and automated scoring (e.g., accuracy, faithfulness, utility, cost/latency).
  • Familiarity with retrieval-augmented generation concepts and tool/function calling.
  • Strong scripting (Python/TypeScript) for data prep, evals, and analysis.
  • Clear writing; ability to translate business goals into measurable prompt specs.
Full job description

Do you want to love what you do at work? Do you want to make a difference, an impact, and transform peoples lives? Do you want to work with a team that believes in disrupting the normal, boring, and average?

If yes, then this is the job you are looking for , webook.com is Saudiโ€™s #1 event ticketing and experience booking platform in terms of technology, features, agility, revenue serving some of the largest mega events in the Kingdom surpassing over 2 billion in sales.

Role Overview

Design high-quality prompts, system instructions, and tooling that make our LLM features accurate, safe, and cost-effective. Youโ€™ll own evaluation, prompt versioning, and continuous improvement.

Key Responsibilities:

  • Author, refactor, and chain prompts (system/tool/policy) for varied tasks.
  • Create offline/online evaluation harnesses (rubrics, golden sets, metrics).
  • Build prompt libraries with versioning, A/B testing, and telemetry.
  • Reduce hallucinations via verification, constrained decoding, and tool use.
  • Implement safety: jailbreak/prompt-injection tests, content policy checks, PII handling.
  • Partner with engineers to integrate prompts into production features.

Requirements

  • Demonstrated prompt design across multiple task types and models.
  • Experience building eval datasets and automated scoring (e.g., accuracy, faithfulness, utility, cost/latency).
  • Familiarity with retrieval-augmented generation concepts and tool/function calling.
  • Strong scripting (Python/TypeScript) for data prep, evals, and analysis.
  • Clear writing; ability to translate business goals into measurable prompt specs.

Nice-to-Haves

  • Experience with LangChain/LLM orchestration, vector stores, and rerankers.
  • Knowledge of safety tooling and red-teaming techniques.
  • Experiment platforms (feature flags, A/B tests), analytics.
Weloglobal

Project Lion - Senior Prompt Engineer - Portugal (Remote, Part-Time)

๐Ÿ“… Mar 16
Weloglobal๐Ÿข Translation And Localization๐Ÿค B2B

Own the technical migration of templates to LLM autoraters by generating, optimizing, and refining prompts, monitoring humanโ€“model disagreements, evaluating performance, and documenting launch readiness.

๐Ÿ“ ๐Ÿ‡ต๐Ÿ‡น Porto - Remoteโณ Temporary/Contract๐ŸŽธ Senior๐Ÿ“จ Prompt Engineer๐Ÿ“ข ๐Ÿ‡ง๐Ÿ‡ท๐Ÿ‡ต๐Ÿ‡น Portuguese Required๐Ÿ“ข ๐Ÿ‡ฌ๐Ÿ‡ง English Required
Prompt EngineeringLarge Language Models (llms)Automatic Prompt Generation (apg)Automated Prompt Optimization (apo)
Weloglobal

Project Lion - Senior Prompt Engineer - Italy (Remote, Part-Time)

๐Ÿ“… Mar 16
Weloglobal๐Ÿข Translation And Localization๐Ÿค B2B

Own the technical migration of templates to LLM autoraters by engineering and optimizing prompts, evaluating model performance against human ratings, and preparing launch-readiness documentation.

๐Ÿ“ ๐Ÿ‡ฎ๐Ÿ‡น Italy - Remoteโณ Temporary/Contract๐ŸŽธ Senior๐Ÿ“จ Prompt Engineer๐Ÿ“ข ๐Ÿ‡ฎ๐Ÿ‡น Italian Required๐Ÿ“ข ๐Ÿ‡ฌ๐Ÿ‡ง English Required
Prompt EngineeringLarge Language Models (llms)Automatic Prompt Generation (apg)Automated Prompt Optimization (apo)
Weloglobal

Project Lion - Senior Prompt Engineer - Spain (Remote, Part-Time)

๐Ÿ“… Mar 16
Weloglobal๐Ÿข Translation And Localization๐Ÿค B2B

Own the technical migration of templates to LLM autoraters by generating, optimizing, and refining prompts, monitoring evaluation runs, measuring model quality, and preparing launch-readiness documentation.

๐Ÿ“ ๐Ÿ‡ช๐Ÿ‡ธ Spain - Remoteโณ Temporary/Contract๐ŸŽธ Senior๐Ÿ“จ Prompt Engineer๐Ÿ“ข ๐Ÿ‡ช๐Ÿ‡ธ Spanish Required๐Ÿ“ข ๐Ÿ‡ฌ๐Ÿ‡ง English Required
Prompt EngineeringLarge Language Models (llms)Automatic Prompt Generation (apg)Automated Prompt Optimization (apo)
Weloglobal

Project Lion - Senior Prompt Engineer - Germany (Remote, Part-Time)

๐Ÿ“… Mar 16
Weloglobal๐Ÿข Translation And Localization๐Ÿค B2B

Own the technical migration of templates to LLM autoraters by designing and optimizing prompts, evaluating model performance against human ratings, and preparing launch-readiness documentation.

๐Ÿ“ ๐Ÿ‡ฉ๐Ÿ‡ช Germany - Remoteโณ Temporary/Contract๐ŸŽธ Senior๐Ÿ“จ Prompt Engineer๐Ÿ“ข ๐Ÿ‡ฉ๐Ÿ‡ช German Required๐Ÿ“ข ๐Ÿ‡ฌ๐Ÿ‡ง English Required
Prompt EngineeringLarge Language Models (llms)Automatic Prompt Generation (apg)Automated Prompt Optimization (apo)

Trusted by Remote Workers