Remote Jobs RockRemote Jobs Rock

AI Infrastructure / Product Engineer

πŸ•’ yesterday
PythonAI Evaluation PipelinesBenchmarkingCloud Deployment
Apply Now

πŸ“œ Description

  • Build benchmarks and evaluation pipelines for model accuracy, hallucinations, retrieval quality, latency, and cost.
  • Create dashboards that surface changes in system performance.
  • Turn research prototypes into production retrieval, drafting, document, and agent workflows.
  • Develop backend services, APIs, and internal tools for testing and releases.
  • Deploy and operate cloud infrastructure, including monitoring, databases, and delivery pipelines.
  • Collaborate with AI research while staying connected to product and user needs.

πŸ› οΈ Requirements

  • At least 3 years of experience as a software, infrastructure, or product engineer building and deploying production systems.
  • Strong Python skills and hands-on experience deploying software to the cloud.
  • Experience building evaluation pipelines, benchmarks, or assessment systems for machine learning or AI systems.
  • Experience with APIs, databases, backend services, deployment pipelines, and monitoring or performance dashboards.
  • Ability to turn experimental code or ambiguous ideas into usable, maintainable products.
  • Full-stack experience is a plus. Helpful technologies include FastAPI, Docker, React, Next.js, Postgres, and vector databases.
  • Familiarity with LLMs, retrieval-augmented generation, agents, AI benchmarks, or document automation is valuable.
Full job description

About the Role

Join a healthtech team applying AI to legal workflows. You will bridge AI research and product development, building the evaluations, services, and features needed to bring applied AI into dependable production systems.

What You'll Do

  • Build repeatable benchmarks and evaluation pipelines for model accuracy, hallucinations, retrieval quality, latency, and cost.

  • Create dashboards that make system performance changes visible to the team.

  • Turn research prototypes into production retrieval, drafting, document, and agent workflows.

  • Develop backend services, APIs, and internal tools to support testing and releases.

  • Deploy and operate cloud infrastructure, including monitoring, databases, and delivery pipelines.

  • Work with AI research while staying connected to product and user needs.

What We're Looking For

  • At least 3 years of experience as a software, infrastructure, or product engineer building and deploying production systems.

  • Strong Python skills and hands-on experience deploying software to the cloud.

  • Experience building evaluation pipelines, benchmarks, or assessment systems for machine learning or AI systems.

  • Experience with APIs, databases, backend services, deployment pipelines, and monitoring or performance dashboards.

  • Ability to turn experimental code or ambiguous ideas into usable, maintainable products.

  • Full-stack experience is a plus. Helpful technologies include FastAPI, Docker, React, Next.js, Postgres, and vector databases.

  • Familiarity with LLMs, retrieval-augmented generation, agents, AI benchmarks, or document automation is valuable.

Compensation & Benefits

Annual base salary is $180,000 to $260,000 USD, depending on skills, experience, and role scope. Visa sponsorship is not available.

Location

Remote within the United States.

Ample Insight

AI Engineer (Agentic Systems)

πŸ•’ 4 days ago
Ample InsightπŸ‘₯ 11 - 50 employees🏒 Information Technology And Services

Design and build production-grade AI systems, with a focus on agentic architectures, scalable machine learning, model evaluation, and turning emerging research into working prototypes.

PythonAgentic SystemsMachine LearningDeep Learning
Aimpoint Digital

Lead AI Engineer 2026 - US, COL, UK

πŸ•’ 4 days ago
Aimpoint DigitalπŸ‘₯ 51 - 200 employees🏒 Computer Software

Design, build, and deploy production AI applications for enterprise clients, spanning solution architecture, backend development, agentic workflows, cloud deployment, evaluation, and operationalization.

PythonJavaC#Go
Nagarro

AI Agent Platform Engineer

πŸ•’ 5 days ago
NagarroπŸ‘₯ 10,000+ employees🏒 Information Technology And Services

Designs and builds agentic platforms and AI-driven enterprise workflows, while delivering secure, scalable cloud architectures and integrating AI solutions with existing enterprise systems.

Software EngineeringCloud ArchitectureKubernetesInfrastructure As Code (iac)
CVEDIA

Agentic AI Engineer (Computer Vision) - Remote

πŸ•’ 5 days ago
CVEDIA🏒 Artificial Intelligence🀝 B2B🧠 AI-native

Build agentic systems that automate computer vision model training, evaluation, and improvement, while advancing vision-language research and solving detection and classification problems for customers.

AI AgentsAgent HarnessesAgentic WorkflowsNeural Network Training

Trusted by Remote Workers