Remote Jobs RockRemote Jobs Rock

Senior/Staff ML Ops Engineer

📅 Jun 17
Machine LearningML OpsModel DeploymentData Management

📜 Description

  • Filevine is a Legal AI company delivering Legal Operating Intelligence for the future of legal work. Grounded in a singular system of truth, Filevine brings together data, documents, workflows, and teams into one
  • You will be responsible for the full stack of ML infrastructure: evals, observability, model serving, annotation tooling, and the prompt platform that lets every team move with confidence.
  • Compensation starts at 150,000 CZK per month, with the final offer determined by the candidate’s seniority and experience.
  • This opportunity is for independent contractors and is not intended to establish an employment relationship. Contractors are responsible for their own taxes and compliance with applicable laws in their jurisdiction.
  • This role is open exclusively to candidates currently residing in, or willing to relocate to, Czechia or Slovakia with the legal right to work in these countries. Unfortunately, we are unable to consider applications

🛠️ Requirements

  • 5+ years building and operating software systems end-to-end
  • Hands-on experience with ML infrastructure: model serving, training pipelines, or LLM integrations in production
  • Strong understanding of cloud infrastructure and distributed systems (primarily AWS)
  • Familiarity with observability tooling and cost management for LLM workloads
  • Experience with or openness to: Python, Kubernetes, Terraform
  • Thrives in a remote-first, async environment: clear communicator, high ownership, low ego
  • Bonus: experience with eval frameworks, annotation tooling, or prompt management platforms
Full job description
Filevine is a Legal AI company delivering Legal Operating Intelligence for the future of legal work. Grounded in a singular system of truth, Filevine brings together data, documents, workflows, and teams into one unified platform—where modern legal work happens with clarity and consistency.

Powered by LOIS, the Legal Operating Intelligence System, Filevine connects context across every matter to transform legal operations from reactive to proactive. LOIS reads, understands, and reasons across your data to surface insight, automate complexity, and give professionals the clarity and confidence to see more, know more, and do more. Fueled by a team of exceptional collaborators and innovators, Filevine’s rapid growth has earned AI awards and recognition from Deloitte and Inc. as one of the most innovative and fastest-growing technology companies in the country.

Role Summary:

As a Senior MLOps Engineer at Filevine, you'll sit at the intersection of machine learning, platform infrastructure, and product velocity. You'll build and own the systems that make Filevine's AI capabilities faster to develop, safer to ship, and easier to trust, at scale.

You will be responsible for the full stack of ML infrastructure: evals, observability, model serving, annotation tooling, and the prompt platform that lets every team move with confidence.

Filevine is a Legal AI company delivering Legal Operating Intelligence for the future of legal work. Grounded in a singular system of truth, Filevine brings together data, documents, workflows, and teams into one unified platform—where modern legal work happens with clarity and consistency. Powered by LOIS, the Legal Operating Intelligence System, Filevine connects context across every matter to transform legal operations from reactive to proactive. LOIS reads, understands, and reasons across your data to surface insight, automate complexity, and give professionals the clarity and confidence to see more, know more, and do more. Fueled by a team of exceptional collaborators and innovators, Filevine’s rapid growth has earned AI awards and recognition from Deloitte and Inc. as one of the most innovative and fastest-growing technology companies in the country. Compensation starts at 150,000 CZK per month, with the final offer determined by the candidate’s seniority and experience.               This opportunity is for independent contractors and is not intended to establish an employment relationship. Contractors are responsible for their own taxes and compliance with applicable laws in their jurisdiction. This role is open exclusively to candidates currently residing in, or willing to relocate to, Czechia or Slovakia with the legal right to work in these countries. Unfortunately, we are unable to consider applications from candidates based outside of these locations due to operational and regulatory requirements Privacy Policy Notice Filevine will handle your personal information according to what’s outlined in our Privacy Policy.

Responsibilities

  • Setup and maintain LLM observability frameworks/tools

  • Help improve data annotation tooling

  • Ensure stability of LLM calls (rate limits, provisioned throughput, backups, …)

  • Help to drive security review processes for AI vendors and providers

  • LLM cost optimization recommendations (caching, batching, identification of workflow parts causing high costs, etc.)

  • Hosting finetuned/open weight machine learning models

  • Helping with LLM evaluations (tooling/framework) with the current main focus on agentic evals

  • Platform tooling for enabling non-technical people (e.g. PMs) to iterate on prompts

  • Qualifications

  • 5+ years building and operating software systems end-to-end

  • Hands-on experience with ML infrastructure: model serving, training pipelines, or LLM integrations in production

  • Strong understanding of cloud infrastructure and distributed systems (primarily AWS)

  • Familiarity with observability tooling and cost management for LLM workloads

  • Experience with or openness to: Python, Kubernetes, Terraform

  • Thrives in a remote-first, async environment: clear communicator, high ownership, low ego

  • Bonus: experience with eval frameworks, annotation tooling, or prompt management platforms

  • Lyft

    Senior ML Software Engineer, Mapping

    Lyft👥 10,000+ employees🏢 Transportation
    🕒 3 days ago

    Our technology stack ranges from basic machine learning models to large language models and running them at scale on millions of images. You will work with incredibly passionate and talented colleagues from machine learning, data science,.

    📍 🇺🇸 San Francisco - Hybrid💰 $162.8k - $203.5k / year💼 Full-Time🎸 Senior🤖 AI Engineer📢 🇬🇧 English Required
    Machine LearningData AnalysisStatistical ModelingOptimization Models
    Celonis

    Senior Applied Value Engineer (NAM) - CMT/CPGR

    Celonis👥 1001 - 5000 employees🏢 Computer Software
    🕒 4 days ago

    As a Senior Applied Value Engineer, you will solve critical business challenges for strategic customers by leveraging AI technologies and Celonis' Process Intelligence platform to drive ROI and successful implementations.

    AI TechnologiesProcess IntelligenceGenerative AIMachine Learning

    Trusted by Remote Workers