Remote Jobs RockRemote Jobs Rock

Tech Lead, Machine Learning (Real-time AI)

🕒 yesterday
📍 🇨🇿 Prague - Hybrid🎺 Lead🗣️ Machine Learning Engineer💼 Full-Time
Machine LearningLarge Language ModelsNatural Language ProcessingPython
Apply Now

📜 Description

  • Build LLM pipelines that reason over case files and real-time transcripts, grounding outputs in source material.
  • Select and implement model strategies, including fine-tuning or trained models when needed.
  • Create evaluation frameworks, datasets, rubrics, metrics, and release checks with legal experts and annotators.
  • Improve latency, efficiency, and cost for live analysis; move prototypes into production with testing and observability.
  • Guide design decisions, collaborate across product and engineering teams, mentor ML engineers, and lead incident response during live proceedings.

🛠️ Requirements

  • 5+ years building production ML or software systems, including at least 3 years in machine learning roles with end-to-end project ownership.
  • Technical leadership experience setting architecture, conducting design reviews, and mentoring engineers.
  • Strong NLP and production LLM experience, including retrieval and grounding, long-context reasoning, structured outputs, and evaluation.
  • Experience designing generative AI evaluation frameworks, datasets, and rubrics with domain experts and annotators.
  • Strong software engineering foundations in API design, data modeling, distributed and asynchronous workflows, testing, and fault tolerance.
  • Advanced Python proficiency and hands-on experience with PyTorch or another deep learning framework.
  • Strong written and verbal English communication, collaboration, and autonomous problem-solving skills.

✨ Benefits

  • Own technical vision and architecture for machine learning workflows across deposition and meeting products.
Full job description
Filevine is a Legal AI company delivering Legal Operating Intelligence for the future of legal work. Grounded in a singular system of truth, Filevine brings together data, documents, workflows, and teams into one unified platform—where modern legal work happens with clarity and consistency.

Powered by LOIS, the Legal Operating Intelligence System, Filevine connects context across every matter to transform legal operations from reactive to proactive. LOIS reads, understands, and reasons across your data to surface insight, automate complexity, and give professionals the clarity and confidence to see more, know more, and do more. Fueled by a team of exceptional collaborators and innovators, Filevine’s rapid growth has earned AI awards and recognition from Deloitte and Inc. as one of the most innovative and fastest-growing technology companies in the country.

The Depo Intelligence team powers the AI behind Filevine's deposition product line. We deliver automated post-deposition transcript analysis, timelines, summaries, and witness impressions. Our latest product, Depo Copilot, assists attorneys during deposition preparation and delivers real-time insights during live proceedings. Additionally, our intelligent insights extend support to the Filevine Meetings and Notetaking apps.

As the Tech Lead for Depo Intelligence, you will drive the technical direction of our AI systems. This is a hands-on machine learning role requiring strong software engineering skills. You will spend your time designing and building LLM pipelines and evaluations, as well as leading the team's architectural and design choices. You will collaborate closely with the team's Engineering Manager, who handles people management and delivery, allowing you to focus squarely on technical leadership.

Filevine is a Legal AI company delivering Legal Operating Intelligence for the future of legal work. Grounded in a singular system of truth, Filevine brings together data, documents, workflows, and teams into one unified platform—where modern legal work happens with clarity and consistency. Powered by LOIS, the Legal Operating Intelligence System, Filevine connects context across every matter to transform legal operations from reactive to proactive. LOIS reads, understands, and reasons across your data to surface insight, automate complexity, and give professionals the clarity and confidence to see more, know more, and do more. Fueled by a team of exceptional collaborators and innovators, Filevine’s rapid growth has earned AI awards and recognition from Deloitte and Inc. as one of the most innovative and fastest-growing technology companies in the country. This opportunity is for independent contractors and is not intended to establish an employment relationship. Contractors are responsible for their own taxes and compliance with applicable laws in their jurisdiction. This role is open exclusively to candidates currently residing in, or willing to relocate to, Czechia or Slovakia with the legal right to work in these countries. Unfortunately, we are unable to consider applications from candidates based outside of these locations due to operational and regulatory requirements Privacy Policy Notice Filevine will handle your personal information according to what’s outlined in our Privacy Policy.

Key Responsibilities

  • Own the technical vision and system architecture for machine learning workflows driving Depo Copilot, Depo Summaries, and the Meetings and Notetaking app.
  • Architect and build LLM pipelines capable of reasoning over extensive case files and real-time transcripts, ensuring all outputs are fully grounded in source material.
  • Determine optimal model strategies - evaluating when custom fine-tuning or trained models are required over prompt engineering - and lead implementation.
  • Establish evaluation frameworks alongside our legal experts and annotators, creating custom datasets, rubrics, offline metrics, and release checks to proactively prevent regressions.
  • Optimize pipeline efficiency, latency, and operational costs for live streaming analysis using strategic model selection, fallbacks, and precomputation.
  • Transition prototypes into production-grade systems with typed contracts, test coverage, tracing, and observability, serving as technical lead for incident response during live proceedings.
  • Author design documents, guide architectural decisions, and partner with Product, product engineering, speech recognition, and document retrieval teams to translate roadmap goals into actionable technical plans.
  • Mentor machine learning engineers through detailed code reviews, pair programming, and design feedback while clearly communicating technical outcomes and tradeoffs to business stakeholders.

    • Who are you?

  • Minimum of 5 years of experience building production ML or software systems, including at least 3 years in machine learning roles with end-to-end project ownership.
  • Proven track record of technical leadership, including conducting design reviews, setting architectural direction, and mentoring engineers.
  • Strong background in NLP and production LLM systems, encompassing retrieval and grounding, long-context reasoning, structured outputs, evaluation, and mitigation of common failure modes.
  • Experience designing evaluation frameworks for generative AI systems, including developing datasets and rubrics in collaboration with domain experts and annotators.
  • Solid software engineering foundations, including API design, data modeling, distributed and asynchronous workflows, testing, and fault tolerance.
  • Advanced proficiency in Python, alongside hands-on experience with PyTorch or other deep learning frameworks.
  • Experience with real-time/streaming systems or legal domain NLP is a plus.
  • Strong written and verbal communication skills in English, a collaborative team spirit, and an autonomous problem-solving mindset.
  • Ability to meet periodically at our Prague or Bratislava office to support in-person collaboration.
  • Our current stack primarily utilizes Python (DSPy, Pydantic, Temporal), PostgreSQL, Kubernetes, AWS, Google Cloud, and multi-provider LLMs; strong core engineering skills are prioritized over familiarity with specific tools or frameworks.
    • Apply Now

    Similar jobs

    Search more Machine Learning Engineer jobs
    Faculty

    Lead Machine Learning Engineer (Safety)

    🕒 16 days ago
    Faculty👥 501 - 1000 employees🏢 Internet
    WebsiteLinkedInAll Job Openings

    Leads the strategy, architecture, and deployment of secure, scalable machine learning systems, advancing AI safety evaluations and multi-agent tooling while advising clients and mentoring engineering teams.

    📍 🇬🇧 London - Hybrid💼 Full-Time🎺 Lead🗣️ Machine Learning Engineer
    Machine LearningLarge Language ModelsAI Safety EvaluationMulti-agent Systems
    View jobApply
    PhysicsX

    Principal Machine Learning Engineer

    🕒 3 days ago
    PhysicsX👥 201 - 500 employees🏢 Computer Software🧠 AI-native
    WebsiteLinkedInAll Job Openings

    Lead the development and deployment of production machine-learning systems for manufacturing and MRO, turning sparse industrial data and simulation into validated, transferable tools with measurable shop-floor impact.

    📍 🇺🇸 New York - Hybrid💼 Full-Time🎺 Lead🗣️ Machine Learning Engineer
    Machine LearningManufacturing Process DataSensor DataMachine Learning Deployment
    View jobApply
    Doctolib

    Principal Machine Learning Engineer - Applied AI & LLMs (x/f/m)

    🕒 4 days ago
    Doctolib👥 1001 - 5000 employees🏢 Computer Software
    WebsiteLinkedInAll Job Openings

    Own cross-team machine learning architecture and evaluation standards, guide agentic AI design, and strengthen production practices across AI teams while ensuring safe, compliant deployment.

    📍 🇩🇪 Berlin - Hybrid💼 Full-Time🎺 Lead🗣️ Machine Learning Engineer
    Machine LearningArtificial IntelligencePythonPytorch
    View jobApply
    Wayve

    Staff Machine Learning Engineer, Robotics

    🕒 16 days ago
    Wayve👥 501 - 1000 employees🏢 Computer Software🧠 AI-native
    WebsiteLinkedInAll Job Openings

    Develop and evaluate machine-learning methods that help autonomous-driving models transfer reliably across vehicle platforms, diagnosing real-world failures and improving production performance.

    📍 🇺🇸 Sunnyvale - Hybrid💰 $370.0k - $419.8k / year💼 Full-Time🎺 Lead🗣️ Machine Learning Engineer
    Machine LearningPytorchPythonRobotics
    View jobApply
    Plaid

    Staff Machine Learning Engineer (Research Scientist) - DFAI

    🕒 16 days ago
    Plaid👥 10,000+ employees🏢 Software Development
    WebsiteLinkedInAll Job Openings

    Lead the technical strategy and end-to-end development of foundation models, from data curation and pretraining through production serving, evaluation, and monitoring, while guiding teams across Plaid.

    📍 🇺🇸 San Francisco - Hybrid💰 $249.1k - $367.9k / year💼 Full-Time🎺 Lead🗣️ Machine Learning Engineer
    Machine LearningFoundation ModelsTransformersLLMs
    View jobApply
    View more Machine Learning Engineer jobs

    Trusted by Remote Workers