Remote Jobs RockRemote Jobs Rock

Data Scientist - R01572335

🕒 17 days ago
📍 🇮🇳 Hyderabad - Hybrid🎸 Senior🤖 AI Engineer💼 Full-Time
PythonLangchainLlamaindexPrompt Engineering
Apply Now

📜 Description

  • Design and deploy scalable, reliable end-to-end AI agent workflows.
  • Develop and optimize RAG pipelines, including chunking, embeddings, retrieval ranking, and context management.
  • Build and systematically refine prompts and multi-step tool orchestration.
  • Create automated quality checks, evaluation frameworks, and feedback loops to improve agent performance.
  • Deploy, monitor, and maintain production AI/ML solutions with robust error handling.
  • Collaborate with Data Scientists to measure solution performance against defined targets.

🛠️ Requirements

  • Design and build end-to-end AI agent workflows, from initial prompt design through production deployment, ensuring scalable and reliable solutions
  • Develop and optimize Retrieval-Augmented Generation (RAG) pipelines by implementing chunking strategies, embedding models, retrieval ranking, and context window management for precise information retrieval
  • Build and iterate on prompt engineering layers, systematically testing and refining prompts and chain-of-thought strategies to deliver consistent outputs across diverse inputs
  • Implement tool orchestration within agent workflows, integrating agents with databases, rule engines, validation systems, and formatting tools for seamless operation
  • Establish automated quality checks and validation layers to proactively identify and resolve issues before outputs reach human reviewers
  • Collaborate with Data Scientists to instrument solutions for measurement, developing evaluation frameworks and tracking solution performance against defined targets
  • Deploy, monitor, and maintain AI/ML solutions in production environments, ensuring reliability, scalability, and robust error handling
  • Design and implement feedback loops to capture expert review data and translate it into measurable improvements in agent performance
  • Advanced proficiency in Python
  • Hands-on experience with LLM frameworks such as LangChain or LlamaIndex
Full job description
Senior AI/ML Engineer

Job requirements

Experience Range: 2 to 4 years of experience, including at least 2 years specifically focused on developing LLM-based applications, RAG systems, or AI agent workflows Key Responsibilities:
  • Design and build end-to-end AI agent workflows, from initial prompt design through production deployment, ensuring scalable and reliable solutions
  • Develop and optimize Retrieval-Augmented Generation (RAG) pipelines by implementing chunking strategies, embedding models, retrieval ranking, and context window management for precise information retrieval
  • Build and iterate on prompt engineering layers, systematically testing and refining prompts and chain-of-thought strategies to deliver consistent outputs across diverse inputs
  • Implement tool orchestration within agent workflows, integrating agents with databases, rule engines, validation systems, and formatting tools for seamless operation
  • Establish automated quality checks and validation layers to proactively identify and resolve issues before outputs reach human reviewers
  • Collaborate with Data Scientists to instrument solutions for measurement, developing evaluation frameworks and tracking solution performance against defined targets
  • Deploy, monitor, and maintain AI/ML solutions in production environments, ensuring reliability, scalability, and robust error handling
  • Design and implement feedback loops to capture expert review data and translate it into measurable improvements in agent performance
    • Required Skills:
  • Advanced proficiency in Python
  • Hands-on experience with LLM frameworks such as LangChain or LlamaIndex
  • Expertise in prompt engineering for systematic testing and iteration
  • Deep understanding of RAG architectures including embedding models, vector stores, retrieval strategies, and re-ranking
  • Experience building multi-step agent workflows with tool use and branching logic
  • Experience deploying and maintaining AI/ML solutions in production environments
  • Experience with data pipeline development for feeding AI systems
    • Preferred Skills:
  • Experience with multi-agent orchestration frameworks
  • Background in content generation, translation, or document processing solutions
  • Familiarity with feedback loops, RLHF, or reward model training
  • Knowledge of multi-modal AI systems including voice-to-text, document understanding, and image analysis
  • Experience with evaluation frameworks for generative AI and automated scoring
  • Experience with LLM cost optimization strategies such as model routing, caching, and prompt compression
    • Desired Qualifications:
  • Bachelor's degree in Computer Science, Data Science, Information Technology, Statistics, or a closely related discipline
  • Certification in Machine Learning or Artificial Intelligence (e.g., TensorFlow Developer Certificate, AWS Certified Machine Learning – Specialty)
  • Certification in LLM engineering or generative AI (e.g., DeepLearning.AI Generative AI with LLMs)
    • Apply Now

    Similar jobs

    Search more AI Engineer jobs
    Lexroom

    Senior AI Engineer

    🕒 yesterday
    Lexroom🏢 Legal Technology🤝 B2B
    WebsiteAll Job Openings

    Build agent-driven and retrieval-augmented AI systems for legal work, improve LLM quality through fine-tuning and evaluation, and develop scalable search and document-processing pipelines.

    📍 🇪🇸 Barcelona - Hybrid💰 €70k - €100k / year💼 Full-Time🎸 Senior🤖 AI Engineer📢 🇬🇧 English Required📢 🇮🇹 Italian Required
    PythonLLM ResearchDeep LearningMachine Learning Pipelines
    View jobApply
    View more AI Engineer jobs

    Trusted by Remote Workers