Remote Jobs RockRemote Jobs Rock

Staff/Senior AI Engineer, AI for Code

🕒 15 days ago
📍 🇦🇲 Armenia +8 - Hybrid?🎺 Lead🤖 AI Engineer💼 Full-Time
AI SystemsLLM-powered ProductsModel TrainingFine-tuning
Apply Now

📜 Description

  • Build production-ready coding agents and agentic workflows for real developer tasks inside JetBrains products.
  • Turn promising model capabilities into dependable product behavior through prompt design, context construction, fine-tuning, instruction-tuning, or other post-training techniques where appropriate.
  • Design and improve the agent loop itself, including tool use, execution strategy, safeguards, and task completion quality.
  • Create evaluation suites and quality infrastructure for agent behavior, including online and offline evaluations, regression checks, failure analysis, and release criteria.
  • Build feedback loops from real usage, using logs, user signals, and edge cases to improve data, evaluations, and agent behavior.
  • Work with both hosted frontier APIs and self-hosted or open-weight models, making pragmatic decisions about where each model belongs based on capability, latency, reliability, privacy, and cost.

🛠️ Requirements

  • Strong software engineering fundamentals and a track record of shipping complex systems to production.
  • Hands-on experience building LLM-powered products, coding agents, or other AI systems.
  • Experience improving model behavior through systematic iteration, whether via prompting, context engineering, fine-tuning, preference optimization, or broader post-training methods.
  • Practical experience with evaluation and benchmarking for LLM systems, including defining task-grounded success metrics and catching regressions.
  • Experience working from noisy real-world signals rather than only from clean benchmark datasets.
  • Good judgment about trade-offs between model quality, latency, reliability, privacy, and cost.

✨ Benefits

  • Flexible work location. Enjoy the freedom to work from home or from the office.
  • Extra time off. More days to relax, recharge, and do the things you love.
  • Medical insurance allowance. Enjoy peace of mind for you and your family
  • Learning and development opportunities. Access to conferences, courses, and language classes.
  • Relocation support. We help make your move as smooth and stress-free as possible.
Apply Now

Similar jobs

Search more AI Engineer jobs
Pinterest

Manager II, Machine Learning – Conversion Visibility

Pinterest👥 5001 - 10,000 employees🏢 Computer Software
WebsiteLinkedInAll Job Openings
🔥 22 hours ago

As a Machine Learning Engineering Manager, you will lead a team to develop end-to-end identity and conversion visibility solutions, enhancing advertiser performance on Pinterest.

📍 🇺🇸 Seattle - Remote💰 $189.3k - $389.8k / year💼 Full-Time🎺 Lead🤖 AI Engineer
Machine LearningBackend DevelopmentData InfrastructureModeling
View jobApply
Pinterest

Principal Engineer, Shopping & Delivery Infra

Pinterest👥 5001 - 10,000 employees🏢 Computer Software
WebsiteLinkedInAll Job Openings
🔥 22 hours ago

Lead the technical strategy and execution for indexing and retrieval infrastructure at Pinterest, enhancing freshness, quality, and cost efficiency across Core, Ads, and Shopping.

📍 🇺🇸 San Francisco - Remote💰 $285.5k - $449.5k / year💼 Full-Time🎺 Lead🤖 AI Engineer
Indexing SystemsRetrieval InfrastructureTechnical LeadershipSystems Design
View jobApply
View more AI Engineer jobs

Trusted by Remote Workers