Remote Jobs RockRemote Jobs Rock

Staff Software Engineer- AI Platform

๐Ÿ•’ yesterday
AI Platform InfrastructureLLM InfrastructureFoundation Model APIsDistributed Systems
Apply Now

๐Ÿ“œ Description

  • Build and operate shared infrastructure for secure, reliable foundation-model access across applications and AI agents.
  • Develop model gateways, provider integrations, routing and fallback, usage controls, observability, reliability, and governance capabilities.
  • Design scalable production platforms with attention to architecture, security, failure modes, cost, and developer experience.
  • Partner with engineering, product, security, infrastructure, and AI application teams to shape platform strategy and execution.
  • Establish engineering architecture and quality standards, and mentor and coach engineers.

๐Ÿ› ๏ธ Requirements

  • BS/BTech (or higher) in Computer Science, Engineering or a related field required.
  • 8+ years of production-level experience as an engineer building highly scalable systems.
  • 4+ years of experience acting as a trusted technical decision-maker in a team setting, solving for short-term and long-term business value.
  • 4+ years of experience working with SQL or other database querying languages on large multi-table data sets.
  • Experience architecting, developing, and deploying large-scale distributed systems at scale.
  • Experience with cloud technologies, e.g., AWS, Azure, GCP.
  • Experience building continuous integration and continuous development (CI/CD) pipelines.
  • Strong familiarity with server-side web technologies (eg: Java, Python, Scala, C#, C++, Go).
  • Experience building or operating production platform infrastructure, distributed systems, developer platforms, or other high-availability shared services.
  • Experience with LLM infrastructure, model gateways, foundation model APIs, or managed AI platforms such as AWS Bedrock, Azure OpenAI, Google Vertex AI, or similar technologies.
Full job description

As a Staff Software Engineer on Aledade's AI Core Platform team, you will help build and operate the shared infrastructure that enables applications and AI agents across Aledade to securely and reliably access foundation models.

You will work on the platform capabilities behind model access, including model gateways, cloud AI services, provider integrations, routing and fallback, usage controls, observability, reliability, and model governance.

Weโ€™re looking for engineers who think beyond implementing individual features and consider the full lifecycle of production platform systems: architecture, scalability, failure modes, security, observability, operational readiness, cost, and developer experience. You will help evolve the platform as AI adoption grows across Aledade, building reusable and self-service capabilities rather than one-off solutions.

You will work closely with engineers, product partners, security, infrastructure teams, and teams building AI applications and agents. Successful engineers in this role are comfortable operating in ambiguous problem spaces, making pragmatic technical decisions, and building secure, maintainable, observable, and resilient systems.

Primary Duties:

  • Identify and develop scalable and performant solutions.
  • Work across discipline to shape product strategy and execution.
  • Develop the foundations of code architecture and quality.
  • Mentor and coach engineers.
  • Set and uphold the standard for engineering processes to support high-quality engineering.
  • Minimum Qualifications:

  • BS/BTech (or higher) in Computer Science, Engineering or a related field required.
  • 8+ years of production-level experience as an engineer building highly scalable systems.
  • 4+ years of experience acting as a trusted technical decision-maker in a team setting, solving for short-term and long-term business value.
  • 4+ years of experience working with SQL or other database querying languages on large multi-table data sets.
  • Experience architecting, developing, and deploying large-scale distributed systems at scale.
  • Experience with cloud technologies, e.g., AWS, Azure, GCP.
  • Experience building continuous integration and continuous development (CI/CD) pipelines.
  • Strong familiarity with server-side web technologies (eg: Java, Python, Scala, C#, C++, Go).
  • Preferred KSAs:

    AI Infrastructure & Model Platform:
  • Experience building or operating production platform infrastructure, distributed systems, developer platforms, or other high-availability shared services.
  • Experience with LLM infrastructure, model gateways, foundation model APIs, or managed AI platforms such as AWS Bedrock, Azure OpenAI, Google Vertex AI, or similar technologies.
  • Strong experience with cloud infrastructure, preferably AWS, and technologies such as Kubernetes, containers, and infrastructure as a code.
  • Experience designing observability and operational practices for production systems, including metrics, distributed tracing, logging, alerting, SLOs, dashboards and failure handling.
  • Experience designing APIs and self-service platform capabilities used by other engineering teams.
  • Experience with Identity, access control, secrets management, security and governance for shared infrastructure.
  • Experience with cost management, usage attribution, quotas, budgets, or capacity management for shared platforms.
  • Experience operating systems that handle sensitive or regulated data.
  • Ability to evaluate architectural tradeoffs across reliability, performance, security, cost, scalability and developer experience.
  • Physical Requirements:

    Sitting for prolonged periods of time. Extensive use of computers and keyboard. Occasional walking and lifting may be required.
    Cribl

    Sr. Staff Engineer, Security AI-SOC

    ๐Ÿ•’ yesterday
    Cribl๐Ÿ‘ฅ 1001 - 5000 employees๐Ÿข Technology๐Ÿค B2B

    Architect and build AI SOC capabilities that automate post-detection triage, investigation, evidence synthesis, and response, using production-grade AI systems and scalable security workflows.

    LLMsLLM OrchestrationMulti-agent SystemsEmbeddings
    HungerRush

    Staff Software Engineer

    ๐Ÿ•’ 2 days ago
    HungerRush๐Ÿ‘ฅ 201 - 500 employees๐Ÿข Computer Software

    Leads full-stack development for e-commerce, growth marketing, and consumer applications, shaping architecture and engineering quality while mentoring engineers and applying AI to improve software delivery.

    Full-stack Software DevelopmentC#AzureSQL Server
    Toast

    Staff Software Engineer, Enterprise

    ๐Ÿ•’ 2 days ago
    Toast๐Ÿ‘ฅ 5001 - 10,000 employees๐Ÿข Computer Software

    Leads engineering for Toastโ€™s Enterprise Sports & Entertainment team, building and scaling resilient platform features while guiding complex projects, improving reliability, and mentoring engineers.

    Backend ServicesAPIsJavaKotlin
    Verity

    Tech Lead - REMOTO

    ๐Ÿ”ฅ 15 hours ago
    Verity๐Ÿ‘ฅ 51 - 200 employees๐Ÿข Information Technology And Services

    Lidera o desenvolvimento de soluรงรตes Java escalรกveis, APIs RESTful e microsserviรงos, definindo padrรตes tรฉcnicos, garantindo qualidade e seguranรงa e orientando desenvolvedores juniores e plenos.

    JavaSpring BootSpring DataSpring Security
    AJAIA

    Lead Developer (EdTech, AI)

    ๐Ÿ•’ yesterday
    AJAIA๐Ÿ‘ฅ 11 - 50 employees

    Lead the architecture and hands-on development of AI-powered education products, guide and mentor developers, and partner with product and design to deliver secure, accessible learning tools.

    Edtech Product DevelopmentTechnical ArchitectureReactNext.js

    Trusted by Remote Workers