Define the architecture and technical delivery of a customer-context platform, while establishing event-driven integration patterns and AI-assisted engineering practices that scale across complex teams.
AI Architect
📜 Description
- Stand up and run squads (Discovery → Prototype → Product → Platform & SRE).
- Design and ship RAG/agent systems: pick models (e.g., Anthropic Claude, OpenAI, Google, or open-weights like Llama/Mistral), define tools/functions, and choose retrieval.
- Operate AI safely: evals & guardrails, structured outputs (JSON/Schema), PII redaction, refusal policies, cost/latency budgets, and LLM observability.
- Own delivery outcomes: SLOs, quality, cost, velocity; release with feature flags and canaries.
- Be client-facing: discovery, scoping, SoW, roadmap, QBRs.
- Hire/coach Tech Leads, EMs, and PMs; level up practices.
🛠️ Requirements
- 8–12+ yrs engineering; 4+ yrs leading multi-team delivery; shipped production web/mobile systems at scale.
- Shipped at least one production AI app using Claude/GPT/Gemini/Llama/Mistral, backed by retrieval (pgvector or a vector DB) and a basic eval/guardrail pipeline.
- Implemented orchestration (LangGraph/DSPy or Temporal for durable workflows), rerankers (e.g., Cohere/Jina/Voyage), and prompt/tool versioning.
- Built with modern cloud + data: serverless/K8s, Terraform, OpenTelemetry, feature flags/experimentation.
- Excellent client communication and commercial sense (SoWs, staffing, utilization).
- Models: Anthropic Claude; OpenAI; Google; open-weights (Llama, Mistral).
- Orchestration & agents: LangGraph (or DSPy) for graphs; Temporal for durable, long-running tasks and SLAs.
- Retrieval: Postgres + pgvector (default); Weaviate/Qdrant/Pinecone when scale/ops require; hybrid search with OpenSearch/Typesense.
- Embeddings / rerankers: OpenAI/Voyage/E5/BGE; Cohere/Jina/Voyage rerank.
- Guardrails & evals: JSON/Pydantic schemas, red-team sets, promptfoo/Ragas/DeepEval; content/PII filters.
Full job description
Job Summary:
As an AI Architect you will build AI-native products. You’ll lead cross-functional Innovation Delivery Squads—owning outcomes end-to-end across web, mobile, AI agents, and streaming backends. You’re a hands-on technical leader who can scope, architect, staff, and ship; then run the product safely at scale.
Job Responsibilities:
- Stand up and run squads (Discovery → Prototype → Product → Platform & SRE).
- Design and ship RAG/agent systems: pick models (e.g., Anthropic Claude, OpenAI, Google, or open-weights like Llama/Mistral), define tools/functions, and choose retrieval (default Postgres + pgvector, scale to Weaviate/Qdrant/Pinecone when needed).
- Operate AI safely: evals & guardrails, structured outputs (JSON/Schema), PII redaction, refusal policies, cost/latency budgets, and LLM observability.
- Own delivery outcomes: SLOs, quality, cost, velocity; release with feature flags and canaries.
- Be client-facing: discovery, scoping, SoW, roadmap, QBRs.
- Hire/coach Tech Leads, EMs, and PMs; level up practices.
Requirements
- 8–12+ yrs engineering; 4+ yrs leading multi-team delivery; shipped production web/mobile systems at scale.
- Shipped at least one production AI app using Claude/GPT/Gemini/Llama/Mistral, backed by retrieval (pgvector or a vector DB) and a basic eval/guardrail pipeline.
- Implemented orchestration (LangGraph/DSPy or Temporal for durable workflows), rerankers (e.g., Cohere/Jina/Voyage), and prompt/tool versioning.
- Built with modern cloud + data: serverless/K8s, Terraform, OpenTelemetry, feature flags/experimentation.
- Excellent client communication and commercial sense (SoWs, staffing, utilization).
Tech stack (you have hands on experience)
- Models: Anthropic Claude; OpenAI; Google; open-weights (Llama, Mistral).
- Orchestration & agents: LangGraph (or DSPy) for graphs; Temporal for durable, long-running tasks and SLAs.
- Retrieval: Postgres + pgvector (default); Weaviate/Qdrant/Pinecone when scale/ops require; hybrid search with OpenSearch/Typesense.
- Embeddings / rerankers: OpenAI/Voyage/E5/BGE; Cohere/Jina/Voyage rerank.
- Guardrails & evals: JSON/Pydantic schemas, red-team sets, promptfoo/Ragas/DeepEval; content/PII filters.
- Observability: OpenTelemetry traces incl. prompt/tool spans; Langfuse/Arize Phoenix (or equivalent) + Sentry/Grafana.
- App & data: Next.js 15 (RSC), TypeScript/Go/Python; Postgres; Kafka/Redpanda/NATS; dbt/lakehouse optional.
- Ops: Cloud Run/ECS/K8s; Terraform/OpenTofu; GitHub Actions; LaunchDarkly/Unleash; Statsig/GrowthBook.
Similar jobs
Search more AI Engineer jobsSenior Applied AI Enginner, AI Platform
Build AI-powered products for internal teams, embed with each function to automate complex workflows, own solutions in production, and turn reusable capabilities into primitives for Eddy’s AI platform.
Own the architecture and production delivery of an AI-powered tool that extracts requirements from legacy code and documentation, building agentic workflows, Python services, and React applications.
Build and own multi-agent systems for mobile products, from architecture and implementation through evaluation and iteration, using real-world performance data to improve reliability and user experience.
Software Engineer - AI Tooling
Build and own Supabase’s AI developer tooling, including agents, MCP, and dashboard assistance, while using evaluations and metrics to improve quality, reliability, and developer experience.
