San Francisco, California, United States · On-site
$236k–$290k/yr
Why Harvey At Harvey, we’re transforming how legal and professional services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work…
Skills: Distributed Systems, Go, Java, Python, Rust
San Francisco, California, United States · Hybrid
$250k–$340k/yr
About WorkWhile WorkWhile is on a mission to help workers earn a better living and live better lives. More than 80 million Americans work hourly jobs, often with unpredictable schedules that pay close to minimum wage and…
Skills: Engineering Management, Technical Strategy, System Design, React, TypeScript
San Francisco, California, United States · On-site
$280k–$310k/yr
Full-time. In-person at our Presidio office in San Francisco. Start date: ASAP. About The Electric Plant Co. The Electric Plant Co. is building a new category of plant and tree intelligence. Our IoT hardware measures the…
Skills: Technical Leadership, Hardware Engineering, Firmware Development, Cloud Infrastructure, AI/ML Systems
San Francisco, California, United States · Hybrid
$200k–$300k/yr
At Early Warning, we’ve powered and protected the U.S. financial system for over thirty years with cutting-edge solutions like Zelle®, Paze℠, and so much more. As a trusted name in payments, we partner with thousands of …
Skills: Technical Program Management, Strategic Leadership, Operational Excellence, Portfolio Management, Change Management
San Francisco, California, United States · Remote OK
$180k–$300k/yr
Senior Software Engineer, Block Production - Anza Who We Are Anza is a Solana R&D lab pushing the boundaries of blockchain performance and scalability. Anza was founded by experienced executives and core engineers solvin…
Skills: Rust, C, C++, Distributed Systems, Blockchain Technology
San Francisco, California, United States · Hybrid
$227k–$381k/yr
Amplitude is the leading AI analytics platform, helping over 4,700 customers—including Atlassian, Burger King, NBCUniversal, and Square—build better products and digital experiences. With powerful AI Agents embedded acro…
Skills: SDK Design, Distributed Systems, API Design, Technical Leadership, Polyglot Programming
San Francisco, California, United States · Hybrid
$1/hr–$2/hr
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co…
Skills: Sql, Python, Etl/Elt Pipelines, BigQuery, Redshift
San Francisco, California, United States · Hybrid
$180k–$230k/yr
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co…
Skills: MacOS Support, Google Workspace Administration, Slack Administration, SaaS Administration, Identity And Access Management
San Francisco, California, United States · Hybrid
$208k–$260k/yr
At Ripple, we’re building a world where value moves like information does today. It’s big, it’s bold, and we’re already doing it. Through our crypto solutions for financial institutions, businesses, governments and devel…
Skills: Software Delivery, Network Design, Crypto Custody Solutions, Software Development, Technical Problem Solving
San Francisco, California, United States · On-site
$196k–$220k/yr
Discord has a highly engaged community of millions of daily active users who use the platform for many different reasons, but there’s one thing that nearly everyone does: play video games. Discord plays a uniquely import…
Skills: TypeScript, React, Python, Flask, A/B Testing
San Francisco, California, United States · Hybrid
$305k–$385k/yr
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co…
Skills: Product Management, AI/ML Concepts, Python, SQL, Strategic Planning
San Francisco, California, United States · On-site
About Civ Robotics Civ Robotics is transforming how infrastructure and renewable energy projects are built. Our mission is to empower construction teams to build faster, more accurately, and more efficiently through reli…
Skills: Robotics Deployment, Technical Support, Hardware Troubleshooting, Mechatronics, Customer Training
San Francisco, California, United States · Hybrid
$231k–$300k/yr
About Us At Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the world’s largest networks that powers millions of websites and other Internet properties for customers ranging…
Skills: Web Security, Networking, Cloud Infrastructure, AI-Native Development, Technical Discovery
San Francisco, California, United States · On-site
Join the Team at Stress-Free Auto Care: Where Your Skills and Passion Drive Success! Stress Free Auto Care is redefining the auto repair experience by delivering exceptional service with honesty, transparency, and conven…
Skills: Automotive Diagnosis, Vehicle Repair, Hand-tool Proficiency, Manual Transmission Operation, Customer Service
San Francisco, California, United States · On-site
Join the Team at Stress-Free Auto Care: Where Your Skills and Passion Drive Success! Stress Free Auto Care is redefining the auto repair experience by delivering exceptional service with honesty, transparency, and conven…
Skills: Automotive Diagnosis, Vehicle Repair, Hand-Tool Proficiency, Manual Transmission Operation, Customer Service
San Francisco, California, United States · On-site
$105k–$138k/yr
About Redwood Materials Redwood is localizing a global battery supply chain that seamlessly integrates recovery, reuse, and recycling — keeping critical minerals in circulation and driving the energy transition. Founded …
Skills: Business Development, Pipeline Management, RFP Response, Commercial Proposal Development, BESS
San Francisco, California, United States · Hybrid
$220k–$280k/yr
Heartflow is a medical technology company advancing the diagnosis and management of coronary artery disease, the #1 cause of death worldwide, using cutting-edge technology. The flagship product—an AI-driven, non-invasive…
Skills: Python, Machine Learning, Computer Vision, Deep Learning, Statistical Analysis
San Francisco, California, United States · Hybrid
$350k–$500k/yr
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co…
Skills: Python, Distributed Systems, Machine Learning Infrastructure, Data Pipelines, Large-scale Inference
San Francisco, California, United States · On-site
$127k–$175k/yr
Who We Are HP IQ is HP’s new AI innovation lab. Combining startup agility with HP’s global scale, we’re building intelligent technologies that redefine how the world works, creates, and collaborates. We’re assembling a d…
Skills: Python, Java, C++, LLM Integration, Agent Orchestration
San Francisco, California, United States · Hybrid
$35/hr–$40/hr
Description MWA Architects is seeking a Designer to join our growing San Francisco infrastructure design studio. Our collaborative team designs sustainable, resilient, and beautiful facilities for the water, power, publi…
Skills: Revit, Bluebeam, 3D Computer Modeling, SketchUp, California Building Codes
San Francisco, California, United States • On-site
Sign up with Clera and we'll reach out the moment a role actually fits you — no more spraying applications into the void.
Lead the design and implementation of Harvey's Model Infrastructure platform to ensure high availability and low latency for AI inference. Develop systems for model routing, provisioning, and observability while partnering with AI Research and Product Engineering.
Requires over 7 years of experience building large-scale distributed systems and proficiency in languages like Go, Java, Python, Rust, or C++. Candidates must have a deep understanding of cloud infrastructure and experience leading cross-functional technical projects.
At Harvey, we’re transforming how legal and professional services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work gets done for decades to come.
This is a rare chance to help build a generational company at a true inflection point. With 1500+ customers in 60+ countries, strong product-market fit, and world-class investor support, we’re scaling fast and defining a new category in real time. The work is ambitious, the bar is high, and the opportunity for growth — personal, professional, and financial — is unmatched.
Our team moves fast, takes ownership, and is deeply committed to the mission — operating with intensity, staying close to our customers, and pushing each other for excellence. We live by three values: Decisiveness, Simplicity, and Job's Not Finished. We act quickly on clear judgment over perfect information, we believe simplicity is what scales, and we're never satisfied with where we are. If you want to do the best work of your career alongside people who share that drive, we'd love to build with you.
At Harvey, the future of professional services is being written today — and we’re just getting started.
As a Staff Software Engineer on the Model Infrastructure team, you'll lead the design and development of the systems that power every AI request at Harvey. You'll partner closely with AI Research, Product Engineering, Infrastructure, and external model providers to build a platform that is highly reliable, scalable, observable, and efficient.
Lead the design and implementation of Harvey's Model Infrastructure platform.
Build systems to ensure high availability, low latency, and operational excellence for AI inference.
Design and improve Harvey's Unified Model Controller (UMC) and Model Selector platform to automatically detect model degradations and intelligently route traffic based on reliability, latency, quality, compliance, and cost.
Develop systems for model provisioning, capacity management, failover, and traffic engineering across multiple AI providers.
Integrate new model providers and maintain provider APIs and SDKs, enabling Harvey to rapidly adopt emerging frontier models.
Improve observability through health dashboards, alerting, token usage analytics, cost reporting, and end-to-end telemetry.
Partner with Product Engineering to support model launches, experimentation, and proactive monitoring of production AI workloads.
Drive infrastructure efficiency through capacity planning, utilization optimization, and cost visibility.
Collaborate with AI Research to build the infrastructure foundation for future model evaluation, training, and deployment.
Lead cross-functional technical initiatives and mentor engineers across the organization.
You'll help build the core platform behind Harvey's AI capabilities, including:
Model health monitoring
Automated failover and recovery
Capacity provisioning
Operational tooling and incident automation
Policy-based model routing
Intelligent Model Selector
Model health monitoring
Traffic management
Reliability and latency optimization
Multi-provider architecture
API and SDK integrations
OpenAI, Anthropic, Azure OpenAI, Fireworks, Baseten, and future providers
Rapid adoption of new frontier models
Token usage analytics
Cost attribution
Latency and reliability dashboards
Capacity forecasting
Utilization optimization
Infrastructure supporting model evaluation
Model deployment and operations
Future model training platform
Agent infrastructure and CcaaS
7+ years of software engineering experience building large-scale distributed systems.
Experience designing and operating highly available production services.
Strong programming skills in Go, Java, Python, Rust, or C++.
Deep understanding of distributed systems, cloud infrastructure, networking, and observability.
Experience leading technical projects across multiple engineering teams.
Ability to balance long-term architecture with pragmatic execution.
Strong communication and collaboration skills.
Passion for building foundational platforms that enable other engineering teams.
Experience with AI infrastructure, LLM serving, or machine learning platforms.
Experience with model routing, inference gateways, or policy-based serving systems.
Experience working with OpenAI, Anthropic, Azure OpenAI, Fireworks, Baseten, or open-source LLMs.
Experience with Kubernetes, cloud infrastructure, and service mesh technologies.
Experience with large-scale observability and SRE best practices.
Experience with data infrastructure technologies such as Kafka, Spark, Flink, Airflow, or Iceberg.
Familiarity with GPU infrastructure or model training platforms.
$236,000 - $290,000 USD
#LI-AN2
Harvey is an equal opportunity employer and does not discriminate on the basis of race, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition, or any other basis protected by law.
We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made by emailing [email protected]
Based on 2735 listings with disclosed salaries, most engineering jobs in San Francisco, CA pay between $130k–$285k per year. Individual offers vary with seniority, company size, and specialization.
There are currently 3,548 open engineering positions in San Francisco, CA listed on Clera. New openings are added daily as companies post roles.
Companies currently hiring include OpenAI, San Francisco Department of Public Health, Anthropic, Amazon, Astranis Space Technologies, among others. Browse the listings above to see every active employer.
Yes — 1756 of the 3548 open engineering positions offer remote or hybrid work (365 remote, 1391 hybrid).
Each listing links directly to the employer's application page. Apply early — fresh listings get the most recruiter attention in the first two weeks.
