San Francisco, California, United States · On-site
$236k–$290k/yr
Why Harvey At Harvey, we’re transforming how legal and professional services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work…
Skills: Distributed Systems, Go, Java, Python, Rust
San Francisco, California, United States · Hybrid
$189k–$265k/yr
About the Team The Growth team drives user and revenue growth across ChatGPT’s consumer and business segments as well as other OpenAI products worldwide. We operate across the full funnel - from awareness and acquisition…
Skills: Paid Search, Paid Social, Programmatic Advertising, Affiliate Marketing, Performance Marketing
San Francisco, California, United States · Hybrid
$224k–$336k/yr
Job Description Zendesk is looking for a Director of GTM M&A Strategy and Integration to lead go-to-market strategy and execution for acquired businesses, new product motions, and complex cross-functional GTM transformat…
Skills: GTM Strategy, M&A Integration, Corporate Development, Revenue Operations, Sales Transformation
San Francisco, California, United States · On-site
The role We're looking for a design engineer who lives at the intersection of design and code. You'll craft the product experience that makes Specific Intelligence legible and intuitive. This includes the interfaces wher…
Skills: TypeScript, React, CSS, Animations, Front-end Engineering
San Francisco, California, United States · Hybrid
$140k–$200k/yr
About Sift Sift is the data infrastructure platform for hardware engineering teams. Sift turns high-frequency telemetry into engineering insights for mission-critical systems. Teams use Sift to build and operate rockets,…
Skills: React, NextJS, Go, Python, Rust
San Francisco, California, United States · Hybrid
$374k–$436k/yr
About the Team The AI Transformation and Innovation team helps senior leaders imagine how AI could reshape their business—and turn the strongest ideas into action. We work in small, multidisciplinary pods that bring toge…
Skills: Innovation Strategy, Executive Facilitation, AI Transformation, Strategic Judgment, Workshop Design
San Francisco, California, United States · Hybrid
$295k–$555k/yr
About the Team The Personal AGI team is responsible for training and improving pre-trained models to be deployed into ChatGPT, the API, and potential future products. In the Model Experience team, we shape the default ch…
Skills: Machine Learning, Reinforcement Learning, ML Engineering, Model Evaluation, Post-training
San Francisco, California, United States · On-site
$150k–$300k/yr
About us At Sierra, we’re creating a platform to help businesses build better, more human customer experiences with AI. We are primarily an in-person company based in San Francisco, with growing offices in Atlanta, New Y…
Skills: Conversation Design, Strategic Problem Solving, Technical Aptitude, Customer Relationship Management, Analytical Thinking
San Francisco, California, United States · Hybrid
$302k–$352k/yr
About the Team OpenAI’s mission is to build safe artificial general intelligence (AGI) that benefits all of humanity. Achieving this requires bringing together world-class scientists, engineers, and business leaders to t…
Skills: Strategic Partnerships, Enterprise GTM, Platform Sales, Business Development, Corporate Strategy
San Francisco, California, United States · On-site
$200k–$250k/yr
About Loop: Loop is an agentic AI platform for the back office of the real economy. Founded in 2022, we're trusted by 300+ brands powering thousands of locations across the US, backed by a $14M Series A led by Nyca Partn…
Skills: Product Strategy, Product Discovery, Roadmapping, AI Fluency, Prototyping
San Francisco, California, United States · On-site
If you have a Candidate Login already, but have forgotten your password please use the steps to reset your password. If you have forgotten your email login, please contact [email protected] subject Workday Candi…
Skills: Generative AI, Prompt Engineering, LLM, RLHF, Data Labeling
San Francisco, California, United States · Hybrid
$140k–$160k/yr
Our Mission and Vision Unlearn exists to transform clinical development by making every trial smarter. We harness data, AI, and digital twins to enable faster, more robust studies that bring life-saving treatments to pat…
Skills: Python, Numpy, Pandas, Data Wrangling, Data Cleaning
San Francisco, California, United States · On-site
$175k–$240k/yr
About us Edison Scientific builds and deploys AI scientist agents to accelerate science and the development of new medicines. We are an ambitious team run by scientists and engineers from leading institutions across biol…
Skills: Python, AWS, GCP, Terraform, Pulumi
San Francisco, California, United States · On-site
$80k–$125k/yr
About Artie Artie is a real-time streaming platform that moves production data across systems in real time, with zero maintenance. We make high-volume data replication simple, reliable, and scalable for engineering teams…
Skills: Outbound Prospecting, Lead Qualification, Technical Selling, Discovery Conversations, Multi-channel Campaigns
San Francisco, California, United States · Remote OK
$150k–$180k/yr
Our Mission and Vision Unlearn exists to transform clinical development by making every trial smarter. We harness data, AI, and digital twins to enable faster, more robust studies that bring life-saving treatments to pat…
Skills: Biostatistics, Clinical Trial Design, SAS, R, Statistical Analysis Plans
Radical NumericsSan Francisco, California, United States · On-site
About Us Radical Numerics is an AI research lab building general biological intelligence. Our mission is to master the code of life, and our purpose is to reduce human suffering. Our team created Evo, and started the fie…
Skills: Protein Structure Prediction, Geometric Deep Learning, PyTorch, JAX, Protein Language Models
San Francisco, California, United States · Remote OK
$162k–$245k/yr
Phantom is the modern money app used by tens of millions around the world. Our product combines everything people need to manage, spend, and grow their money in one simple, intuitive experience. Phantom brings all the co…
Skills: Typescript, React, React Native, Node.js, Python
San Francisco, California, United States · Hybrid
$272k–$355k/yr
Why Harvey At Harvey, we’re transforming how legal and professional services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work…
Skills: Engineering Management, Distributed Systems, Cloud Infrastructure, Model Infrastructure, AI Platform Development
San Francisco, California, United States · On-site
$187k–$253k/yr
Principal Account Manager We are seeking a self-starter and strategic sales leader to serve as the Principal Account Manager for one of AWS's most exciting and consequential ISV partnerships — a $1B+ ARR business with a …
Skills: Strategic Sales Leadership, Account Management, CxO Relationship Management, Technical Sales, Go-To-Market Strategy
San Francisco, California, United States · Hybrid
$169k–$271k/yr
About Us Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to …
Skills: Product Management, Authentication Flows, API Strategy, Technical Writing, Stakeholder Management
San Francisco, California, United States • On-site
Sign up with Clera and we'll reach out the moment a role actually fits you — no more spraying applications into the void.
Lead the design and implementation of Harvey's Model Infrastructure platform to ensure high availability and low latency for AI inference. Develop systems for model routing, provisioning, and observability while partnering with AI Research and Product Engineering.
Requires over 7 years of experience building large-scale distributed systems and proficiency in languages like Go, Java, Python, Rust, or C++. Candidates must have a deep understanding of cloud infrastructure and experience leading cross-functional technical projects.
At Harvey, we’re transforming how legal and professional services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work gets done for decades to come.
This is a rare chance to help build a generational company at a true inflection point. With 1500+ customers in 60+ countries, strong product-market fit, and world-class investor support, we’re scaling fast and defining a new category in real time. The work is ambitious, the bar is high, and the opportunity for growth — personal, professional, and financial — is unmatched.
Our team moves fast, takes ownership, and is deeply committed to the mission — operating with intensity, staying close to our customers, and pushing each other for excellence. We live by three values: Decisiveness, Simplicity, and Job's Not Finished. We act quickly on clear judgment over perfect information, we believe simplicity is what scales, and we're never satisfied with where we are. If you want to do the best work of your career alongside people who share that drive, we'd love to build with you.
At Harvey, the future of professional services is being written today — and we’re just getting started.
As a Staff Software Engineer on the Model Infrastructure team, you'll lead the design and development of the systems that power every AI request at Harvey. You'll partner closely with AI Research, Product Engineering, Infrastructure, and external model providers to build a platform that is highly reliable, scalable, observable, and efficient.
Lead the design and implementation of Harvey's Model Infrastructure platform.
Build systems to ensure high availability, low latency, and operational excellence for AI inference.
Design and improve Harvey's Unified Model Controller (UMC) and Model Selector platform to automatically detect model degradations and intelligently route traffic based on reliability, latency, quality, compliance, and cost.
Develop systems for model provisioning, capacity management, failover, and traffic engineering across multiple AI providers.
Integrate new model providers and maintain provider APIs and SDKs, enabling Harvey to rapidly adopt emerging frontier models.
Improve observability through health dashboards, alerting, token usage analytics, cost reporting, and end-to-end telemetry.
Partner with Product Engineering to support model launches, experimentation, and proactive monitoring of production AI workloads.
Drive infrastructure efficiency through capacity planning, utilization optimization, and cost visibility.
Collaborate with AI Research to build the infrastructure foundation for future model evaluation, training, and deployment.
Lead cross-functional technical initiatives and mentor engineers across the organization.
You'll help build the core platform behind Harvey's AI capabilities, including:
Model health monitoring
Automated failover and recovery
Capacity provisioning
Operational tooling and incident automation
Policy-based model routing
Intelligent Model Selector
Model health monitoring
Traffic management
Reliability and latency optimization
Multi-provider architecture
API and SDK integrations
OpenAI, Anthropic, Azure OpenAI, Fireworks, Baseten, and future providers
Rapid adoption of new frontier models
Token usage analytics
Cost attribution
Latency and reliability dashboards
Capacity forecasting
Utilization optimization
Infrastructure supporting model evaluation
Model deployment and operations
Future model training platform
Agent infrastructure and CcaaS
7+ years of software engineering experience building large-scale distributed systems.
Experience designing and operating highly available production services.
Strong programming skills in Go, Java, Python, Rust, or C++.
Deep understanding of distributed systems, cloud infrastructure, networking, and observability.
Experience leading technical projects across multiple engineering teams.
Ability to balance long-term architecture with pragmatic execution.
Strong communication and collaboration skills.
Passion for building foundational platforms that enable other engineering teams.
Experience with AI infrastructure, LLM serving, or machine learning platforms.
Experience with model routing, inference gateways, or policy-based serving systems.
Experience working with OpenAI, Anthropic, Azure OpenAI, Fireworks, Baseten, or open-source LLMs.
Experience with Kubernetes, cloud infrastructure, and service mesh technologies.
Experience with large-scale observability and SRE best practices.
Experience with data infrastructure technologies such as Kafka, Spark, Flink, Airflow, or Iceberg.
Familiarity with GPU infrastructure or model training platforms.
$236,000 - $290,000 USD
#LI-AN2
Harvey is an equal opportunity employer and does not discriminate on the basis of race, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition, or any other basis protected by law.
We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made by emailing [email protected]
Based on 3208 listings with disclosed salaries, most software jobs in San Francisco, CA pay between $140k–$289k per year. Individual offers vary with seniority, company size, and specialization.
There are currently 4,124 open software positions in San Francisco, CA listed on Clera. New openings are added daily as companies post roles.
Companies currently hiring include OpenAI, Anthropic, Salesforce, Harvey, Amazon, among others. Browse the listings above to see every active employer.
Yes — 2430 of the 4124 open software positions offer remote or hybrid work (573 remote, 1857 hybrid).
Each listing links directly to the employer's application page. Apply early — fresh listings get the most recruiter attention in the first two weeks.
