San Francisco, California, United States · On-site
$200k–$260k/yr
Senior
Rust Engineer LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services. W…
Skills: Rust, Python, System Architecture, Performance Optimization, Backend Infrastructure
We are empowering people to go from concepts to construction within hours, enhancing collaboration in the world of atoms & pushing the boundaries of what’s possible, for humanity over the next few decades. For phase 1, w…
About the Opportunity We are seeking a Business Systems Analyst to join our Finance Systems team, to support and improve our core finance applications, with a primary focus on NetSuite and Zip. In this role, you’ll split…
Skills: NetSuite Configuration, Zip Procurement, Business Process Mapping, Requirements Gathering, Financial Systems Analysis
San Francisco, California, United States · On-site
$230k–$300k/yr
Senior+$108M raised
About Us Reducto is the agentic document platform for leading AI teams who demand enterprise performance at scale. We provide a comprehensive toolkit for working with documents the way a human would, combining custom in-…
Skills: Solutions Engineering, Sales Engineering, People Management, Python, API Integration
San Francisco, California, United States · On-site
Mid level$19M raised
About Primer Primer is a growing network of K–8 schools restoring the timeless foundations of American education. Inspired by the original teaching primers that shaped a nation of readers, thinkers, and builders, our sch…
San Francisco, California, United States · Remote OK
Entry level
The Role We're hiring a Growth Generalist. This isn't a traditional growth role. You won't be optimizing funnels or running playbook GTM motions — you'll be experimenting, building, and figuring things out from scratch a…
Skills: Growth Experimentation, Partnership Management, Event Planning, Social Media Marketing, User Onboarding
Magnitude
Senior GTM Engineer
San Francisco, California, United States · Hybrid
$160k–$200k/yr
Senior
About Magnitude Magnitude is pioneering the world's first 100% multi-agent approach to enterprise security, starting with Third-Party Risk Management, a domain that is mission critical, deeply human, and notoriously brok…
About the Team: OpenAI’s Hardware organization develops AI-native silicon and system-level solutions for the unique demands of advanced AI workloads. Building on efforts like Jalapeño, the team is developing future gener…
Grow Therapy is on a mission to serve as the trusted partner for therapists growing their practice, and patients accessing high-quality care. Powered by technology, we are a three-sided marketplace that empowers provider…
San Francisco, California, United States · On-site
Senior
Founding Account Executive (SF In-Person Preferred) About Hyperscale Hyperscale is building AGI for physical operations. We're a team of ex-Samsara engineers and operators deploying frontier agentic systems in the real w…
Company Overview Construction is one of the largest industries in the U.S., but also one of the least technologically advanced. Every year, firms spend over $60B on teams creating cost estimates for bids. The process rel…
Senior Sales Development Representative, Enterprise (Hybrid)
San Francisco, California, United States · Hybrid
$70k–$70k/yr
Mid level$70M raised
About Nooks.ai: Nooks is an applied AI lab building the Agent Workspace for GTM. We design AI agents that operate across the full sales action set, from account strategy to prospect research and outreach. Building 0→1 ha…
Binti builds software for state and county government agencies, focusing on reinventing social services. We started in child welfare, with the mission of helping every child have a safe, loving, and stable family. To dat…
San Francisco, California, United States · Remote OK
Senior$136M raised
Senior Manager, Account-Based Experience (ABX) Sanity is looking for a strategic, data-driven Sr Manager of ABX to design and lead our account-based experience programs for enterprise. You'll orchestrate personalized, cr…
Company Overview Construction is one of the largest industries in the U.S., but also one of the least technologically advanced. Every year, firms spend over $60B on teams creating cost estimates for bids. The process rel…
San Francisco, California, United States · On-site
$180k–$240k/yr
Senior$260M raised
The Anyscale Technical Program Management (TPM) team is expected to play a critical role executing high impact programs while continuously improving processes to sustainably grow and increase the effectiveness of the Tec…
About Fundamental Fundamental is an AI company pioneering the future of enterprise decision-making. Founded by DeepMind alumni, Fundamental has developed NEXUS – the world's most powerful Large Tabular Model (LTM) – purp…
Skills: Solution Design, Data Science, Machine Learning, Production Engineering, Python
We believe that the way people interact with their finances will drastically improve in the next few years. We’re dedicated to empowering this transformation by building the tools and experiences that thousands of develo…
Why Harvey At Harvey, we’re transforming how legal and professional services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work…
San Francisco, California, United States · On-site
Mid level$16M raised
About Sapiom Sapiom is the end-to-end platform that removes barriers to ship and scale agentic products. We unify everything an agent needs to act in the world: compute and sandboxes, memory, identity, domains and DNS, s…
Skills: Software Engineering, Backend Development, Systems Design, API Integration, Platform Engineering
Sign up with Clera and we'll reach out the moment a role actually fits you — no more spraying applications into the void.
$200k–$260k/yr
Full-time
Health Insurance, Dental Insurance, Vision Insurance, Equity
Posted 50d ago
~40 hrs/week
Responsibilities
Lead the end-to-end migration of the LiteLLM gateway from Python to Rust to maximize performance and throughput. Collaborate with the CTO to plan a stability-first rollout and restructure the codebase for high-volume production traffic.
Requirements
Requires deep, long-standing production expertise in Rust and a strong focus on low-latency system performance. Experience with backend infrastructure, databases like PostgreSQL and Redis, and a track record of shipping performance-critical systems is highly valued.
Full job description
Rust Engineer
LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services. We're looking for a Rust Engineer to own the migration of LiteLLM from Python to Rust and make us the fastest AI gateway ever built.
About The Role
You'll own LiteLLM's migration to Rust end to end. This is a high-stakes, high-visibility role: you'll plan the migration directly with the CTO, structure the codebase so it's ready for Rust, and lead a gradual, stability-first rollout. The work is fundamentally about performance. Every decision you make will move us toward being the lowest-latency, highest-throughput gateway in the category, without ever compromising the reliability our enterprise customers depend on.
This is a single-owner mandate. You will be the person leading the entire Python-to-Rust migration.
Responsibilities
Own the end-to-end migration of LiteLLM from Python to Rust, from architecture through rollout.
Plan the migration alongside the CTO, sequencing work to minimize risk to live, high-volume traffic.
Design and execute a gradual rollout that holds stability as the top constraint while the migration progresses.
Restructure the existing codebase so it's positioned for a clean, incremental move to Rust.
Drive performance gains across latency, throughput, and resource efficiency at 1B+ requests/mo.
Collaborate cross-functionally to ensure the migration aligns with backend priorities across performance, reliability, and security.
What We're Looking For
Deep, long-standing expertise in Rust. You've been writing production Rust for years and know it cold.
Obsessive about performance. You care about latency and throughput at a level most engineers don't.
Strong instinct for stability, with a track record of balancing ambitious change against reliability.
Major bonus: prior experience leading codebase migrations from another language to Rust.
Major bonus: a demonstrated history of shipping performance-critical systems.
Familiarity with backend infrastructure, databases (PostgreSQL, Redis), and high-volume production systems.
Why Join LiteLLM?
Own one of the most important technical bets in the company's roadmap.
Define the architectural foundation that the entire platform will run on.
Fast-paced growth environment with deep technical ownership.
Competitive salary, health, dental, and vision benefits.
About LiteLLM
LiteLLM (https://github.com/BerriAI/litellm) is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.
Ready to make LiteLLM the fastest AI gateway ever? Apply now!
The industry-standard AI Gateway platform for models, agents, and MCPs.
Industry
Software Development
Company size
11-50 employees
Founded
2023
Headquarters
San Francisco, California
LinkedIn followers
11,843
One governed platform for AI access, cost management, and guardrails across every model, agent, and MCP in your organization. LiteLLM is the foundation teams worldwide rely on to manage and scale their entire AI program. Backed by Y Combinator with 40k+ GitHub stars.
Offices: 1730 Jones St, San Francisco, California 94109, US
How much do Software jobs in San Francisco, CA pay?
Based on 3643 listings with disclosed salaries, most software jobs in San Francisco, CA pay between $140k–$289k per year. Individual offers vary with seniority, company size, and specialization.
How many Software jobs are open in San Francisco, CA right now?
There are currently 4,685 open software positions in San Francisco, CA listed on Clera. New openings are added daily as companies post roles.
Which companies are hiring for Software roles in San Francisco, CA?
Companies currently hiring include OpenAI, Anthropic, Salesforce, Harvey, Amazon, among others. Browse the listings above to see every active employer.
Are there remote or hybrid Software jobs in San Francisco, CA?
Yes — 2800 of the 4685 open software positions offer remote or hybrid work (639 remote, 2161 hybrid).
How do I apply for Software jobs in San Francisco, CA?
Each listing links directly to the employer's application page. Apply early — fresh listings get the most recruiter attention in the first two weeks.