About the Role We’re seeking a strong Senior Backend Engineer to join our AI Evaluation team, focused on building the infrastructure and internal tooling that enable reliable, repeatable evaluation of AI systems in produ…
Skills: Backend Engineering, API Design, Data Pipelines, Python, Typescript
San Francisco, California, United States · On-site
$170k–$210k/yr
Mid level$63M raised
What We're Building: If you want to shape the future of science, come build with us. Medra is building Physical AI Scientists: robotic systems that work hand-in-hand with leading biopharma partners to enable scientific b…
San Francisco, California, United States · On-site
Senior
Own client acquisition and revenue growth from first touch through long-term partnership at Hellyeah — an autonomous ad optimization agent that replaces the entire media buying stack. Work directly with founders to build…
Skills: Business Development, Partnerships, Sales, Pipeline Management, CRM
Hellyeah AI
Developer Relations Engineer
San Francisco, California, United States · On-site
Mid level
Hellyeah is an AI-powered growth engine that makes paid acquisition automatic, measurable, and accessible to any business. The DevRel role's mission: make Hellyeah the default growth infrastructure that developers integr…
San Francisco, California, United States · On-site
$225k–$275k/yr
Senior+Visa sponsorship$338M raised
fal is the generative media ecosystem powering the next generation of AI products. We build the infrastructure, tools, and model access that teams need to move from idea to production, and do it at scale without compromi…
Skills: Commercial Law, Contract Negotiation, SaaS Licensing, AI Regulation, Data Protection
Newton
Senior Sales Director - USA
San Francisco, California, United States · Remote Solely
Senior+
Senior Sales Director 🇺🇲 US - Remote About Newton Newton is one of Affle’s fastest-growing, performance-driven platforms, designed to supercharge iOS app growth through Apple Ads, App Store Optimization (ASO), and crea…
San Francisco, California, United States · On-site
Senior$85M raised
🌍 We’re making security suck less for developers. Security tools haven’t kept up with how software is built today. They interrupt teams, slow releases, and turn security into a bottleneck instead of a capability. We bui…
Skills: Field Marketing, Event Management, Community Engagement, Pipeline Generation, Account-Based Marketing
About us Encord is the universal data layer for AI that helps 300+ AI teams train and run models on the right data. Our platform indexes, curates, annotates, and evaluates data across the full AI lifecycle, from developm…
About The Role & Team Our infrastructure teams build and operate the backend systems that power Amplitude's products at massive scale — handling more than 1 trillion events per month. We work on the systems that move, st…
Staff Software Engineer, AI Platform (San Francisco)
San Francisco, California, United States · Hybrid
$220k–$260k/yr
Senior+$266M raised
About the Role: We’re looking for an experienced Staff Software Engineer to help architect and build the systems that power Redpanda’s vision for the Agentic Data Plane (ADP), while also shaping the technical culture beh…
San Francisco, California, United States · Remote OK
$180k–$225k/yr
Senior$338M raised
fal is the generative media ecosystem powering the next generation of AI products. We build the infrastructure, tools, and model access that teams need to move from idea to production, and do it at scale without compromi…
Skills: Python, Go, SQL, BigQuery, ClickHouse
Rippling
Director, Sales Development
San Francisco, California, United States · Hybrid
$225k–$235k/yr
Senior
About the role We are seeking a highly motivated and strategic Director of Sales Development to lead and scale our Sales Development Representative (SDR) team. This role is responsible for driving pipeline growth, optimi…
Skills: Sales Development Leadership, Pipeline Growth, AI Implementation, GTM Strategy, Account Based Marketing
Rippling
Head of Storytelling
San Francisco, California, United States · Hybrid
$185k–$230k/yr
Senior
About the role Rippling has a story that no one else in the market can tell — a single system that connects HR, IT, and Finance, built for how modern companies actually operate. We have tens of thousands of customers who…
Skills: Content Strategy, Editorial Judgment, B2B Marketing, Community Management, Storytelling
Intelligence
Open Application
San Francisco, California, United States · On-site
Mid levelVisa sponsorship
Don't see the right role? Reach out anyway — we're always looking for exceptional people. Intelligence is the product lab company behind DesignArena - 5.5M+ users in 8 months, leaderboard referenced by Andrew Ng, Elon Mu…
Skills: Artificial Intelligence, Multimodal Models, Web Development, Game Development, Image Generation
Rippling
Product Lead, Developer Experience
San Francisco, California, United States · Hybrid
$174k–$290k/yr
Senior+
About the role The Rippling Developer Platform team is responsible for the products and frameworks that power the integration of HR, IT, Finance, and third-party applications into one unified system. The team owns the fo…
About the role Scheduling is one of Rippling's highest-potential products and one of our most powerful onramps. For hourly-heavy businesses, getting scheduling right is the first thing that matters, which makes it a natu…
About Supa Health You've probably been to a therapist, or know someone who has. You also probably know that paying for one is broken in ways most things in 2026 aren't. They "think" they take your insurance. The benefits…
San Francisco, California, United States · Remote OK
Mid level
MaintainX is the world's leading AI-powered maintenance and asset management platform, serving 14,000+ customers including Duracell, Shell, Cintas, and Brenntag. We raised $150M in Series D funding led by Bessemer Ventur…
San Francisco, California, United States · Remote OK
$165k–$230k/yr
Senior
Software Engineer, Platform (Technical Lead) San Francisco / Remote At Superserve, our mission is to give builders the foundation to run intelligent software in production. We’re building agent sandboxes—runtime infrastr…
San Francisco, California, United States · Remote OK
$160k–$210k/yr
Senior$75M raised
Ellipsis Health is creating cutting-edge AI/ML products that solve healthcare staffing challenges and administrative burdens using conversational AI and our patented voice biomarker technology, helping deliver better hea…
Sign up with Clera and we'll reach out the moment a role actually fits you — no more spraying applications into the void.
$160k–$210k/yr
Full-time
401(k) Matching, Health Insurance, Vision Insurance, Dental Insurance, Flexible Paid Time Off
Posted 85d ago
~40 hrs/week
Responsibilities
Build and maintain the infrastructure and internal tooling for an AI evaluations platform to ensure reliable testing of AI systems. Develop evaluation frameworks for components like LLMs and ASR while creating debugging tools to improve system observability.
Requirements
Requires 5+ years of professional software engineering experience with a focus on backend systems, platforms, or developer tooling. Proficiency in a general-purpose programming language and experience with production-grade infrastructure and test automation are essential.
Full job description
About the Role
We’re seeking a strong Senior Backend Engineer to join our AI Evaluation team, focused on building the infrastructure and internal tooling that enable reliable, repeatable evaluation of AI systems in production. In this role, you’ll develop the scaffolding around our evaluations platform - API/data integrations, test configuration management, and reporting tools that make evaluations easy to run, extend, and operate at scale. You’ll also build and maintain evaluation frameworks for individual system components such as ASR, LLMs, TTS, knowledge bases, and guardrails, productionalizing these frameworks to support regular analysis, regression detection, and continuous monitoring.
In addition, you’ll create debugging tools that make it easy to inspect end-to-end calls, trace failures, and surface all relevant signals in one place - empowering internal teams to diagnose issues quickly and confidently. The ideal candidate is a pragmatic, infrastructure-minded engineer who enjoys turning ad hoc analysis into durable systems, cares deeply about developer experience, holds a high bar for software-quality and takes pride in building tooling that makes complex AI systems observable, testable, and easier to operate.
Responsibilities:
Build and maintain infrastructure and tooling for the AI evaluations platform used by internal teams, including automated testing platform for AI voice agents, debugging and observability tools.
Develop and productionalize evaluation frameworks for individual system components such as ASR, LLMs, TTS, knowledge bases, and guardrails.
Partner with ML, engineering and QA teams to translate evaluation requirements into robust, maintainable infrastructure and tooling.
Improve developer experience by making evaluation systems easy to extend, well-documented, and reliable in day-to-day use.
Ensure evaluation tooling meets production standards for reliability, performance, and maintainability.
Qualifications:
5+ years of professional software engineering experience, with a strong focus on building backend systems, platforms, or developer tooling.
Proven experience designing and maintaining production-grade infrastructure with code, including APIs, services, and data pipelines.
Strong proficiency in at least one general-purpose programming language (e.g., Python, Typescript/Javascript, Java, or similar).
Experience using test automation frameworks, evaluation pipelines, or CI/CD-integrated testing systems.
Familiarity with observability and debugging tools (logging, metrics, tracing) and building internal tools that improve developer and QA workflows.
Strong debugging skills and a methodical approach to diagnosing production and evaluation issues.
Ability to collaborate effectively across engineering, QA, and operations teams, translating requirements into reliable, maintainable systems.
Product-minded approach to infrastructure, with attention to usability, documentation, and long-term maintainability.
Preferred:
Experience working with complex, multi-component systems (e.g., ASR, LLMs, TTS, or other ML-powered services)
Experience working in healthcare or other regulated environments, including awareness of HIPAA and PHI handling.
Familiarity with conversational AI or voice agents, including multi-turn dialogue, latency constraints, and error recovery.
Familiarity with LLM observability or evaluation tools (e.g., Langfuse, prompt eval frameworks).
Background in digital health, care coordination, or patient-facing systems.
Salary and Benefits
We offer competitive salary and benefits, including 401(k) matching, health, vision, and dental insurance, and very flexible paid time off.
The typical salary range for this role is $160,000 to $210,000 USD, depending on skills, qualifications, and relevant experience.
Background Checks
As a health technology company, we reserve the right to run background checks on candidates to whom we extend offers, in compliance with applicable laws. We evaluate candidates holistically and comply with all “ban the box” regulations.
Assistance
If you have a disability or require accommodations during the application or recruitment process, please contact [email protected].
Related keywords
AI EvaluationsBackendInfrastructureASRLLMTTSKnowledge BasesGuardrailsObservabilityLoggingMetricsTracingLangfusePrompt Eval FrameworksConversational AIVoice Agents
How much do Software jobs in San Francisco, CA pay?
Based on 3643 listings with disclosed salaries, most software jobs in San Francisco, CA pay between $140k–$289k per year. Individual offers vary with seniority, company size, and specialization.
How many Software jobs are open in San Francisco, CA right now?
There are currently 4,685 open software positions in San Francisco, CA listed on Clera. New openings are added daily as companies post roles.
Which companies are hiring for Software roles in San Francisco, CA?
Companies currently hiring include OpenAI, Anthropic, Salesforce, Harvey, Amazon, among others. Browse the listings above to see every active employer.
Are there remote or hybrid Software jobs in San Francisco, CA?
Yes — 2848 of the 4685 open software positions offer remote or hybrid work (639 remote, 2209 hybrid).
How do I apply for Software jobs in San Francisco, CA?
Each listing links directly to the employer's application page. Apply early — fresh listings get the most recruiter attention in the first two weeks.