California, United States · Remote OK
$180k–$240k/yr
Company Overview Deepgram is the leading platform underpinning the emerging trillion-dollar Voice AI economy, providing real-time APIs for speech-to-text (STT), text-to-speech (TTS), and building production-grade voice a…
Skills: Python, Rust, Go, Model Evaluation, AI Systems
Sunnyvale, California, United States · Hybrid
$136k–$180k/yr
Our mission is to detect cancer early, when it can be cured. We are working to change the trajectory of cancer mortality and bring stakeholders together to adopt innovative, safe, and effective technologies that can tran…
Skills: Python, Go, API Design, System Design, Distributed Systems
San Francisco, California, United States · Hybrid
$200k–$275k/yr
About Onos Health Onos Health’s mission is simple but ambitious: ensure every healthcare dollar goes toward delivering the highest quality care. Today, 30% of total U.S. healthcare spending is wasted due to ineffective c…
Skills: Python, Django, NextJS, Typescript, System design
Menlo Park, California, United States · On-site
$114k–$172k/yr
Meta is hiring ASIC EDA Infrastructure Engineers within our Infrastructure ASIC organization. We are looking for individuals with experience in EDA flow and methodology, CAD/automation and ASIC infrastructure to build Sy…
Skills: ASIC, EDA, Infrastructure, SoC, RTL
Santa Clara County, California, United States · On-site
$228k–$339k/yr
Job Summary NetApp's Azure NetApp Files (ANF) team is building industry-leading cloud storage services that power mission-critical enterprise workloads in Microsoft Azure. We are looking for a highly motivated software a…
Skills: Cloud-Native Distributed Systems, Cloud Storage Services, File Systems, Azure, Kubernetes
Santa Clara County, California, United States · On-site
$196k–$293k/yr
Job Summary NetApp's Azure NetApp Files (ANF) team is building industry-leading cloud storage services that power mission-critical enterprise workloads in Microsoft Azure. We are looking for a highly motivated software e…
Skills: Go, Python, Kubernetes, Containers, Microservices
San Francisco, California, United States · Hybrid
ABOUT US Mira Mace pairs Medicare beneficiaries with a dedicated healthcare advocate who navigates appointments, insurance, and care coordination on their behalf. Our customers get the support of caring nurses while AI a…
Skills: LLM Engineering, AI Agents, RAG, Evaluation Infrastructure, Retrieval Systems
Milpitas, California, United States · On-site
Why RoboForce RoboForce is an AI robotics company developing Physical AI–powered Robo-Labor for dull, dirty, and dangerous work. We are not just building AI robots. We are building an AI-native company. We are hiring a F…
Skills: AI Workflow Design, LLM Tooling, Agent Frameworks, API Integration, Scripting
San Francisco, California, United States · Remote OK
岗位职责 视频标注 • 设计并落地各类视频标注任务与规范:caption(prompt 与视频内容对齐)、动作(action)、场景(scene)、风格、镜头 / 运镜、时序一致性、ranking / preference、badcase 分类等。 • 搭建标注质检体系:gold set、抽检、多轮 review、一致性(IAA)、reviewer 校准,保障大批量标注质量稳定可迭代。 • 管理标注供应商 / 众包团队,控制交付质量、一…
Skills: Video Data Labeling, Evaluation Framework Design, Quality Assurance, Vendor Management, Multimodal Data Analysis
San Francisco, California, United States · Remote OK
$100k–$200k/yr
About Flick Flick is defining the future interface for AI-native filmmaking. Think Figma and Cursor, but for creating AI films. Founded by Ray Wang (engineer who built Instagram Stories) and Zoey Zhang (award-winning fil…
Skills: React, TypeScript, Full-stack Engineering, Product Sense, UX Design
San Francisco, California, United States · Hybrid
ABOUT US Mira Mace pairs Medicare beneficiaries with a dedicated healthcare advocate who navigates appointments, insurance, and care coordination on their behalf. Our customers get the support of caring nurses while AI a…
Skills: Backend Engineering, Full-stack Engineering, AI/ML Engineering, System Architecture, LLM Production
Milpitas, California, United States · On-site
Why RoboForce RoboForce is an AI robotics company developing Physical AI–powered Robo-Labor for dull, dirty, and dangerous work. The company's robots are engineered for demanding industrial environments, with a focus on …
Skills: C++, Python, Linux, Embedded Software, Robotics Platform Architecture
San Francisco, California, United States · Remote OK
$100k–$200k/yr
About Flick Flick is defining the future interface for AI-native filmmaking. Think Figma and Cursor, but for creating AI films. Founded by Ray Wang (engineer who built Instagram Stories) and Zoey Zhang (award-winning fil…
Skills: React, TypeScript, Frontend Architecture, UI/UX Optimization, CI/CD
Milpitas, California, United States · On-site
Why RoboForce RoboForce is an AI robotics company developing Physical AI–powered Robo-Labor for dull, dirty, and dangerous work. The company's robots are engineered for demanding industrial environments, with a focus on …
Skills: Mechanical Design, CAD, SolidWorks, AutoCAD, FEA
Milpitas, California, United States · On-site
Why RoboForce RoboForce is an AI robotics company developing Physical AI–powered Robo-Labor for dull, dirty, and dangerous work. The company's robots are engineered for demanding industrial environments, with a focus on …
Skills: Motion Planning, C++, Trajectory Optimization, Rigid Body Dynamics, MPC
San Francisco, California, United States · Hybrid
ABOUT US Mira Mace pairs Medicare beneficiaries with a dedicated healthcare advocate who navigates appointments, insurance, and care coordination on their behalf. Our customers get the support of caring nurses while AI a…
Skills: Healthcare Integrations, Revenue Cycle Management, API Design, Data Modeling, FHIR
San Francisco, California, United States · On-site
We help physicians to achieve independence by making it easier to start, operate, and grow their practices. We believe that the future of healthcare will not come from bureaucratic health care systems, but individual phy…
Skills: Full Stack Development, Agentic Architectures, AI Evals, Frontier Models, Data Indexing
Milpitas, California, United States · On-site
Why RoboForce RoboForce is an AI robotics company developing Physical AI–powered Robo-Labor for dull, dirty, and dangerous work. The company's robots are engineered for demanding industrial environments, with a focus on …
Skills: Python, PyTorch, JAX, Vision-Language-Action Models, World Models
San Francisco, California, United States · Remote OK
我们在训练自研视频生成基础模型(DiT / Flow Matching),需要一位既能搭起训练平台、又能把研究代码变成数百卡集群上稳定结果的工程师。你不只是用平台的人,更是建平台的人。 你会做 • 训练平台搭建:从作业调度、断点续训、监控告警到数据 / 权重流水线,把分散的脚本沉淀为团队可复用的训练基础设施。 • 数百卡规模的分布式训练:FSDP、张量并行、Context Parallel、Ulysses,把 MFU 推到合理水位。 •…
Skills: PyTorch Distributed, CUDA, FSDP, Megatron, DeepSpeed
Los Altos, California, United States · On-site
<p dir="ltr">The private markets are a multi-trillion-dollar powerhouse that funds everything from tech startups to major infrastructure projects, yet much of it still operates on fragmented, inefficient legacy systems. …
Skills: Account Management, Customer Success, B2B SaaS, Relationship Management, Customer Onboarding
California, United States • Remote OK
Sign up with Clera and we'll reach out the moment a role actually fits you — no more spraying applications into the void.
Define and build evaluation methodologies and automated pipelines to validate the quality of speech, audio, and multimodal AI models. Partner with Research and DevOps to create reproducible pass/fail gates and production monitoring systems to prevent regressions.
Requires a degree in Computer Science or a related field and 5+ years of professional software or QA engineering experience. Candidates must be proficient in backend languages like Python, Rust, or Go and have experience building scalable test infrastructure.
Deepgram is the leading platform underpinning the emerging trillion-dollar Voice AI economy, providing real-time APIs for speech-to-text (STT), text-to-speech (TTS), and building production-grade voice agents at scale. More than 200,000 developers and 1,300+ organizations build voice offerings that are ‘Powered by Deepgram’, including Twilio, Cloudflare, Sierra, Decagon, Vapi, Daily, Cresta, Granola, and Jack in the Box. Deepgram’s voice-native foundation models are accessed through cloud APIs or as self-hosted and on-premises software, with unmatched accuracy, low latency, and cost efficiency. Backed by a recent Series C led by leading global investors and strategic partners, Deepgram has processed over 50,000 years of audio and transcribed more than 1 trillion words. There is no organization in the world that understands voice better than Deepgram.
At Deepgram, we expect an AI-first mindset—AI use and comfort aren’t optional, they’re core to how we operate, innovate, and measure performance.
Every team member who works at Deepgram is expected to actively use and experiment with advanced AI tools, and even build your own into your everyday work. We measure how effectively AI is applied to deliver results, and consistent, creative use of the latest AI capabilities is key to success here. Candidates should be comfortable adopting new models and modes quickly, integrating AI into their workflows, and continuously pushing the boundaries of what these technologies can do.
Additionally, we move at the pace of AI. Change is rapid, and you can expect your day-to-day work to evolve just as quickly. This may not be the right role if you’re not excited to experiment, adapt, think on your feet, and learn constantly, or if you’re seeking something highly prescriptive with a traditional 9-to-5.
Deepgram is looking for a Senior Software Engineer - Model Evaluation & AI Systems to join the team responsible for validating the quality of our speech, audio, and multilingual models before they reach customers.
This team owns the evaluation and quality assurance surfaces that ensure Deepgram's models — across speech-to-text, text-to-speech, and increasingly LLM- and multimodal-powered systems — meet their performance targets in both batch and streaming environments. We build the pipelines, harnesses, canaries, and test frameworks that catch regressions, hallucinations, and quality issues before they impact customers, and we partner closely with Research to turn model expectations into automated, reproducible, enforceable checks.
In this role, you'll define evaluation methodology and build the infrastructure that measures model quality at scale. You'll create evaluation pipelines, define pass/fail criteria grounded in Research benchmarks, and build the monitoring that keeps models honest in production. Your work provides the trusted signals that inform release and optimization decisions, and directly protects the customer experience.
We're looking for a strong engineer who is equally comfortable building test infrastructure and reasoning about model behavior. This role is aimed at senior engineers with broad instincts for quality, measurement, and automation; hands-on experience evaluating modern AI systems is a strong plus.
Define and build evaluation methodologies for Deepgram's models, spanning speech-to-text, text-to-speech, and emerging LLM, RAG, agent, and multimodal systems.
Design, build, and maintain automated evaluation pipelines across batch and streaming (e.g. WER, runaway/hallucination detection, latency and time-to-first-byte), with a focus on correctness, reproducibility, and ease of adoption.
Build scalable, reproducible evaluation infrastructure — harnesses, orchestration, and result-aggregation pipelines — running against production models and, where needed, large GPU clusters.
Translate Research benchmarks and expected model metrics into automated, enforceable pass/fail gates.
Build and operate canaries and continuous-monitoring systems that detect quality regressions in production before they reach customers.
Partner with DevOps/Infra to stand up ephemeral test environments and results-aggregation infrastructure.
Work alongside Research, model training, inference, and product teams to provide trusted evaluation signals that inform release and optimization decisions.
Integrate evaluation and quality gates into CI/CD so quality is verified continuously, not manually.
Help raise the bar through code reviews, technical design discussions, and strong engineering and QA practices.
BS, MS, or PhD in Computer Science, AI, Applied Math, or a related field, or equivalent experience.
5+ years of professional software or QA engineering experience, with a track record of shipping test infrastructure or evaluation systems (senior candidates with significantly deeper experience welcome).
Solid backend/scripting experience in a language such as Python, Rust, Go, or similar.
Experience designing and building automated test pipelines, evaluation frameworks, or data-processing systems.
Strong analytical skills and comfort reasoning about metrics, thresholds, and statistical variation in results — able to distinguish real regressions from noise.
Ability to take charge of ambiguous technical challenges and communicate effectively across research, engineering, and product teams.
Hands-on experience evaluating modern AI systems such as LLMs, RAG pipelines, agents, or multimodal models, including model behavior analysis.
Experience with React Native or other cross-platform mobile frameworks for building tooling that's accessible beyond the desktop.
Experience building or improving evaluation frameworks, benchmarks, or ML infrastructure used by other teams or external users.
A strong appreciation for evaluation quality — correctness, reproducibility, and consistency across environments.
Experience with voice, audio, speech recognition, or real-time systems, and familiarity with metrics like WER, MOS, or latency/TTFB.
Prior involvement in open-source projects, through contributions, reviews, maintenance, or community engagement.
Experience acting as a technical bridge across teams or platforms (evaluation, training, inference, agent frameworks), combining architectural understanding with clear communication and influence.
Familiarity with cloud infrastructure, containerized/ephemeral environments, and monitoring tooling (e.g. Grafana, canaries, anomaly detection).
Powering the Voice AI economy—trusted by 200,000+ developers to build low-latency, enterprise-grade Voice AI at scale.
Deepgram is the real-time API platform powering the trillion-dollar Voice AI economy. Backed by a $130M Series C at a $1.3B valuation, Deepgram is trusted by 200,000+ developers and 1,300+ organizations to build Voice AI products, platforms, and autonomous agents with the lowest latency, highest accuracy, and enterprise reliability. Our voice-native foundation models and runtime infrastructure have processed 50,000+ years of audio and over 1 trillion words, making Deepgram the most experienced voice AI platform in the world. Industry-leading models & platform: 👂 Nova-3 — the world’s most accurate real-time speech-to-text model 🔊 Aura-2 — professional, enterprise-grade text-to-speech 💬 Flux — the first Conversational Speech Recognition model designed to handle interruptions 🚀 Voice Agent API — enterprise-ready, real-time conversational AI 🧠 Saga — the Voice OS Beyond core infrastructure, Deepgram is expanding the Voice AI ecosystem through: 💪 Powered by Deepgram, supporting voice products built by leading AI startups and enterprise organizations 🌉 A new Voice AI Collaboration Hub in San Francisco for builders, partners, and the voice community 🍔 The acquisition of OfOne, delivering real-time Voice AI for restaurants and drive-thru operations with 95%+ containment 📃 A growing patent portfolio in Voice AI Much like APIs powered the payments and cloud economies, Deepgram is building the foundation for a trillion-dollar B2B Voice AI economy—centered on the most natural human interface: voice.
Offices: 548 Market St., Suite 25104, San Francisco, California 94104, US · 207 E Washington St, Ann Arbor, Michigan 48104, US
Based on 13987 listings with disclosed salaries, most software jobs in California pay between $124k–$275k per year. Individual offers vary with seniority, company size, and specialization.
There are currently 16,966 open software positions in California listed on Clera. New openings are added daily as companies post roles.
Companies currently hiring include Google, Apple, Amazon, NVIDIA, Qualcomm, among others. Browse the listings above to see every active employer.
Yes — 7740 of the 16966 open software positions offer remote or hybrid work (2246 remote, 5494 hybrid).
Each listing links directly to the employer's application page. Apply early — fresh listings get the most recruiter attention in the first two weeks.
