System Software Engineer - AI About us: We are a stealth-mode startup building foundational technology to address performance, scalability, and resiliency challenges in large-scale AI data center clusters. We are backed …
Skills: C++, Python, Systems Programming, Linux, CUDA
Striim, (pronounced “stream” with two i’s for integration and intelligence), is a unified data integration and streaming platform that connects clouds, data, and applications with unprecedented speed and simplicity to de…
Clinical Systems Analyst - Data Integration & Software Development
Palo Alto, California, United States · Hybrid
$55/hr–$74/hr
Mid level
If you're ready to be part of our legacy of hope and innovation, we encourage you to take the first step and explore our current job openings. Your best is waiting to be discovered. Day - 08 Hour (United States of Americ…
Skills: .NET Core, C#, ASP.NET Core, RESTful APIs, SQL Server
About Nu Nu is the leading digital bank in Latin America, serving 135 million customers across Brazil, Mexico, and Colombia. The company has been leading an industry transformation by leveraging data and proprietary tech…
Skills: Deep Learning, Foundation Models, Transformers, Graph Neural Networks (GNNs), Python
About Nu Nu is the leading digital bank in Latin America, serving 135 million customers across Brazil, Mexico, and Colombia. The company has been leading an industry transformation by leveraging data and proprietary tech…
Skills: Data Engineering, Distributed Systems, Spark, Flink, Kafka
Engineering Director, AI Developer Experience (AIDE)
Palo Alto, California, United States · Hybrid
Senior+$4.5B raised
About Nu Nu is the leading digital bank in Latin America, serving 135 million customers across Brazil, Mexico, and Colombia. The company has been leading an industry transformation by leveraging data and proprietary tech…
About Nu Nu is the leading digital bank in Latin America, serving 135 million customers across Brazil, Mexico, and Colombia. The company has been leading an industry transformation by leveraging data and proprietary tech…
Skills: Backend Engineering, Platform Engineering, Distributed Systems, API Design, Microservices
Lead Software Engineer (Crypto, SV) - US - IC6 - 2026
Palo Alto, California, United States · Hybrid
Senior+$4.5B raised
About Nu Nu is the leading digital bank in Latin America, serving 135 million customers across Brazil, Mexico, and Colombia. The company has been leading an industry transformation by leveraging data and proprietary tech…
About Nu Nu is the leading digital bank in Latin America, serving 135 million customers across Brazil, Mexico, and Colombia. The company has been leading an industry transformation by leveraging data and proprietary tech…
About Nu Nu is the leading digital bank in Latin America, serving 135 million customers across Brazil, Mexico, and Colombia. The company has been leading an industry transformation by leveraging data and proprietary tech…
About Rivian Rivian is on a mission to keep the world adventurous forever. This goes for the emissions-free Electric Adventure Vehicles we build, and the curious, courageous souls we seek to attract. As a company, we con…
Skills: Vision-Language Models, Machine Learning, Python, Data Mining, Model Training
About Rivian Rivian is on a mission to keep the world adventurous forever. This goes for the emissions-free Electric Adventure Vehicles we build, and the curious, courageous souls we seek to attract. As a company, we con…
Skills: Vision-Language Models, Python, Machine Learning, Data mining, Perception pipelines
Who You Are An agent orchestrator, not a typist. You don't want to be a faster keyboard. You want to be a manager of agents — handing off the heavy lifting, reviewing the output, and keeping your hands on the architectur…
Who You Are An agent orchestrator, not a typist. You don't want to be a faster keyboard. You want to be a manager of agents — handing off the heavy lifting, reviewing the output, and keeping your hands on the architectur…
Lead Software Engineer -Infrastructure Technical Duty Officer
Palo Alto, California, United States · On-site
$152k–$215k/yr
Senior$1.6B raised
As a Lead Software Engineer of Software Engineering at JPMorganChase within the Commercial and Investment Bank Payments Team, you lead multiple technical areas, manage the activities of multiple departments, and collabor…
Senior Software Developer in Test, Infrastructure + Automation
Palo Alto, California, United States · Hybrid
$134k–$215k/yr
Mid level$16B raised
At Ford Motor Company, we believe freedom of movement drives human progress. We also believe in providing you with the freedom to define and realize your dreams. With our incredible plans for the future of mobility, we h…
Senior Software Developer in Test, Infrastructure + Automation
Palo Alto, California, United States · Hybrid
$134k–$215k/yr
Mid level$16B raised
At Ford Motor Company, we believe freedom of movement drives human progress. We also believe in providing you with the freedom to define and realize your dreams. With our incredible plans for the future of mobility, we h…
About Rivian Rivian is on a mission to keep the world adventurous forever. This goes for the emissions-free Electric Adventure Vehicles we build, and the curious, courageous souls we seek to attract. As a company, we con…
About Rivian Rivian is on a mission to keep the world adventurous forever. This goes for the emissions-free Electric Adventure Vehicles we build, and the curious, courageous souls we seek to attract. As a company, we con…
Skills: C++, Robotics, State estimation, Multi-target tracking, Sensor fusion
WindBorne Systems is supercharging weather forecasts with a proprietary data source: a global constellation of next-generation smart weather balloons targeting critical atmospheric data. We design, manufacture, and opera…
Skills: Production ML Systems, PyTorch, Docker, Distributed Training, Data Pipelines
Sign up with Clera and we'll reach out the moment a role actually fits you — no more spraying applications into the void.
$140k–$200k/yr
Full-time
bachelor degree, postgraduate degree
Equity, Benefits, 401k
Posted 53d ago
~40 hrs/week
Responsibilities
Design and implement communication and execution primitives to enable large-scale AI models to run efficiently across thousands of GPUs. Identify and resolve performance bottlenecks in distributed training and inference workloads through software-hardware interface analysis.
Requirements
Requires strong proficiency in C++ and Python with a deep understanding of systems programming and Linux environments. A Bachelor's or Master's degree in Computer Engineering, Computer Science, or a related field is required.
Full job description
System Software Engineer - AI
About us:
We are a stealth-mode startup building foundational technology to address performance, scalability, and resiliency challenges in large-scale AI data center clusters. We are backed by top-tier VC firms and notable angel investors.
The company is led by experienced builders and operators who have founded companies, taken them to scale, and exited successfully. We work with a strong sense of unity and shared responsibility, and we expect trust, integrity, and respect in how we collaborate and make decisions. We hold ourselves accountable to one another and to the quality of the work we deliver.
Headquartered in Silicon Valley, we operate across a mix of remote and on-site locations in the U.S. and Canada. We aim to create an environment where people are treated fairly, supported in their growth, and are empowered to do meaningful work alongside others who take the craft seriously.
We arelooking for a talented System Software Engineer to help us redefine the infrastructure layer of AI. In this role, you will bridge the gap between high-level AI frameworks and low-level system software. You will be responsible for designing and implementing the communication and execution primitives that allow large-scale AI models to run efficiently across thousands of GPUs. We are looking for a "builder" who thrives in the early stages of a product’s lifecycle and is passionate about solving the "hard" systems problems of the generative AI era.
Key Responsibilities:
Collaborate across the stack to influence the design of our foundational technology, ensuring it meets the needs of next-generation AI models.
Identify and resolve performance bottlenecks in distributed training and inference workloads through deep-dive analysis of the software-hardware interface.
Conduct rigorous performance benchmarking and characterization on multi-node clusters.
Required Skills and Qualifications:
Strong proficiency in C++ and Python, with a deep understanding of systems programming fundamentals (memory management, concurrency, OS internals).
Proficient in a Linux development environment.
Desired Skills:
Experience with GPU programming (CUDA) and performance optimization for parallel architectures.
Familiarity with distributed AI frameworks (PyTorch, JAX, or DeepSpeed) and/or inference engines (vLLM, SGLang, Dynamo/TRT-LLM).
Hands-on experience with large-scale cluster orchestration and telemetry tools.
Education:
Bachelor's or Master's degree in Computer Engineering, Computer Science, or a related field.
Location:
This is a hybrid role based in Palo Alto or Charlottesville, VA.
Compensation:
Target base salary for this role is $140,000 - $200,000 per year + meaningful equity + benefits + 401k. Our salary ranges are determined by role, level, experience, and location.
We are an equal opportunity employer. We value a range of perspectives and experiences and make employment decisions based on merit and business needs. We do not discriminate on the basis of legally protected characteristics.
Agency Note:
We do not accept resumes from agencies or search firms. Please do not forward candidate profiles through our careers page, email, LinkedIn messages, or directly to company employees. Any resumes submitted will be deemed the property of the company, and no fees will be paid in the event the candidate is hired.
Based on 729 listings with disclosed salaries, most software jobs in Palo Alto, CA pay between $120k–$275k per year. Individual offers vary with seniority, company size, and specialization.
How many Software jobs are open in Palo Alto, CA right now?
There are currently 952 open software positions in Palo Alto, CA listed on Clera. New openings are added daily as companies post roles.
Which companies are hiring for Software roles in Palo Alto, CA?
Companies currently hiring include Rivian, Amazon, Ford Motor Company, JPMorganChase, Rivian and Volkswagen Group Technologies, among others. Browse the listings above to see every active employer.
Are there remote or hybrid Software jobs in Palo Alto, CA?
Yes — 472 of the 952 open software positions offer remote or hybrid work (102 remote, 370 hybrid).
How do I apply for Software jobs in Palo Alto, CA?
Each listing links directly to the employer's application page. Apply early — fresh listings get the most recruiter attention in the first two weeks.