Machine Learning Research Engineer, Model Evaluation
$140k - $240k
- Location
- Redwood City
- Workplace
- Hybrid
- Employment
- Full-time
About this role
Machine Learning Research Engineer, Model Evaluation
WindBorne Systems is supercharging weather forecasts with a proprietary data source: a global constellation of next-generation smart weather balloons targeting critical atmospheric data. We design, manufacture, and operate our own balloons, using their observations to generate otherwise unattainable weather intelligence.
Our mission is to eliminate weather uncertainty and help humanity adapt to climate change—whether by predicting hurricanes or speeding the adoption of renewables. The founding team of Stanford engineers was named Forbes 2019 30 Under 30 and is backed by top-tier investors, including Khosla Ventures and Footwork VC.
WindBorne builds AI weather models that run 24/7, producing global forecasts every 20 minutes. Evaluating these models is much harder than producing a headline accuracy number: performance varies across regions, lead times, weather regimes, and customer use cases, while standard metrics often fail to capture what makes a forecast meteorologically sound or useful.
We need someone with excellent scientific taste to determine where our models excel, where they fail, and which results we should trust. You will work at the intersection of machine learning and meteorology, combining fast analyses with robust systems that make future research faster and more reliable.
Responsibilities
What you’d own:
Evaluation strategy — Work with our Meteorology team to develop a rigorous, meteorologically valid strategy for comparing WeatherMesh with leading AI and physics-based models. Choose the metrics, datasets, baselines, and case studies that provide an honest picture of forecast quality.
Fast feedback and durable systems — Build quick evaluations that give researchers useful signals, then turn recurring analyses into reliable, reusable infrastructure. Think systematically about reproducibility, provenance, and how evaluation tools fit into the broader research workflow.
Agentic tooling for evals — Improve our existing evaluation infrastructure, including agentic AI-based tools for investigating forecasts and synthesizing results.
Technical communication — Produce clear scorecards, visualizations, and explanations for researchers, leadership, customers, and external partners. Communicate model performance precisely, including uncertainty and important caveats.
Skills and Qualifications
Requirements
Excellent scientific judgment and healthy skepticism. You ask whether a comparison is fair, what else could explain a result, and what evidence would change your mind.
Strong experimental taste: you can identify the evaluation that answers the question that matters and distinguish robust improvement from noise.
Systems thinking: you can solve today’s problem while recognizing what should become reusable infrastructure for future work.
Experience evaluating ML systems using large, scientific, geospatial, multidimensional, or time-series datasets.
Strong Python skills and experience with scientific and ML tools such as PyTorch, NumPy, pandas, or xarray.
Able to investigate ambiguous results independently, synthesize evidence, and communicate conclusions clearly.
Experience with weather, climate, forecasting, physical science, or AI-assisted research tools is helpful, but not required.
Benefits
401(k)
Dental, health, and vision insurance
Unlimited PTO
Stock Option Plan
Office food and beverages
Salary
$140k–$240k. We consider a range of backgrounds and experience levels and adjust offers to be competitive with market rates.
Location
1600 Bridge Pkwy, Redwood City, CA. Hybrid or in-person.
WindBorne Systems is an equal opportunity employer. All qualified applicants will receive consideration without regard to race, color, religion, sex, national origin, disability, protected veteran status, or any other legally protected characteristic. To request an accommodation in the application process, email [email protected].
Apply to WindBorne Systems
Clera fills in WindBorne Systems's application for you.
How it works
Open the role in Clera
Sign in, and this role opens on your Clera job board, ready to apply.
Clera fills in the application
Clera fills the form from your profile and resume, and asks what's missing.
Track it in Clera
Each application you send shows up in your Clera tracker, sorted by stage.
Ask your AI about this role
It knows you. Clera gives it the role.
First time? Connect Clera once, about a minute.
https://mcp.getclera.comSign in with your Clera account. MCP docs
About WindBorne Systems
WindBorne is a company focused on weather data and forecasting. WindBorne's mission is to create weather certainty. WindBorne describes its approach as fusing data from a constellation of smart, long-duration sensing balloons with AI forecasts.
- Team size
- 51-200 people
- Founded
- 2019
- Industry
- Defense
- Workplace
- Hybrid
- Locations
- Redwood City, California, United States
Benefits
- 401(k)
- Dental Insurance
- Health Insurance
- Vision Insurance
- Unlimited PTO
- Stock Option Plan
- Office Food and Beverages