Member of Technical Staff, AI Evaluation
$200k - $300k + equity
- Location
- San Mateo
- Workplace
- Remote
- Employment
- Full-time
- Visa
- US Work Authorization Required
About this role
We are looking for a Member of Technical Staff, AI Evaluation with 5+ years of experience, blending physical engineering (mechanical, electrical, aerospace, robotics) and AI evals, to own how we measure Archie, our AI engineer for the physical world. You'll build the evaluation framework that shows how Archie compares to human engineers and what it takes to grow him from junior to senior engineer, and eventually to engineering superintelligence.
What will you be doing?
- Own Archie's evaluation framework from scratch, defining what "good" engineering design looks like when there's no single right answer
- Work with engineering SMEs, customers, partners and internal teams to learn how top engineers work and where Archie succeeds or fails
- Recreate real-world engineering tasks and failure modes in evaluation environments that the dev teams can rerun
- Design and refine automated judges and human evaluation processes, and check that judges match expert human judgment
- Turn eval results into clear priorities for improving Archie's engineering reasoning
Key Requirements
- 5+ years of experience across physical engineering and/or AI work. The ideal candidate is strong in both, but deep strength in one with working knowledge of the other is fine
- Hands-on AI evaluation experience: building eval tasks, designing judges, and running human evaluation for agentic systems
- Physical engineering background (mechanical, electrical, aerospace, robotics, power systems), enough to recognize strong engineering design
- The presence and confidence to lead work across SMEs, customers and cross-functional teams in a high-ownership role
- Experience in scrappy, early-stage environments building new things from scratch (physical AI or robotics companies a plus)
Apply to P-1 AI
They hire through Clera: your intro goes straight to the hiring team.
How it works
Confirm the fit
A few questions to make sure this role is the right shape for you. Two minutes.
Clera pitches you to the company
Clera writes the intro, sends it to the founder, and handles the back-and-forth.
A meeting lands on your calendar
When the company wants to meet, Clera gets the call on your calendar. You just show up.
Ask your AI about this role
It knows you. Clera gives it the role.
First time? Connect Clera once, about a minute.
https://mcp.getclera.comSign in with your Clera account. MCP docs
About P-1 AI
P-1 AI develops Archie, an AI engineer agent that solves complex physical-world problems for industrial enterprises in aerospace, automotive, and HVAC sectors through a bring-your-own-cloud deployment model integrated into customers' existing infrastructure.
- Stage
- Series A
- Founded
- 2024
- Industry
- AI
- Workplace
- Remote
- Locations
- Canada; San Mateo, United States; Remote (Canada); Remote (United States)
- Open roles
- 4
Know someone who'd fit?
Earn $5,000 per hire
Culture & values
- Culture is scrappy and focused on building from zero to one
- Big, complex problems are seen as exciting challenges to solve, not extra work
- There can be short crunches to ship key features
- Early-stage work comes with ambiguity
- Not a '996' culture
- If you manage your own time and do great work, nobody counts your hours
- Values hands-on engineers who design and build systems themselves
- Values engineers who have seen both large-scale enterprise systems and startup speed
- Values engineers who lean hard into AI-assisted development and coding agents
- Team is remote across the US and Canada
- Everyone meets in person for one week every six weeks at San Mateo, CA office

