Member of Technical Staff, AI Evaluation

$200k - $300k + equity

Location
San Mateo
Workplace
Remote
Employment
Full-time
Visa
US Work Authorization Required

About this role

We are looking for a Member of Technical Staff, AI Evaluation with 5+ years of experience, blending physical engineering (mechanical, electrical, aerospace, robotics) and AI evals, to own how we measure Archie, our AI engineer for the physical world. You'll build the evaluation framework that shows how Archie compares to human engineers and what it takes to grow him from junior to senior engineer, and eventually to engineering superintelligence.

What will you be doing?

  • Own Archie's evaluation framework from scratch, defining what "good" engineering design looks like when there's no single right answer
  • Work with engineering SMEs, customers, partners and internal teams to learn how top engineers work and where Archie succeeds or fails
  • Recreate real-world engineering tasks and failure modes in evaluation environments that the dev teams can rerun
  • Design and refine automated judges and human evaluation processes, and check that judges match expert human judgment
  • Turn eval results into clear priorities for improving Archie's engineering reasoning

Key Requirements

  • 5+ years of experience across physical engineering and/or AI work. The ideal candidate is strong in both, but deep strength in one with working knowledge of the other is fine
  • Hands-on AI evaluation experience: building eval tasks, designing judges, and running human evaluation for agentic systems
  • Physical engineering background (mechanical, electrical, aerospace, robotics, power systems), enough to recognize strong engineering design
  • The presence and confidence to lead work across SMEs, customers and cross-functional teams in a high-ownership role
  • Experience in scrappy, early-stage environments building new things from scratch (physical AI or robotics companies a plus)

Apply to P-1 AI

They hire through Clera: your intro goes straight to the hiring team.

How it works

Confirm the fit

A few questions to make sure this role is the right shape for you. Two minutes.

Clera pitches you to the company

Clera writes the intro, sends it to the founder, and handles the back-and-forth.

A meeting lands on your calendar

When the company wants to meet, Clera gets the call on your calendar. You just show up.

Not the right role?

Ask your AI about this role

It knows you. Clera gives it the role.

Does this role fit my profile?

First time? Connect Clera once, about a minute.
One click above pre-fills the connector. Or by hand: Settings > Connectors > Add custom connector, paste https://mcp.getclera.com. Either way, sign in with the account you use on Clera and approve the consent screen.
https://mcp.getclera.com

Sign in with your Clera account. MCP docs

About P-1 AI

P-1 AI develops Archie, an AI engineer agent that solves complex physical-world problems for industrial enterprises in aerospace, automotive, and HVAC sectors through a bring-your-own-cloud deployment model integrated into customers' existing infrastructure.

Stage
Series A
Founded
2024
Industry
AI
Workplace
Remote
Locations
Canada; San Mateo, United States; Remote (Canada); Remote (United States)
Open roles
4

Know someone who'd fit?

Earn $5,000 per hire

Culture & values

  • Culture is scrappy and focused on building from zero to one
  • Big, complex problems are seen as exciting challenges to solve, not extra work
  • There can be short crunches to ship key features
  • Early-stage work comes with ambiguity
  • Not a '996' culture
  • If you manage your own time and do great work, nobody counts your hours
  • Values hands-on engineers who design and build systems themselves
  • Values engineers who have seen both large-scale enterprise systems and startup speed
  • Values engineers who lean hard into AI-assisted development and coding agents
  • Team is remote across the US and Canada
  • Everyone meets in person for one week every six weeks at San Mateo, CA office