Berkeley, California, United States · On-site
About METR We are a nonprofit research organization that develops scientific methods to assess AI capabilities, risks, and mitigations, with a specific focus on threats related to AI R&D automation and misalignment. METR…
Skills: Unix, Linux, C, C++, Rust
Berkeley, California, United States · Hybrid
$286k–$503k/yr
About METR We are a nonprofit research organization that develops scientific methods to assess AI capabilities, risks, and mitigations, with a specific focus on threats related to AI R&D automation and misalignment. METR…
Skills: Offensive security, Red teaming, Cloud security, AWS, IAM
Berkeley, California, United States · Hybrid
$286k–$503k/yr
About METR We are a nonprofit research organization that develops scientific methods to assess AI capabilities, risks, and mitigations, with a specific focus on threats related to AI R&D automation and misalignment. METR…
Skills: Research Execution, Software Engineering, ML Research, System Architecture, Rapid Prototyping
Sign up with Clera and we'll reach out the moment a role actually fits you — no more spraying applications into the void.
You will help build and maintain the organization's open-source LLM evaluation platform while debugging and improving evaluation processes. Additionally, you will manage cloud infrastructure, build automation agents, and support AI researchers in their technical tasks.
Candidates should have deep familiarity with UNIX/Linux systems and experience with low-level programming languages like C, C++, or Rust. You should also possess knowledge of LLMs, basic web development skills, and a demonstrated ability to learn new technologies quickly.
We are a nonprofit research organization that develops scientific methods to assess AI capabilities, risks, and mitigations, with a specific focus on threats related to AI R&D automation and misalignment.
METR has consistently set precedents for catastrophic AI risk evaluations, including the first independent safety evaluations (working informally with Anthropic and OpenAI in 2022), the first loss-of-control evaluations and first agentic dangerous capability evaluations, the first evaluations using finetuning (mentioned briefly here),the first independent evaluations using internal information about training, the first review partnership for company risk analysis, the first embedded redteaming, and the first evaluations of internal deployments.
We’ve been consulted and/or favorably referenced by groups on opposite ends of various spectra, including a16z, Khosla, Gary Marcus, Obama, and Dean Ball, and are known for producing one of the most positive results on AI capabilities (the time horizon trend) and the most negative (our downlift study). We’re generally referenced as the canonical third party assessor, e.g. as the obvious candidate to verify conditional pause agreements.
We believe it is robustly good for policymakers and civil society to have a clear understanding of risks from AI systems, and we are extremely excited to build a team of ambitious, excellent people to tackle one of the most important challenges of our time.
\nAbout the roleNearly everything we do runs on our evaluation platform, and we're expanding the ambition, speed, and scale of our evaluations over 2026 (Time Horizon 2.0, our first large-scale monitorability publication, industry-wide risk assessment programs). This means the platform needs to do more, faster, and more reliably.
We're looking for platform engineering interns to help build and maintain that platform, working directly with our infrastructure team. You would report to Mischa Spiegelmock, who leads the team.
You'll join our infrastructure team and be expected to learn many things mostly on your own, with some guidance. We will be happy to answer questions and guide you, but expect to do a fair bit of reading and discovery. This work includes:
Helping build and maintain the world's leading open-source LLM evaluation platform.
Debugging and improving LLM evaluations.
Deploying and managing cloud infrastructure.
Building robust observability and monitoring of our cloud platform.
Building agents to automate tasks.
Supporting AI researchers in their quests to challenge and confound the leading AI models.
We're looking for someone passionate about software, open source, and learning - the kind of person who works on personal projects for fun and has a track record of teaching themselves new things.
You have deep familiarity with UNIX/Linux systems.
You have some low-level programming experience (C, C++, or Rust - open source contributions are a plus).
You know more about LLMs than the average engineer — you can talk about transformers and embeddings, or have done ML work.
You have basic web development experience (full-stack, React, TypeScript).
Nice to haves: AWS (IAM, ECS, Lambda), PostgreSQL, infrastructure-as-code (Terraform, Pulumi, CDK), Kubernetes administration, or experience with LLM evaluation tooling like Inspect.
None of these individually is a hard requirement. Evidence that you pick things up quickly matters more than having experience with all of the above.
METR is a mission-driven organization. We believe our work can meaningfully shape humanity's future for the better, and we want to be the best people in the world doing this work. We have a tight-knit, collaborative research culture rooted in truth-seeking and integrity. We're fiercely committed to producing high-quality, trustworthy science. We're honest and transparent about our results, especially when they may go against the grain. We've earned trust as reliable partners who handle confidential information with care. We maintain a low-ego, drama-free environment focused on what matters.
We are committed to diversity and equal opportunity in all aspects of our hiring process. We do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. We welcome and encourage all qualified candidates to apply for our open positions.
A research non-profit developing frontier AI evaluations to safeguard public safety and national security.
METR is a research non-profit that develops evaluations to empirically test AI systems for capabilities that could threaten catastrophic harm to society.
Offices: Berkeley, CA, US
A research non-profit developing frontier AI evaluations to safeguard public safety and national security.
METR is a research non-profit that develops evaluations to empirically test AI systems for capabilities that could threaten catastrophic harm to society.
Offices: Berkeley, CA, US
