Senior QA Engineer, Agent Security

Remote ok

About this role

About Runlayer


AI is transforming how every company operates, but most enterprises are stuck. They want to move fast with AI Agents, tools, and workflows, but they can't do it safely. We're fixing that.

Our team built AI Actions for OpenAI, shipped Zapier Agents to millions of users, and launched the first remote MCP server with Anthropic. We helped establish the protocol, and now we're building the platform enterprises need to actually put AI to work.

Runlayer is one platform for MCPs, Skills, and Agents: purpose-built security, fine-grained governance, and complete observability so organizations can go all-in on AI across the entire company without the risk. We just raised a $30M Series A led by Felicis, with participation from Khosla Ventures, bringing our total raised to $42M. Already trusted by Gusto, Instacart, Opendoor, dbt Labs, and Decagon.

About the Role

You’ll own quality and testability for Runlayer Endpoint across macOS, Windows, Linux, enterprise device-management platforms, and AI clients.

This is a senior, hands-on engineering role combining exploratory testing, release qualification, and test-infrastructure development. You’ll build scalable, agent-driven testing systems for a complex cross-platform product and help ensure every release is reliable in real enterprise environments.

What You’ll Do

  • Own release testing and quality for Runlayer Endpoint

  • Build and operate a physical and virtual device lab

  • Design a scalable test strategy across platforms, configurations, clients, and product states

  • Automate installation, enrollment, configuration, upgrade, rollback, and removal flows

  • Test deployments through enterprise device-management platforms

  • Validate integrations with leading AI coding clients

  • Build agent-driven tooling that expands coverage, gathers evidence, and accelerates failure analysis

  • Integrate automated quality signals into CI and release workflows

  • Reproduce customer issues and turn confirmed incidents into permanent regression tests

  • Partner with engineers to improve product diagnostics, observability, and testability

  • Define testability and coverage standards for new platforms, clients, and features

What We’re Looking For

  • Senior-level experience owning QA automation or test infrastructure

  • Strong engineering skills in Python and system scripting such as Bash and PowerShell

  • Hands-on experience testing software across macOS, Windows, and Linux

  • Experience with endpoint management, MDM, device labs, or comparable fleet orchestration

  • Experience testing native installation, upgrades, background services, permissions, credentials, and OS configuration

  • Strong knowledge of integration, end-to-end, stateful, and combinatorial testing

  • Ability to distinguish product defects from infrastructure failures and flaky tests

  • Experience building reliable CI-driven systems with useful diagnostics and test artifacts

  • Clear technical judgment and excellent bug reporting

Bonus Qualifications

  • Experience with Intune, Jamf Pro, Kandji, SimpleMDM, Mosyle, or Workspace ONE

  • Experience testing endpoint-security or fleet-management products

  • Familiarity with MCP and AI coding clients

  • Experience building testing tools for AI agents

  • Experience with native packaging and signing on macOS, Windows, or Linux

  • Experience with fault injection, change-impact analysis, or combinatorial test generation

What We Offer

We provide a competitive package designed to attract and retain top talent who can work effectively with enterprise customers.

  • Competitive salary and equity — compensation that reflects your expertise and customer-facing responsibilities.

  • Paid time off — paid vacation, paid sick leave, and paid parental leave.

  • Professional development — budget for conferences, courses, and certifications in AI, enterprise software, and customer success.

  • Top-tier equipment — your choice of laptop and accessories to create your ideal work environment.

  • Health benefits — comprehensive health, dental, and vision coverage.

  • Customer interaction opportunities — work directly with innovative companies and see the immediate impact of your work.

Not quite the right fit? Reach out to [email protected] with details about your experience and interests.

Company at a glance

The company builds an infrastructure layer that makes Model Context Protocol (MCP) enterprise-ready by providing a security and management platform that sits between AI agents and company systems and data. By addressing key enterprise challenges with MCP—including security, usability, and governance issues—the company enables organizations to safely deploy and manage AI agents at scale. The platform serves as a critical intermediary, ensuring that AI systems can access necessary resources while maintaining control, compliance, and protection over sensitive business information.

Founded2025
Team Size11-50
WorkspaceRemote ok
IndustrySaaS
Location
United States
LinkedInLinkedIn

Top Benefits

  • Competitive salary
  • Equity
  • Paid vacation
  • Paid sick leave
  • Paid parental leave
  • Professional development budget
  • Top-tier equipment
  • Health insurance
  • Dental coverage
  • Vision coverage

Tired of cold applications?

Sign up with Clera and we'll reach out the moment a role actually fits you — no more spraying applications into the void.

Know someone who'd be great for this?