Senior QA Engineer, Agent Security
About Runlayer
AI is transforming how every company operates, but most enterprises are stuck. They want to move fast with AI Agents, tools, and workflows, but they can't do it safely. We're fixing that.
Our team built AI Actions for OpenAI, shipped Zapier Agents to millions of users, and launched the first remote MCP server with Anthropic. We helped establish the protocol, and now we're building the platform enterprises need to actually put AI to work.
Runlayer is one platform for MCPs, Skills, and Agents: purpose-built security, fine-grained governance, and complete observability so organizations can go all-in on AI across the entire company without the risk. We just raised a $30M Series A led by Felicis, with participation from Khosla Ventures, bringing our total raised to $42M. Already trusted by Gusto, Instacart, Opendoor, dbt Labs, and Decagon.
About the Role
You’ll own quality and testability for Runlayer Endpoint across macOS, Windows, Linux, enterprise device-management platforms, and AI clients.
This is a senior, hands-on engineering role combining exploratory testing, release qualification, and test-infrastructure development. You’ll build scalable, agent-driven testing systems for a complex cross-platform product and help ensure every release is reliable in real enterprise environments.
What You’ll Do
Own release testing and quality for Runlayer Endpoint
Build and operate a physical and virtual device lab
Design a scalable test strategy across platforms, configurations, clients, and product states
Automate installation, enrollment, configuration, upgrade, rollback, and removal flows
Test deployments through enterprise device-management platforms
Validate integrations with leading AI coding clients
Build agent-driven tooling that expands coverage, gathers evidence, and accelerates failure analysis
Integrate automated quality signals into CI and release workflows
Reproduce customer issues and turn confirmed incidents into permanent regression tests
Partner with engineers to improve product diagnostics, observability, and testability
Define testability and coverage standards for new platforms, clients, and features
What We’re Looking For
Senior-level experience owning QA automation or test infrastructure
Strong engineering skills in Python and system scripting such as Bash and PowerShell
Hands-on experience testing software across macOS, Windows, and Linux
Experience with endpoint management, MDM, device labs, or comparable fleet orchestration
Experience testing native installation, upgrades, background services, permissions, credentials, and OS configuration
Strong knowledge of integration, end-to-end, stateful, and combinatorial testing
Ability to distinguish product defects from infrastructure failures and flaky tests
Experience building reliable CI-driven systems with useful diagnostics and test artifacts
Clear technical judgment and excellent bug reporting
Bonus Qualifications
Experience with Intune, Jamf Pro, Kandji, SimpleMDM, Mosyle, or Workspace ONE
Experience testing endpoint-security or fleet-management products
Familiarity with MCP and AI coding clients
Experience building testing tools for AI agents
Experience with native packaging and signing on macOS, Windows, or Linux
Experience with fault injection, change-impact analysis, or combinatorial test generation
What We Offer
We provide a competitive package designed to attract and retain top talent who can work effectively with enterprise customers.
Competitive salary and equity — compensation that reflects your expertise and customer-facing responsibilities.
Paid time off — paid vacation, paid sick leave, and paid parental leave.
Professional development — budget for conferences, courses, and certifications in AI, enterprise software, and customer success.
Top-tier equipment — your choice of laptop and accessories to create your ideal work environment.
Health benefits — comprehensive health, dental, and vision coverage.
Customer interaction opportunities — work directly with innovative companies and see the immediate impact of your work.
Not quite the right fit? Reach out to [email protected] with details about your experience and interests.