Engineering Manager AI Platform Managed AI

You will lead and scale a team of engineers building a platform for the full lifecycle of large language models. You will guide the design and implementation of scalable, fault-tolerant infrastructure, shape the engineering roadmap, oversee core AI services, drive project execution, and collaborate with product, infrastructure, and go-to-market stakeholders.

Responsibilities

• Lead, mentor, and grow a team of software engineers
• Partner with leadership to define and execute the AI roadmap
• Oversee the architecture and development of core AI services
• Ensure delivery of scalable systems capable of handling millions of API requests per second
• Deliver an AI platform that supports training and agentic execution infrastructure
• Work cross-functionally with product, infrastructure, and go-to-market stakeholders
• Represent engineering in strategic discussions
• Promote knowledge sharing, technical mentorship, and evolving engineering processes

Requirements

• 5+ years managing or leading high-performing engineering teams
• Experience with distributed and concurrent systems or AI infrastructure
• Deep knowledge of cloud-native environments, container orchestration, and service-oriented architectures
• Familiarity with CPU and GPU performance, inference frameworks, or large language model systems
• Experience owning deliverables from design through production
• Experience in fast-paced startup or growth-stage environments
• Proficiency in Python, Go, or Rust
• Experience with Kubernetes, gRPC, and observability stacks
• Familiarity with open-source AI ecosystems such as vLLM, Hugging Face, or Triton

Benefits

• Competitive compensation and equity packages
• Restricted Stock Units
• Paid time off
• Paid holidays
• Leave of absence programs
• Comprehensive health insurance
• Dental insurance
• Vision insurance
• Employer contributions to HSA account
• Paid parental leave
• Paid life insurance
• Short-term disability insurance
• Long-term disability insurance
• Professional development
• Tuition reimbursement
• Mental health and wellness support
• Commuter benefits
• Cell phone stipend
• 401(k) retirement plan with company match up to 4% of salary
• Volunteer time off
• Global travel insurance and emergency assistance
• Daily meals allowance
• Additional location-specific perks and programs