Principal AI SoC Runtime Software Architect
You will own the software architecture for a heterogeneous AI SoC and define the end-to-end runtime across sensor ingest, preprocessing, AI inference, postprocessing, and application delivery. You will coordinate workloads and data movement across CPU cores, AI accelerators, vision and multimedia engines, and embedded processors. You will establish memory-sharing, synchronization, API, observability, resilience, and recovery architectures while providing hands-on technical leadership across runtime, kernel, driver, firmware, multimedia, and SDK development.
Responsibilities
- Define the SoC-wide execution model for coordinating workloads across heterogeneous compute and media engines
- Set the architecture and technical direction for the AI inference runtime
- Own the end-to-end dataflow architecture for sensor-to-application pipelines
- Define the SoC-wide memory and buffer-sharing architecture across user space, the kernel, and hardware engines
- Define interface contracts among the runtime, kernel drivers, firmware, and hardware engines
- Partner with the compiler team to define the compiler-runtime contract
- Establish system-wide observability and performance architecture
- Define runtime resilience and validation architecture
Requirements
- Extensive experience designing and building production runtime systems, embedded middleware, multimedia frameworks, or performance-critical systems software
- Strong C/C++ programming skills
- Experience architecting production runtime software across application-facing APIs, user-space libraries, drivers, firmware, and hardware interfaces
- Understanding of heterogeneous and asynchronous execution, command submission, queues, events, dependencies, synchronization, concurrency, scheduling, and resource management
- Understanding of device memory, DMA, IOMMU/SMMU, cache coherency, memory mapping, shared buffers, buffer lifetimes, and kernel/user-space memory interfaces
- Experience optimizing data movement and execution across multiple hardware engines
- Experience designing stable runtime APIs with compatibility, versioning, error handling, diagnostics, and recovery behavior
- Ability to debug cross-layer correctness and performance problems using profiling and tracing
- Technical leadership across component and organizational boundaries
Benefits
- Medical coverage
- Dental coverage
- Vision coverage
- Paid time off
- Flexible work arrangements