Sr. Staff Machine Learning Systems Engineer
- Build and scale data pipelines for ingestion transformation and dataset versioning
- Design adversarial and red team evaluation programs
- Design statistical regression testing methodology
- Implement labeling and calibration workflows
- Lead multi team initiatives for automated evaluation gates
- Mentor engineers and raise technical and statistical bar
- Own evaluation systems end to end
- Rearchitect evaluation and data pipeline systems for reliability
- Resolve cross team technical disagreements and drive alignment
- Set technical direction for evaluation metrics judge and scorer design
- Track and categorize evaluation failures over time
Perks/Benefits:
- 401k employer matching
- Company holidays
- Comprehensive health benefits
- Employee stock purchase program
- Offsite team retreats
- Parental leave
- Quarterly mental health days
- Unlimited PTO