Staff Software Engineer Data Engineering
You will set the technical direction for the Caspian Data Platform while remaining deeply hands-on. You will architect and build ingestion, transformation, governance, and data quality capabilities, define Databricks patterns, lead complex initiatives, develop AI systems for data engineering, establish quality standards, and mentor senior engineers.
Responsibilities
- Lead the design of ingestion, transformation, governance, and data quality platform pillars
- Build critical platform components
- Define engineering patterns and reference architectures for Databricks pipelines
- Ship production data flows and reference implementations
- Prototype complex technical components
- Establish data quality and governance standards
- Build data contracts, lineage, and validation frameworks
- Lead complex initiatives spanning multiple quarters and teams
- Direct the application of AI across data engineering
- Develop agentic systems, automated transformation generation, and conversational analytics interfaces
- Raise code quality and engineering judgment across the team
- Mentor senior engineers
Requirements
- 10+ years of data engineering experience
- Track record of architecting and operating data platforms at scale
- Deep mastery of Databricks, Delta Live Tables, Unity Catalog, Delta Lake, and Spark
- Experience owning ingestion, transformation, governance, and data quality across a production platform
- Expertise in SQL and Python
- Strong AWS experience operating data systems at scale
- Experience setting technical standards and engineering patterns
- Experience driving AI tooling into data engineering workflows
- Ability to influence through technical credibility and explain tradeoffs to engineers and leadership
Benefits
- Professional development budget
- Flexible in-office schedule
- Team offsites
- Team bonding activities
- Happy hours
- Competitive salary
- Bonuses
- Equity
- Physical healthcare
- Mental healthcare
- Retirement benefits
- Family-forming benefits
- Family support
- Employee giving match
- Mobile phone stipend
- R&R days
- Wellness reimbursement
- Vacation policy
- Parental leave
- Family planning benefits
- Catered lunches
- Stocked kitchens
- Premium snacks and beverages