Senior Staff Data Engineer Data Platform
You will build and operate the core data platform end to end, develop Java and Python services and pipelines, scale storage backends, maintain data quality and operational reliability, support data consumers, evolve platform infrastructure, and use AI tooling in development and data operations.
Responsibilities
- Build and operate end-to-end data pipelines
- Ingest data from exchange and venue APIs
- Develop streaming and batch processing
- Deliver data to storage
- Develop platform services, tooling and jobs in Java and Python
- Operate and scale Apache Iceberg, ClickHouse, MySQL and PostgreSQL backends
- Design schemas and tune performance
- Monitor pipelines and infrastructure
- Configure alerting and data-quality checks
- Perform backfills and incident response
- Support trading desks, quants and analytics users
- Provide query support and onboard schemas and sources
- Maintain client libraries
- Drive backend migrations and performance optimization
- Implement CI/CD on Kubernetes
- Onboard new data sources and venues
- Use AI coding assistants and LLM tooling
Requirements
- Bachelor's degree or above in Computer Science or a related field
- 3–8 years of software or data engineering experience
- Production skills in Java and/or Python
- Strong SQL skills
- Experience with MySQL, PostgreSQL, ClickHouse or a comparable columnar or time-series store
- Experience building and operating production data pipelines
- Experience integrating external REST and WebSocket APIs
- Operational mindset focused on data quality, monitoring, reproducibility, incident response and documentation
- Experience using AI coding assistants and LLMs
- Willingness to learn Rust and new storage technologies
- Strong communication skills
- Fluency in Chinese and English
Benefits
- L&D programs
- Education subsidy
- Team building programs
- Company events
- Wellness allowance
- Meal allowance
- Healthcare schemes for employees and dependants