Job Description
We are seeking a highly skilled Real-time Data Warehouse Engineer to lead the architecture design and core code development of our real-time data warehouse. The ideal candidate will build stable and efficient real-time data pipelines while ensuring seamless integration across internal business systems and external data sources (e.g., GA, AF). This role requires designing highly available real-time data services and APIs, establishing robust monitoring systems with alert mechanisms, and developing standard operating procedures for exception handling. A deep understanding of derivatives trading business will be essential to support core business applications with real-time data solutions.
Key Responsibilities
- Lead the architecture design and core development of real-time data warehouse solutions
- Build and optimize stable, high-performance real-time data pipelines
- Develop cross-system data integration solutions for both internal systems and external data sources
- Design and implement highly available real-time data services and APIs
- Establish comprehensive monitoring systems with effective alert mechanisms
- Develop standard operating procedures for exception handling and troubleshooting
- Support core business applications with real-time data solutions for derivatives trading
Job Requirements
- 5+ years of experience in big data development with strong theoretical knowledge and practical experience in real-time computing
- Expertise in Alibaba Cloud-based streaming architecture with deep understanding of Flink and Kafka
- Proven ability to handle high-concurrency, low-latency trading data with extensive experience in real-time data pipeline optimization
- Advanced skills in using and optimizing real-time data warehouses/analytical engines like Hologres
- Preferred experience with cryptocurrency exchanges (especially derivatives/contract trading) or traditional financial matching engines
- Strong independent problem-solving skills and ownership mentality to manage full lifecycle projects from requirements to deployment
Benefits
Remote work opportunity
