Ingestion Pipeline Ownership: Own the lifecycle development of real-time collection, cleaning, and warehousing of business logs, user behavior data, and database operational logs to guarantee pipeline stability, completeness, and low latency.
Real-Time Data Warehouse Architecture: Design multi-layer real-time data models, build and tune streaming ETL pipelines, and support continuous delivery of real-time business metrics and analytics.
Kafka & Streaming Optimization: Maintain and optimize core Kafka streaming infrastructure. Diagnose and resolve online challenges including message backlogs, data skew, message loss, duplication, and partition tuning....