Job Responsibilities:
- Real-Time Data Pipeline Development: Build, maintain, and optimize end-to-end data ingestion pipelines for business logs, user behavior data, and database records.
- Real-Time Data Warehouse Development: Design and optimize data warehouse architecture, streaming ETL processes, and real-time data models to support dashboards and business analytics.
- Streaming Technology Optimization: Manage and troubleshoot Kafka, Spark, and Flink pipelines to ensure data accuracy, low latency, high throughput, and system stability.
- Business Collaboration: Work closely with business teams, data analysts, and product managers to translate business requirements into data solutions.
- Data Quality and Governance: Establish data standards, quality monitoring, alerting mechanisms, and best practices to improve data reliability and development efficiency.
- Cloud Data Platform Management: Develop and maintain data solutions using cloud platforms and tools such as BigQuery, DBT, and Databricks.
- Operational Support: Troubleshoot production issues, optimize computing resources, and ensure reliable data delivery to BI dashboards, data services, and business performance measurement platforms.
Requirements:
. Bachelor’s degree or above in Computer Science, Software Engineering, Data Science, or related majors. 3+ years of professional big data development experience in the internet industry, with proven experience in end-to-end real-time data warehouse implementation and data ingestion system construction.
Pay: $7,000.00 - $17,000.00 per month
Work Location: In person