- Jalan Stesen Sentral Bandar Kuala Lumpur WP Kuala Lumpur Malaysia 50470

Lokasi Kerja
Penerangan Kerja
Kelayakan
Big Data Development Engineer
Bachelor's degree or above in Computer Science or a related field.
2+ years of big data development experience; led 50TB+ data platform construction or core module refactoring projects.
Must-have: Proficient in Hadoop/Spark/Flink ecosystem; familiar with Kafka/Pulsar streaming architecture; proficient in SQL/Hive/Python/Java/Scala; experienced in Doris/StarRocks tuning.
Nice-to-have: Distributed system tuning (Spark Shuffle, Flink backpressure); data lake technologies (Iceberg/Delta Lake/Paimon); cloud-native big data (EMR/CDH operations, K8s scheduling).
Familiar with full-chain data scenarios in at least one vertical domain (logistics, e-commerce, telecommunications).
Able to translate business requirements into actionable data solutions.
Big Data Operations Engineer
Bachelor's degree or above in Computer Science or a related field.
2+ years of relevant experience; proficient in Linux principles, systems, and applications.
Deep understanding of mainstream big data open-source systems (Hadoop, Kafka, StarRocks, Flink, ClickHouse) — architecture, configuration, optimisation, deployment, and troubleshooting.
Proficient in at least one programming language: Python / Rust / Golang / Java, with Linux/Unix development experience.
Familiar with Alibaba Cloud big data products, especially StarRocks and Flink monitoring, scheduling, and troubleshooting.
Experience with Hadoop/Hive/Spark/Flink/HBase/Presto/ClickHouse operations is preferred.
Data governance experience is a plus; strong sense of responsibility and excellent communication skills.
Tanggungjawab
Big Data Development Engineer
Participate in the design and implementation of highly available, scalable big data architectures (Lambda/Kappa).
Optimise large-scale data processing performance (e.g., Spark tuning, Flink state backend optimisation).
Independently develop big data platform modules and resolve technical challenges in data pipelines.
Collaborate with data analysts and algorithm teams to provide efficient data interfaces and tooling.
Lead or participate in technical solution design, produce development documentation, and drive implementation.
Big Data Operations Engineer
Manage and develop automation tools for operations and deployment.
Handle requirements analysis, product design, coding, deployment, and maintenance for the data operations platform and its components.
Ensure data quality across collection and processing pipelines.
Manage daily operations, deploy and optimise production servers, and maintain technical documentation.
Manfaat
LRT - MASJID JAMEK
0.5 km
LRT - PLAZA RAKYAT
0.7 km
LRT - DANG WANGI
0.8 km
MRL - BUKIT NANAS
0.8 km
MRT - MERDEKA
0.9 km
LRT - BANDARAYA
0.9 km
KTM - BANK NEGARA
1.0 km
MRL - MEDAN TUANKU
1.0 km
MRT - PASAR SENI
1.1 km
LRT - PASAR SENI
1.1 km
MRL - RAJA CHULAN
1.1 km
MRT - BUKIT BINTANG
1.2 km
MRL - BUKIT BINTANG
1.2 km
MRL - HANG TUAH
1.2 km
MRL - IMBI
1.3 km
Peringatan Penting
Jangan pernah kongsikan maklumat bank atau kad kredit anda semasa memohon pekerjaan. Elakkan membuat sebarang pembayaran atau mengisi survey yang tidak berkaitan. Jika ada yang mencurigakan, sila laporkan iklan pekerjaan ini segera.