jobs in DCI CONSULTANTS PRIVATE LIMITED

Kerja Sepenuh Masa 21. Data Engineer (Senior) - KT, Gaji tinggi SGD 7,000 di DCI CONSULTANTS PRIVATE LIMITED Islandwide (Singapore) - Maukerja

21. Data Engineer (Senior) - KT

DCI CONSULTANTS PRIVATE LIMITED

Islandwide (Singapore)

Kongsi
Simpan

Lokasi Kerja

  • Islandwide (Singapore) Singapore

Penerangan Kerja

Tanggungjawab

Mandatory Requirements 

• 5–8 years of data engineering experience, including building and deploying large-scale data systems 

• Strong hands-on experience designing batch and streaming pipelines using Apache Spark, Apache Flink and Apache Kafka 

• Proficiency in Java or Scala for distributed data processing, together with SQL 

• Experience deploying and scaling data workloads in containerised Kubernetes environments

 • Experience with S3-compatible object storage, data-quality controls, schema and lineage management, checkpointing and recovery, GitLab and CI/CD practices 

Preferred Requirements 

• Experience working within the SAFe framework 

• Experience developing data solutions for safety-critical and mission-critical systems 

• Experience with MinIO or equivalent S3-compatible object storage; schema and lineage design; data-quality checks; metadata preservation; bronze/silver/gold layered processing; and data-integrity controls including erasure coding, checksums, bit-rot protection, background healing and strong consistency 

• Experience implementing checkpointing and recovery across hot and cold reboots, retention and lifecycle controls for the contracted retention period, high availability, backup and recovery, and operational/disaster-recovery deployment with inter-site synchronisation 

Equivalent Technologies 

• Equivalent large-scale batch or stream-processing frameworks may be considered where the candidate demonstrates transferable distributed-data-system experience; Apache Airflow or an equivalent workflow-orchestration platform and other S3-compatible object stores remain relevant supporting technologies 

**We regret to inform that only shortlisted candidates will be notified. Personal data collected will be used for recruitment purposes**

Peringatan Penting

Jangan pernah kongsikan maklumat bank atau kad kredit anda semasa memohon pekerjaan. Elakkan membuat sebarang pembayaran atau mengisi survey yang tidak berkaitan. Jika ada yang mencurigakan, sila laporkan iklan pekerjaan ini segera.

Lebih Lanjut