- Bedok East Region (Singapore) Singapore
Kerja Sepenuh Masa Senior Data Engineer, Gaji tinggi SGD 9,000 di Exceltech Computers Pte. Ltd. East Region (Singapore) - Maukerja
Kongsi
Simpan
Lokasi Kerja
Penerangan Kerja
Tanggungjawab
Work location- Paya Lebar
Lead the design and operation of scalable batch and streaming data pipelines on AWS and Databricks using Python, PySpark, and SQL.
Build Bronze, Silver, and Gold layers in Delta Lake and develop reusable data models and curated datasets for analytics, reporting, and ML.
Integrate databases, files, APIs, and event streams using incremental loads and change data capture, with support for late-arriving data, backfills, and replay.
Enforce data contracts, schema validation, and reconciliation, and implement end-to-end lineage, encryption, and least-privilege access.
Orchestrate workflows with Databricks and AWS services, and automate testing and deployment across environments using Git, CI/CD, and Terraform.
Monitor pipeline health and data freshness, lead incident troubleshooting, and optimise Spark and SQL workloads for performance and cloud cost.
The Company's principal activity is manpower contracting services with other information technology and computer services.
Lead the design and operation of scalable batch and streaming data pipelines on AWS and Databricks using Python, PySpark, and SQL.
Build Bronze, Silver, and Gold layers in Delta Lake and develop reusable data models and curated datasets for analytics, reporting, and ML.
Integrate databases, files, APIs, and event streams using incremental loads and change data capture, with support for late-arriving data, backfills, and replay.
Enforce data contracts, schema validation, and reconciliation, and implement end-to-end lineage, encryption, and least-privilege access.
Orchestrate workflows with Databricks and AWS services, and automate testing and deployment across environments using Git, CI/CD, and Terraform.
Monitor pipeline health and data freshness, lead incident troubleshooting, and optimise Spark and SQL workloads for performance and cloud cost.
The Company's principal activity is manpower contracting services with other information technology and computer services.
Peringatan Penting
Jangan pernah kongsikan maklumat bank atau kad kredit anda semasa memohon pekerjaan. Elakkan membuat sebarang pembayaran atau mengisi survey yang tidak berkaitan. Jika ada yang mencurigakan, sila laporkan iklan pekerjaan ini segera.
Lebih Lanjut