- Bedok East Region (Singapore) Singapore
Full Time Senior Data Engineer Jobs, Salary up to SGD 9,000 in Exceltech Computers Pte. Ltd. East Region (Singapore) - Maukerja
Share
Save
Working Location
Job Description
Responsibilities
Work location- Paya Lebar
Lead the design and operation of scalable batch and streaming data pipelines on AWS and Databricks using Python, PySpark, and SQL.
Build Bronze, Silver, and Gold layers in Delta Lake and develop reusable data models and curated datasets for analytics, reporting, and ML.
Integrate databases, files, APIs, and event streams using incremental loads and change data capture, with support for late-arriving data, backfills, and replay.
Enforce data contracts, schema validation, and reconciliation, and implement end-to-end lineage, encryption, and least-privilege access.
Orchestrate workflows with Databricks and AWS services, and automate testing and deployment across environments using Git, CI/CD, and Terraform.
Monitor pipeline health and data freshness, lead incident troubleshooting, and optimise Spark and SQL workloads for performance and cloud cost.
The Company's principal activity is manpower contracting services with other information technology and computer services.
Lead the design and operation of scalable batch and streaming data pipelines on AWS and Databricks using Python, PySpark, and SQL.
Build Bronze, Silver, and Gold layers in Delta Lake and develop reusable data models and curated datasets for analytics, reporting, and ML.
Integrate databases, files, APIs, and event streams using incremental loads and change data capture, with support for late-arriving data, backfills, and replay.
Enforce data contracts, schema validation, and reconciliation, and implement end-to-end lineage, encryption, and least-privilege access.
Orchestrate workflows with Databricks and AWS services, and automate testing and deployment across environments using Git, CI/CD, and Terraform.
Monitor pipeline health and data freshness, lead incident troubleshooting, and optimise Spark and SQL workloads for performance and cloud cost.
The Company's principal activity is manpower contracting services with other information technology and computer services.
Important Information
Never provide your bank or credit card details when applying for jobs. Do not transfer any money or complete unrelated online surveys. If you see something suspicious, Report this Job ad.
Learn More