- Singapore Central Region (Singapore) Singapore
Full Time Data Engineer (ODIN) - 1608 Jobs, Salary up to SGD 8,000 in JOBSTER PRIVATE LTD. Central Region (Singapore) - Maukerja
Share
Save
Working Location
Job Description
Responsibilities
Data Pipeline & Interface Engineering: Develop and maintain ETL pipelines and file-based interfaces for ingesting HR data into ODIN, including data profiling, mapping, specifications and dataset onboarding
Data Transformation & Modelling: Build and maintain SQL and Python logic to cleanse, standardise, transform and reconcile HR data into reliable, reusable datasets, including historical and legacy data
Data Model & Dataset Maintenance: Enhance ODIN data models, tables and dependencies to meet new requirements, with traceable mappings, definitions and processing rules
System Enhancements & Testing: Support CRs and SRs by reviewing requirements, executing tests, validating outputs, documenting defects and resolving issues through implementation
Data Quality, Validation & Lineage: Automate validation, reconciliation and cleansing checks; investigate anomalies, trace lineage, resolve root causes and verify fixes
Pipeline Operations & Reliability: Monitor pipelines and interfaces, troubleshoot failures, perform reruns and improve reliability, performance, maintainability and operational documentation
Downstream Data Consumption: Develop governed datasets, Athena tables/views and queries, and Tableau data sources/workbooks for approved reporting and analytics needs
Technical Collaboration & Delivery: Translate stakeholder requirements into data mappings, transformation rules and technical solutions, while documenting decisions and supporting timely delivery
Audit & Governance Support: Provide technical evidence for audits, access reviews and assurance activities, and support required remediation
Requirements
Strong SQLand working knowledge ofPython
Experience in ETL, data pipelines, data transformation, data modelling and data quality
Hands-on experience with AWS S3 and Athena or similar cloud data platforms
Knowledge of data validation, reconciliation, lineage and troubleshooting
Experience with Tableau or BI tools is advantageous
Spark/Databricks experience is a plus
Data Transformation & Modelling: Build and maintain SQL and Python logic to cleanse, standardise, transform and reconcile HR data into reliable, reusable datasets, including historical and legacy data
Data Model & Dataset Maintenance: Enhance ODIN data models, tables and dependencies to meet new requirements, with traceable mappings, definitions and processing rules
System Enhancements & Testing: Support CRs and SRs by reviewing requirements, executing tests, validating outputs, documenting defects and resolving issues through implementation
Data Quality, Validation & Lineage: Automate validation, reconciliation and cleansing checks; investigate anomalies, trace lineage, resolve root causes and verify fixes
Pipeline Operations & Reliability: Monitor pipelines and interfaces, troubleshoot failures, perform reruns and improve reliability, performance, maintainability and operational documentation
Downstream Data Consumption: Develop governed datasets, Athena tables/views and queries, and Tableau data sources/workbooks for approved reporting and analytics needs
Technical Collaboration & Delivery: Translate stakeholder requirements into data mappings, transformation rules and technical solutions, while documenting decisions and supporting timely delivery
Audit & Governance Support: Provide technical evidence for audits, access reviews and assurance activities, and support required remediation
Requirements
Strong SQLand working knowledge ofPython
Experience in ETL, data pipelines, data transformation, data modelling and data quality
Hands-on experience with AWS S3 and Athena or similar cloud data platforms
Knowledge of data validation, reconciliation, lineage and troubleshooting
Experience with Tableau or BI tools is advantageous
Spark/Databricks experience is a plus
Important Information
Never provide your bank or credit card details when applying for jobs. Do not transfer any money or complete unrelated online surveys. If you see something suspicious, Report this Job ad.
Learn More