Perform ETL (Extract, Transform, Load) processes on large and complex transaction datasets to support business reporting, modelling, and analytical needs.
Design, build and enhance enterprise data platforms, including Data Lakes, Data Warehouses, data pipelines and analytics solutions that power business decisions across the organisation.
Our data ecosystem will be migrating their products from Azure to AWS. Data Engineers needed to assist with new and current pipelines. All IT equipment are provided and it is the responsibilities of consultants to ensure the security of the organization's data and applications.
Collaborate with internal and external stakeholders to identify and acquire relevant data sources for AI/ML projects, leveraging on both structured and unstructured data to enrich the organization’s data assets.
Design, implement, and maintain scalable data pipelines using the Databricks Lakehouse Platform using technologies such as Apache Spark and Delta Lake.
Experienced professional with strong expertise in back-end development and data analytics. Proficient in Python, and SQL, with hands-on experience in cloud-native development on Azure and Infrastructure as Code (IaC) using Terraform Enterprise.
Perform ETL (Extract, Transform, Load) processes on large and complex transaction datasets to support business reporting, modelling, and analytical needs.
Perform ETL (Extract, Transform, Load) processes on large and complex transaction datasets to support business reporting, modelling, and analytical needs.
Perform ETL (Extract, Transform, Load) processes on large and complex transaction datasets to support business reporting, modelling, and analytical needs.
Perform ETL (Extract, Transform, Load) processes on large and complex transaction datasets to support business reporting, modelling, and analytical needs.
Perform ETL (Extract, Transform, Load) processes on large and complex transaction datasets to support business reporting, modelling, and analytical needs.
Perform ETL (Extract, Transform, Load) processes on large and complex transaction datasets to support business reporting, modelling, and analytical needs.
Perform ETL (Extract, Transform, Load) processes on large and complex transaction datasets to support business reporting, modelling, and analytical needs.
Perform ETL (Extract, Transform, Load) processes on large and complex transaction datasets to support business reporting, modelling, and analytical needs.