Sepenuh Masa ETL Operation Jobs, in Reliable Business Technologies Kuala Lumpur - Maukerja

Job Purpose

The ETL Operations is responsible for ensuring the stability, reliability, and timely delivery of enterprise data pipelines and batch processing environments. This role oversees end-to-end ETL operations, including monitoring, incident resolution, and performance optimization of data workflows. The incumbent drives operational excellence, enforces data governance standards, and collaborates with data engineering, platform, and business teams to ensure data availability and accuracy for critical business functions.

Key Responsibilities

1. ETL Operations & Batch Management

• Oversee daily ETL batch cycles, ensuring successful execution within defined SLA timelines

• Monitor job pipelines (ETL, ingestion, transformation) across multiple systems

• Manage job dependencies, reruns, and recovery processes during failures

• Ensure timely delivery of data warehouse outputs (e.g., month-end, regulatory reporting)
  

2. Incident & Problem Management

• Lead resolution of ETL and batch-related failures, including root cause analysis (RCA)

• Drive reduction of recurring incidents through permanent fixes and automation

• Coordinate with upstream/downstream teams to mitigate data pipeline disruptions

• Maintain production stability and minimize business impact
  

3. Data Quality & Integrity Assurance

• Implement validation checks and reconciliation processes

• Work with Data Management and Business teams to address data discrepancies

• Ensure completeness, accuracy, and consistency of data across pipelines

• Enforce data governance and audit requirements 4. SLA & Performance Management

• Ensure ETL job completion within defined SLA / batch window

• Optimize ETL performance (query tuning, job parallelism, resource allocation)

• Track and report operational KPIs (failure rates, SLA breaches, processing time)

• Drive continuous improvements in pipeline efficiency
  

4. SLA & Performance Management

• Ensure ETL job completion within defined SLA / batch window

• Optimize ETL performance (query tuning, job parallelism, resource allocation)

• Track and report operational KPIs (failure rates, SLA breaches, processing time)

• Drive continuous improvements in pipeline efficiency

5. Automation & Continuous Improvement

• Identify opportunities to automate manual operational tasks (e.g., reruns, monitoring alerts, reporting)

• Develop scripts (bash, SQL, scheduling tools) to improve operational efficiency

• Standardize runbooks and operational procedures

• Reduce dependency on manual intervention and tribal knowledge Restricted

6. Stakeholder Management & Communication

• Act as primary liaison for ETL operations with Data Engineering, Platform, and Business teams

• Provide timely updates during major incidents and batch delays

• Support business-critical cycles (e.g., month-end processing, regulatory deadlines)

• Prepare operational reports and dashboards for management

7. Risk, Control & Compliance

• Ensure adherence to data governance, audit, and compliance requirements

• Maintain proper controls over production data processing

• Support audit activities with required documentation and evidence

• Identify and mitigate operational risks in ETL processes

8. Team Leadership & Knowledge Management

• Lead and mentor ETL operations team members

• Build strong documentation (runbooks, job inventory, dependency mapping)

• Enable faster onboarding through structured knowledge sharing

• Drive operational discipline and accountability within the team Key Deliverables / Success Metrics

• ETL batch success rate (%)

• SLA adherence (on-time batch completion)

• Reduction in recurring failures

• Mean Time to Resolution (MTTR)

• Data quality issue reduction

• Automation coverage (% of manual tasks eliminated)

Required Skills & Experience Technical Expertise

• Strong experience with ETL tools / frameworks (e.g., Informatica, Nifi, or similar)

• Hands-on with SQL, data warehousing, and performance tuning

• Experience in batch scheduling tools and job orchestration

• Knowledge of databases (Teradata, CDH Hadoop, CDP Hadoop, Spark, pyspark etc.)

• Scripting (bash, shell) for automation Operational & Analytical Skills

• Strong troubleshooting and root cause analysis capabilities

• Experience managing production support (L2/L3)

• Understanding of data lineage and dependency management

• Ability to work under tight batch timelines and business-critical cycles Leadership & Stakeholder Management

• Experience leading production operations teams

• Strong communication and incident management skills

• Ability to manage cross-team dependencies effectively