Kerja Sepenuh Masa, Data Engineer di TIVORA LABS Selangor - Maukerja

Company Description TIVORA LABS is a technology-focused organization dedicated to building data-driven solutions that support business decision-making and innovation. The team works with modern data platforms and analytics tools to transform raw information into actionable insights for internal and external stakeholders. TIVORA LABS values technical excellence, collaborative problem-solving, and continuous learning in a dynamic environment. The company offers opportunities to work with complex datasets, scalable architectures, and emerging technologies. Team members are encouraged to contribute ideas, improve processes, and grow their skills in data and engineering disciplines.

Job Scope: Data Engineer (ETL Mapping Design)

Purpose

The Data Engineer is responsible for reviewing the approved User Requirements Study (URS) and Data Warehouse Design (DWD) documents and producing a comprehensive ETL Mapping Design Document for an Oracle Exadata Data Warehouse environment.

The ETL Mapping Design will serve as the technical specification for ETL developers to build data integration processes that load, transform, validate, and maintain data within the Oracle Exadata Data Warehouse.

⸻

Key Responsibilities

1. Requirements & Design Analysis

* Review and understand the approved User Requirements Study (URS) to identify:

    * Business requirements

    * Reporting requirements

    * Data transformation logic

* Review the approved Data Warehouse Design (DWD), including:

    * Dimensional models

    * Fact tables

    * Dimension tables

    * Data relationships

    * Target schemas

* Understand:

    * Source systems

    * Source data structures

    * Data extraction requirements

⸻

2. ETL Mapping Design

Develop a detailed ETL Mapping Design Document based on the approved URS and DWD.

Source-to-Target Mapping

* Produce comprehensive source-to-target mapping specifications.

* Define field-level mappings between source systems and Oracle Exadata target tables.

Transformation Rules

Document:

* Business rules

* Transformation logic

* Derivation rules

* Lookup logic

* Default values

Data Processing Rules

Define:

* Data cleansing rules

* Data standardization

* Deduplication rules

* Data enrichment logic

Dimension & Key Management

Specify:

* Surrogate key generation

* Dimension loading strategies:

    * Slowly Changing Dimension (SCD) Type 1

    * SCD Type 2

    * Other applicable strategies

Data Loading Strategy

Define:

* Full load approach

* Incremental load approach

* Change Data Capture (CDC) methodology

Controls & Exception Handling

Document:

* Exception handling

* Reject processing

* Audit logging

* Restart and recovery mechanisms

* Data reconciliation requirements

Data Quality

Define:

* Data quality validation rules

* Control checks

⸻

3. Oracle Exadata Considerations

Ensure the ETL Mapping Design aligns with Oracle Exadata architecture and best practices.

Responsibilities include:

* Designing ETL mappings optimized for Oracle Exadata performance.

* Supporting efficient partition loading where applicable.

* Ensuring compatibility with:

    * Oracle database objects

    * Constraints

    * Indexes

    * Partitioning strategies defined in the DWD

* Considering Oracle-specific data types and performance optimization during mapping.

⸻

4. Collaboration & Documentation

* Identify and resolve gaps, inconsistencies, or ambiguities between:

    * URS

    * DWD

    * Source systems

* Collaborate with:

    * Business Analysts

    * Data Architects

    * Database Administrators (DBAs)

    * Business users

* Participate in design walkthroughs.

* Obtain stakeholder approval for the ETL Mapping Design.

* Provide technical clarification and support to ETL developers during implementation.

⸻

5. Testing Support

Support both System Integration Testing (SIT) and User Acceptance Testing (UAT) by:

* Validating ETL mappings.

* Verifying that implemented ETL processes conform to approved mapping specifications.

* Assisting in resolving mapping-related defects identified during testing.

⸻

Deliverables

The Data Engineer is expected to produce:

* ETL Mapping Design Document

* Source-to-Target Mapping Matrix

* Transformation Rules Specification

* Data Validation & Reconciliation Rules

* Data Quality Rules Documentation

* ETL Design Review & Sign-off Documents

⸻

Required Skills & Experience

Technical Skills

* Strong experience in Data Warehousing and ETL Design.

* Experience working with Oracle Exadata Data Warehouse environments.

* Strong SQL and Oracle Database expertise.

* Good understanding of Oracle performance optimization, including:

    * Partitioning

    * Indexing

    * Parallel processing

* Experience with ETL tools such as:

    * Oracle Data Integrator (ODI)

    * Informatica PowerCenter

    * IBM DataStage

    * Talend

    * Or equivalent ETL platforms

* Strong understanding of:

    * Star Schema

    * Snowflake Schema

* Experience preparing detailed ETL Mapping Design documentation.

Soft Skills

* Excellent analytical and problem-solving skills.

* Strong documentation capabilities.

* Effective communication skills.

• * Good stakeholder management and collaboration skills.