Job Title : Senior Data Engineer
Experience : 7 to 10 Years
Location : Kuala Lumpur, Malaysia
Duration : 6 Months Contract (Extendable)
Role Overview:
We are looking for an experienced Senior Data Engineer to design, develop, and optimize scalable data pipelines and ETL workflows using AWS cloud technologies. The ideal candidate should possess strong expertise in big data processing, orchestration frameworks, and distributed data systems, with the ability to independently manage deployments and production changes.
Key Responsibilities:
- Design, develop, and maintain robust ETL pipelines and data workflows using AWS services.
- Build scalable and high-performance data processing solutions using PySpark.
- Develop and manage orchestration workflows using AWS Step Functions and related tools.
- Work with large-scale datasets while ensuring data quality, integrity, scalability, and performance optimization.
- Collaborate with business stakeholders and technical teams to gather requirements and deliver effective data solutions.
- Support migration and optimization initiatives involving Databricks.
- Implement automation and CI/CD practices for data engineering workflows.
- Deploy and manage production changes with strong ownership and accountability.
- Troubleshoot and optimize existing data pipelines and processing jobs.
Mandatory Skills:
- Strong hands-on experience with AWS data engineering services:
- AWS Glue
- Amazon S3
- AWS Lambda
- AWS Step Functions
- Strong expertise in PySpark for distributed data processing.
- Advanced SQL querying and performance tuning skills.
- Experience with data lake architectures and big data technologies.
- Experience in ETL pipeline development and workflow orchestration.
- Familiarity with CI/CD practices in data engineering environments.
- Ability to work independently in a fast-paced environment.
- Strong analytical and problem-solving skills.
Good to Have:
- Experience with Databricks.
- AWS Certifications such as:
- AWS Certified Data Analytics – Specialty
- AWS Solutions Architect
Preferred Candidate Profile:
- 7–10 years of relevant Data Engineering experience.
- Currently based in Kuala Lumpur, Malaysia preferred.
- Strong communication and stakeholder management skills.
- Self-driven professional with the ability to manage end-to-end delivery independently.
Pay: RM10,000.00 - RM18,000.00 per month
Work Location: In person