About Us
Asgard is a multiple award-winning local recruitment company specialising in connecting top talent with leading companies across the Tech, Banking, Financial Services, Insurance (BFSI), Oil & Gas, and Fast-Moving Consumer Goods (FMCG) sectors.
About the Role
We are looking for a passionate and skilled Data Engineer to build scalable big data platforms that power real-time decision-making, AI-driven automation, and smart industrial systems.
In this role, you will work closely with AI, IoT, and software engineering teams to design high-performance data pipelines, optimize large-scale processing systems, and improve operational efficiency through advanced analytics and cloud technologies.
This is an exciting opportunity to work on impactful technology that improves energy efficiency, enables real-time visibility, and supports intelligent automation in industrial environments.
Key Responsibilities
- Build, maintain, and optimize scalable big data pipelines handling high-volume sensor and operational data
- Design and support real-time data processing systems for live monitoring and analytics
- Develop low-latency streaming architectures using Kafka and Spark Streaming
- Implement cloud-based analytics and data solutions across AWS, Azure, or GCP environments
- Create automated data quality validation and monitoring frameworks
- Collaborate with AI Engineers, IoT Engineers, and Software Developers to support data ingestion and machine learning workflows
- Optimize processing performance, storage utilization, and infrastructure costs
- Monitor, troubleshoot, and improve system reliability, scalability, and efficiency
- Implement metadata management and maintain structured data governance practices
- Support dashboarding and reporting initiatives for operational insights and analytics
Requirements
- 3–6+ years of experience in Data Engineering, Big Data, or Data Infrastructure roles
- Strong hands-on experience with Spark, Python, and SQL
- Experience building ETL pipelines and large-scale distributed data processing systems
- Familiarity with Kafka, Spark Streaming, Delta Lakehouse, Databricks (DLT), and Azure Synapse
- Experience with cloud platforms such as AWS, Azure, or GCP
- Knowledge of data quality validation, schema management, and pipeline monitoring
- Experience with data visualization tools such as Apache Superset, Tableau, or Power BI
- Familiarity with Git version control and collaborative development workflows
- Strong analytical and problem-solving skills
- Ability to work in a fast-paced, cross-functional engineering environment
- Experience improving processing efficiency, system scalability, or infrastructure optimization is highly preferred
Pay: RM8,000.00 - RM15,000.00 per month
Benefits:
- Cell phone reimbursement
- Dental insurance
- Flexible schedule
- Maternity leave
Work Location: In person