Full Time Senior Data Engineer (Python - SQL - ETL) (2 Year Contract) Jobs, in Rhino Partners - Maukerja

Rhino Partners is seeking an experienced Senior Data Engineer to lead the design, development, and modernisation of data engineering solutions supporting large-scale statistical and analytical processes.

The successful candidate will work closely with business stakeholders, statisticians, and technical teams to build scalable, reliable, and maintainable data pipelines. The role involves modernising legacy processes, ensuring data accuracy and consistency, and providing technical leadership to the engineering team.

• Lead the architecture, design, development, and implementation of scalable ETL processes, data pipelines, and integration workflows across multiple data sources.
• Develop and optimise large-scale batch and real-time data processing solutions, ensuring reliability, performance, and operational efficiency.
• Modernise legacy data processing systems while preserving existing business logic and ensuring accurate reconciliation of outputs.
• Design and optimise database schemas, data models, and storage structures for large-scale datasets.
• Develop reusable Python libraries, configuration frameworks, logging utilities, and common engineering components to improve development efficiency.
• Implement CI/CD pipelines and automated testing and deployment processes across Development, UAT, and Production environments.
• Design and manage complex data workflow scheduling, orchestration, dependency management, and failure recovery.
• Establish GitLab version control practices, conduct code reviews, and maintain technical documentation and engineering standards.
• Troubleshoot production issues, perform root cause analysis, and implement improvements to enhance system performance and reliability.
• Provide technical guidance and mentorship to data engineers on solution design, coding practices, and implementation approaches.
• Collaborate with business users, statisticians, and technical stakeholders to translate complex requirements into robust engineering solutions.

• 7 years of professional experience in data engineering, data platform development, or related software engineering roles.
• Strong proficiency in Python and SQL, including complex data transformations, processing logic, and performance optimisation.
• Solid experience in ETL/ELT development, batch processing, data integration, and data pipeline architecture.
• Strong working knowledge of Linux/Unix environments, shell scripting, and command-line tools.
• Experience designing and implementing scalable, production-grade data engineering solutions.
• Strong understanding of software engineering best practices, including modular design, configuration management, logging, exception handling, and automated testing.
• Hands-on experience with Git/GitLab, branching strategies, merge requests, code reviews, and CI/CD pipelines.
• Experience in data pipeline orchestration, workflow scheduling, dependency management, and operational monitoring.
• Proven ability to lead technical design discussions, conduct code reviews, and mentor junior engineers.
• Experience with legacy system migration, process modernisation, and data reconciliation.
• Strong analytical, troubleshooting, and communication skills, with the ability to work effectively with technical and business stakeholders.

• Experience with cloud data platforms and cloud-based data engineering solutions.
• Familiarity with enterprise workflow orchestration and CI/CD tools.
• Experience working with large-scale statistical datasets or statistical production systems.
• Exposure to data quality frameworks, automated validation, and reconciliation processes.