About the Role
We are looking for a highly experienced Data Engineer to support the PM Dashboard project. This role combines hands-on data engineering, data architecture, technical coordination and stakeholder management.
The successful candidate will design and develop scalable data solutions within the Azure ecosystem, support Power BI reporting and coordinate technical activities across data engineering teams.
Key Responsibilities
- Design, develop and maintain scalable data engineering and data architecture solutions.
- Build and optimise data pipelines using Azure Databricks, Azure Data Factory (ADF) and ADLS.
- Develop data transformation and integration processes using SQL and Python.
- Design and maintain data models, data warehouses and enterprise data platforms.
- Develop and maintain Power BI reports and dashboards.
- Translate business requirements into effective technical data solutions.
- Lead and coordinate technical activities across data engineering teams.
- Work closely with project managers, business stakeholders, architects and technical teams.
- Manage technical dependencies, priorities and project delivery timelines.
- Develop and maintain CI/CD pipelines using Azure DevOps and GitHub Actions.
- Monitor and troubleshoot data pipelines and resolve data quality or performance issues.
- Implement secure and scalable solutions using Azure services such as Entra ID, ADLS and Key Vault.
- Optimise data architecture, pipeline performance and cloud resource utilisation.
- Participate in Agile/Scrum ceremonies and technical discussions.
- Provide technical guidance, mentoring and knowledge sharing to team members.
- Prepare technical documentation, architecture documentation and project reports.
Must-Have Requirements
- Minimum 10 years of overall IT/Data Engineering experience.
- 7+ years of Power BI experience.
- 7+ years of Azure Databricks experience.
- 4+ years of Data Architecture experience.
- Strong hands-on experience with:
- Azure Databricks
- Power BI
- Azure Data Factory
- ADLS
- SQL
- Python
- Strong understanding of data architecture, data modelling and data warehouse concepts.
- Experience with Azure DevOps and/or GitHub Actions.
- Experience with APIs and data integration.
- Strong experience working with technical and business stakeholders.
- Proven ability to lead and coordinate data engineering teams.
- Good understanding of Agile/Scrum methodologies.
- Strong analytical, troubleshooting and problem-solving skills.
Work Location: In person