About the Role
We are looking for a highly experienced Data Engineer to join the MB.CO Static Sales Steering project. The role focuses on building scalable data solutions within the Microsoft Azure ecosystem, developing data pipelines and Power BI reporting, and supporting data architecture initiatives.
The ideal candidate should have strong hands-on experience in Azure Databricks, Power BI, SQL, Python and Azure data services, together with a solid background in data architecture.
Key Responsibilities
- Design, develop and maintain scalable data engineering solutions on Azure.
- Build and optimise data pipelines using Azure Databricks, Azure Data Factory (ADF) and ADLS.
- Develop data transformation and integration processes using SQL and Python.
- Design and implement data architecture and data models based on business requirements.
- Develop and maintain Power BI reports and dashboards.
- Integrate data and applications through APIs and other integration solutions.
- Develop and maintain CI/CD pipelines using Azure DevOps and GitHub Actions.
- Work with Azure services including Entra ID, ADLS and Key Vault.
- Monitor, troubleshoot and optimise data pipelines and cloud solutions.
- Perform performance and cost optimisation across data platforms.
- Work closely with business stakeholders, architects and technical teams to understand requirements.
- Participate in Agile/Scrum ceremonies and project activities.
- Maintain technical documentation and follow data engineering best practices.
- Continuously improve data platforms, processes and reporting solutions.
Must-Have Requirements
- Minimum 10 years of overall IT/Data Engineering experience.
- 7+ years of Power BI experience.
- 7+ years of Azure Databricks experience.
- 5+ years of Data Architecture experience.
- Strong hands-on experience with:
- Azure Databricks
- Power BI
- Azure Data Factory
- ADLS
- SQL
- Python
- Strong understanding of data architecture, data modelling and data warehouse concepts.
- Experience with Azure DevOps and/or GitHub Actions.
- Experience with APIs and data integration.
- Good understanding of Agile/Scrum methodologies.
- Strong analytical, troubleshooting and problem-solving skills.
- Good communication and stakeholder management skills.
Work Location: In person