Role Description
Build reliable data integration, storage, and modelling solutions that support reporting and analytics. Translate business requirements into maintainable pipelines, warehouse structures, and data models, ensuring information is accurate, traceable, and accessible to authorized users.
Key Responsibilities
- Gather data requirements and assess source systems, structures, and dependencies.
- Design and maintain data transformations and source-to-target mappings.
- Validate data for completeness, accuracy, consistency, and reconciliation.
- Implement incremental processing, error handling, logging, and recovery mechanisms.
- Optimize data processing, storage, and query performance.
- Apply appropriate access controls and sensitive data handling practices.
- Maintain documentation covering schemas, business rules, lineage, and operational procedures.
- Use version control, testing, and controlled deployment processes.
- Investigate pipeline failures and data discrepancies with relevant teams.
- Coordinate changes with source-system owners, analysts, and application developers.
- Monitor capacity, reliability, and operating costs.
- Support migrations, enhancements, and ongoing technical improvements.
Role-Specific Responsibilities
- ETL Developer: Develop extraction, transformation, and loading workflows, including ELT where appropriate. Manage orchestration, dependencies, scheduling, and operational monitoring.
- Data Warehouse Developer: Build warehouse tables, staging layers, dimensional structures, and reporting datasets. Implement historical tracking, workload optimization, and reliable refresh processes.
- Data Modeller: Develop conceptual, logical, and physical models. Define entities, relationships, keys, grain, and naming standards in collaboration with business and technical stakeholders.
Qualifications
- Relevant experience in data integration, warehouse development, database development, data modelling, or a related field.
- Strong SQL skills and understanding of relational databases.
- Knowledge of data transformation, dimensional modelling, and data quality principles.
- Experience with relevant integration tools, databases, or cloud data platforms.
- Strong analytical, troubleshooting, and problem-solving skills.
- Ability to translate business definitions into clear technical specifications.
- Familiarity with testing, version control, and deployment practices.
- Clear documentation and effective cross-functional communication skills.
- A degree in computer science, information systems, engineering, analytics, or a related field, or equivalent practical experience.
- ETL Developer: Experience with workflow orchestration, incremental loads, and failure recovery.
- Data Warehouse Developer: Experience with warehouse architecture, historical data management, and performance tuning.
- Data Modeller: Experience facilitating modelling discussions and maintaining consistent models across business domains.
Preferred Qualifications
- Proficiency in Python or another language used for data processing and automation.
- Experience with distributed processing, change data capture, or streaming integration.
- Familiarity with data catalogs, lineage tools, and metadata management.
- Experience implementing automated data tests and deployment pipelines.
- Knowledge of cloud cost optimization and workload management.
- Relevant database, integration, or cloud platform certifications.
Scope by Role
- ETL Developer: Owns the movement and transformation of data between systems.
- Data Warehouse Developer: Owns warehouse structures and processing capabilities that support analytical use.
- Data Modeller: Owns the structural representation of data and its alignment with agreed business meaning.