Job Description:
Job Title: Data Engineer
Job Type: Hybrid
Role Overview:
The Data Engineer will work on a range of projects to data extraction, cleansing, transformation and modelling from case management systems, utilizing Microsoft Fabric. This role involves bringing data into Microsoft Fabric, building medallion architectures, and working across various projects including social care, revenue and benefits and a range of other projects. They will also be responsible for establishing and maintaining communication with relevant stakeholders to gather requirements and deliver effective solutions. Building and managing data pipelines, implementing CI/CD practices, and leveraging source control within Microsoft DevOps.
Responsibilities:
- Develop and maintain data pipelines to support reporting and analytics.
- Ensure data quality and integrity throughout the data lifecycle.
- Collaborate with stakeholders to understand data requirements and deliver solutions.
- Implement and optimize medallion architectures within Microsoft Fabric.
- Monitor and troubleshoot data pipelines to ensure seamless operation.
- Provide technical expertise and support for data management initiatives.
- Document data processes and workflows to facilitate knowledge sharing.
Skills and Abilities
- Proficiency with Microsoft Fabric and medallion architectures.
- Strong SQL and Python skills and experience with data integration tools.
- Experience with data modelling and ETL processes.
- Strong communication skills for effective collaboration with colleagues and stakeholders.
- Commitment to ethical practices and the security of personal data.
Behaviours:
- Proactive and self-motivated with a strong work ethic.
- Collaborative mindset with a focus on team success.
- Adaptable and flexible in a dynamic work environment.
- Detail-oriented with a commitment to delivering high-quality work.