Data Engineer
Somerset - Fully Remote Role
Role Overview
You will work on a range of projects to data extraction, cleansing, transformation and modelling from case management systems, utilizing Microsoft Fabric. This role involves bringing data into Microsoft Fabric, building medallion architectures, and working across various projects including social care, revenue and benefits and a range of other projects. They will also be responsible for establishing and maintaining communication with relevant stakeholders to gather requirements and deliver effective solutions. Building and managing data pipelines, implementing CI/CD practices, and leveraging source control within Microsoft DevOps.
Key Responsibilities
Develop and maintain data pipelines to support reporting and analytics.
Ensure data quality and integrity throughout the data lifecycle.
Collaborate with stakeholders to understand data requirements and deliver solutions.
Implement and optimize medallion architectures within Microsoft Fabric.
Monitor and troubleshoot data pipelines to ensure seamless operation.
Provide technical expertise and support for data management initiatives.
Document data processes and workflows to facilitate knowledge sharing.
Necessary Skills and Abilities
Proficiency with Microsoft Fabric and medallion architectures.
Strong SQL and Python skills and experience with data integration tools.
Experience with data modelling and ETL processes.
Strong communication skills for effective collaboration with colleagues and stakeholders.