Azure Data Engineer
- Salary: £48,341
- Location: Kirklees (Hybrid working, currently one day per month in the office, possibly moving to 1 day per week in the future)
- Job Type: Full-time
We are looking for an Azure Data Engineer to join our forward-thinking team at Kirklees Council. In this role, you will design, develop, and deliver data products and services that provide business intelligence, analytics, and insights across the Council, helping us to deliver innovative services to our communities.
Day to Day of the role:
- Contribute to the Data and Insight Service, supporting decision-makers with actionable insights.
- Collaborate within and between council services and partner organisations to enhance data capabilities.
- Lead the design, development, and implementation of automated data flows for analytics and business intelligence.
- Review and reengineer manual data flows to enable scalability and repeatability.
- Write optimal ETL and ELT scripts and code.
- Build accessible data models for analysis.
- Oversee database design, development, maintenance, and management.
- Design, develop, and maintain metadata repositories.
- Implement testing regimes to ensure the quality of data engineering work.
- Document source-to-target mappings.
- Engage with both technical and non-technical stakeholders to understand data engineering requirements.
- Apply best practices in data engineering and agile development methodologies.
- Mentor SQL Developers and deputise for the Data Engineering and Development Lead as needed.
Required Skills & Qualifications:
- Undergraduate degree with a strong data component (e.g., Computer Science, Engineering, Statistics) or equivalent experience.
- Advanced skills in SQL and experience with SQL Server Integration Services (SSIS).
- Experience with cloud-based technology and services, particularly in a Microsoft Azure environment.
- Proficiency in programming languages such as Python, C#, or Scala.
- Experience in implementing data standards and data quality rules at scale.
- Knowledge of Continuous Integration (CI) and Continuous Deployment (CD).
- Ability to reverse-engineer data models and design metadata repositories.
- Experience in documenting source-to-target mappings.
- Skilled in developing automated data flows that are scalable.
- Experience with various data types and structures.
- Agile development experience or willingness to work in an agile manner.
- Knowledge of local government functions and services.
- Commitment to personal and professional development.
- Ability to work with confidentiality and take on line-management responsibilities.
Benefits:
- Competitive salary.
- Opportunities for professional development and training.
- Work in a role that has a direct impact on community services.
- Supportive and innovative work environment.
To apply for the Azure Data Engineer position, please submit your CV and cover letter detailing your relevant experience and why you are interested in this role