Job Title: Lead Data Engineer
?? Daily rate: Up to £600 inside IR35
?? Flexible working: 2 days in London office, 3 days work from home
?? Contract: 6 months
?? Please note: SC Clearance is required for this position. ??
About Our Client: Our client is a leading organisation within the central government, dedicated to leveraging data-driven insights to support decision-making and optimise performance. With a focus on innovation and collaboration, they are reshaping the way data is utilised to drive positive change.
About The Job: We are seeking an experienced and collaborative Lead Data Engineer to join our client's team and oversee the integration of additional microservice data onto their Analytical Platform. In this role, you will play a crucial part in developing infrastructure, enabling tooling, and supporting the team of data engineers.
Responsibilities:
- Utilise your excellent skills in Python, SQL, and jinja to design and develop data pipelines.
- Guide and support the team of data engineers, ensuring the application of best practises.
- Stay up to date with the latest developments in data engineering and ensure that practises are aligned.
- Build and maintain relationships with business stakeholders and cross-functional teams.
- Implement CI/CD workflows, particularly utilising GitHub Actions.
- Utilise cloud platforms, preferably AWS, and orchestration tools like Airflow.
- Leverage dbt and implement best practises for data modelling.
- Implement infrastructure as code using Terraform (desirable).
Requirements:
- Excellent skills in Python, SQL, and jinja.
- Experience with cloud platforms, ideally AWS.
- Familiarity with orchestration tools, preferably Airflow.
- Proven leadership skills, guiding and enabling a team of data engineers.
- Familiarity with CI/CD workflows, particularly GitHub Actions.
- Strong understanding of data engineering best practises and latest trends.
- Experience in reviewing, designing, and developing data pipelines.
- Excellent communication skills to engage with business stakeholders and cross-functional teams.
- Experience with dbt, including implementation of best practises.
- Knowledge of infrastructure as code, preferably Terraform (desirable).
Apply now to embark on an exciting journey of innovation and collaboration in the central government sector. ?