Airflow SME
- 6 month contract
- Based in London
- Remote / Hybrid role
- Inside IR35
The role
- Provide technical leadership on data engineering (acquisition, transformation, distribution), across multiple projects and squads
- Guide, nurture, and coach a team of data engineers, architects and database administrators working in an agile, fast-paced environment
- Drive adoption and evolution of frameworks and products based on best-in-class data management technologies, such as ETL/ELT tools, open-source frameworks, workflow management tools, etc.
- Provide suggestions and recommendation on how to improve the overall data engineering architecture towards a scalable, cost effective ecosystem
Your expertise:
- Excellent understanding of enterprise data warehousing principles of ETL/ELT and the tools/technologies used to implement them
- Proven experience with Apache Airflow, including designing and maintaining complex workflows.
- Strong knowledge of Python programming.
- Experience with SQL and relational databases.
- Familiarity with cloud platforms (e.g., AWS) and their data services.
- Experience with version control systems such as Git.
- Strong problem-solving skills and attention to detail.
- Excellent communication and collaboration skills.
- Be an expert in handling ECS, Fargate, EC2, EKS infrastructure hosting Airflow.
- DBT including handling Infrastructure related upgrades and optimising DBT code (desirable).
Carbon60, Lorien & SRG - The Impellam Group STEM Portfolio are acting as an Employment Business in relation to this vacancy.