Lead Data Engineer - 6-Month Contract
Location: Manchester (2 days on-site per week)
Inside IR35
We're seeking an experienced Lead Data Engineer for a 6-month contract role. The ideal candidate will have:
- Extensive experience with Apache Airflow
- Proficiency in dbt (data build tool)
- Strong AWS expertise (crucial), including: • Amazon S3 • Amazon Redshift • AWS Glue • Amazon EMR • AWS Lambda • Amazon EC2 • Amazon RDS • Amazon Athena
- Experience with Python and SQL
- Ability to lead and mentor a data engineering team
- Excellent problem-solving and communication skills
Responsibilities include:
- Designing, implementing, and maintaining scalable data pipelines using Airflow and AWS services
- Developing and optimizing ETL processes to handle large volumes of data efficiently
- Implementing data modeling and transformation logic using dbt
- Architecting and managing cloud-based data infrastructure on AWS
- Ensuring data quality, reliability, and security across all data systems
- Collaborating with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions
- Leading code reviews and implementing best practices for data engineering
- Optimizing database performance and query efficiency
- Troubleshooting and resolving complex data issues
- Staying current with the latest data engineering technologies and methodologies
If you're a skilled data engineer looking for a challenging contract role that leverages your expertise in Airflow, dbt, and AWS, apply now!