About the Role:
I am looking for a talented Data Engineer to join our clients dynamic team on a 6-month contract basis. This is an exciting opportunity for a mid-level professional with 3-5 years of experience to make a significant impact on our data infrastructure and projects. The position offers flexibility with remote/hybrid working options and a competitive day rate of £250-£400, falling inside IR35 regulations.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines and ETL processes using AWS, Databricks, Python, Spark, and SQL.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
- Optimize and troubleshoot data workflows to ensure efficiency and reliability.
- Implement data quality and validation checks to ensure data integrity.
- Contribute to the development and maintenance of our data lake and data warehouse solutions on AWS.
- Participate in code reviews and provide constructive feedback to peers.
Required Skills and Experience:
- 3-5 years of experience as a Data Engineer or in a similar role.
- Strong proficiency in AWS services related to data engineering (e.g., S3, Redshift, Glue).
- Hands-on experience with Databricks for data processing and analytics.
- Proficient in Python programming for data manipulation and automation.
- Solid understanding of Apache Spark for big data processing.
- Strong SQL skills for data querying, transformation, and analysis.
- Excellent problem-solving abilities and attention to detail.
- Ability to work independently and collaboratively in a remote/hybrid team environment.