We are searching for an experienced Senior Data Engineer someone to help deliver an ambitious and exciting data transformation programme for one of our technology clients. The position is offered on a remote basis with very occasional trips to the office (this is likely to be less than 2 or 3 times per year).
This is an extremely exciting Senior Data Engineer role which would be ideal for an experienced professional, someone who is ready to lead and innovate. Our client is a 100% data-driven company who pride themselves on deploying the best engineering practices across their products, solutions and services.
In this role, you will:
- Assemble large, complex data sets. You will craft and manage data sets that meet both functional and non-functional business requirements.
- Build advanced data solutions - you will develop software and infrastructure for optimal data extraction, transformation and loading using leading cloud technologies including Azure and AWS.
- Leverage Big Data Technologies - you will utilise tools such as Hadoop, Spark and Kafka to design and manage large-scale data processing systems.
- Extend and maintain the data Warehouse - you will be supporting and enhancing the data warehouse platform which is used for all reporting solutions.
- Ensure cost efficiency - you will help to keep the data platform and its solutions within agreed cost models and budgets.
- Lead by example - you will provide thought leadership, helping to inspire and guide your team and colleagues through your excellence.
About You
We are looking for a passionate Senior Data Engineer with the ability to inspire and mentor more junior team members. You will ideally have the following experience and skill set: -
- Extensive experience in data engineering, in both Cloud & On-Prem environments.
- Expert knowledge in data technologies, data transformation tools, data governance techniques.
- Exceptional coding skills.
- Strong analytic and problem-solving abilities.
- Good understanding of Quality and Information Security principles.
- Azure and/or AWS experience (coding, configuration, automation, monitoring and security)
- Big Data expertise.
- Advanced Database and SQL skills.
- Effective communication, ability to explain technical concepts to a range of audiences.
- Strong understanding of the principles of data model design and implementation.
- Able to provide coaching and training to less experienced members of the team.
Essential skills:
- ETL Tools - Azure Data Fabric, Azure Data Factory and Databricks or similar.
- Languages - Python, Spark, Java, PySpark, Spark SQL or similar.
- Lakes - Azure Data, Delta Lake, Data Lake or Databricks Lakehouse.
- SQL and/or data warehousing design patterns and implementation.
Highly desirable skills (not essential)
- Geospatial data experience
The role comes with an excellent benefits package, including an incredibly good holiday allowance, good pension, healthcare options, professional development and a bonus!
Please note - to be considered for this role you MUST be able to work in the UK without company sponsorship and you MUST be UK based (you cannot be based overseas even though the role is remote).
Keywords
Data Engineer, Lead Data Engineer, Senior Data Engineer, Cloud Data Platform, Data Transformation, Data Insights, CI/CD, Deployment Pipelines, Data Pipelines, Data Architectures, Architecture Patterns, Cloud Data Migration, Data Governance, ETL, Databricks, Azure Data Fabric, Azure Data Factory, Azure Data, Delta Lake, Databricks Lakehouse, Python, PySpark, Spark SQL, SQL, Data Warehousing.
Please note that due to a high level of applications, we can only respond to applicants whose skills and qualifications are suitable for this position.
No terminology in this advert is intended to discriminate against any of the protected characteristics that fall under the Equality Act 2010.
Bowerford Associates Ltd is acting as an Employment Agency in relation to this vacancy.