Lead Data Engineer - Amazing Software company for the Transport Industry based in Guildford
On-Site working - Paying up to £80k
My client are a software and services company delivering bespoke software to the transport industry across Europe operating in the UK and internationally. My client are set to build a new Big Data Infrastructure and set of tools to allow their software to improve on data collection, data usage and Data reporting for their customers who are massive blue chip clients across Europe.
This is a new venture within the company and this role is to be first Data Engineer to start developing new data tools and data lakes and to be foundation of a growing team.
This is a fantastic job opportunity to design and develop a new Big Data solution from scratch, working closely with the CTO, the Head of Data and several key clients to design something original and fairly unique for their software.
Your responsibilities as a Lead Data Engineer are:
- Data collection and integration
- Data storage and management
- ETL (Extract, Transform, Load) Processes
- Creating data warehouses/data lakes
- Developing big data technologies ideally in Scala (possibly Python)
- Building data systems and pipelines from scratch
- Preparing data for descriptive and diagnostic analytics
- Preparing data for prescriptive and predictive modelling
- Writing well-designed, efficient code
- Understanding analytics and reporting requirements and their implications on a system-wide basis
- Managing expectations and estimating reasonable timescales for development activities
- Working to deadlines
- Documenting procedures and workflows, and following previously documented workflows to ensure the efficient running of the Data Team and Development Team.
- Communicating effectively with the Data team, the Development team, and other teams as required. This includes attending and contributing to regular meetings
Skills my client are looking for you to have:
Essential:
- Previous experience as a Senior or Lead Data Engineer or experience in a similar role
- Technical expertise in data models, data mining, and segmentation techniques
- Knowledge and experience of programming languages (preferably Scala)
- Knowledge and experience of working with large relational databases and with SQL database design
- Strong problem-solving skills with experience in debugging and error fixing with a keen eye for detail
- A proactive attitude in identifying and fixing data quality and code issues
- A strong understanding of data science and statistical concepts
- Excellent communication skills with the ability to translate technically complex ideas to effectively collaborate with non-technical personnel
Desirable:
- Experience with big data technologies (Hadoop, Spark, Hive)
- Proficient understanding of code versioning tools such as SVN
- Knowledge and experience of NoSQL databases
- Knowledge and experience of data streaming technologies (Apache Kafka)
The overall package includes a generous holiday package.
This role is only applicable to UK citizens, sponsorship is not available.
If this is something you are interested in please apply or email your CV