We are looking for a Data Engineer with proven experience with Databricks, including strong experience Python/ PySpark. This is an initial 6 month contract; you will be required onsite 3 days per week.
- Experience in managing teams of Data Engineers and Data Scientists working for 3rd
- Proven experience with Databricks, including building and optimizing Databricks notebooks and workflows.
- Demonstrated expertise in designing and implementing scalable, fault-tolerant data pipelines using Databricks.
- Strong proficiency in SQL and Python/PySpark for data transformation and analysis
- Experience integrating Databricks with other Azure data services, such as Azure Data Factory, Azure Synapse, and Azure DevOps
- Knowledge of data modelling techniques, including the creation of relational and dimensional data models
- Familiarity with data governance best practices, including data quality management and master data management.
- Passion for staying up to date with the latest Databricks features, capabilities, and industry trends.
- Proactive problem-solving mindset and a commitment to delivering high-quality data engineering solutions.
- Ability to collaborate effectively with cross-functional teams, including data analysts and data scientists.
- Excellent written and verbal communication skills for documenting processes and presenting findings
Carbon60, Lorien & SRG - The Impellam Group STEM Portfolio are acting as an Employment Business in relation to this vacancy.