We are seeking a highly skilled Data Engineer to join our dynamic data engineering team. The ideal candidate will have extensive experience in designing, implementing, and managing data solutions; with opportunities to gain experience in Azure through training and certifications. You will be responsible for developing and maintaining our data architecture, migrating data, ensuring data quality, and enabling advanced analytics capabilities to support business decision-making.
Data Engineer
- Location: Sunderland, Tyne & Wear
- Job Type: Full-time, with 1 day remote working
- Salary: Competitive, up to £65,000 per annum
Day to Day of the role:
- Design and develop robust, scalable, and efficient data architectures.
- Collaborate with various stakeholders to understand data requirements and translate them into technical solutions.
- Ensure data security, quality, and compliance with governance policies.
- Design robust data models to enhance data accessibility and facilitate deeper analysis.
- Build and maintain ETL/ELT processes to ingest data from various sources.
- Implement and manage data integration solutions using Azure Data Factory, Azure Databricks, Azure Data Lake, and Azure Synapse Analytics.
- Monitor and troubleshoot data pipeline issues to ensure data availability and accuracy.
- Develop scripts and automation using PowerShell, Python, or other relevant languages.
- Design, implement, and manage databases and data models using Azure SQL Database, MySQL Database, Cosmos DB, and other Azure database services.
- Optimize database performance and ensure data integrity and security.
- Migrate existing on-premises databases to Azure Cloud.
- Document data processes, system designs, and architecture.
- Stay up-to-date with industry trends and technologies to drive continuous improvement.
- Provide technical guidance and mentorship to other team members.
Required Skills & Qualifications:
- 5+ years of experience in database administration/data engineering, with a focus on Microsoft focus.
- Proficiency with SQL, Azure Data Factory, Azure Databricks, Python/Pyspark, Azure Synapse Analytics, and MySQL on Azure.
- Microsoft Azure Certifications such as Azure Database Administrator, Data Engineer Associate.
- Strong understanding of data warehousing concepts and ETL processes.
- Experience with data modelling, data warehousing, building data pipelines, and data integration techniques.
- Data warehouse development experience using Azure Synapse Analytics.
Desirable Skills/Experience:
- Strong data engineering experience.
- Familiarity with data visualization tools like Power BI or Tableau.
Benefits:
- Competitive salary with annual reviews.
- Company pension scheme and death in service benefit.
- 25 days annual leave plus birthday off and the opportunity to purchase additional holidays.
- Enhanced family-friendly policies and cycle to work scheme.
- Private healthcare and discounts at local retail outlets.
- Professional development opportunities including training and industry-recognised certifications.
- Dynamic and collaborative work environment with cutting-edge technologies.
To apply for this Data Engineer role, please submit your CV and cover letter detailing your relevant experience and why you are interested in this position.