Role: Data Engineer
Salary: £40-55k
Location: Derby/Hybrid (3x a week)
I have partnered up with a prolific asset management company who are looking for an experienced Data Engineer to join their team.
Delivering innovative and sustainable stock, they currently have billions of £ worth of investments under asset management.
Benefits:
- 10% performance based bonus
- Visa sponsorship
- 25 days annual leave (increasing with service) + bank holidays
- Annual leave buy/sell scheme
- Employer pays 1.5x the employee pension contribution
- Financial wellbeing support
- Flexible working around core hours
- Cycle to work scheme
- Clear progression opportunities
This position is crucial for supporting the development and delivery of a comprehensive digital portfolio. Leveraging a unified data platform and collaborating with the team, you will be tasked with managing and maintaining data pipelines, overseeing workloads, conducting root cause analysis, ensuring data quality, and escalating technical issues.
Responsibilities
- Oversee and restore operations for Azure Data Factory and Databricks jobs.
- Actively monitor data quality.
- Become an expert on the organisation's data sources, ingestion methods, and data quality standards.
- Help develop and adhere to data governance policies and internal procedures.
- Work closely with the team to understand business needs and enhance data quality.
- Create and maintain KPIs for digital services data quality.
- Manage and monitor user-facing dashboards and other internal digital products.
- Update and patch existing digital software products.
- Document outcomes of root cause analyses.
Skills, Knowledge, and Expertise
General Requirements
- Extensive experience with Microsoft Azure is essential for this role.
- Familiarity with Azure components like Azure Data Factory, Azure SQL DB, and Azure Data Lake.
- Strong proficiency in Python is critical for data manipulation and automation tasks.
- Experience with Apache Spark and/or Databricks.
- Proficient in using BI visualisation tools such as Power BI.
- Experience in managing end-to-end analytics pipelines (both batch and streaming) for data science applications.
- Skilled in root-cause analysis and post-incident reporting in a production environment.
Knowledge and Qualifications
- A relevant degree in Computer Science, Engineering, or related fields, and/or relevant certifications such as Azure Data Engineer Associate.
- Extensive experience with data ingestion methods for both real-time and batch processing.
- Proficient in PySpark.
- Skilled in debugging Apache Spark workloads.
- Experience using BI visualisation tools like Power BI.
Key Skills
- Strong interpersonal skills.
- Proficient in report writing, presentation, and record-keeping.
- Excellent communication and stakeholder management skills.
If you are a talented Data Engineer and are wanting to join a great organisation with excellent people who place emphasis on personal development, then we would love to hear from you.
Send your CV over today to apply!
Keywords: Data Engineer, Python, SQL, Azure, ETL, ADF, Azure Data Factory
BeTechnology Group Limited is acting as an Employment Agency in relation to this vacancy.