Job Title: Data Engineer
Location: Remote UK (Candidates must eligible for clearance)
Company: 167 Solutions Ltd
Employment Type: Full Time
Salary: £35,000 - £50,000
**Job Description
167 Solutions Ltd is seeking a skilled Data Engineer with a strong background in SQL, Azure Data Factory, and Python to join our clients dynamic team. This role involves designing, building, and optimizing data pipelines to support data analytics and reporting. The ideal candidate will have hands-on experience with data integration, transformation, and analysis, and will work closely with our data science and analytics teams to ensure data availability and reliability across projects.
**Key Responsibilities
- Develop and maintain scalable data pipelines using Azure Data Factory to integrate data from various sources and deliver insights.
- Design and optimize data architecture and data models to support analytics and reporting needs.
- Write complex SQL queries for data extraction, transformation, and load (ETL) processes, ensuring data quality and performance.
- Implement data solutions with Azure cloud services, including setting up data storage, transformation, and retrieval processes.
- Use Python for scripting and data manipulation, enhancing ETL workflows and automating data tasks.
- Collaborate with stakeholders to understand data requirements and translate them into technical specifications.
- Troubleshoot and resolve any issues related to data workflows, ensuring data integrity and availability.
- Monitor and improve data processes, including performance tuning and error handling.
**Qualifications
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
- 2+ years of experience in a data engineering role, with hands-on expertise in SQL, Azure Data Factory, and Python.
- Proficiency in SQL: strong ability to write and optimize complex queries.
- Experience with Azure Data Factory: familiarity with data integration, data flow orchestration, and data transformation on Azure.
- Knowledge of Python: ability to use Python for data manipulation, automation, and ETL scripting.
- Experience with Azure services: including Azure SQL Database, Blob Storage, and other data-related tools in the Azure ecosystem.
- Understanding of data warehousing principles, data modeling, and data architecture best practices.
- Analytical mindset with attention to detail, problem-solving skills, and a commitment to data quality.
**Preferred Skills
- Knowledge of additional data engineering tools such as Apache Spark, Databricks, or other ETL tools.
- Familiarity with data visualization tools like Power BI or Tableau.
- Experience with CI/CD pipelines and version control systems like Git.
**Why Join Us?
- Opportunity to work on innovative data projects in a supportive and collaborative environment.
- Competitive compensation and benefits package.
- Access to ongoing professional development and training.
How to Apply:
If you are a data engineering professional with expertise in SQL, Azure Data Factory, and Python, we'd love to hear from you!