£200/day to £500/day
London, England
Contract, Variable

Big Data Engineer

Posted by Robert Half.

Robert Half have partnered with a leading pharmaceutical logistics company who are seeking a talented Data Engineer to join their team, responsible for designing, building, and maintaining robust data pipelines and infrastructure. The ideal candidate will possess expertise in dbt, CI/CD processes, automated unit testing in a data context, and strong SQL skills. This role offers an exciting opportunity to work with cutting-edge technologies and contribute to the advancement of data-driven initiatives.

This role is a day rate contract of 3-6 months.

Outside IR35

Key Responsibilities:

Data Pipeline Development:

  • Design, develop, and maintain scalable data pipelines using dbt.
  • Collaborate with cross-functional teams to understand data requirements and implement best practices for data modelling.
  • Ensure efficient data processing and transformation to support analytical and reporting needs.
  • Continuous Integration and Deployment (CI/CD):
  • Define and build CI/CD processes in dbt and DevOps environments.
  • Establish quality control measures and automated testing frameworks for data pipeline reliability.

Automated Unit Testing:

  • Develop and implement automated unit testing strategies tailored to data context.
  • Monitor test results to maintain data pipeline robustness and reliability.
  • SQL Development and Optimisation:
  • Utilise strong SQL skills to optimise database performance and implement schema changes aligned with business requirements.
  • Communication and Collaboration:
  • Communicate effectively with stakeholders and collaborate with data scientists and analysts.
  • Deliver solutions that meet business objectives.

Desirable Knowledge & Skills:

  • Understanding of data modelling principles and frameworks.
  • Familiarity with ETL techniques, especially Snap logic.
  • Experience in Life Sciences/Pharmaceutical industry is desirable.

Requirements:

  • Experience of and expertise in dbt.
  • Experience defining and building CI/CD processes (ideally in dbt and DevOps).
  • Experience of automated unit testing in a data context.
  • Strong SQL skills.
  • Proven written and verbal communication skills, and attention to detail.
  • Experience with AirFlow

Qualifications:

  • Demonstrated experience in data engineering, ETL development, and database management.
  • Certification in relevant technologies or platforms is a plus.

Robert Half Ltd acts as an employment business for temporary positions and an employment agency for permanent positions. Robert Half is committed to equal opportunity and diversity. Suitable candidates with equivalent qualifications and more or less experience can apply. Rates of pay and salary ranges are dependent upon your experience, qualifications and training. If you wish to apply, please read our Privacy Notice describing how we may process, disclose and store your personal data: gb/en/privacy-notice

Security alert: scammers are currently targeting jobseekers. Robert Half do not ask candidates for a fee or request candidates to send applications through instant messaging services such as WhatsApp or Telegram. Learn how to protect yourself by visiting our website: gb/en/how-spot-recruitment-scams-and-protect-yourself