Senior Data Engineer, Oxford, £75-80K, flexible working. You must have a background as a Data Engineer with strong Python, AWS and have worked in technical teams, building data pipelines, delivering productionised code, building / maintaining live applications and developing tooling and improvement backtesting frameworks. You should also have experience of orchestrating machine learning workflows.
This role is based in Oxford, Oxfordshire and requires only 1 day a week in the office.
The role:
Supporting Data Engineering Infrastructure: Contribute to the design, development, implementation and continuous improvement of our data engineering tools, workflows, processes, and platforms. This includes enhancing the architectural foundations and integrating new data management technologies.
Writing Well-Structured Code: Develop clean, maintainable, well-documented code that adheres to best practices. Mentor and support in the continued improvement of coding practices within the Data Science team.
Enhance data engineering knowledge: Improve expertise within the software team and ensure their ability to support and collaborate on the data science infrastructure.
Data Quality Management: Continuously enhance data quality across multiple dimensions such as accuracy, availability, performance, and accessibility to ensure a clear understanding of data within the company.
Providing backup/escalation to the tech-on-call team.
Communicating effectively across Software and Data Science teams.
Your background / skills:
5+ years of Python experience.
3+ years of working in technical teams, building data pipelines, delivering productionised code, building/maintaining live applications, developing tooling and improving backtesting frameworks.
2+ years of orchestrating machine learning workflows.
Proficiency with Orchestration and IaC in AWS (e.g. Terraform, Kubernetes, RabbitMQ, Airflow), Git, containerisation (Docker), database management (e.g. Postgres, Alembic).
Fluent in Python and its wider numerical ecosystem (e.g. Pandas, NumPy, Polars, Pydantic).
Bonus / advantageous experience:
Relational database design.
Cloud infrastructure experience.
Experience with monitoring frameworks (e.g. Prometheus).
Experience archiving data to Parquet on S3 and creating tools for API/Grafana queries.
Experience centralising diverse datasets for analytics, visualisation and machine learning.
Familiarity with time-series forecasting and/or optimisation.
Experience with data visualisation and dashboards (e.g. Grafana, Superset).
Familiarity with machine learning and associated techniques (feature engineering, boosting methods, LightGBM).
This Senior Data Engineer role is based in Oxford, Oxfordshire and pays £75-80K with flexible working and just 1 day a week in their office.