This is a fantastic opportunity for a Senior Data Engineer to join CMC Markets as we develop new data driven products and services and transition to a more cloud-native architecture. As a Senior Data Engineer, you will be responsible for implementing CMC's data strategy, working as part of the Core Data team on our cloud native data platform.
Please note we are 5 days onsite
The Core Data team engages and works with stakeholders across the organisation. A key responsibility of the team is to promote CMC's data strategy of providing a decentralised approach to data, working with other teams to develop shared data capabilities that will allow them to operate with increased autonomy. A driving principle of the team is to realise better data citizenship, treat data as a product, and enable CMC to build scalable data services with increased velocity.
What do we expect from a Senior Data Engineer?
- Design, build, and maintain scalable data pipelines to deliver relevant and timely data to our users
- Develop and optimise ELT processes to transform raw data into meaningful insights
- Manage and optimise data warehousing plans in Snowflake, ensuring efficient storage, retrieval, and analysis of data
- Implement and maintain data lakes, ensuring data organisation, security, and availability
- Work closely with BI developers, business analysts and internal stakeholders to understand data needs and deliver data in a secure, scalable and efficient way for the whole company
- Ensure data quality, integrity, and governance by implementing and adhering to best practices across the entire data lifecycle
- Perform performance tuning and optimisation of data queries and pipelines to ensure efficient data processing and retrieval
- Participate in our on-call rota to monitor data pipelines and infrastructure, troubleshooting issues as they arise to deliver a robust platform for our critical internal use cases
- Implement and enforce data security and compliance measures across the entire data platform and guide other teams to do the same
Key Skills & Experience
We are looking for someone who can demonstrate the below:
- Several years of experience as a Data Engineer or similar role
- Proven experience developing, and deploying data pipelines in the cloud (AWS)
- Strong proficiency in SQL and experience with scripting languages (Python, Bash)
- Experience with data warehousing solutions (e.g., AWS Redshift, Snowflake)
- Exposure to big data technologies (e.g., Apache Spark, Hadoop)
- Solid understanding of data modelling concepts and techniques
- Excellent communication, collaboration, and problem-solving skills
- A passion for data and a dedication to building high-quality, efficient data solutions
Useful Skills or Interests
Any of these are a bonus, but not necessary to start the role as you'll pick it up as you go.
- Experience with DBT (Core or Cloud) or another ELT tool
- Exposure to Data Quality & Automation concepts
- Experience designing data systems or platforms
- Exposure to streaming data processing
- Relevant certifications
- Open Source contributions
- Financial Services/Fintech (or another regulated industry) experience
CMC Markets is powered by our people. We are an equal opportunities employer and are committed to creating a diverse and inclusive workplace, where our people feel confident to be themselves, feel valued and are able to do their best work. We don't just value differences and unique perspectives, we seek them out and we invite them in, because we know it will lead to better outcomes for everyone.