We are Global IT Recruitment specialist that provides support to the clients across UK, Europe and Australia. We have an excellent job opportunity for you.
Role - Databricks Engineer Location - Glasgow(preferable) but can also be based in London/Northampton/Radbroke 2-3 days p/week Duration - 6 months
Role Overview:
Are seeking a professional to set up and automate our Databricks environment. Responsibilities include Databricks DevOps automation, GitHub integration, Unity Catalog setup, cluster provisioning, and access management automation.
Key Responsibilities:
- Automate Databricks DevOps processes for efficient operations.
- Integrate Databricks with GitHub for streamlined CI/CD workflows.
- Configure and maintain Unity Catalog for data access management.
- Automate cluster provisioning for optimal performance and cost-efficiency.
- Develop solutions for automated access management to Databricks resources.
- Build data migration pipelines using medallion architecture and integrations with enterprise data platform (Immuta, Alation, Iceberg, and Snowflake, S3)
- Databricks DR setup.