Kobalt Music
London, United Kingdom
Tech Lead - Data Platform
Job description
The Data Platform and Analytics team manages Kobalt Music’s data platform infrastructure as well as pipelines and services providing data extracts and analytics. These include ingesting and transforming disparate datasets, like artist metrics from streaming services, social networks, etc., played songs and related metadata, past royalties to create forecasts and so on; supporting multiple business units with data products and self-serve tooling.
To improve our data products, we have started to work on a new self-serving data mesh with the aim of empowering data analysts with data discovery and quality control.
Ultimately DPA offers a diverse range of opportunities to make a positive tangible benefit to the business and our clients.
We are looking for a Tech Lead Data Platform Engineer to implement our new strategy for a Data Platform, focusing on shared infrastructure that will enable all teams to create, discover and consume data products easily. The role offers the opportunity to work on disparate aspects of the infrastructure: from access control and monitoring to cost allocation, from providing tools for data cataloguing and quality to templates and tools to speed up adoption and migration to the new platform for Data Engineers, Analysts and BI users. This is an exciting opportunity to work in the heart of music publishing, empowering innovation, enhancing business efficiency and catalysing revenue generation opportunities through the strategic use of data, AI, scalable tooling and self-service analytics.
Tech Stack
- AWS: Athena, Glue, Step Functions, Lambda, RDS, S3, DMS, EMR, SageMaker
- Terraform, CircleCI, Kubernetes, Docker
- Spark, DBT, Jupyter Notebook
- Python, Java, Scala, SQL
Recent Projects
- Engaging with stakeholder to ideate and building out Kobalt’s Data Platform and Data Mesh
- Large scale entity resolution service, attributing user consumption to our catalogue to maximise claims
- Forecasting to estimate royalties across our catalogue
- Detecting and tracking the performance of up and coming singer/songwriters
Responsibilities
We are looking for a Tech Lead Data Platform Engineer to implement our Data Platform Strategy. This is an exciting opportunity to work in the heart of music publishing, empowering innovation, enhancing business efficiency and catalysing revenue generation opportunities through the strategic use of data, AI, scalable tooling and self-service analytics
- You will lead the strategy & development of Kobalt Music’s Data Platform
- Liaises with key stakeholders across the business to align requirements and priorities
- Applies newly acquired knowledge and skills to enhance their work and contribute to the team’s objectives.
- Proposes new ideas or improvements to processes that benefit the team or company.
- Demonstrates a commitment to continuous learning by staying updated with the latest industry trends and technologies
Requirements
- Infrastructure as Code (e.g. Terraform, CloudFormation, ...)
- Experience maintaining CI/CD pipelines
- Expertise writing Automated Tests
- Expertise monitoring, automated alerting of services
- Experience writing and optimising ETL pipelines
- Cloud computing experience, especially around ETL, orchestration and permissions
- Expertise in at least one OOP language out of Python, Java, Scala
- Experience writing SQL
- AWS
- Docker, Kubernetes
- Jupyter, DBT
- BI tools such as Tableau/Quicksight
Benefits
- Salary Range: Discuss with the Talent Partner.
- Flexible working. KTech operates with a hybrid working policy (fully remote possible).
- 25 days annually.
- 1 wellbeing day per quarter.
- Half day summer Fridays (July and August).
- Christmas closure.
- Meeting free Fridays afternoon outside of the summer months. We use this as dedicated learning time.
- 5% pension contribution.
- Health Insurance.