Tech Lead - Data Platform
The Data Platform and Analytics team manages Kobalt Music’s data platform infrastructure as well as pipelines and services providing data extracts and analytics. These include ingesting and transforming disparate datasets, like artist metrics from streaming services, social networks, etc., played songs and related metadata, past royalties to create forecasts and so on; supporting multiple business units with data products and self-serve tooling.
To improve our data products, we have started to work on a new self-serving data mesh with the aim of empowering data analysts with data discovery and quality control.
Ultimately DPA offers a diverse range of opportunities to make a positive tangible benefit to the business and our clients.
We are looking for a Tech Lead Data Platform Engineer to implement our new strategy for a Data Platform, focusing on shared infrastructure that will enable all teams to create, discover and consume data products easily. The role offers the opportunity to work on disparate aspects of the infrastructure: from access control and monitoring to cost allocation, from providing tools for data cataloguing and quality to templates and tools to speed up adoption and migration to the new platform for Data Engineers, Analysts and BI users. This is an exciting opportunity to work in the heart of music publishing, empowering innovation, enhancing business efficiency and catalysing revenue generation opportunities through the strategic use of data, AI, scalable tooling and self-service analytics.
##### Tech Stack
- AWS: Athena, Glue, Step Functions, Lambda, RDS, S3, DMS, EMR, SageMaker
- Terraform, CircleCI, Kubernetes, Docker
- Spark, DBT, Jupyter Notebook
- Python, Java, Scala, SQL
##### Recent Projects
- Engaging with stakeholder to ideate and building out Kobalt’s Data Platform and Data Mesh
- Large scale entity resolution service, attributing user consumption to our catalogue to maximise claims
- Forecasting to estimate royalties across our catalogue
- Detecting and tracking the performance of up and coming singer/songwriters