Data Engineer
The Data Team is seeking a Data Engineer to play a vital part in building the complex, scalable systems that power its data strategy. The role involves contributing to architectural discussions and delivering high-quality data solutions that bring millions of fans closer to the sports they love.
This is a fantastic opportunity to develop expertise in optimising data platforms for real-time AI/ML workloads, collaborate with experienced engineers, and make a significant impact on the business.
- Develop and deploy robust data pipelines using GCP services such as BigQuery, Dataflow, Pub/Sub and Cloud Storage.
- Integrate data from various sources, ensuring data quality and enabling real-time processing capabilities.
- Design data models and manage databases effectively to support business analytics and intelligence using dimensional data-modelling principles.
- Use GCP database technologies such as Bigtable, Spanner or Firestore to optimise performance and scalability.
- Automate data workflows and optimise data storage and processing costs within GCP.
- Use tools such as Cloud Composer for orchestration and apply best practices in performance tuning.
- Ensure data security by implementing GCP security practices.
- Manage access controls, comply with data-governance policies and safeguard sensitive information.
- Work closely with data engineers, business analysts, and IT teams to define data requirements and deliver comprehensive data solutions.
- Stay up to date with the latest GCP features and data-engineering technologies.
- Explore ways to enhance data infrastructure and contribute to the development of new data products.
- Provide second-line support for pipeline failures or data quality incidents and perform fault analysis to resolve issues.
- Contribute to system-design decisions and help develop data solutions that support real-time workloads.
- Partner with cross-functional teams to translate business needs into effective data solutions.
- Design data systems that solve problems and improve reliability and cost-effectiveness.
- Develop and maintain robust, secure integrations with core internal systems and third-party platforms.
- Implement monitoring and alerting to ensure high system reliability and minimal downtime.
- Experience in data engineering or data warehousing with large-scale, complex datasets (required).
- Experience writing complex SQL queries (required).
- Experience with Python or a similar programming language, with the ability to turn business requirements into working solutions (required).
- Experience with cloud data services and technologies, ideally within the GCP ecosystem, such as Dataflow, Pub/Sub, BigQuery or Vertex AI (required).
- Experience with Airflow environment management and Docker (required).
- An interest in contributing to the AI roadmap and experimenting with AI tooling, including coding agents, within the development lifecycle (required).
- The ability to explain technical concepts clearly and concisely to technical and non-technical stakeholders (required).
- Experience developing and optimising real-time and large-scale batch data-processing frameworks (required).
- Experience deploying and maintaining data infrastructure using Infrastructure as Code principles and tools such as Terraform (required).
- An understanding of data-governance, privacy and security best practices in a regulated environment (required).
- A proactive and curious approach to identifying and resolving system inefficiencies (required).
- The ability to work effectively with cross-functional teams and translate requirements into robust data solutions (required).
- A strong sense of responsibility for the quality, reliability and performance of the data solutions you help create (required).
- Company Performance Bonus
- Flexible Working Agreements where applicable
- Private Healthcare Scheme + Employee Enhanced Assistance
- Enhanced Family Leave - Maternity, Shared Parental & Adoption Leave: up to 6 months at full pay and 6 months at half pay
- Paternity leave: up to 4 weeks at full pay
- Subsidised Gym Membership
- Annual Travel Card Loan & Ride to Work Scheme
- Life Assurance (x3 salary)
- Contributory Pension Plan
- Virgin Family: Giving you access to exclusive Virgin offers and experiences
- Thursday drinks in the office and regular socials
LiveScore Group is a sports media and betting company, home to the LiveScore, LiveScore Bet and Virgin Bet brands. Its flagship LiveScore product delivers real-time scores and free live streams to a large global audience, while LiveScore Bet and Virgin Bet provide online sports betting and gaming. Headquartered in London, the privately owned group operates internationally, with offices in Stoke, Galway, Vienna, Gibraltar, Lagos, Malta and Cape Town. It combines media reach with regulated betting products across the UK and other markets.