Senior Data Engineer
This Senior Data Engineer will play a key role in the evolution of our data platform, driving innovation and delivering high-quality data solutions. This role will focus on both migration from our current Data Warehouse to an AWS ecosystem, and developing cutting edge real-time data solutions including automation, business intelligence, and enabling analytics.
- Design, develop, and maintain data pipelines and ETL processes using AWS services such as AWS Glue, AWS Lambda and AWS S3.
- Support the migration of the existing Data Warehouse from SQL Server to AWS through S3 and Redshift.
- Develop and implement data quality checks and validation procedures.
- Design and implement best practice data lakehouse architectures and data warehousing solutions.
- Collaborate with data scientists and analysts to support the deployment of machine learning and advanced analytical solutions.
- Develop and maintain data documentation and operational procedures.
- Investigate and resolve data quality issues and performance bottlenecks.
- Stay abreast of the latest data technologies and industry best practices.
- Mentor junior data engineers and provide technical guidance to other team members where applicable.
- Contribute to the development and improvement of data platform best practices.
- Good understanding of AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. (required)
- Proficiency in Python, SQL, Pipeline Orchestration, and data warehousing concepts. (required)
- Ability to diagnose and resolve complex data issues. (required)
- Ability to effectively communicate with both technical and non-technical stakeholders. (required)
- Experience with data lakehouse architectures and data warehousing solutions. (required)
- Experience in migrating data from on-premises systems to cloud environments would be desirable. (preferred)
- Experience with Agile development methodologies. (preferred)
- Experience with data security and privacy best practices. (preferred)
- A competitive rate of pay and pension contribution (£55,000 - £80,000)
- Generous discretionary bonus schemes, incentives and competitions
- An annual leave entitlement that increases with length of service
- Access to an online GP 24/7, 365 days a year for you and your immediate family.
- Employee wellbeing support through our Employee Assistance Programme
- Enhanced Maternity & Paternity Pay
- Long Service Recognition
- Access to a pay day savings scheme, financial coach and up to 40% of your earned wage ahead of payday, through Wagestream.
Betfred is a betting and gaming company that has operated for over 50 years, founded by Fred and Peter Done. It runs more than 1,300 betting shops and employs around 9,500 people, combining a large retail estate with online sports betting and gaming. In 2019 it entered the US sports betting market as Betfred Sportsbook, now operating in several states, and has established a presence in South Africa, where it holds a majority stake in the online betting company LottoStar. Headquartered in Warrington, England, Betfred emphasises customer service and responsible gambling across its operations.