Data Engineer
Smarkets is seeking a Data Engineer to join its Data team. The role involves working closely with the Data team lead and other team members, who will provide assistance to ensure a smooth integration into the company. The Data team operates using Agile methodologies and tools such as Jira, with regular standups. This environment offers a clear engineering direction, allowing focus on work and honing skills as a data engineer through exciting projects. Support from engineers across the company will always be available.
As a member of the data team, responsibilities will include contributions to developing and maintaining Smarkets' Data ETL pipelines, some of which are real-time. These pipelines are fundamental to helping teams and stakeholders understand and drive business direction. Data components can also be user-facing, such as sending notifications to users.
The role also involves ensuring the data lake is kept in a healthy state, particularly the data warehouses: Redshift and Bigquery. Developing and maintaining Flask services and Postgres databases within the Data team is also a key responsibility, to provide access to data or manage certain business entities relevant to Data.
Assistance will be provided to different teams in the company with reporting, especially concerning automated reporting pipelines. This includes doing data exploration and training & deploying ML models used to perform different kinds of user segmentation, detect operational anomalies, or estimate important business quantities. In particular, maintaining and improving the existing recommender service that provides users with suggestions on new sport competitions is a key task.
- Developing and maintaining Smarkets' Data ETL pipelines, some of which are real-time.
- Ensuring the data lake is kept in a healthy state, particularly the data warehouses: Redshift and Bigquery.
- Developing and maintaining Flask services and Postgres databases within the Data team to provide access to data or manage certain business entities relevant to Data.
- Assisting different teams in the company with reporting, especially concerning automated reporting pipelines.
- Doing data exploration and training & deploying ML models used to perform different kinds of user segmentation, detect operational anomalies, or estimate important business quantities.
- Maintaining and improving the existing recommender service that provides users with suggestions on new sport competitions.
- 3+ years of experience (required)
- Understanding of developing ETL pipelines using Python frameworks such as luigi or airflow (required)
- Experience with the development of Python-based REST APIs or services and their integration with databases like Postgres (required)
- Familiarity with the key tools of the Python data science stack, e.g. Pandas, Numpy and scikit-learn (required)
- Some experience with training and deploying ML models (required)
- Enjoy writing elegant, well-tested and maintainable code (required)
- A team player that enjoys contributing to the success of the team in a proactive and friendly environment (required)
- Bachelor’s in Computer Science, Math or equivalent field, or possess relevant experience (required)
- Stock Options: Vest over 4 years
- Pension Scheme: Competitive plan via Aviva, with up to 6% matched contributions if you opt in.
- Health Insurance: Comprehensive coverage.
- Enhanced Parental Leave: Enhanced maternity and paternity leave.
- Stay Fuelled: Fresh, chef-made breakfast and lunch every day, plus a constant supply of fruit, snacks, tea, coffee and soft drinks.
- Cycle-to-Work Scheme: Support for sustainable commuting and staying active.
- Learning & Development: £1,000 annual education budget for courses, conferences, books, or training.
- Holiday: 25 days paid leave + bank holidays, with the option to carry over 5 days.
- Flexible Working: Choose to work 1 day from home (20 WFA days/year) or 2 days from home (5 WFA days/year) based on your needs and preferences.
- Team Energy: Regular socials, hackathons, and events.
Smarkets is a peer-to-peer betting exchange based in London, where customers bet against each other rather than against a bookmaker and the exchange earns a commission on net winnings. It offers markets on sport and politics, and its teams in London work across engineering, product, design and commercial roles, with customer operations staff in Malta.






