Data Engineer
Catena Media is seeking a Data Engineer to join its Data & Analytics team. The role focuses on designing, building, testing, and maintaining scalable data pipelines and data models on a Databricks lakehouse on Azure, governed through Unity Catalog.
Catena Media operates an AI-first team where agentic AI is integrated into the design, construction, testing, and operation of the data platform. The successful candidate will contribute to technical design and help shape engineering standards within the organisation.
- Design and develop data pipelines in Python (PySpark) on Databricks, applying engineering best practices for performance, reliability and maintainability.
- Ingest and integrate diverse data sources into the lakehouse in batch, following bronze, silver and gold layering and ensuring data quality and accuracy.
- Help introduce event streaming and real-time ingestion to the platform: design, build and operate streaming pipelines on Databricks from sources such as Kafka, handling late, duplicate and out-of-order events reliably.
- Maintain data models and the data estate codebase, with data governed, secured and documented in Unity Catalog.
- Write automated tests for every change: unit tests for pipeline logic, integration tests against real data, and data quality checks that catch issues before they reach users.
- Follow and contribute to the team’s engineering standards: clean, modular code, peer code review, CI/CD, infrastructure as code (Databricks Asset Bundles) and clear documentation.
- Use agentic AI tools (such as Claude Code) daily to build, test, review and troubleshoot, and help design and improve the AI agents and skills that automate our data workflows, with human review built in.
- Monitor and operate our cloud data platform (Databricks on Azure) day to day: track pipelines and jobs, troubleshoot issues and support daily data operations.
- Collaborate with engineers, analysts, and business stakeholders; support ad hoc data analysis requests.
- Drive continuous improvement through training and self-development.
- Perform any other ad hoc tasks that may be required by the business from time to time.
- A Degree in IT, Computer Science, or related fields (required)
- Proven experience as a Data Engineer, building and maintaining scalable ETL/ELT pipelines for data lakes or lakehouses, with exposure to both batch and real-time data (required)
- Hands-on experience with Databricks on Azure, including Unity Catalog (catalogs, schemas, permissions and lineage) (required)
- Hands-on experience with event streaming and real-time ingestion: Spark Structured Streaming and event platforms such as Kafka (required)
- Strong SQL skills; experience with relational databases and complex queries (required)
- Experience orchestrating pipelines with Databricks Workflows (Jobs) and deploying them with Databricks Asset Bundles (required)
- Azure Data Factory experience (nice-to-have)
- Coding proficiency in PySpark and Python (required)
- A strong testing mindset: experience writing unit and integration tests (e.g. pytest) and data quality checks, and writing code that is designed to be tested (required)
- Solid software engineering practices: Git, pull requests and code review, CI/CD (Azure DevOps, GitHub Actions or equivalent) and documentation (required)
- Hands-on experience working with agentic AI: using AI coding agents (such as Claude Code) in daily engineering work, and designing, building or integrating LLM-powered agents that orchestrate data workflows (required)
- Comfortable delivering in a fast-paced, agile environment (required)
- Strong analytical and problem-solving skills (required)
- Excellent communication and team collaboration (required)
- Self-motivated with a drive for continuous learning (required)
Catena Media is a performance-based online marketing and lead-generation company focused on the iGaming, sports betting and esports industries. It connects operators with new customers through a portfolio of affiliate websites and content across multiple markets, with a particular strength in North America. Headquartered in Gżira, Malta, the company employs a globally distributed workforce of more than 200 people. Catena Media is listed on Nasdaq Stockholm.







