Senior Data Engineer, Training Data Platform
On-site · Amsterdam (Netherlands) · Senior · Full-time
Want offers like this one?
Create your free PyHires profile: you will see how well you match each offer and get a weekly email with the ones that fit you.
Overview
- Work mode
- On-site
- Location
- Amsterdam (Netherlands)
- Engagement
- Full-time
- Seniority
- Senior
- Languages
- English
- Open to candidates from
- EU countries only
- Company
- Prosus
- Posted
- Nov 19, 2026
About the role
Prosus, the group behind Just Eat Takeaway, OLX and PayU, builds LCM, the Large Commerce Model: its own foundation model trained on billions of transactions and interactions across the portfolio, already powering search, recommendations and marketing at iFood. As a senior data engineer you will build and operate LCM's training-data platform, turning events, sessions, orders, catalogues, feedback and external sources into reproducible datasets for scientists and ML engineers.
What you'll do
- Build acquisition and processing pipelines for portfolio data and public or licensed sources, including connectors and content extraction
- Turn commerce records into ordered histories and link behaviour to outcomes without leaking future information
- Work with scientists, engineers and the relevant teams on data provenance, permitted use and privacy-aware handling of customer histories
- Provide tools for source tagging, sampling and weighting, and maintain evaluation datasets with temporal splits and overlap checks
- Build synthetic data pipelines for pre- and post-training: instruction examples, preference data and agent trajectories, with generation, validation, scoring and filtering
- Within three months, own part of the platform and deliver a reproducible dataset used in a training run
What you bring
- At least five years of data engineering experience, including ownership of substantial production pipelines
- Strong Python and SQL, with tested, maintainable code
- Hands-on distributed processing with Spark, Ray, Beam or a comparable framework
What they offer
- A flat AI team of about 30 engineers, working directly with applied scientists, training engineers and domain experts
- A base at the Amsterdam office and AI House, with relocation support (remote considered for particularly strong candidates)
- Scope to publish methods, models and benchmarks
- Competitive compensation and a top-spec MacBook Pro
Requirements
Based on:Python
Must-have
- Apache Spark
- LLM
- SQLEssential
About Prosus
Prosus is a global technology company behind some of the world's leading lifestyle ecommerce businesses, such as Just Eat Takeaway, OLX and PayU. Its AI-driven ecosystem spans 100+ companies across ecommerce, food delivery, fintech and experiences, serving billions of consumers, and its investment team backs founders in areas from robotics to frontier AI.
Stack
- Python
- Apache Spark
- LLM
- SQL
Company
Prosus
Netherlands