Senior Data Engineer, Training Data Platform
In sede · Amsterdam (Paesi Bassi) · Senior · Tempo pieno
Vuoi altre offerte come questa?
Crea il tuo profilo gratuito su PyHires: vedrai quanto sei compatibile con ogni offerta e riceverai ogni settimana un'email con quelle più adatte a te.
Panoramica
- Modalità di lavoro
- In sede
- Sede
- Amsterdam (Paesi Bassi)
- Tipo di contratto
- Tempo pieno
- Seniority
- Senior
- Lingue
- Inglese
- Aperta a candidati da
- Solo Paesi UE
- Azienda
- Prosus
- Pubblicata
- 19 nov 2026
Il ruolo
Prosus, the group behind Just Eat Takeaway, OLX and PayU, builds LCM, the Large Commerce Model: its own foundation model trained on billions of transactions and interactions across the portfolio, already powering search, recommendations and marketing at iFood. As a senior data engineer you will build and operate LCM's training-data platform, turning events, sessions, orders, catalogues, feedback and external sources into reproducible datasets for scientists and ML engineers.
What you'll do
- Build acquisition and processing pipelines for portfolio data and public or licensed sources, including connectors and content extraction
- Turn commerce records into ordered histories and link behaviour to outcomes without leaking future information
- Work with scientists, engineers and the relevant teams on data provenance, permitted use and privacy-aware handling of customer histories
- Provide tools for source tagging, sampling and weighting, and maintain evaluation datasets with temporal splits and overlap checks
- Build synthetic data pipelines for pre- and post-training: instruction examples, preference data and agent trajectories, with generation, validation, scoring and filtering
- Within three months, own part of the platform and deliver a reproducible dataset used in a training run
What you bring
- At least five years of data engineering experience, including ownership of substantial production pipelines
- Strong Python and SQL, with tested, maintainable code
- Hands-on distributed processing with Spark, Ray, Beam or a comparable framework
What they offer
- A flat AI team of about 30 engineers, working directly with applied scientists, training engineers and domain experts
- A base at the Amsterdam office and AI House, with relocation support (remote considered for particularly strong candidates)
- Scope to publish methods, models and benchmarks
- Competitive compensation and a top-spec MacBook Pro
Requisiti
Basata su:Python
Indispensabili
- Apache Spark
- LLM
- SQLEssenziale
Chi è Prosus
Prosus is a global technology company behind some of the world's leading lifestyle ecommerce businesses, such as Just Eat Takeaway, OLX and PayU. Its AI-driven ecosystem spans 100+ companies across ecommerce, food delivery, fintech and experiences, serving billions of consumers, and its investment team backs founders in areas from robotics to frontier AI.
Stack
- Python
- Apache Spark
- LLM
- SQL
Azienda
Prosus
Paesi Bassi