Senior Data Engineer, Training Data Platform
Presencial · Amsterdam (Países Bajos) · Senior · Jornada completa
¿Quieres más ofertas como esta?
Crea tu perfil gratis en PyHires: verás tu encaje con cada oferta y recibirás un email semanal con las que mejor encajan contigo.
Resumen
- Modalidad de trabajo
- Presencial
- Ubicación
- Amsterdam (Países Bajos)
- Modalidad
- Jornada completa
- Seniority
- Senior
- Idiomas
- Inglés
- Abierta a candidatos de
- Solo países de la UE
- Empresa
- Prosus
- Publicada
- 19 nov 2026
Sobre el puesto
Prosus, the group behind Just Eat Takeaway, OLX and PayU, builds LCM, the Large Commerce Model: its own foundation model trained on billions of transactions and interactions across the portfolio, already powering search, recommendations and marketing at iFood. As a senior data engineer you will build and operate LCM's training-data platform, turning events, sessions, orders, catalogues, feedback and external sources into reproducible datasets for scientists and ML engineers.
What you'll do
- Build acquisition and processing pipelines for portfolio data and public or licensed sources, including connectors and content extraction
- Turn commerce records into ordered histories and link behaviour to outcomes without leaking future information
- Work with scientists, engineers and the relevant teams on data provenance, permitted use and privacy-aware handling of customer histories
- Provide tools for source tagging, sampling and weighting, and maintain evaluation datasets with temporal splits and overlap checks
- Build synthetic data pipelines for pre- and post-training: instruction examples, preference data and agent trajectories, with generation, validation, scoring and filtering
- Within three months, own part of the platform and deliver a reproducible dataset used in a training run
What you bring
- At least five years of data engineering experience, including ownership of substantial production pipelines
- Strong Python and SQL, with tested, maintainable code
- Hands-on distributed processing with Spark, Ray, Beam or a comparable framework
What they offer
- A flat AI team of about 30 engineers, working directly with applied scientists, training engineers and domain experts
- A base at the Amsterdam office and AI House, with relocation support (remote considered for particularly strong candidates)
- Scope to publish methods, models and benchmarks
- Competitive compensation and a top-spec MacBook Pro
Requisitos
Basada en:Python
Imprescindible
- Apache Spark
- LLM
- SQLEsencial
Sobre Prosus
Prosus is a global technology company behind some of the world's leading lifestyle ecommerce businesses, such as Just Eat Takeaway, OLX and PayU. Its AI-driven ecosystem spans 100+ companies across ecommerce, food delivery, fintech and experiences, serving billions of consumers, and its investment team backs founders in areas from robotics to frontier AI.
Stack
- Python
- Apache Spark
- LLM
- SQL
Empresa
Prosus
Países Bajos