Senior Data Engineer, Training Data Platform

On-site · Amsterdam (Netherlands) · Senior · Full-time

Want offers like this one?

Create your free PyHires profile: you will see how well you match each offer and get a weekly email with the ones that fit you.

Create my profile

Overview

Work mode
On-site
Location
Amsterdam (Netherlands)
Engagement
Full-time
Seniority
Senior
Languages
English
Open to candidates from
EU countries only
Company
Prosus
Posted
Nov 19, 2026

About the role

Prosus, the group behind Just Eat Takeaway, OLX and PayU, builds LCM, the Large Commerce Model: its own foundation model trained on billions of transactions and interactions across the portfolio, already powering search, recommendations and marketing at iFood. As a senior data engineer you will build and operate LCM's training-data platform, turning events, sessions, orders, catalogues, feedback and external sources into reproducible datasets for scientists and ML engineers. What you'll do - Build acquisition and processing pipelines for portfolio data and public or licensed sources, including connectors and content extraction - Turn commerce records into ordered histories and link behaviour to outcomes without leaking future information - Work with scientists, engineers and the relevant teams on data provenance, permitted use and privacy-aware handling of customer histories - Provide tools for source tagging, sampling and weighting, and maintain evaluation datasets with temporal splits and overlap checks - Build synthetic data pipelines for pre- and post-training: instruction examples, preference data and agent trajectories, with generation, validation, scoring and filtering - Within three months, own part of the platform and deliver a reproducible dataset used in a training run What you bring - At least five years of data engineering experience, including ownership of substantial production pipelines - Strong Python and SQL, with tested, maintainable code - Hands-on distributed processing with Spark, Ray, Beam or a comparable framework What they offer - A flat AI team of about 30 engineers, working directly with applied scientists, training engineers and domain experts - A base at the Amsterdam office and AI House, with relocation support (remote considered for particularly strong candidates) - Scope to publish methods, models and benchmarks - Competitive compensation and a top-spec MacBook Pro

Requirements

Based on:Python

Must-have

  • Apache Spark
  • LLM
  • SQLEssential

About Prosus

Prosus is a global technology company behind some of the world's leading lifestyle ecommerce businesses, such as Just Eat Takeaway, OLX and PayU. Its AI-driven ecosystem spans 100+ companies across ecommerce, food delivery, fintech and experiences, serving billions of consumers, and its investment team backs founders in areas from robotics to frontier AI.

Stack

  • Python
  • Apache Spark
  • LLM
  • SQL

Company

Prosus logo
Prosus
Netherlands
View company profile