Senior Data Engineer, Training Data Platform

Vor Ort · Amsterdam (Niederlande) · Senior · Vollzeit

Mehr Stellen wie diese?

Erstelle dein kostenloses Profil bei PyHires: Du siehst, wie gut du zu jeder Stelle passt, und bekommst jede Woche eine E-Mail mit den Stellen, die zu dir passen.

Mein Profil erstellen

Überblick

Arbeitsmodell
Vor Ort
Standort
Amsterdam (Niederlande)
Anstellung
Vollzeit
Erfahrung
Senior
Sprachen
Englisch
Offen für Bewerber/innen aus
Nur EU-Länder
Unternehmen
Prosus
Veröffentlicht
19. Nov. 2026

Über die Stelle

Prosus, the group behind Just Eat Takeaway, OLX and PayU, builds LCM, the Large Commerce Model: its own foundation model trained on billions of transactions and interactions across the portfolio, already powering search, recommendations and marketing at iFood. As a senior data engineer you will build and operate LCM's training-data platform, turning events, sessions, orders, catalogues, feedback and external sources into reproducible datasets for scientists and ML engineers. What you'll do - Build acquisition and processing pipelines for portfolio data and public or licensed sources, including connectors and content extraction - Turn commerce records into ordered histories and link behaviour to outcomes without leaking future information - Work with scientists, engineers and the relevant teams on data provenance, permitted use and privacy-aware handling of customer histories - Provide tools for source tagging, sampling and weighting, and maintain evaluation datasets with temporal splits and overlap checks - Build synthetic data pipelines for pre- and post-training: instruction examples, preference data and agent trajectories, with generation, validation, scoring and filtering - Within three months, own part of the platform and deliver a reproducible dataset used in a training run What you bring - At least five years of data engineering experience, including ownership of substantial production pipelines - Strong Python and SQL, with tested, maintainable code - Hands-on distributed processing with Spark, Ray, Beam or a comparable framework What they offer - A flat AI team of about 30 engineers, working directly with applied scientists, training engineers and domain experts - A base at the Amsterdam office and AI House, with relocation support (remote considered for particularly strong candidates) - Scope to publish methods, models and benchmarks - Competitive compensation and a top-spec MacBook Pro

Anforderungen

Basiert auf:Python

Muss

  • Apache Spark
  • LLM
  • SQLUnverzichtbar

Über Prosus

Prosus is a global technology company behind some of the world's leading lifestyle ecommerce businesses, such as Just Eat Takeaway, OLX and PayU. Its AI-driven ecosystem spans 100+ companies across ecommerce, food delivery, fintech and experiences, serving billions of consumers, and its investment team backs founders in areas from robotics to frontier AI.

Stack

  • Python
  • Apache Spark
  • LLM
  • SQL

Unternehmen