Senior Data Engineer, Training Data Platform

In sede · Amsterdam (Paesi Bassi) · Senior · Tempo pieno

Vuoi altre offerte come questa?

Crea il tuo profilo gratuito su PyHires: vedrai quanto sei compatibile con ogni offerta e riceverai ogni settimana un'email con quelle più adatte a te.

Crea il mio profilo

Panoramica

Modalità di lavoro
In sede
Sede
Amsterdam (Paesi Bassi)
Tipo di contratto
Tempo pieno
Seniority
Senior
Lingue
Inglese
Aperta a candidati da
Solo Paesi UE
Azienda
Prosus
Pubblicata
19 nov 2026

Il ruolo

Prosus, the group behind Just Eat Takeaway, OLX and PayU, builds LCM, the Large Commerce Model: its own foundation model trained on billions of transactions and interactions across the portfolio, already powering search, recommendations and marketing at iFood. As a senior data engineer you will build and operate LCM's training-data platform, turning events, sessions, orders, catalogues, feedback and external sources into reproducible datasets for scientists and ML engineers. What you'll do - Build acquisition and processing pipelines for portfolio data and public or licensed sources, including connectors and content extraction - Turn commerce records into ordered histories and link behaviour to outcomes without leaking future information - Work with scientists, engineers and the relevant teams on data provenance, permitted use and privacy-aware handling of customer histories - Provide tools for source tagging, sampling and weighting, and maintain evaluation datasets with temporal splits and overlap checks - Build synthetic data pipelines for pre- and post-training: instruction examples, preference data and agent trajectories, with generation, validation, scoring and filtering - Within three months, own part of the platform and deliver a reproducible dataset used in a training run What you bring - At least five years of data engineering experience, including ownership of substantial production pipelines - Strong Python and SQL, with tested, maintainable code - Hands-on distributed processing with Spark, Ray, Beam or a comparable framework What they offer - A flat AI team of about 30 engineers, working directly with applied scientists, training engineers and domain experts - A base at the Amsterdam office and AI House, with relocation support (remote considered for particularly strong candidates) - Scope to publish methods, models and benchmarks - Competitive compensation and a top-spec MacBook Pro

Requisiti

Basata su:Python

Indispensabili

  • Apache Spark
  • LLM
  • SQLEssenziale

Chi è Prosus

Prosus is a global technology company behind some of the world's leading lifestyle ecommerce businesses, such as Just Eat Takeaway, OLX and PayU. Its AI-driven ecosystem spans 100+ companies across ecommerce, food delivery, fintech and experiences, serving billions of consumers, and its investment team backs founders in areas from robotics to frontier AI.

Stack

  • Python
  • Apache Spark
  • LLM
  • SQL

Azienda