Senior Machine Learning Engineer, Evals
Vor Ort · Amsterdam (Niederlande) · Senior · Vollzeit
Mehr Stellen wie diese?
Erstelle dein kostenloses Profil bei PyHires: Du siehst, wie gut du zu jeder Stelle passt, und bekommst jede Woche eine E-Mail mit den Stellen, die zu dir passen.
Überblick
- Arbeitsmodell
- Vor Ort
- Standort
- Amsterdam (Niederlande)
- Anstellung
- Vollzeit
- Erfahrung
- Senior
- Sprachen
- Englisch
- Offen für Bewerber/innen aus
- Nur EU-Länder
- Unternehmen
- Prosus
- Veröffentlicht
- 19. Nov. 2026
Über die Stelle
Prosus, the group behind Just Eat Takeaway, OLX and PayU, builds LCM, the Large Commerce Model: its own foundation model trained on billions of transactions and interactions across the portfolio, already powering search, recommendations and marketing at iFood. Evaluation is at the core of the team's work. As Senior ML Engineer you will own the development of evaluations and the platform that runs them, building on ProLLM, Prosus' benchmarking platform for real-world use cases.
What you'll do
- Define meaningful evaluation tasks and implement reliable scoring
- Curate evaluation data and calibrate task difficulty so evaluations separate models of different quality, working with domain experts on sourcing and annotation
- Analyse model outputs and agent trajectories, separate model failures from evaluation problems and explain what changed between versions
- Integrate evaluations into training and release workflows with dashboards and regression checks
- Help portfolio teams contribute evaluations and check whether offline gains match online results
- Within three months, own part of the evaluation platform and deliver new evaluations used in a training or release decision
What you bring
- At least five years of ML or software engineering experience, with substantial hands-on work building and evaluating ML systems
- Strong Python and experience with PyTorch, Transformers or comparable ML libraries, plus reliable production software development
- Experience with language-model training or post-training
What they offer
- A flat AI team of about 30 engineers, working directly with applied scientists, training engineers and domain experts
- A base at the Amsterdam office and AI House, with relocation support (remote considered for particularly strong candidates)
- Scope to publish methods, models and benchmarks
- Competitive compensation and a top-spec MacBook Pro
Anforderungen
Basiert auf:Python
Muss
- Hugging Face
- LLM
- PyTorchUnverzichtbar
Über Prosus
Prosus is a global technology company behind some of the world's leading lifestyle ecommerce businesses, such as Just Eat Takeaway, OLX and PayU. Its AI-driven ecosystem spans 100+ companies across ecommerce, food delivery, fintech and experiences, serving billions of consumers, and its investment team backs founders in areas from robotics to frontier AI.
Stack
- Python
- Hugging Face
- LLM
- PyTorch
Unternehmen
Prosus
Niederlande