Senior Product Manager, Evals

Il y a 2 jours

SaintOuenl'Aumône, Île-de-France PENCIL Télétravail Temps plein 90 000 € - 120 000 € Contrat

Pencil is seeking a leader to own the Evals & Quality charter, defining success metrics, rubrics, and evaluation processes for our generative AI advertising platform. You will shape how we measure first-pass quality, coverage, and regression, aligning automated judges with human raters and scaling QC across formats and client contexts.

You will also own the golden dataset, its versioning, and the public adevals.ai site, ensuring rigorous evidence for commercial work and client responses.