Goodhart’s regulation famously says: “When a measure turns into a goal, it ceases to be a just right measure.” Even supposing at the start from economics, it’s one thing we need to grapple with at OpenAI when working out the way to optimize targets which are tricky or expensive to measure.
