Reward Hacking

A reward signal is a proxy for an intended outcome. Reward hacking describes achieving that proxy in a way that defeats the intention.

Concrete Problems in AI Safety includes avoiding reward hacking among its research problems. The submission event places the paper in the chronology.