Goodhart’s Law:
Once a social or economic indicator or other surrogate measure is made a target for the purpose of conducting social or economic policy, then it will lose the information content that would qualify it to play such a role.
Translation: once people know what you’re measuring, they start to game the system. Read about it here.
Tags: No Tags
1 comment
Comments feed for this article
Trackback link
http://hughmcguire.net/2008/01/16/goodharts-law/trackback/
January 16, 2008 at 9:30 pm
Mat
well, the correct solution (not mentioned in the post) is to construct more robust algorithms, i.e. that place more weight on ungameable data (similarly attribute little weight to questionable data), that behave well at the edge, and that penalize unwanted behaviour.
the laws of biology/physics/chemistry serve as good prototypes. eg you can’t game gravity, or death, or energy conservation.