A nice example of getting around goodharts law is Google’s pageranking algorithms becoming more and more private over time. Seeing like a state notesExplanation, Ethics, and AI
On this note, cf. tyler cowen interview, why is the spam/anti-spam arms race never in balances where spam wins for 3 months, then theres no spam for 6, then all spam for 6, why the equilibrium?