Edit: Ok. Just had another look at http://www.paulgraham.com/arc0.html , specifically the part about changing stuff without even keeping track of the changes. So, I rescind my suggestion for the ChangeLog.

You also say, "full of hacks and note-to-self comments about fixing them.", so there goes the possible TODO file too. :)