Productive and lively discussion at coffee today (Ben Weiner visiting from NOAO, Zabludoff, Moustakas, Blanton, myself) about good policies for the journals and large surveys to adopt in regards the public release of data and code.
My vision (with which no-one agreed) is that the journals should require all papers be released with a tarball that contains all the data and code, such that a reader can unpack the tarball, type make, and produce all of the analyses and figures for that paper! Of course there are implementation issues, but if we want to
stay clamped to the manifold of repeatable science (Sam Roweis) we have no other options. I could write about this for hours, but I have an NSF proposal due. I hope to return to this later, because in the course of the discussion I discovered many new reasons to support my view.
We are very far from my vision right now, and it is hard to get there incrementally.