Bertram Ludäscher, Kyle Chard, Niall Gaffney, Matthew B. Jones, Jaroslaw Nabrzyski, Victoria Stodden, and Matthew Turk, Capturing the “Whole Tale” of Computational Research: Reproducibility in Computing Environments
see here: https://arxiv.org/abs/1610.09958
A Nature interview with Victoria Stodden on making research reproducible and sharing research code. Victoria Stodden is now one of the reproducibility editors of JASA. Read the article here.
Very interesting article here.
Some more interesting resources, including slide decks and/or presentation recordings:
EPFL is organizing a workshop on open research data on October 28, 2014. Interesting program and list of speakers, I hope some great conclusions and policies will follow!
While preparing my talk last week in Leuven, I wanted to update the slide with non-reproducible results making news headlines. Unfortunately, it’s always very easy to find recent material for that slide…
An interesting site which I recently discovered in that respect, is RetractionWeb: an overview of retracted works. And when reading some of the recent posts, I can fully see how the authors have a hard time keeping up with all related news. The authors also describe why they started this blog. Great site! Sad to see so much news on it.
It has been silent here for a while again, which by no means implies that people promoting reproducible research were sitting still.
ResearchCompendia.org is a site set up by Victoria Stodden and her colleagues at Columbia university. It invites everyone to upload their research compendia (paper with source code) onto the site. It has a clean interface, and the source code for the site is maintained at GitHub. Currently the site already contains more than 200 compendia, maybe soon also yours?
Another nice article on reproducible research by Victoria Stodden in IMS Bulletin:
V. Stodden, Resolving Irreproducibility in Empirical and Computational Research, IMS Bulletin, Nov 2013.
I just read a very well-written article on reproducible research, giving 10 simple but important rules for making your results (more) reproducible:
It’s probably the way things go, but still I feel sad about it. One of the reproducible research tools linked on our site does not seem to exist anymore: ResearchAssistant (by Daniel Ramage). Typical story: PhD student graduates, and moves on to another position (I did find a “now at Google” when searching what happened), and the web pages with useful links and tools disappear. RIP.
(If you read this blog in the next month, and you know that ResearchAssistant is still alive, let me know. I promise to keep the link alive for another month.)