1 article.
METR ran a randomised controlled trial where 16 experienced open-source developers worked on issues in repositories they knew, with AI tools freely available in half the tasks. Implementation took 19% longer with AI. The developers predicted a 24% speedup before starting and still estimated a 20% speedup afterwards. Economics experts had forecast 39% and ML experts 38%. No confidence interval was published for the headline number, and the study has since been superseded.