3 articles.
METR ran a randomised controlled trial where 16 experienced open-source developers worked on issues in repositories they knew, with AI tools freely available in half the tasks. Implementation took 19% longer with AI. The developers predicted a 24% speedup before starting and still estimated a 20% speedup afterwards. Economics experts had forecast 39% and ML experts 38%. No confidence interval was published for the headline number, and the study has since been superseded.
Studies across multiple languages and scenarios show GitHub Copilot can produce insecure code suggestions at nontrivial rates. The risk is highest when developers accept suggestions uncritically without security review.
CodeRabbit, Greptile, and GitHub Copilot Code Review compared on price, depth, and the kind of cross-file bug a diff-only reviewer walks right past.