25% of Incoming Pull Requests May Be AI Slop, Finds Study From Linux Foundation Research
So what do these results show us? “Generative AI is fundamentally changing how people participate in open source,” says the head of Open Source Ecosystem Development at Huawei’s R&D subsidiary Futurewei, which helped support the study. Specifically GenAI is “lowering barriers to contribution” but also “creating new challenges” for maintainers and communities. Their recommendation? “Build the governance, transparency and trust mechanisms that allow AI-assisted contributions to strengthen, but not overwhelm, the open source ecosystem.”
“Open source projects need to design for a growing AI-generated contributor base, not simply react to it,” said Hilary Carter, SVP of Research at the Linux Foundation. “That means setting clear expectations for GenAI, putting responsibility for testing and disclosure on contributors and giving maintainers better tools to manage incoming pull requests. If we get those fundamentals right, AI can expand participation without overburdening and increasing costs for maintainers.”
More from the blog It’s FOSS:
LF Research is the Linux Foundation’s research arm. It was set up in 2021 and publishes studies on how open source is built and used, drawing on surveys and project data. Its latest report, Navigating Open Source Software Development in the Generative AI Era, surveyed 234 contributors and maintainers on how generative AI is affecting the way open source gets made…Other interesting findings:
64% say reviews now take longer. Burnout is their top concern at 63%, narrowly ahead of contribution quality at 60%.
You will also find that policies have not caught up to the AI-assisted coding and vulnerability reporting trend. Of the 119 respondents who answered the question, 35% said their project has a formal policy permitting AI use. Another 32% have none and no plans for one, 23% plan to write one, and 10% ban AI contributions outright....
Most maintainers (71%) say AI makes it easier for newcomers to start contributing.
- “Respondents estimate average time reductions across all six OSS development activities measured, including proposal discussions (19%) and code authoring (52%). For high-complexity tasks, however, 21% of respondents report taking more time when using GenAI.”
- “71% of maintainers agree GenAI reduces barriers to entry for OSS, but 53% of maintainers disagree that GenAI has improved community trust.”
- Developers are reinvesting the time they save back into open source: 66% report using productivity gains to address technical debt, 63% to develop new features and 58% for learning and upskilling.
- Continued investment in human mentorship remains important: 46% of maintainers say GenAI increases the need for mentorship of new contributors, compared with 32% who say it decreases that need.
OpenSSF and LF AI & Data also helped support the study.
When you can’t be bothered to to write something..