LLM Use Degrades Software Development Value, Study Finds
TL;DR. New data from Faros.ai indicates that LLM usage in software development is destroying value, despite individual productivity gains. - The study of 22,000 developers found system-level deployment frequency decreased by 11% with LLM use. - Individual developer productivity saw a modest improvement, at best a 2x increase, not the often-cited 10x. - Faros.ai's report suggests that while developers benefit, the overall software delivery pipeline suffers.
- LLM use in software development negatively impacts overall value creation.
- Individual developer productivity sees modest gains (up to 2x), not 10x.
- System-level metrics, like deployment frequency, show an 11% decline with LLM integration.
- The data comes from Faros.ai, analyzing 22,000 developers and 4,000 teams.
Sources
- brianguthrie.com — brianguthrie.com
- cnbc.com — cnbc.com
- Talk Is Cheap: The Operational Impact of LLM Use — unessays.substack.com