AI-authored code contains worse bugs than software crafted by humans

Generating code using AI increases the number of issues that need to be reviewed and the severity of those issues.

CodeRabbit, an AI-based code review platform, made that determination by looking at 470 open source pull requests for its State of AI vs Human Code Generation report.

The report finds that AI-generated code contains significantly more defects of logic, maintainability, security, and performance than code created by people.

On average, AI-generated pull requests (PRs) include about 10.83 issues each, compared with 6.45 issues in human-generated PRs. That's about 1.7x more when AI is involved, meaning longer code reviews and increased risk of defects.

Problems caused by AI-generated PRs also tend to be more severe than human-made messes. AI-authored PRs contain 1.4x more critical issues and 1.7x more major issues on average than human-written PRs, the report says.

Machine-generated code therefore seems to require reviewers ...