A 24% Success Rate for AI Agents - Is That Acceptable?

New Study Shows AI Agents Can't Work Without Humans in the Loop, But Give Them Time Rahul Neel Mani (@rneelmani) • February 3, 2026

Artificial intelligence agents are quickly moving from experimental demos to enterprise pilots. Ultimately agents will be embedded in core business processes, and they're already being used by professionals for tasks such as financial analysis, document review and drafting. But as agentic AI gains momentum, one question goes largely unanswered: How can we measure the effectiveness of AI agents?

See Also: On-Demand | NYDFS MFA Compliance: Real-World Solutions for Financial Institutions

A recent benchmark study, the AI Productivity Index for Agents, or APEX-Agents, sought to answers questions on the minds of CIOs and COOs everywhere. The research, based on real tasks designed by investment banking analysts, management consultants and corporate lawyers, evaluated whether AI agents can handle long-term, cross-application tasks common in knowledge-intensive industries.

How ...