Why CIOs Are Rethinking AI Strategy as ROI Pressure Mounts in 2026
Chief Information Officers are shifting from experimental AI pilots to demanding measurable financial returns, forcing a fundamental rethinking of how enterprises approach artificial intelligence investments. According to CIO.com's 2026 State of the CIO survey, 82% of CIOs are responsible for researching and evaluating AI products, with 78% saying their IT departments are driving AI adoption efforts. But boards and executives are no longer content with proof-of-concept projects; they want quantifiable business value.
What Changed in the AI Investment Landscape?
The shift is dramatic. Kyndryl's 2025 Readiness Report found that 61% of senior business leaders felt more pressure to prove AI ROI than they did the previous year. This pressure is translating into real results. According to the May 2026 AI Momentum Survey from Dun & Bradstreet, 67% of 10,000 businesses surveyed reported seeing early signs or pockets of AI ROI, 20% reported multiple projects delivering returns, and 10% reported strong ROI. That represents significant progress compared to earlier findings, where MIT's research found that 95% of enterprise generative AI projects failed to show measurable financial returns within six months.
"The era of funding AI is shifting from everything all-in to every project has to have line of sight to some financial value at the end of the day. It's moving from the experimentation phase to expecting measurable outcomes," said Jim Piazza, Chief AI Officer at IT services firm Ensono.
Jim Piazza, Chief AI Officer at Ensono
However, the pressure to deliver results quickly creates a paradox. The No. 1 concern for CEOs this year, according to PwC's 2026 Global CEO Survey, is whether they're transforming fast enough to keep pace with technological change, cited by 42% of respondents. Yet moving too quickly can backfire. Steve Santana, CIO and head of AI at ETS, the world's largest private nonprofit educational testing and assessment organization, believes innovation should trump speed.
"The winners and losers in the AI race aren't always going to be the ones that got there the fastest. Those who move too fast can drive behaviors that are very dangerous," said Steve Santana, CIO and head of AI at ETS.
Steve Santana, CIO and head of AI at ETS
Why Are AI Infrastructure Costs So Hard to Predict?
One major obstacle to proving ROI is cost uncertainty. Research firm IDC found that global 1,000 companies will underestimate their AI infrastructure costs by 30% through 2027. This gap between projected and actual spending makes it extremely difficult for CIOs to identify which AI use cases will produce genuine value. Yet waiting for perfect cost data is not an option.
"You can't sit on the sidelines and wait and watch. The general conclusion is you're going to lose if you do that, so you have to play even though the cost dynamics are not really well understood," said Mohan Sankararaman, Executive Vice President and CIO of First Horizon Bank.
Mohan Sankararaman, Executive Vice President and CIO of First Horizon Bank
Sankararaman is addressing this challenge by treating AI cost management as a strategic discipline, similar to how organizations optimized cloud spending. He emphasizes the importance of avoiding vendor lock-in and preventing over-engineering of solutions. IDC research suggests that organizations successfully managing this challenge share a common trait: they've reimagined FinOps (financial operations) as a strategic team, not an after-the-fact accounting exercise, treating AI economics as a continuously optimized ecosystem.
How to Build a Winning AI Use-Case Strategy
With limited budgets and unlimited potential applications, CIOs must prioritize ruthlessly. Enterprise Strategy Group's 2025 report on generative AI's ROI surveyed 1,900 business and IT leaders across nine countries and uncovered a critical challenge:
- Use-Case Abundance Problem: 71% of respondents had more potential AI use cases they wanted to pursue than they could possibly fund, creating a prioritization nightmare.
- Selection Difficulty: 54% said selecting the right use cases based on objective measures like cost, business impact, and organizational execution capability is hard.
- High Stakes: 71% acknowledged that selecting the wrong use cases could hurt their company's market position, and 59% said advocating for the wrong use cases could cost them their job.
The root cause of this challenge, according to longtime CIO adviser Larry Wolff, is that boards and CEOs often command their teams to "do AI" without first establishing clear business goals. This puts technology first and business strategy second, a mistake CIOs have been trying to avoid for years.
"There should not be a technology strategy. There should be a business strategy with a technology component. The same applies to AI. We need to talk about business challenges and opportunities first and then talk about how AI can solve for those," said Larry Wolff, CIO of Preferred Travel Group.
Larry Wolff, CIO of Preferred Travel Group
Why AI Fluency Matters More Than You Think
Even as organizations build their AI strategies, many lack sufficient understanding of what the technology can actually do. Sankararaman noted that while executives at his organization have basic AI knowledge, "AI fluency isn't where it should be," and that subpar fluency "can hamper creativity." When leaders don't understand AI's capabilities and limitations, they can't design ambitious enough strategies or identify transformative use cases.
Sankararaman
This knowledge gap has real consequences. If a company's strategic goal is to become top-notch in customer experience but its leadership doesn't fully understand what AI can accomplish, the resulting roadmap will be unnecessarily limited. Sankararaman is addressing this by running AI boot camps for executives and their direct reports to improve their knowledge of the technology and its potential applications.
The 2026 AI landscape is fundamentally different from the previous era of experimentation. CIOs are now expected to be strategic business partners who can navigate cost uncertainty, prioritize high-impact use cases, and build organizational fluency around AI capabilities. Success requires balancing speed with measured innovation, avoiding vendor lock-in, and ensuring that every AI investment connects directly to business outcomes that boards and CEOs can measure and defend.