Artificial intelligence has become the top priority for many professional services firms.
Leaders are rolling out AI assistants, copilots, and knowledge bots to boost productivity. Then they hit the same wall.
The AI can't find the answers.
Not because the technology is weak. Because the knowledge behind it is a mess.
Garbage in, garbage out.
The Adoption Gap Is Real
This isn't a hypothetical problem. It's showing up in the data.
Generative AI adoption in professional services jumped from 33% to 71% between 2023 and 2024, faster than almost any other sector, according to McKinsey. But adoption isn't the same as results.
Thomson Reuters' 2026 AI in Professional Services survey of over 1,500 professionals found that only 18% of organizations actually track ROI on their AI investment. Another 40% don't even know if it's being measured. Firms are buying the tools. Few can say whether the tools are working.
That gap traces back to the same root cause: the knowledge feeding the AI isn't ready.
Where Your Firm's Knowledge Actually Lives
If your firm's information is scattered across:
- Email threads
- Teams chats
- Individual desktops
- Multiple SharePoint sites
- Old project folders
- Employees' memories
then AI has no reliable source of truth to draw from. It doesn't fail loudly. It fails quietly, by giving different answers to the same question depending on who asks and when.
AI Needs Organized Knowledge
Before AI can deliver consistent results, a firm needs:
- Clearly documented processes
- Current policies
- Consistent terminology
- Structured project documentation
- Well-organized knowledge repositories
Skip these, and AI doesn't fix confusion. It scales it.
What This Looks Like in Practice
When the foundation is missing: A partner asks the firm's new AI assistant for the standard client onboarding process. The AI pulls from three different versions of the process saved by three different people over the past five years, none of them marked as current. It gives a confident answer that's two years out of date. The partner trusts it. The client gets the wrong instructions.
When the foundation is there: Audit teams that pair AI with well-structured, standardized engagement documentation are seeing real results. EY has reported AI-augmented audit teams completing engagements 35% faster while catching 22% more material issues, because the underlying methodology and workpapers were already consistent and well organized before AI touched them.
The people side matters too: A 2025 Altman Weil survey of 350 law firms found that firms rolling out AI document review cut paralegal hours by 45%, but many struggled because the knowledge and judgment paralegals held in their heads was never captured or documented. Firms that saw the disruption coming and built structured knowledge repositories ahead of time made the transition smoothly. Firms that didn't saw confusion, attrition, and AI outputs nobody fully trusted.
Same technology. Different outcome. The difference is what the AI had to work with.
Knowledge Management Comes First
Knowledge management builds the structure AI depends on. It identifies what knowledge is critical, captures the expertise sitting in people's heads, organizes the information, and keeps it current.
Only then can AI reliably retrieve and apply it.
Future-Proofing Your Firm
The firms getting the most value from AI didn't start with technology. They started by fixing how knowledge moves through their organization.
Knowledge management isn't a separate initiative from your AI strategy. It's the prerequisite.
The Real Question
The question isn't whether your firm will adopt AI. It almost certainly will. The question is whether your knowledge is ready for it. Because AI can't organize knowledge that doesn't exist.