There is a pattern we see repeatedly across enterprise IT organisations right now. Leadership commits to an AI investment. A platform is selected. The project launches with genuine enthusiasm. And then, some months later, the results disappoint. Triage accuracy is lower than expected. The virtual agent is being bypassed. Predictive analytics is producing noise. The vendor is blamed, or the implementation partner, or both.
In our experience, the root cause is rarely the technology. AI tools from the major ITSM vendors are mature and capable. The problem is almost always what the AI has to work with. Garbage in, garbage out is a phrase so old it has become a cliché, but in the context of AI and ITSM it is precisely accurate. AI amplifies what is already there. If what is already there is inconsistent data, poorly defined processes and a knowledge base that nobody maintains, AI will amplify all of it.
The organisations we see getting genuine value from AI in ITSM share one characteristic: they invested in their foundations before they invested in AI. Here are the five signs that your foundations may not be ready.
Sign 1: Your incident categorisation is inconsistent
Pull a sample of 100 recent incidents from your ITSM tool and look at how they have been categorised. If the same type of incident is categorised differently depending on who logged it, which team handled it, or what time of day it arrived, you have an incident categorisation problem. This matters enormously for AI.
AI-powered triage works by recognising patterns in historical incident data and applying those patterns to new incidents. If your historical data is inconsistently categorised, the patterns the AI learns are unreliable. The result is triage recommendations that are frequently wrong, which erodes user trust quickly and causes agents to override the AI rather than act on it. Within weeks the AI triage tool becomes something people work around rather than with.
Fixing incident categorisation before AI deployment is unglamorous work. It requires agreeing a consistent taxonomy, training your team, and running data cleansing on historical records. But it is the single most impactful thing you can do to prepare for AI triage investment.
Sign 2: Your knowledge base hasn't been reviewed in over a year
AI knowledge tools and virtual agents work by surfacing relevant articles from your knowledge base at the point of need. When the knowledge base is well-maintained, this genuinely reduces resolution time and improves first-contact resolution rates. When it is not, the AI surfaces outdated or incorrect content confidently, which is worse than surfacing nothing at all.
A knowledge article that was accurate eighteen months ago may no longer be. Systems change, processes change, contact details change. An AI that recommends a workaround that no longer works, or routes a user to a team that no longer owns that service, does not just fail to help. It actively damages the user's confidence in the service desk.
"An AI that confidently surfaces wrong answers is more damaging to user trust than no AI at all. The knowledge base is not a nice-to-have. It is the foundation AI stands on."
Before deploying AI knowledge tooling, conduct an honest audit of your knowledge base. How many articles exist? When were they last reviewed? What is the process for creating, reviewing and retiring articles? If there is no active knowledge lifecycle, fix that first.
Sign 3: Your service catalogue is incomplete or out of date
Virtual agents and AI self-service tools depend on a well-structured, comprehensive service catalogue. Without it, AI cannot route requests correctly, cannot provide accurate fulfilment guidance, and cannot support genuine self-service. Users who encounter an AI that cannot help them with their actual request do not try again — they pick up the phone.
We frequently encounter organisations where the service catalogue was built during a tool implementation several years ago and has not been meaningfully updated since. Services have been added and retired. Teams have restructured. The tool's service catalogue bears little resemblance to what IT actually delivers today. Deploying AI into this environment produces a self-service experience that is worse than the alternatives, which is not a small problem when self-service deflection is typically one of the headline use cases in the business case for AI investment.
A service catalogue review and refresh is not a small piece of work, but it delivers value independently of AI. It improves request fulfilment, reduces misdirected contacts and gives users a clearer picture of what IT offers. Doing it before AI deployment means the AI has something reliable to work from on day one.
Sign 4: The same incidents keep recurring
Recurring incidents are one of the clearest signals of ITSM foundation weakness, and they create a specific problem for AI. AI-powered problem management and predictive analytics work by identifying patterns in incident data that suggest underlying problems before they escalate. If problem management is not functioning, the same issues recur repeatedly without root cause investigation, and the incident data becomes full of repeating patterns that the AI cannot distinguish from emerging new problems.
More fundamentally, recurring incidents indicate that problem management as a discipline is either absent or not followed. In organisations at this stage, problem records are often raised and then left open indefinitely. Root cause investigations stall. Known errors are logged but the workaround is never communicated to the service desk. The problem record eventually closes not because the problem was resolved but because it became old enough that nobody remembered to chase it.
AI will not fix this. If problem management is broken, AI-powered problem analytics will produce confused outputs that reflect the broken process rather than surfacing genuine insight. The fix is a functioning problem management practice, which means ownership, structured investigation, defined timescales and a commitment to acting on root cause findings.
Sign 5: Your data is not governed or trusted
This is the broadest of the five signs and in some ways the most fundamental. AI performance is entirely dependent on data quality. Not just incident data or knowledge articles, but the full picture: configuration data, asset information, service ownership, team structures, user data. All of it feeds into the decisions AI tools make and the outputs they produce.
In organisations where data governance is weak, this manifests in specific ways. Nobody is sure which version of the CMDB is current. Asset records do not match reality. Service ownership has not been updated since a restructure two years ago. Reporting is distrusted because everyone knows the underlying data is unreliable. In these environments, AI does not solve the data problem. It makes it visible at scale and at speed, which tends to be embarrassing rather than helpful.
Before committing to AI investment, it is worth conducting an honest assessment of your data governance position. Not an aspirational review of what the policies say, but a practical assessment of what the data actually looks like and how much of it can be trusted. That assessment, done properly, will tell you more about your AI readiness than any vendor demo.
What to do if you recognise these signs
Recognising these signs is not a reason to abandon AI ambitions. It is a reason to sequence the investment correctly. The organisations that are getting genuine, measurable value from AI in ITSM are the ones that fixed their foundations first, then deployed AI into an environment where it had reliable inputs to work with. That sequence takes longer to show results but the results, when they come, are real and sustainable.
If you are unsure where your foundations stand, our free AI Readiness Scorecard gives you a directional view across ten key areas in under five minutes. For a more detailed picture, our independent AI readiness assessment covers all the areas above and more, with a prioritised roadmap for getting your organisation into a position where AI investment will actually deliver.
Not sure if your ITSM is ready for AI?
Our free AI Readiness Scorecard takes 5 minutes and gives you an instant view across 10 key areas. Or book a free strategy call to talk through where you stand.
Take the Free AI Readiness Scorecard →