From Repeated Questions to Instant Answers
How an AI Knowledge Bot Saved a Financial Services Team Thousands of Hours
The Challenge
A mid-sized financial services company had a familiar problem: the same questions kept getting asked, and the same people kept answering them.
The DevOps team — about 10 engineers — were fielding constant queries from across the business. "How do I set up my dev environment?" "Where's the runbook for X?" "What's the process for Y?" The answers existed somewhere — buried in Slack threads, GitHub repos, internal wikis, and people's heads — but nobody could find them quickly.
The IT support team of 20 had it worse. They were handling thousands of tickets a month, many of which were variations of the same handful of questions. Senior engineers were spending hours on repetitive support instead of doing the work they were hired for.
The Approach
Boxcar built an AI-powered Slack bot that connected to the company's existing knowledge sources — Slack history, GitHub documentation, internal wikis, and runbooks. No new tools for employees to learn, no portals to log into. It worked right where the team already worked: Slack.
The bot was designed with clear boundaries. It answered what it could confidently, flagged what it wasn't sure about, and escalated what it couldn't handle. Boxcar set up simple YAML configuration files so subject-matter experts could fine-tune the bot's behaviour for their specific domain — no coding required.
The initial build took two weeks. The DevOps team were the first users, and it worked well enough that word spread quickly.
The Outcome
The bot was built on a reusable framework — standing up a new instance for a different team was straightforward, each with its own Slack channel, GitHub repos, and documentation sources. Within a few months, 16 teams across the business had their own bots. Nobody mandated it. Teams saw it working and asked for their own.
For IT support, about 40% of queries were now handled entirely by the bot, with another 20% partially assisted. That's a significant chunk of repetitive work that no longer lands on someone's desk. Engineers got their time back, and employees got faster answers. Across the IT Support and DevOps teams alone, the bot delivered over $200K AUD in annual efficiency savings — freeing skilled engineers from repetitive questions and reducing support bottlenecks, with further gains across 14 additional teams that adopted the system organically.
The bot kept learning. As teams used it and fed back on answers, accuracy stayed above 97%. The YAML configuration approach meant teams could adjust the bot's knowledge and behaviour themselves — Boxcar built the capability, not the dependency.
Got a Similar Challenge?
Let's talk about how we can help your business.