The instinct is understandable. Finance flags an unexpected AI API charge. Legal asks about data handling for a model you didn't know existed. The CISO wants a full inventory by end of week. So you do what seems logical: pull access, mandate approval workflows, lock down the API keys.
Congratulations. You've just ensured that every engineer who was using a tool openly will now use it through a personal credit card and a VPN. Shadow AI doesn't disappear when you clamp down — it just gets better at hiding.
The more productive path is a collaborative audit: one that treats engineers as partners in the discovery process rather than suspects in an investigation. It's harder to execute than a top-down lockdown, but it produces a governance framework that actually holds because the people who have to live inside it helped build it.
This is that playbook.
Why the Top-Down Approach Backfires
Before getting into mechanics, it's worth understanding why the authoritarian approach fails so predictably. Engineers don't reach for shadow AI tools because they're trying to circumvent policy. They reach for them because the approved path doesn't work — the procurement cycle takes six weeks, the approved tool can't handle their use case, or nobody thought to approve anything at all because there was no AI governance framework when the tools became available.
When you respond to that with a compliance crackdown, you're punishing problem-solving. The message engineers hear is: we didn't build you a path, and now we're going to blame you for finding your own. That's a relationship-damaging message, and it will cost you cooperation you need both for this audit and for every governance initiative that follows.
The alternative framing: we have tools in use that we don't have full visibility into, and that's a risk to everyone — the company legally, the engineers professionally, and the products technically. We want to understand what's being used, why it's being used, and how we can get it into a framework that protects the people using it while giving us the visibility we need.
That framing is not soft. It's strategic. It converts engineers from audit subjects into audit partners.
What You're Actually Looking For
A shadow AI audit has four discovery surfaces. You need to work all of them, and you need to understand what each reveals and what it misses.
Financial Scanning
Start with accounts payable and expense reports. Look for charges from known AI vendors: Anthropic, OpenAI, Mistral, Cohere, Replicate, Hugging Face, Together AI, and the growing roster of model API providers. Also look for infrastructure charges that could be masking AI spend — AWS Bedrock, Azure AI, Google Vertex AI costs embedded in broader cloud bills.
Financial scanning finds tools that are being paid for. It misses tools on free tiers, tools accessed through shared credentials, and tools where someone else is paying (a vendor who bundles AI into their SaaS, for instance).
Network and API Layer Analysis
Work with your platform or security team to look at outbound API calls to known AI endpoints. This is more technically intensive but reveals active usage that may not show up in financials. You're looking for DNS queries and HTTPS connections to api.openai.com, api.anthropic.com, and similar endpoints.
This finds tools in active use. It misses tools being accessed through proxies, tools that are installed but dormant, and tools accessed from personal devices on personal networks.
Codebase Search
A search of your version control system for AI SDK imports, API client instantiations, and common AI model references will surface tools embedded in production code. This is often where the most consequential shadow AI lives — not the analyst's ChatGPT subscription, but the GPT-4 call quietly sitting inside a customer-facing workflow.
This finds tools that made it into code. It misses tools used in workflows that don't touch the codebase: content generation, research, internal tooling built outside version control.
Team Survey
The most comprehensive and most underused method. Ask people what they're using. A well-designed survey, properly framed, will surface more than any technical scan because engineers know their own workflows and most of them will tell you honestly if they believe you're not going to use the information against them.
The framing matters enormously. The survey is not: "Are you using unapproved tools?" It is: "We want to understand what AI tools would be most valuable to formally support. What are you using today, even if it's unofficial, and what problem is it solving?"
How to Frame the Audit to Your Engineering Team
Before you start any of the above, communicate with the engineering organization directly. Not through a policy memo — through a conversation, ideally with leadership visible and engaged.
The communication should accomplish three things:
- Acknowledge the gap: Your governance framework hasn't kept pace with the availability of AI tools. That's a structural problem, not an individual failure.
- Name the risk: Without visibility, you can't protect the company from data leakage, compliance exposure, or unexpected cost. These risks fall on engineers too, not just on the company.
- Describe the outcome: The goal is an approved toolset that engineers can actually use, with a clear process for getting new tools added. The audit is the first step toward that, not an exercise in finding violations.
Then be specific about what you're going to do: a financial scan, a codebase search, a survey. Don't surprise people with network analysis after telling them you're doing a survey — that will feel like surveillance and will be treated accordingly.
Handling What You Find
The audit will turn up tools that were being used without authorization. How you handle those findings will determine whether you end up with a governance framework or an underground resistance movement.
High-Risk Findings
Some findings will require immediate action regardless of the relationship implications: customer data being passed to consumer AI tools, keys with production access committed to public repositories, tools processing regulated data outside their contractual scope. These are genuine security and compliance incidents and need to be handled as such — but even here, the response should be "we need to fix this together" rather than "someone is in trouble."
Medium-Risk Findings
The majority of shadow AI findings are not security incidents. They're tools that engineers are using legitimately but informally — a Cursor license on a personal card, an OpenAI API key for a side project that turned into a production tool, a team-level Anthropic account that nobody in procurement knows about. These don't require punitive action. They require a transition plan: how do we get this into the official system?
Low-Risk Findings
Free-tier tools, tools used for personal productivity rather than company data, tools that have been abandoned but left installed. These can often be left alone or quietly deprecated without anyone losing anything meaningful.
Turning the Audit Into a Framework
The audit is only valuable if it produces something durable. The most common failure mode is doing the audit, documenting what you found, and then allowing the same patterns to re-emerge because you didn't build the infrastructure to prevent them.
The infrastructure you need has three components:
An Approved Tool Registry
A living document — ideally tooling, not a spreadsheet — that lists approved AI tools, their approved use cases, their data classification permissions, and their cost owners. The audit should populate the initial version of this registry. Keep the approval process fast enough that people don't route around it: if getting a tool approved takes three months, the shadow AI problem will immediately reconstitute itself.
A Fast-Track Approval Process
Design the approval process with engineering velocity in mind. A lightweight checklist — what data will this touch, who is the cost owner, what's the expected spend — can be reviewed in days rather than weeks. Build in a provisional approval tier for low-risk tools so engineers can start using them while the full review completes.
Attribution and Visibility Infrastructure
The audit tells you what's being used today. Attribution infrastructure tells you what's being used tomorrow and next month. This means tagging every AI call with a team, product, and use-case identifier so that when costs appear, you can trace them to their origin. Without this, you'll be back doing audits every six months because spend will again become invisible.
Platforms like Oberhahn are built specifically for this layer — centralizing AI spend data, enforcing attribution at the key level, and surfacing anomalies before they become incidents. Getting that infrastructure in place as a direct output of the audit converts a one-time discovery exercise into an ongoing governance capability.
What Success Looks Like
A well-executed collaborative audit ends with three things: a complete inventory of AI tools in use, a populated approved tool registry with clear owners, and an engineering team that trusts the governance process enough to come to you first rather than routing around it.
That last one is the hardest to achieve and the most valuable. If engineers believe that asking for approval is faster and easier than using a personal card, you've solved the shadow AI problem structurally. The audit is just the mechanism that gets you to that state.
The top-down approach — lock everything, mandate everything, audit for violations — does achieve a kind of compliance. It's just compliance that doesn't survive contact with actual engineering work. The collaborative approach takes longer to execute, requires more organizational skill, and produces governance that holds.
The choice is between a shadow AI problem you can see and one you can't. The engineers who are already routing around your controls aren't going away. The question is whether they're doing it in the open, where you can manage it, or in the dark, where you can't.