AI & Agentic AI · 6 min read
AI still needs a data foundation
Better prompts cannot compensate for messy definitions, missing lineage, and weak data models. AI works best when it can reason over trusted business context.
Updated
Better prompts cannot compensate for weak data foundations. A prompt can make an AI response sound organized, but it cannot create trusted definitions, repair missing lineage, reconcile conflicting metrics, or decide which source system should be treated as authoritative. If the underlying business context is messy, AI will often make the mess faster, more fluent, and harder to spot.
This matters because many AI initiatives begin with an exciting interface. A user asks a question in natural language and receives a confident answer. The demo looks promising. Then the team asks a harder question: "Which revenue number did it use?" or "Why does this answer not match the dashboard?" or "Can we trust this recommendation enough to act on it?" Those questions reveal whether the AI is connected to a real data foundation or only wrapped around fragments of context.
AI works best when it can reason over trusted business context. That context includes clean source data, shared definitions, lineage, permissions, freshness rules, and a model that represents how the business actually operates.
Why AI exposes data gaps
Traditional reporting often hides data gaps because people know where the exceptions are. An analyst may know that one dashboard uses booked sales while another uses shipped sales. A planner may know which export needs manual cleanup. A finance team may know which fees are missing until close. These workarounds are informal, but they keep the organization moving.
AI does not inherit that institutional knowledge unless it is captured in the model, metadata, documentation, or retrieval layer. If "customer," "account," "product," "margin," or "active" means different things across systems, the AI may select an inappropriate definition or combine incompatible measures. A well-designed assistant should ask for clarification or explain its chosen interpretation instead.
The same problem appears in data freshness. If an assistant retrieves yesterday's inventory but today's ad spend, the recommendation may be wrong. If a model uses a stale product hierarchy, category-level summaries may mislead decision makers. If permissions are weak, AI may expose context to people who should not see it.
The foundation AI needs
An AI-ready data foundation does not need to be perfect. It does need to be explicit. The most important building blocks are:
- Source ownership. Which systems are authoritative for orders, inventory, products, customers, campaigns, finance, and plans?
- Data contracts. What fields are expected, how often do they arrive, and what changes should trigger review?
- Quality checks. Which completeness, uniqueness, freshness, reconciliation, and anomaly checks protect downstream use?
- Lineage. Where did the answer come from, and what transformations shaped it?
- Semantic definitions. What does each metric mean, and what grain, filter, and business rule are attached to it?
- Permissions. Who can see which data, documents, customers, financials, or operational details?
- Context documents. What policies, definitions, runbooks, and examples should the AI retrieve?
- Evaluation sets. Which known questions and answers prove the system is behaving well?
These foundations help every kind of AI. Predictive models need reliable historical features. Retrieval systems need approved documents and metadata. Agents need tools that operate against clean entities. Copilots need shared definitions so they do not contradict the reporting layer.
A practical example
Consider an AI assistant for retail replenishment. A user asks, "Which SKUs are at risk next week?" The assistant needs more than a language model. It needs product, location, sales, inventory, open orders, forecast, lead time, pack size, account priority, and service-level context. It also needs to know whether "inventory" means on hand, available to promise, or on hand plus inbound.
Without that foundation, the assistant may summarize a report but miss the operational decision. It might flag a SKU with low inventory even though inbound supply arrives tomorrow. It might ignore a product with healthy total inventory but severe shortage in a key region. It might recommend replenishment for a low-margin item where the better decision is markdown or rationalization.
With a governed foundation, the AI can provide a better answer: "These five SKU-location combinations are most at risk because recent sell-through is above forecast, inbound supply is late, and weeks of supply is below threshold. The recommended first step is to rebalance from nearby locations before placing a new order." That answer is useful because the data model understands the business.
Data modeling is not optional
AI projects sometimes try to skip modeling by connecting a model directly to raw tables, files, or documents. That can be fine for exploration, but it is rarely enough for operational use. Raw data usually reflects how systems store transactions, not how people make decisions.
A good model resolves business entities: product, SKU, account, campaign, customer, vendor, store, location, order, shipment, claim, and forecast. It also defines relationships between them. This is what allows AI to answer cross-domain questions. For example, an Amazon Marketplace recommendation may need to connect ad spend, inventory coverage, Buy Box status, sales velocity, fees, returns, and margin. A document-only assistant cannot do that reliably without modeled data.
Retrieval needs governance too
Retrieval-augmented generation, often called RAG, can make AI more grounded by retrieving relevant documents or data snippets before answering. But retrieval is only as good as the content and metadata behind it. If outdated policies remain in the index, the assistant may cite them. If documents lack ownership, nobody knows whether they are still valid. If permissions are not enforced, the assistant can become a new data leakage path.
Governed retrieval should include document ownership, versioning, freshness, access control, source citation, and retirement. It should also include testing. Ask the assistant known questions and confirm that it retrieves the right sources, refuses when context is missing, and does not overstate confidence.
Build the foundation in increments
The right answer is not to pause AI until the entire data platform is perfect. It is to pick a use case and build the minimum trustworthy foundation around it. If the goal is a finance assistant, start with approved metrics, close status, definitions, and access controls. If the goal is a commerce recommendation engine, start with advertising, inventory, sales, fees, and product entities. If the goal is a policy assistant, start with current documents, ownership, and permissions.
This incremental approach creates value while improving the foundation. Each use case strengthens contracts, definitions, lineage, and evaluation assets that later use cases can reuse.
Test what the assistant must not retrieve
Positive examples are only half of a readiness check. Test that a user cannot retrieve another account's records, see restricted financial fields through a summary, or recover deleted material from an old search index. Apply authorization in the retrieval and tool layers; a prompt asking the model to respect permissions is not an access-control mechanism.
Track the identity and effective permissions used for each request. Shared caches and generated summaries need the same attention as source documents because they can preserve information after access changes. Return a clear unavailable or permission-limited answer when necessary, without revealing confidential details through an explanation of the restriction. These checks connect data governance to observable system behavior rather than relying on a reassuring instruction.
A useful test
Before putting AI in front of a business workflow, ask:
- Can we explain which data sources the answer used?
- Do the definitions match our reporting and planning process?
- Is the data fresh enough for the decision?
- Can the user see evidence or citations?
- Are permissions enforced?
- Do we have test questions with expected answers?
- Is there a feedback loop when the answer is wrong?
If the answer is no, the issue may not be the model. It may be the foundation.
VeriVal helps teams prepare AI-ready data foundations: source contracts, warehouse models, semantic layers, governed retrieval, evaluation sets, and operating controls. If AI is on the roadmap but the data context is not ready yet, start a conversation.