AI guide · Updated August 2026

An AI chatbot over your own documents: what it costs, and where it breaks

These systems are genuinely useful and they are also confidently wrong in four specific, predictable situations. Most vendors demo the parts that work. Here are both halves.

What it costs

Four routes, and what each buys you

The pilot row is the one to take seriously. Two to four weeks and a couple of lakh tells you whether the production build is worth commissioning at all.

RouteCostWhat you get
Off-the-shelf tool₹2,000 – ₹15,000 / monthUpload documents, ask questions. Fine for a small, tidy document set and a team that can live with generic answers.
Pilot / proof of concept₹75,000 – ₹2,50,000Two to four weeks on your real documents with an agreed pass mark. The cheapest way to find out if this works for you.
Production build₹4,00,000 – ₹20,00,000Permissions, evaluation, citations, integration with SharePoint, Drive or your intranet. Three to five months.
Running cost₹8,000 – ₹80,000 / monthModel API usage, vector storage and hosting. Scales with query volume and how much context each answer needs.

Running cost is the figure most proposals leave out. It scales with query volume and with how much document context each answer needs — a system answering 500 questions a day costs meaningfully more to operate than one answering 50.

Where it fails

Four question types that produce confident, wrong answers

These aren't bugs to be fixed in a later version — they're consequences of how retrieval works. Ask any vendor how they handle each one specifically.

"How many..." and "which is the highest..."

Counting and aggregation across many documents. Retrieval fetches a handful of relevant chunks, so the model answers from those rather than the full set. Ask how many contracts expire this quarter and you'll get a confident, wrong number.

Questions where the answer changed

Policy v3 supersedes v1, but both are in the index and both look authoritative. Without version handling the system will happily quote the outdated one. This is the failure that causes real damage in HR and compliance use.

Anything living in a scanned image or a spreadsheet

Scanned PDFs need OCR before they're readable at all. Spreadsheets lose their meaning when flattened into text — a table of rates becomes a wall of numbers with no structure. Both need handling as explicit work, not assumptions.

Questions needing reasoning across documents

"Does our leave policy conflict with what we promised in the Mumbai contract?" requires holding two documents together and comparing them. Standard retrieval fetches passages; it doesn't reason across sources. Possible to build, but it's a different and more expensive system.

Where it works

Four use cases that genuinely pay off

All four share a shape: the answer already exists in one place, and the cost is a person spending time finding it.

Finding the clause nobody can locate

Policy documents, SOPs, contracts and manuals where the answer exists in one place and someone has to find it. This is what retrieval is genuinely good at, and it's most of the value.

The questions your senior people keep answering

Every organisation has two or three people who get interrupted constantly because they know where things are. That interruption load is the measurable thing a document assistant removes.

Onboarding new staff

New joiners ask a high volume of questions with answers already written down somewhere. High query volume, low risk if an answer is imperfect — close to an ideal first use case.

Support teams working from a knowledge base

Agents finding the right article faster while a human still decides what to tell the customer. The human review step is what makes this safe to deploy early.

How to test it

Five steps that tell you the truth in two weeks

Run this with two vendors at once if you can. Same questions, same documents, same scoring — the difference in what comes back is usually stark.

  1. 1

    Write 30 real questions before you see any demo

    Collect them from the people who'd actually use it, in their own words. Include the awkward ones. Questions written after watching a demo are unconsciously shaped to suit it.

  2. 2

    Include ten you know the system should struggle with

    Counting questions, superseded policies, anything in a scanned document. You're not trying to make it fail — you're finding out whether the vendor tells you it failed.

  3. 3

    Use your actual documents, not the tidy sample

    The scanned ones, the near-duplicate versions, the spreadsheet everyone relies on. Clean data proves nothing about how this performs on Monday morning.

  4. 4

    Require a citation with every answer

    Which document, which section. Without citations nobody can verify an answer, and an unverifiable answer in a policy context is worse than no answer at all.

  5. 5

    Score it honestly and set the bar before you start

    Correct, partially correct, or wrong — decided by someone who knows the right answers. Agree the pass mark in writing beforehand, because deciding what counts as success afterwards always ends in an argument.

Don't build if

Five reasons to wait

The first one accounts for most failed projects we've seen. No retrieval system rescues a document store nobody has organised.

Hold off when any of these are true

  • 01Your documents aren't organised — fix that first, no AI system rescues a chaotic file store
  • 02Under about 50 documents — search and a good folder structure will serve you better
  • 03The questions need counting or aggregation rather than finding a passage
  • 04Nobody will own keeping the index current as documents change
  • 05You need certainty rather than a good answer — for legal or regulatory certainty, a human still reads the document

Questions

What teams ask before starting

Not covered here? Ask us directly — we answer scoping questions without putting you into a sales sequence.

What does an internal AI chatbot for company documents cost in India?

Off-the-shelf tools cost ₹2,000 to ₹15,000 a month. A proof of concept on your real documents costs ₹75,000 to ₹2,50,000 over two to four weeks. A production build with permissions, evaluation, citations and integration into SharePoint or Drive costs ₹4,00,000 to ₹20,00,000 across three to five months. Running costs add ₹8,000 to ₹80,000 monthly depending on query volume.

What is RAG and how does it work?

RAG stands for retrieval-augmented generation. Your documents are split into passages and indexed. When someone asks a question, the system retrieves the passages most likely to contain the answer and passes them to a language model, which writes a reply grounded in that text. This is why RAG can cite sources — and why it struggles with questions requiring the whole document set rather than a few passages.

When does a document AI chatbot give wrong answers?

Four situations reliably. Counting or aggregation questions, because retrieval fetches a few passages rather than everything. Questions where an older document was superseded but both remain indexed. Content locked in scanned images or spreadsheets, which need OCR and structured handling. And questions requiring reasoning across two documents at once. Ask any vendor how they handle each of these specifically.

Is it safe to put company documents into an AI system?

It can be, with three things in place. Document-level permissions so the assistant only surfaces what that user could already open. A named model provider with data retention terms confirming your content isn't used for training. And an audit log of queries and answers. Ask for all three in writing — vague reassurance that it's 'completely secure' is not an answer.

How many documents do you need for this to be worth it?

Below roughly 50 documents, a good folder structure and search will usually serve you better. The value grows with volume and with how scattered the information is — a few hundred policies, SOPs, contracts and manuals across several systems is where a document assistant genuinely earns its cost. The other requirement is that the documents are reasonably organised to begin with.

How long does it take to build an internal document chatbot?

A proof of concept on your real documents takes two to four weeks. A production system takes three to five months, and most of that time goes into permissions, evaluation and handling edge cases rather than the retrieval itself. Anyone promising a production-grade internal assistant in two weeks is showing you a demo and skipping the evaluation work that keeps it trustworthy.

Send us thirty real questions

Not a requirements document — the actual questions your team asks each other. We'll tell you which ones retrieval handles well, which ones it won't, and whether a pilot is worth running at all.

Scope a pilot
Government of India Seal (Ashok Stambh)
MSME Registered
Government e-Marketplace — GeM