
The AI Vendor Dossier: Buying Evidence, Not a Demo
AI procurement should test the service behind the interface: data handling, evaluations, security, operations, cost, portability, and exit.
Read MoreZharfAI Team

This guide is written for the product manager, support lead, or CTO who searches for a Persian chatbot and wants a defensible decision path instead of a promotional demo. The real question is usually not whether building a chatbot is possible; it is. The real questions are which workflow deserves automation, how Persian answer quality gets measured before deployment, and which controls stop a confident wrong answer from reaching a real customer.
Modern language models produce fluent Persian, and that fluency has raised Iranian users' expectations. In practice, three families of business use deliver most of the value: answering repetitive customer questions from approved documents, helping internal staff find the correct procedure and clause, and drafting replies for human review. A fourth family, taking direct action on systems such as placing orders or editing customer records, requires far more operational maturity and much stricter authority boundaries, and it is rarely the right starting point.
The important difference between a legacy rule-based bot and a language-model assistant is how each one fails. A rule-based bot goes silent when it does not know the answer; a language model may construct a wrong answer with complete confidence. A sound enterprise design manages this failure pattern from day one rather than discovering it after the first customer complaint.
For organizational question answering, the reference pattern is retrieval-augmented generation, introduced in the original RAG research paper: instead of relying purely on training memory, the model grounds each answer in documents retrieved from the organization's approved repository. Three components decide quality in practice: how documents are chunked and indexed, how accurately retrieval works for Persian queries, and a system prompt that binds the model to citations and to an honest refusal when nothing relevant is found.
Our working rule on projects is simple: every answer must cite a specific clause of an approved document, and when retrieval returns nothing, the bot must say it has no answer and route the user to a human. Mandatory citations build user trust and make review and audit possible.
Persian processing has details that an English demo never shows: the half-space and multiple character forms, Persian and Latin digits, the Solar Hijri calendar, inconsistent spellings of loanwords, and mixed Persian-English technical text. Research such as the ParsBERT language model paper demonstrated that Persian-specific modeling produces measurable gains in text understanding; the same logic applies to normalization, search, and evaluation.
The most practical advice is to build your test set from the language your users actually write, not from polished formal Persian. Conversational phrasing, typos, internal abbreviations, and multi-part questions belong in the evaluation set, because that is what real users type.
A good chatbot is built from a good knowledge base. Before signing anything, prepare four things: an inventory of approved documents with owners and validity dates, real samples of frequent questions from current channels, a clear definition of out-of-scope questions, and a human escalation path with response hours. If the correct answer is scattered across several contradictory documents, your first problem is content governance rather than artificial intelligence; the bot will simply expose the existing contradictions to customers faster.
A realistic estimate is that preparing and cleaning content usually takes longer than connecting the model. Put that hidden cost into the project plan.
Ownership matters as much as preparation: every document in the knowledge base needs a named owner who is responsible for keeping it current, because an assistant that quotes an expired policy with a confident citation is worse than one that says nothing. Agree on a review cadence for high-change documents such as pricing and terms before launch, not after the first incident.
Before deployment, build a versioned acceptance set: real questions, reference answers, and the supporting document for each answer. Then measure four things separately: the rate of grounded answers, citation correctness, the rate of honest refusals, and the severity of unsupported answers. An average satisfaction score cannot reveal a dangerous failure; one wrong answer about pricing or contractual commitments costs more than ten mediocre ones.
Our guide to choosing an AI company in Iran explains why the same acceptance set should also be the basis for comparing vendors: without an identical test, comparing demos only compares presentation skills.
A chatbot connected to internal documents is a new attack surface. The OWASP Top 10 for generative language model applications is a good starting point for threat modeling: prompt injection through user messages or retrieved documents, sensitive data exposure in answers or logs, and excessive tool authority. For each relevant threat, define a preventive control and a test: separating the system prompt from retrieved content, filtering sensitive data before indexing, constraining the answer domain, and keeping inspectable event logs.
Management frameworks such as the NIST AI Risk Management Framework help these controls get an owner and a review cycle instead of remaining a scattered checklist.
Launching to all users at once is almost always a mistake. The low-risk path has three stages: first, shadow mode, where the bot generates answers that only staff can see; second, assisted use, where staff edit and send the drafts; and finally, direct answers for a bounded domain of low-risk questions, with automatic escalation of ambiguous cases. Define explicit promotion criteria for each stage and let the data decide, not project enthusiasm.
If a voice channel is on the roadmap, stabilize the text path first; our article on Persian speech technology explains why Persian speech recognition and synthesis add a separate layer of complexity.
After deployment, metrics must connect to business outcomes: full resolution rate without escalation, time to first useful answer, correct escalation rate, user satisfaction by topic, and cost per resolved conversation. Alongside these, keep a weekly qualitative review of sampled conversations; quality degradation usually shows up in samples before it moves any aggregate number.
One overlooked but valuable metric is knowledge coverage: what share of questions reaches a document that actually contains the answer? Growth in that number means the content improvement loop genuinely works.
We have repeatedly seen five failure patterns: starting with an unbounded scope instead of one defined workflow, trusting a clean-data demo instead of evaluating on real data, missing a human escalation path with response hours, neglecting knowledge base updates after launch, and having no product owner who reviews conversations weekly. None of these are model problems; they are operational design problems, and preventing them is cheaper than curing them.
If you want to see how a company-knowledge assistant behaves, the live ZharfAI assistant is available on our chat page and demonstrates the same citation and escalation pattern this guide describes.

AI procurement should test the service behind the interface: data handling, evaluations, security, operations, cost, portability, and exit.
Read More
A practical guide to deciding when AI should answer, seek evidence, defer, or refuse using calibrated signals, risk–coverage curves, and fallback capacity.
Read More
A field guide to admitting, quarantining, or rejecting MCP servers, plugins, and agent tools using provenance, capability tests, and enforceable runtime limits.
Read MoreIf this note maps to a real system in your organization, start with the services page or a shipped case study.