Answer knowledge base questions with a faster, cheaper AI chatbot

Routes simple questions to a fast, cheap AI model and hard questions to a smarter one, so answers stay quick and affordable.

How the work actually flows

It branches. Exactly one path is taken.

Pattern: Exclusive Choice (4) · Simple Merge (5)

flowchart TD trig>"user sends chat message"]:::trig s0["check message complexity"]:::task s1["reply with lightweight model"]:::svc s2["search docs answer with strong model"]:::svc trig --> s0 s1 --> s2 gx{"× simple message or real question"}:::gate s0 --> gx p00["quick lightweight reply"]:::task gx -->|"simple message"| p00 p10["search docs strong model answer"]:::task gx -->|"real question"| p10 jn{"○ reply sent"}:::gate p00 --> jn p10 --> jn jn --> s1 out[/"fast cost controlled chatbot reply"/]:::out pay{{"keeps AI costs down without losing accuracy"}}:::pay s2 --> out out --> pay classDef task fill:#e7f6fe,stroke:#34b8f0,color:#2c2a29 classDef svc fill:#f6f8fa,stroke:#7c8795,color:#2c2a29 classDef mi fill:#e7f6fe,stroke:#0079a8,color:#2c2a29,stroke-width:2px classDef human fill:#fff,stroke:#0079a8,color:#0079a8 classDef store fill:#f6f8fa,stroke:#0079a8,color:#2c2a29 classDef trig fill:#00a4eb,stroke:#0079a8,color:#fff,font-weight:bold classDef trigtime fill:#00a4eb,stroke:#0079a8,color:#fff,font-weight:bold classDef trigdata fill:#8ad4f5,stroke:#0079a8,color:#06314c,font-weight:bold classDef gate fill:#fff,stroke:#e8a23d,color:#6b4708,font-weight:bold classDef out fill:#1f9d6b,stroke:#167a53,color:#fff,font-weight:bold classDef pay fill:#06314c,stroke:#021f33,color:#fff
Starts itA stepAn outside serviceOne path onlyPaths rejoinResultPayoff
Build size
Advanced

A larger build with multiple systems, AI reasoning, and custom rules.

Business functions
AI Agents & Autonomous SystemsAI Chatbots & AssistantsKnowledge Base & RAG
Connects
OpenAI

The problem it solves

Running an AI chatbot on your documentation can get expensive fast if every single message, even a simple hello, gets sent to your most powerful and costly model. You want fast, accurate answers to real questions without paying premium rates for basic chit-chat.

Who it fits

Businesses running a customer-facing or internal AI chatbot who want to control ongoing AI costs.

How it works

  1. A user sends a message in the chat
  2. The system checks whether it is a simple message or a real question
  3. Simple messages get a quick reply from a lightweight model
  4. Real questions are searched against your documents and answered by a stronger model
What you get

Smart answers without runaway AI costs

You get quick answers to simple questions and stronger answers to hard ones, keeping your chatbot fast and affordable.

What you get

A fast, cost-controlled chatbot reply, sourced from your own documents when needed.

What you need

An OpenAI API key and a knowledge base account.

We can build this. But should you?

The hard question is not how to build it. It is whether this is the right thing to build first.

That is what a Fractional Chief AI Officer figures out with you, before anyone writes a line of code.

Let's Talk Strategy

Related automations

Back to the AI Playbook