Chatbot (AI chatbot)
A conversational application that replies to users in real time. Modern variants use LLMs and RAG.
What is a chatbot?
A chatbot is a software application that carries on a conversation with a user in natural language. The first generation worked on fixed rules and keywords, while modern AI chatbots rely on LLMs and usually on RAG too, so that answers are factual and grounded in your own knowledge base.
Types of chatbots
- Rule-based: Responds using preset rules and scripts (decision tree). Simple, but limited.
- AI chatbot (LLM): Powered by a language model. Understands context and replies freely, but may hallucinate without RAG.
- RAG chatbot: Combines an LLM with your documentation. Answers are grounded in real data.
- Agent chatbot: Built on agent systems - not only replies but also acts (places an order, writes to a database, calls an API).
Key components of an AI chatbot
- System prompt: Defines the chatbot's role, tone, and rules
- Knowledge base: Documents and FAQs the chatbot answers from
- Guardrails: Limits on what the chatbot may and may not do
- Integrations: Connections to websites, email, Slack, WhatsApp, or n8n