AnythingLLM is an open-source, customizable, and feature-rich document chatbot application that allows you to intelligently chat with or build knowledge bases using existing documents.
Key Features of AnythingLLM
- Support for multiple LLMs like OpenAI, Microsoft Azure, and Anthropic
- Multi-user support with permissioning
- AI agents that can browse the web, run code, etc.
- Ability to create an embeddable chat widget for your website
- Support for various document types like PDF, TXT, DOCX
- Two chat modes: conversation (retains context) and query (simple QA)
- In-chat citations
- Ability to manage documents in a vector database from a simple UI
- Efficient cost-saving measures for managing large documents
- Full developer API for custom integrations
AnythingLLM can be run locally as a desktop app on Mac, Windows and Linux, or hosted remotely using Docker. It aims to provide an open-source, private and customizable alternative to ChatGPT with no compromises.