Local Model (Local LLM)
A large language model downloaded and run directly on your own computer or server without sending data to third parties.
What is a local model?
Local models are large language models (LLMs) that are downloaded and run directly on your own computer or company server. You don't need an internet connection to run them, and you don't send any data to third parties.
Advantages
- Data privacy: Data never leaves your server
- No monthly fees: You only pay for hardware
- Offline operation: Works without internet connection
Tools for local models
The most popular tool for running local models is Ollama, which allows easy downloading and running of models like Llama, Mistral, or Phi.