You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
 
Jeffrey Morgan 8685a5ad18 move .prettierrc.json to root 3 years ago
app move .prettierrc.json to root 3 years ago
docs Move python docs to separate file 3 years ago
ollama output confirmation after pull 3 years ago
.gitignore add templates to prompt command 3 years ago
.prettierrc.json move .prettierrc.json to root 3 years ago
Dockerfile add basic `Dockerfile` 3 years ago
LICENSE `proto` -> `ollama` 3 years ago
README.md Move python docs to separate file 3 years ago
models.json change name.json 3 years ago
poetry.lock use ctransformers as backup to llama-cpp 3 years ago
pyproject.toml v0.0.9 3 years ago
requirements.txt use ctransformers as backup to llama-cpp 3 years ago

README.md

Ollama

Ollama is a tool for running large language models. It's designed to be easy to use and fast.

Note: this project is a work in progress. Certain models that can be run with ollama are intended for research and/or non-commercial use only.

Install

Using pip:

pip install ollama

Using docker:

docker run ollama/ollama

Quickstart

To run a model, use ollama run:

ollama run orca-mini-3b

You can also run models from hugging face:

ollama run huggingface.co/TheBloke/orca_mini_3B-GGML

Or directly via downloaded model files:

ollama run ~/Downloads/orca-mini-13b.ggmlv3.q4_0.bin

Documentation