You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
 
Bruce MacDonald d34985b9df add templates to prompt command 3 years ago
desktop reorganize directories 3 years ago
models build server into desktop app 3 years ago
.gitignore add templates to prompt command 3 years ago
README.md add cli 3 years ago
build.py reorganize directories 3 years ago
proto.py add templates to prompt command 3 years ago
requirements.txt reorganize directories 3 years ago
template.py add templates to prompt command 3 years ago

README.md

proto

🙊

Running

Install dependencies:

pip install -r requirements.txt

Put your model in models/ and run:

python3 proto.py serve

To run the app:

cd desktop
npm install
npm start

Building

If using Apple silicon, you need a Python version that supports arm64:

wget https://github.com/conda-forge/miniforge/releases/latest/download/Miniforge3-MacOSX-arm64.sh
bash Miniforge3-MacOSX-arm64.sh

Get the dependencies:

pip install -r requirements.txt

Then build a binary for your current platform:

python3 build.py

Building the app

cd desktop
npm run package

API

GET /models

Returns a list of available models

POST /generate

Generates completions as a series of JSON objects

model: string - The name of the model to use in the models folder. prompt: string - The prompt to use.