Daniel Hiltgen
74468513bd
Add ollama user to video group
On OpenSUSE, ollama needs to be a member of the video group
to access the GPU
2 years ago
Daniel Hiltgen
98e0b7e94f
Refine container image build script
Allow overriding the platform, image name, and tag latest for
standard and rocm images.
2 years ago
Jeffrey Morgan
275ea01587
restore windows build flags and compression
2 years ago
Jeffrey Morgan
8782dd5628
fix `build_windows.ps1` script to run `go build` with the correct flags
2 years ago
Josh
f983ef7f5f
Update install.sh success message
2 years ago
Jeffrey Morgan
1ae1c33651
Windows build + installer adjustments ( #2656 )
* remove `-w -s` linker flags on windows
* use `zip` for windows installer compression
2 years ago
Jeffrey Morgan
92423b0600
add `dist` directory in `build_windows.ps`
2 years ago
Daniel Hiltgen
df6dc4fd96
Fix duplicate menus on update and exit on signals
Also fixes a few fit-and-finish items for better developer experience
2 years ago
Daniel Hiltgen
272e53a1f5
Prepare to distribute standalone windows executable
This will be useful for our automated test riggig, and may be useful for
advanced users who want to "roll their own" system service
2 years ago
jmorganca
7ad9844ac0
set exe metadata using resource files
2 years ago
Daniel Hiltgen
29e90cc13b
Implement new Go based Desktop app
This focuses on Windows first, but coudl be used for Mac
and possibly linux in the future.
2 years ago
Daniel Hiltgen
9da9e8fb72
Move Mac App to a new dir
2 years ago
Jeffrey Morgan
1c8435ffa9
Update domain name references in docs and install script ( #2435 )
2 years ago
Daniel Hiltgen
75c44aa319
Add back ROCm container support
This adds ROCm support back as a discrete image.
2 years ago
Daniel Hiltgen
3005ec74b3
Set a default version using git describe
If a VERSION is not specified, this will generate a version string that
represents the state of the repo. For example `0.1.21-12-gffaf52e-dirty`
representing 12 commits away from 0.1.21 tag, on commit gffaf52e
and the tree is dirty.
2 years ago
Daniel Hiltgen
df54c723ae
Make CPU builds parallel and customizable AMD GPUs
The linux build now support parallel CPU builds to speed things up.
This also exposes AMD GPU targets as an optional setting for advaced
users who want to alter our default set.
2 years ago
Daniel Hiltgen
da72235ebf
Combine the 2 Dockerfiles and add ROCm
This renames Dockerfile.build to Dockerfile, and adds some new stages
to support 2 modes of building - the build_linux.sh script uses
intermediate stages to extract the artifacts for ./dist, and the default
build generates a container image usable by both cuda and rocm cards.
This required transitioniing the x86 base to the rocm image to avoid
layer bloat.
2 years ago
Jeffrey Morgan
dc88cc3981
use `gzip` for runner embedding ( #2067 )
2 years ago
Daniel Hiltgen
1b249748ab
Add multiple CPU variants for Intel Mac
This also refines the build process for the ext_server build.
2 years ago
Michael Yang
d9bfb2f08f
install: pin fedora to max 37
repos for fedora 38 and newer do not exist as of this commit
```
$ dnf config-manager --add-repo https://developer.download.nvidia.com/compute/cuda/repos/fedora38/x86_64/cuda-fedora38.repo
Adding repo from: https://developer.download.nvidia.com/compute/cuda/repos/fedora38/x86_64/cuda-fedora38.repo
Status code: 404 for https://developer.download.nvidia.com/compute/cuda/repos/fedora38/x86_64/cuda-fedora38.repo (IP: 152.195.19.142)
Error: Configuration of repo failed
```
2 years ago
Daniel Hiltgen
d88c527be3
Build multiple CPU variants and pick the best
This reduces the built-in linux version to not use any vector extensions
which enables the resulting builds to run under Rosetta on MacOS in
Docker. Then at runtime it checks for the actual CPU vector
extensions and loads the best CPU library available
2 years ago
Daniel Hiltgen
052b33b81b
DRY out the Dockefile.build
2 years ago
Daniel Hiltgen
9754ae4c89
Support optional override of the target archictures
This can help speed up incremental builds when you're only testing one
archicture, like amd64. E.g.
BUILD_ARCH=amd64 ./scripts/build_linux.sh && scp ./dist/ollama-linux-amd64 test-system:
2 years ago
Jeffrey Morgan
34344d801c
clean up cmake `build` directory when cross compiling macOS builds
2 years ago
Michael Yang
f9961c70ae
update build
2 years ago
Daniel Hiltgen
2fcd41ef81
Fail fast on WSL1 while allowing on WSL2
This prevents users from accidentally installing on WSL1 with instructions
guiding how to upgrade their WSL instance to version 2. Once running WSL2
if you have an NVIDIA card, you can follow their instructions to set up
GPU passthrough and run models on the GPU. This is not possible on WSL1.
2 years ago
Daniel Hiltgen
2588cb2daa
Add ollama user to render group for Radeon support
For the ROCm libraries to access the driver, we need to add the ollama user
to the render group.
2 years ago
Jeffrey Morgan
ec261422af
use `docker build` in build scripts
2 years ago
Daniel Hiltgen
697bea6939
Guard integration tests with a tag
This should help CI avoid running the integration test logic in a
container where it's not currently possible.
2 years ago
Jeffrey Morgan
b80081022f
cache docker builds in `build_linux.sh`
2 years ago
Daniel Hiltgen
e5202eb687
Quiet down llama.cpp logging by default
By default builds will now produce non-debug and non-verbose binaries.
To enable verbose logs in llama.cpp and debug symbols in the
native code, set `CGO_CFLAGS=-g`
2 years ago
Daniel Hiltgen
fa24e73b82
Remove CPU build, fixup linux build script
2 years ago
Daniel Hiltgen
1b991d0ba9
Refine build to support CPU only
If someone checks out the ollama repo and doesn't install the CUDA
library, this will ensure they can build a CPU only version
2 years ago
Daniel Hiltgen
51082535e1
Add automated test for multimodal
A simple test case that verifies llava:7b can read text in an image
2 years ago
Daniel Hiltgen
35934b2e05
Adapted rocm support to cgo based llama.cpp
2 years ago
Daniel Hiltgen
d4cd695759
Add cgo implementation for llama.cpp
Run the server.cpp directly inside the Go runtime via cgo
while retaining the LLM Go abstractions.
2 years ago
Michael Yang
95cb38ae47
install: fix rocky kernel packages
2 years ago
jeremiahbuckley
39be7fdb98
fix rhel cuda install ( #1321 )
Co-authored-by: Cloud User <azureuser@testgpu2.hqzwom21okjenksna4y3c4ymjd.phxx.internal.cloudapp.net>
2 years ago
Jeffrey Morgan
927e3ba4a4
tag image with correct version when building with `build_docker` script
2 years ago
Jeffrey Morgan
85e4441c6a
cache docker builds
2 years ago
Jeffrey Morgan
a185b29719
fix install script error on linux
2 years ago
Jeffrey Morgan
41434a7cdc
build intel mac with correct binary and compile flags
2 years ago
Michael Yang
32add8577d
placeholder environment variables
2 years ago
yanndegat
75295b9528
install: fix enable contrib on debian 12 ( #1151 )
On debian 12, sources definitions have moved from
/etc/apt/sources.list to /etc/apt/sources.list.d/debian.sources
2 years ago
thealhu
1359d6cf3b
Fix sudo variable in install.sh ( #1034 )
It was forgotten to replace sudo at one place with the variable for sudo.
2 years ago
Bruce MacDonald
1fb9288661
notify that the ollama api is available after linux install ( #954 )
2 years ago
Michael Yang
92119de9d8
update linux.md
2 years ago
Bruce MacDonald
c039432b5c
add current user to ollama group on install ( #772 )
2 years ago
Victor Vieux
6481b7f34c
Update install.sh, avoid ARCH: unbound variable
2 years ago
Jeffrey Morgan
598621afab
add push script for docker images
2 years ago