ollama

Commit Graph

Author	SHA1	Message	Date
Michael Yang	ba7d31240e	fix: own lib/ollama directory expand backend loading error handling to catch more problems and log them instead of panicing	1 year ago
Daniel Hiltgen	4879a234c4	build: Make target improvements (#7499 ) * llama: wire up builtin runner This adds a new entrypoint into the ollama CLI to run the cgo built runner. On Mac arm64, this will have GPU support, but on all other platforms it will be the lowest common denominator CPU build. After we fully transition to the new Go runners more tech-debt can be removed and we can stop building the "default" runner via make and rely on the builtin always. * build: Make target improvements Add a few new targets and help for building locally. This also adjusts the runner lookup to favor local builds, then runners relative to the executable, and finally payloads. * Support customized CPU flags for runners This implements a simplified custom CPU flags pattern for the runners. When built without overrides, the runner name contains the vector flag we check for (AVX) to ensure we don't try to run on unsupported systems and crash. If the user builds a customized set, we omit the naming scheme and don't check for compatibility. This avoids checking requirements at runtime, so that logic has been removed as well. This can be used to build GPU runners with no vector flags, or CPU/GPU runners with additional flags (e.g. AVX512) enabled. * Use relative paths If the user checks out the repo in a path that contains spaces, make gets really confused so use relative paths for everything in-repo to avoid breakage. * Remove payloads from main binary * install: clean up prior libraries This removes support for v0.3.6 and older versions (before the tar bundle) and ensures we clean up prior libraries before extracting the bundle(s). Without this change, runners and dependent libraries could leak when we update and lead to subtle runtime errors.	2 years ago
frob	e66c29261a	Better error suppresion when getting terminal colours (#7739 ) Co-authored-by: Richard Lyons <frob@cloudstaff.com>	2 years ago
frob	5c18e66384	Notify the user if systemd is not running (#6693 ) Co-authored-by: Richard Lyons <frob@cloudstaff.com>	2 years ago
Daniel Hiltgen	4759d879f2	Install support for jetpacks (#7632 ) Follow up to #7217 - merge after release	2 years ago
王卿	c7c845ec52	Update install.sh：Replace "command -v" with encapsulated functionality (#6035 ) Replace "command -v" with encapsulated functionality	2 years ago
Erkin Alp Güney	7d89e48f5c	install.sh: update instructions to use WSL2 (#6450 )	2 years ago
Daniel Hiltgen	a017cf2fea	Split rocm back out of bundle (#6432 ) We're over budget for github's maximum release artifact size with rocm + 2 cuda versions. This splits rocm back out as a discrete artifact, but keeps the layout so it can be extracted into the same location as the main bundle.	2 years ago
Daniel Hiltgen	88bb9e3328	Adjust layout to bin+lib/ollama	2 years ago
Daniel Hiltgen	74d45f0102	Refactor linux packaging This adjusts linux to follow a similar model to windows with a discrete archive (zip/tgz) to cary the primary executable, and dependent libraries. Runners are still carried as payloads inside the main binary Darwin retain the payload model where the go binary is fully self contained.	2 years ago
Daniel Hiltgen	df3802a65f	Adjust arm cuda repo paths Ubuntu distros fail to install cuda drivers since aarch64 isn't valid	2 years ago
Daniel Hiltgen	ce3c93b08f	Report better error on cuda unsupported os/arch If we detect an NVIDIA GPU, but nvidia doesn't support the os/arch, this will report a better error for the user and point them to docs to self-install the drivers if possible.	2 years ago
Daniel Hiltgen	1a1c99e334	Bump latest fedora cuda repo to 39	2 years ago
jayson-cloude	157f09acdf	fix: "Skip searching for network devices" On an Ubuntu 24.04 computer with vmware installed, the sudo lshw command will get stuck. "Network interfaces" is always displayed	2 years ago
Jeffrey Morgan	1f5008544b	Update install.sh	2 years ago
Jeffrey Morgan	45cbfc5aee	fix wsl2 status check for nvidia cards (#4689 )	2 years ago
Jeffrey Morgan	6d423b383b	Improve install experience on WSL2 and Linux (#4653 )	2 years ago
Jeffrey Morgan	b7d316d98d	fix nvidia detection in install script (#4683 )	2 years ago
Jeffrey Morgan	c79f8c9c39	Ensure `nvidia` and `nvidia_uvm` kernel modules are loaded in `install.sh` script and at startup (#4652 ) * ensure kernel modules are loaded in `install.sh` script and at startup * indentation * use `SUDO` variable * restart if nouveau is detected * consistent success message for AMD	2 years ago
Jeffrey Morgan	485016bfbb	Update install.sh	2 years ago
Daniel Hiltgen	e592e8fccb	Support Fedoras standard ROCm location	2 years ago
Daniel Hiltgen	6459377ae0	Add ROCm support to linux install script (#2966 )	2 years ago
Daniel Hiltgen	74468513bd	Add ollama user to video group On OpenSUSE, ollama needs to be a member of the video group to access the GPU	2 years ago
Josh	f983ef7f5f	Update install.sh success message	2 years ago
Jeffrey Morgan	1c8435ffa9	Update domain name references in docs and install script (#2435 )	3 years ago
Michael Yang	d9bfb2f08f	install: pin fedora to max 37 repos for fedora 38 and newer do not exist as of this commit ``` $ dnf config-manager --add-repo https://developer.download.nvidia.com/compute/cuda/repos/fedora38/x86_64/cuda-fedora38.repo Adding repo from: https://developer.download.nvidia.com/compute/cuda/repos/fedora38/x86_64/cuda-fedora38.repo Status code: 404 for https://developer.download.nvidia.com/compute/cuda/repos/fedora38/x86_64/cuda-fedora38.repo (IP: 152.195.19.142) Error: Configuration of repo failed ```	3 years ago
Daniel Hiltgen	2fcd41ef81	Fail fast on WSL1 while allowing on WSL2 This prevents users from accidentally installing on WSL1 with instructions guiding how to upgrade their WSL instance to version 2. Once running WSL2 if you have an NVIDIA card, you can follow their instructions to set up GPU passthrough and run models on the GPU. This is not possible on WSL1.	3 years ago
Daniel Hiltgen	2588cb2daa	Add ollama user to render group for Radeon support For the ROCm libraries to access the driver, we need to add the ollama user to the render group.	3 years ago
Michael Yang	95cb38ae47	install: fix rocky kernel packages	3 years ago
jeremiahbuckley	39be7fdb98	fix rhel cuda install (#1321 ) Co-authored-by: Cloud User <azureuser@testgpu2.hqzwom21okjenksna4y3c4ymjd.phxx.internal.cloudapp.net>	3 years ago
Jeffrey Morgan	a185b29719	fix install script error on linux	3 years ago
Michael Yang	32add8577d	placeholder environment variables	3 years ago
yanndegat	75295b9528	install: fix enable contrib on debian 12 (#1151 ) On debian 12, sources definitions have moved from /etc/apt/sources.list to /etc/apt/sources.list.d/debian.sources	3 years ago
thealhu	1359d6cf3b	Fix sudo variable in install.sh (#1034 ) It was forgotten to replace sudo at one place with the variable for sudo.	3 years ago
Bruce MacDonald	1fb9288661	notify that the ollama api is available after linux install (#954 )	3 years ago
Michael Yang	92119de9d8	update linux.md	3 years ago
Bruce MacDonald	c039432b5c	add current user to ollama group on install (#772 )	3 years ago
Victor Vieux	6481b7f34c	Update install.sh, avoid ARCH: unbound variable	3 years ago
Bruce MacDonald	958a5a8184	revert fedora cuda version check	3 years ago
Bruce MacDonald	a2b210130f	fedora install fixes (#609 )	3 years ago
Michael Yang	29c056ea39	ordered list of install locations	3 years ago
Michael Yang	9fc3bba9cf	do no unload nouveau driver	3 years ago
Michael Yang	6e6b655956	update install.sh	3 years ago
Michael Yang	5e388f931e	check cuda installed before installing	3 years ago
Michael Yang	d5ad41dd7b	fix path for wsl user	3 years ago
Michael Yang	d294a11bc9	start service on exit instead of immediately	3 years ago
Michael Yang	1b9dcab3ab	ignore systemctl is-system-running exit code	3 years ago
Michael Yang	b934bf23e6	exit on unknown distro (#594 )	3 years ago
Michael Yang	0c5f47177c	update install.sh	3 years ago
Michael Yang	d0854bf1e6	fix dkms on debian	3 years ago

1 2

62 Commits (main)