ollama

Commit Graph

Author	SHA1	Message	Date
Daniel Hiltgen	539043f5e0	CI automation for tagging latest images	2 years ago
Patrick Devine	1b272d5bcd	change `github.com/jmorganca/ollama` to `github.com/ollama/ollama` (#3347 )	2 years ago
Daniel Hiltgen	b8c2be6142	Use Rocky Linux Vault to get GCC 10.2 installed This should hopefully only be a temporary workaround until Rocky 8 picks up GCC 10.4 which fixes the NVCC bug	2 years ago
Daniel Hiltgen	949b6c01e0	Revamp go based integration tests This uplevels the integration tests to run the server which can allow testing an existing server, or a remote server.	2 years ago
Daniel Hiltgen	540f4af45f	Wire up more complete CI for releases Flesh out our github actions CI so we can build official releaes.	2 years ago
Daniel Hiltgen	6459377ae0	Add ROCm support to linux install script (#2966 )	2 years ago
Jeffrey Morgan	b5fcd9d3aa	use `-trimpath` when building releases (#3069 )	2 years ago
Jeffrey Morgan	cdf65e793f	only copy deps for `amd64` in `build_linux.sh`	2 years ago
Daniel Hiltgen	6c5ccb11f9	Revamp ROCm support This refines where we extract the LLM libraries to by adding a new OLLAMA_HOME env var, that defaults to `~/.ollama` The logic was already idempotenent, so this should speed up startups after the first time a new release is deployed. It also cleans up after itself. We now build only a single ROCm version (latest major) on both windows and linux. Given the large size of ROCms tensor files, we split the dependency out. It's bundled into the installer on windows, and a separate download on windows. The linux install script is now smart and detects the presence of AMD GPUs and looks to see if rocm v6 is already present, and if not, then downloads our dependency tar file. For Linux discovery, we now use sysfs and check each GPU against what ROCm supports so we can degrade to CPU gracefully instead of having llama.cpp+rocm assert/crash on us. For Windows, we now use go's windows dynamic library loading logic to access the amdhip64.dll APIs to query the GPU information.	2 years ago
Daniel Hiltgen	74468513bd	Add ollama user to video group On OpenSUSE, ollama needs to be a member of the video group to access the GPU	2 years ago
Daniel Hiltgen	98e0b7e94f	Refine container image build script Allow overriding the platform, image name, and tag latest for standard and rocm images.	2 years ago
Jeffrey Morgan	275ea01587	restore windows build flags and compression	2 years ago
Jeffrey Morgan	8782dd5628	fix `build_windows.ps1` script to run `go build` with the correct flags	2 years ago
Josh	f983ef7f5f	Update install.sh success message	2 years ago
Jeffrey Morgan	1ae1c33651	Windows build + installer adjustments (#2656 ) * remove `-w -s` linker flags on windows * use `zip` for windows installer compression	2 years ago
Jeffrey Morgan	92423b0600	add `dist` directory in `build_windows.ps`	2 years ago
Daniel Hiltgen	df6dc4fd96	Fix duplicate menus on update and exit on signals Also fixes a few fit-and-finish items for better developer experience	2 years ago
Daniel Hiltgen	272e53a1f5	Prepare to distribute standalone windows executable This will be useful for our automated test riggig, and may be useful for advanced users who want to "roll their own" system service	2 years ago
jmorganca	7ad9844ac0	set exe metadata using resource files	2 years ago
Daniel Hiltgen	29e90cc13b	Implement new Go based Desktop app This focuses on Windows first, but coudl be used for Mac and possibly linux in the future.	2 years ago
Daniel Hiltgen	9da9e8fb72	Move Mac App to a new dir	2 years ago
Jeffrey Morgan	1c8435ffa9	Update domain name references in docs and install script (#2435 )	2 years ago
Daniel Hiltgen	75c44aa319	Add back ROCm container support This adds ROCm support back as a discrete image.	2 years ago
Daniel Hiltgen	3005ec74b3	Set a default version using git describe If a VERSION is not specified, this will generate a version string that represents the state of the repo. For example `0.1.21-12-gffaf52e-dirty` representing 12 commits away from 0.1.21 tag, on commit gffaf52e and the tree is dirty.	2 years ago
Daniel Hiltgen	df54c723ae	Make CPU builds parallel and customizable AMD GPUs The linux build now support parallel CPU builds to speed things up. This also exposes AMD GPU targets as an optional setting for advaced users who want to alter our default set.	2 years ago
Daniel Hiltgen	da72235ebf	Combine the 2 Dockerfiles and add ROCm This renames Dockerfile.build to Dockerfile, and adds some new stages to support 2 modes of building - the build_linux.sh script uses intermediate stages to extract the artifacts for ./dist, and the default build generates a container image usable by both cuda and rocm cards. This required transitioniing the x86 base to the rocm image to avoid layer bloat.	2 years ago
Jeffrey Morgan	dc88cc3981	use `gzip` for runner embedding (#2067 )	2 years ago
Daniel Hiltgen	1b249748ab	Add multiple CPU variants for Intel Mac This also refines the build process for the ext_server build.	2 years ago
Michael Yang	d9bfb2f08f	install: pin fedora to max 37 repos for fedora 38 and newer do not exist as of this commit ``` $ dnf config-manager --add-repo https://developer.download.nvidia.com/compute/cuda/repos/fedora38/x86_64/cuda-fedora38.repo Adding repo from: https://developer.download.nvidia.com/compute/cuda/repos/fedora38/x86_64/cuda-fedora38.repo Status code: 404 for https://developer.download.nvidia.com/compute/cuda/repos/fedora38/x86_64/cuda-fedora38.repo (IP: 152.195.19.142) Error: Configuration of repo failed ```	2 years ago
Daniel Hiltgen	d88c527be3	Build multiple CPU variants and pick the best This reduces the built-in linux version to not use any vector extensions which enables the resulting builds to run under Rosetta on MacOS in Docker. Then at runtime it checks for the actual CPU vector extensions and loads the best CPU library available	2 years ago
Daniel Hiltgen	052b33b81b	DRY out the Dockefile.build	2 years ago
Daniel Hiltgen	9754ae4c89	Support optional override of the target archictures This can help speed up incremental builds when you're only testing one archicture, like amd64. E.g. BUILD_ARCH=amd64 ./scripts/build_linux.sh && scp ./dist/ollama-linux-amd64 test-system:	2 years ago
Jeffrey Morgan	34344d801c	clean up cmake `build` directory when cross compiling macOS builds	2 years ago
Michael Yang	f9961c70ae	update build	2 years ago
Daniel Hiltgen	2fcd41ef81	Fail fast on WSL1 while allowing on WSL2 This prevents users from accidentally installing on WSL1 with instructions guiding how to upgrade their WSL instance to version 2. Once running WSL2 if you have an NVIDIA card, you can follow their instructions to set up GPU passthrough and run models on the GPU. This is not possible on WSL1.	2 years ago
Daniel Hiltgen	2588cb2daa	Add ollama user to render group for Radeon support For the ROCm libraries to access the driver, we need to add the ollama user to the render group.	2 years ago
Jeffrey Morgan	ec261422af	use `docker build` in build scripts	2 years ago
Daniel Hiltgen	697bea6939	Guard integration tests with a tag This should help CI avoid running the integration test logic in a container where it's not currently possible.	2 years ago
Jeffrey Morgan	b80081022f	cache docker builds in `build_linux.sh`	2 years ago
Daniel Hiltgen	e5202eb687	Quiet down llama.cpp logging by default By default builds will now produce non-debug and non-verbose binaries. To enable verbose logs in llama.cpp and debug symbols in the native code, set `CGO_CFLAGS=-g`	2 years ago
Daniel Hiltgen	fa24e73b82	Remove CPU build, fixup linux build script	2 years ago
Daniel Hiltgen	1b991d0ba9	Refine build to support CPU only If someone checks out the ollama repo and doesn't install the CUDA library, this will ensure they can build a CPU only version	2 years ago
Daniel Hiltgen	51082535e1	Add automated test for multimodal A simple test case that verifies llava:7b can read text in an image	2 years ago
Daniel Hiltgen	35934b2e05	Adapted rocm support to cgo based llama.cpp	2 years ago
Daniel Hiltgen	d4cd695759	Add cgo implementation for llama.cpp Run the server.cpp directly inside the Go runtime via cgo while retaining the LLM Go abstractions.	2 years ago
Michael Yang	95cb38ae47	install: fix rocky kernel packages	2 years ago
jeremiahbuckley	39be7fdb98	fix rhel cuda install (#1321 ) Co-authored-by: Cloud User <azureuser@testgpu2.hqzwom21okjenksna4y3c4ymjd.phxx.internal.cloudapp.net>	2 years ago
Jeffrey Morgan	927e3ba4a4	tag image with correct version when building with `build_docker` script	2 years ago
Jeffrey Morgan	85e4441c6a	cache docker builds	2 years ago
Jeffrey Morgan	a185b29719	fix install script error on linux	2 years ago

1 2 3

107 Commits (85bdf14b561663acec936c1c4a0cb60f7fa8932e)