ollama

Commit Graph

Author	SHA1	Message	Date
Michael Yang	526b2ed102	fix vocabulary (#10679 )	11 months ago
Bruce MacDonald	a7240c6d63	models: remove unused qwen2vl processing (#10677 )	11 months ago
Daniel Hiltgen	9d6df90805	Follow up to #10363 (#10647 ) The quantization PR didn't block all unsupported file types, which this PR fixes. It also updates the API docs to reflect the now reduced set of supported types.	11 months ago
Jeffrey Morgan	0cefd46f23	llama: update to commit de4c07f93 (#10655 )	11 months ago
Bruce MacDonald	ad035ad595	convert: quantize from safetensors needs kv (#10675 ) When creating a quantized model from safetensors we need the array KV values to be loaded.Changing this value to -1 loads the KV values on the returned layer to be used and saved during quantization.	11 months ago
Michael Yang	f95a1f2bef	feat: add trace log level (#10650 ) reduce prompt log to trace level	11 months ago
HardCodeDev	82a9e9462a	readme: add UnityCodeLama to community integrations (#10665 )	11 months ago
HardCodeDev	76724e2f29	readme: add OllamaPlusPlus C++ library to community integrations (#10664 )	11 months ago
frob	ecf14a220f	llama: allocate grammar buffer based on schema length (#10649 )	11 months ago
frob	69ce44b33c	envconfig: Remove no longer supported max vram var (#10623 ) Co-authored-by: Richard Lyons <frob@cloudstaff.com>	11 months ago
Michael Yang	5969674cf1	feat: add threshold to dump options (#10639 ) ml.Dump will preserve default values if not specified	11 months ago
AliAhmedNada	867d75b21e	readme: add ojira to community integrations (#10648 )	11 months ago
Bruce MacDonald	3fa78598a1	cmd: strip single quotes from image page (#10636 )	11 months ago
Michael Yang	0d6e35d3c6	fix: stream accumulator exits early (#10593 ) the stream accumulator exits as soon as it sees `api.ProgressResponse(status="success")` which isn't strictly correctly since some requests may have multiple successes, e.g. `/api/create` when the source model needs to be pulled.	11 months ago
Devon Rifkin	20c5fd39c8	Merge branch 'main' into drifkin/array-head-count-simple	11 months ago
Michael Yang	6e9a7a2568	lint: enable usetesting, disable tenv (#10594 )	11 months ago
Michael Yang	b585a58121	chore: remove unused ZipReader type (#10621 )	11 months ago
Jeffrey Morgan	fa9973cd7f	api: remove unused sampling parameters (#10581 )	11 months ago
Jesse Gross	3d9498a425	ollamarunner: Use correct constant to remove cache entries The correct constant to remove all entries to the end of the sequence for the Ollama engine is math.MaxInt32. -1 is used by the old engine. The impact of this is currently minimal because it would only occur in situations that are not supported by the implemented models or rarely used options.	11 months ago
Daniel Hiltgen	3098c8b29b	CI: trigger downstream release process (#10508 )	11 months ago
Daniel Hiltgen	5e380c3b42	sched: fix race leading to orphaned runners (#10599 ) If a model is loading, and the request context is canceled during the load by a client closing the connection, and another request is inbound for the same model with a different configuration (context size, etc.) thus requiring a reload, two unload events can be in flight. The first shuts down the original model load, but the second one caused the loss of the new reloading runner reference, thus triggering the leak. The primary fix is detecting the duplicate unload and ignoring the second instance. The load routine is also hardened to ensure we detect clobbering an already present runner and unload it with a warning.	11 months ago
Jeffrey Morgan	392de84031	api: remove unused RetrieveModelResponse type (#10603 )	11 months ago
Daniel Hiltgen	af31ccefc0	fix data race in WriteGGUF (#10598 ) err in the go routine should not be shared with the outer scope	11 months ago
Daniel Hiltgen	fa393554b9	remove cuda v11 (#10569 ) This reduces the size of our Windows installer payloads by ~256M by dropping support for nvidia drivers older than Feb 2023. Hardware support is unchanged. Linux default bundle sizes are reduced by ~600M to 1G.	11 months ago
Aharon Bensadoun	307e3b3e1d	readme: add Flufy to community integrations (#9719 )	11 months ago
Devon Rifkin	4090aca97b	server: send 405 instead of 404 for unallowed methods (#10275 ) Fixes: #5483	11 months ago
Michael Yang	92ce438de0	server: remove internal cmd (#10595 )	11 months ago
Daniel Hiltgen	424810450f	Move quantization to new backend (#10363 ) * Move quantization logic to GGML via new backend This moves the model aware logic to Go code and calls GGMLs quantization code for model creation. * Remove "add model quantizations" This is no longer needed now that quantization is implemented in Go+GGML code directly.	11 months ago
Michael Yang	95e744beeb	discover: fix compiler warnings (#10572 )	11 months ago
Jeffrey Morgan	3b2d2c8326	api: remove unused or unsupported api options (#10574 ) Some options listed in api/types.go are not supported in newer models, or have been deprecated in the past. This is the first of a series of PRs to clean up the API options	11 months ago
Michael Yang	d931ee8f22	create blobs in parallel (#10135 ) * default max term height * error on out of tree files	11 months ago
Jesse Gross	7073600797	ggml: Reduce log level of "key not found" Most of the time this is not an error.	11 months ago
Daniel Hiltgen	b1c40138da	win: lint fix (#10571 )	11 months ago
Ashok Gelal	17466217e5	Hide empty terminal window (#8668 ) This hides the LlamaServer blank window when chatting outside of the terminal (say like with an app like Msty). This has no other side effects when invoking it the regular way.	11 months ago
Jeffrey Morgan	1703d1472e	server: fix panic when runner.Options is nil (#10566 )	11 months ago
Jeffrey Morgan	913905028b	all: fix cgo compiler warnings on windows (#10563 )	11 months ago
湛露先生	7e5c8eee5c	file close check and close. (#10554 ) Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>	11 months ago
Daniel Hiltgen	6a74bba7e7	win: ensure ollama paths come first (#10549 ) For all search path env vars make sure our dirs are first to avoid potentially finding other incompatible libraries on the users system. Also fixes a minor build script glitch for windows rocm	11 months ago
Daniel Hiltgen	76ea735aaf	sched: logging improvements (#10550 ) This enhances our logging in the scheduler. The initial "waiting for server" log no longer claims an initial error state (now "not responding" which better reflects the actual state). Runners now have slog wiring to report more details about the runner, including PID.	11 months ago
aritra saha	dd1d4e99e7	readme: add llama 4 models (#10530 )	11 months ago
Jesse Gross	a6ef73f4f2	ggml: Fix race that resulted in "context canceled" when loading Successfully completing processing with an errgroup cancels the associated context. However, we also have a goroutine that is checking for cancelation of the context. As a result, there is a race where the goroutine can pick up the cancelation and report an error, replacing the sucessful error message. To avoid that, this replaces the goroutine with a cancelation check when we are reading files. This also has the advantage of stopping all reads relatively quickly on error and also ensuring that there are no outstanding I/O operations when we return in this case. The downside is that if a file read blocks forever (for example, over the network) then cancelation of the context effectively won't be honored. However, this is also true for other smaller files we read and the tensors are read in small chunks (128K), so it's consistent and better on balance overall.	11 months ago
Jesse Gross	c2f5d6662b	ollamarunner: Re-enable worst case graph preallocation. Worst case graph preallocation was disabled by `a27462b` "ollamarunner: Temporarily disable worst case graph preallocation" since it caused crashes with large batches when not using the GPU. This backports upstream llama.cpp commit f057808 "ggml: Don't assert fail when tensor data changes (#13222)", which fixes the underlying bug and allows reverting the previous workaround.	11 months ago
Harsh Nevse	57fb759f3c	readme: update link to langchain in community integrations (#10465 )	11 months ago
Jeffrey Morgan	8dd12c873d	llama: update to commit e1e8e099 (#10513 )	11 months ago
frob	e6d2d04121	image: add vision capability for projector-based models (#10509 ) Co-authored-by: Richard Lyons <frob@cloudstaff.com>	11 months ago
Jesse Gross	074bac8447	kvcache: Log batch size if we can't find a slot In some cases, we can't find a cache slot when using sliding window attention. It would be helpful in this (and other cases) to know what the batch size is. Bug #10127	11 months ago
Jesse Gross	8e8f2c6d67	ollamarunner: Fix memory leak when processing images The context (and therefore associated input tensors) was not being properly closed when images were being processed. We were trying to close them but in reality we were closing over an empty list, preventing anything from actually being freed. Fixes #10434	11 months ago
AliAhmedNada	938e8447e8	readme: add Jirapt project to community integrations (#10522 )	11 months ago
aritra saha	d5d5f0c445	readme: change granite3.2 to granite3.3 (#10525 ) Update the list for readme	11 months ago
Michael Yang	a7835c6716	fix: write gguf padding (#10510 ) * add gguf_test * fix padding padding was being added to offset but not to the running count	11 months ago

1 2 3 4 5 ...

4366 Commits (a3f7dd3e98df803695f1ae165bc61a1b52142449) All Branches Search

4366 Commits (a3f7dd3e98df803695f1ae165bc61a1b52142449)

All Branches