ollama

290 Tags

53 MiB

Tree: 8f8e736b13

Author	SHA1	Message	Date
Jeffrey Morgan	8f8e736b13	update llama.cpp submodule to `d7fd29f` (#5475 )	2 years ago
Daniel Hiltgen	58d95cc9bd	Switch back to subprocessing for llama.cpp This should resolve a number of memory leak and stability defects by allowing us to isolate llama.cpp in a separate process and shutdown when idle, and gracefully restart if it has problems. This also serves as a first step to be able to run multiple copies to support multiple models concurrently.	2 years ago
Daniel Hiltgen	85129d3a32	Adapt our build for imported server.cpp	2 years ago
Daniel Hiltgen	1b249748ab	Add multiple CPU variants for Intel Mac This also refines the build process for the ext_server build.	2 years ago
Daniel Hiltgen	77d96da94b	Code shuffle to clean up the llm dir	2 years ago
Daniel Hiltgen	738a8d12eb	Rename the ollama cmakefile	2 years ago
Daniel Hiltgen	9a70aecccb	Refactor how we augment llama.cpp This changes the model for llama.cpp inclusion so we're not applying a patch, but instead have the C++ code directly in the ollama tree, which should make it easier to refine and update over time.	2 years ago