ollama

Commit Graph

Author	SHA1	Message	Date
Mark Ward	34a4a94f13	ignore debug bin files	2 years ago
Daniel Hiltgen	58d95cc9bd	Switch back to subprocessing for llama.cpp This should resolve a number of memory leak and stability defects by allowing us to isolate llama.cpp in a separate process and shutdown when idle, and gracefully restart if it has problems. This also serves as a first step to be able to run multiple copies to support multiple models concurrently.	2 years ago
Daniel Hiltgen	29e90cc13b	Implement new Go based Desktop app This focuses on Windows first, but coudl be used for Mac and possibly linux in the future.	2 years ago
Daniel Hiltgen	d4cd695759	Add cgo implementation for llama.cpp Run the server.cpp directly inside the Go runtime via cgo while retaining the LLM Go abstractions.	2 years ago
Jason Jacobs	3d620f9462	ignore jetbrain ides (#1287 )	2 years ago
Jing Zhang	82b9b329ff	windows CUDA support (#1262 ) * Support cuda build in Windows * Enable dynamic NumGPU allocation for Windows	2 years ago
Jeffrey Morgan	85e4441c6a	cache docker builds	2 years ago
Jeffrey Morgan	a82eb275ff	update docs for subprocess	3 years ago
Bruce MacDonald	42998d797d	subprocess llama.cpp server (#401 ) * remove c code * pack llama.cpp * use request context for llama_cpp * let llama_cpp decide the number of threads to use * stop llama runner when app stops * remove sample count and duration metrics * use go generate to get libraries * tmp dir for running llm	3 years ago
Jeffrey Morgan	67b6f8ba86	add `ggml-metal.metal` to `.gitignore`	3 years ago
jk1jk	e6c427ce4d	Update .gitignore	3 years ago
Jeffrey Morgan	7c71c10d4f	fix compilation issue in Dockerfile, remove from `README.md` until ready	3 years ago
Michael Yang	442dec1c6f	vendor llama.cpp	3 years ago
Michael Yang	fd4792ec56	call llama.cpp directly from go	3 years ago
Jeffrey Morgan	9fe018675f	use `Makefile` for dependency building instead of `go generate`	3 years ago
Jeffrey Morgan	b0e986fb96	add binary to .gitignore	3 years ago
Bruce MacDonald	d34985b9df	add templates to prompt command	3 years ago
Jeffrey Morgan	b361fa72ec	reorganize directories	3 years ago
Jeffrey Morgan	d3709f85b5	build server into desktop app	3 years ago
Bruce MacDonald	c5bafaff54	package server with client	3 years ago
Bruce MacDonald	f0eee3faa0	build server executable	3 years ago
Bruce MacDonald	db81d81b23	Update .gitignore	3 years ago
Jeffrey Morgan	8fa91332fa	initial commit	3 years ago

23 Commits (bmizerany/nosillyggufslurps)