ollama

290 Tags

53 MiB

Tree: 16f4eabe2d

Author	SHA1	Message	Date
Daniel Hiltgen	16f4eabe2d	Refine default thread selection for NUMA systems (#7322 ) Until we have full NUMA support, this adjusts the default thread selection algorithm to count up the number of performance cores across all sockets.	1 year ago
Daniel Hiltgen	05cd82ef94	Rename gpu package discover (#7143 ) Cleaning up go package naming	1 year ago
Daniel Hiltgen	24636dfa87	Discovery CPU details for default thread selection (#6264 ) On windows, detect large multi-socket systems and reduce to the number of cores in one socket for best performance	1 year ago
Daniel Hiltgen	74d45f0102	Refactor linux packaging This adjusts linux to follow a similar model to windows with a discrete archive (zip/tgz) to cary the primary executable, and dependent libraries. Runners are still carried as payloads inside the main binary Darwin retain the payload model where the go binary is fully self contained.	2 years ago
Michael Yang	b732beba6a	lint	2 years ago
Jeffrey Morgan	c4cf8ad559	llm: avoid loading model if system memory is too small (#5637 ) * llm: avoid loading model if system memory is too small * update log * Instrument swap free space On linux and windows, expose how much swap space is available so we can take that into consideration when scheduling models * use `systemSwapFreeMemory` in check --------- Co-authored-by: Daniel Hiltgen <daniel@ollama.com>	2 years ago
Daniel Hiltgen	6f351bf586	review comments and coverage	2 years ago