ollama

Commit Graph

Author	SHA1	Message	Date
Parth Sareen	00ebda8cc4	Revert "parser: remove role validation from Modelfile parser" (#9917 ) This reverts commit `ffbfe833da`.	1 year ago
rylativity	ffbfe833da	parser: remove role validation from Modelfile parser (#9874 ) * updates parser/parser.go to allow arbitrary roles in Modelfile MESSAGE blocks	1 year ago
Michael Yang	58245413f4	next ollama runner (#7913 ) feat: add new Ollama engine using ggml through cgo This change introduces a new way to run pretrained models. It introduces 3 high level interfaces and a bunch of smaller helper interfaces to facilitate this. - `model.Model` defines the interface for a model architecture. Models such as `llama` and `mllama`, which are provided as examples, can implement the model's forward propagation in the `Forward` method. This method will be called to generate completions. This interface can be found in `model/model.go` - `ml.Backend` defines the interface for a backend tensor library, in this case `ggml`. Among other things, a Backend is responsible for loading a pretrained model into hardware (GPU, CPU, etc) and providing an interface for Models to access loaded tensors. This interface can be found in `ml/backend.go` - `ml.Tensor` defines the interface for a tensor and tensor operations This is the first implementation of the new engine. Follow up PRs will implement more features: - non-greedy sampling (#8410) - integration with Ollama and KV caching (#8301) - more model support (#9080) with more coming soon Co-authored-by: Bruce MacDonald <brucewmacdonald@gmail.com>	2 years ago
frob	294b6f5a22	docs: remove tfs_z option from documentation (#8515 )	2 years ago
Jeffrey Morgan	42cf4db601	parser: fix parsing Modelfiles with multiple FROM commands (#8449 )	2 years ago
Patrick Devine	32bd37adf8	make the modelfile path relative for `ollama create` (#8380 )	2 years ago
Patrick Devine	86a622cbdc	Update the /api/create endpoint to use JSON (#7935 ) Replaces `POST /api/create` to use JSON instead of a Modelfile. This is a breaking change.	2 years ago
Stefan Weil	abfdc4710f	all: fix typos in documentation, code, and comments (#7021 )	2 years ago
Patrick Devine	4efb98cb4f	add line numbers for parser errors (#7326 )	2 years ago
Jesse Gross	a909417602	runner.go: Remove unused arguments Now that server.cpp is gone, we don't need to keep passing arguments that were only ignored and only kept for compatibility.	2 years ago
Michael Yang	b732beba6a	lint	2 years ago
Tibor Schmidt	f3d7a481b7	feat: add support for min_p (resolve #1142 ) (#1825 )	2 years ago
Josh Yan	7e571f95f0	trimspace test case	2 years ago
Josh Yan	26e4e66faf	updated parsefile test	2 years ago
Josh Yan	9bd00041fa	trim all params	2 years ago
Josh Yan	4e986a823c	unquote, trimp space	2 years ago
Michael Yang	cd234ce22c	parser: add test for multibyte runes	2 years ago
Michael Yang	e40145a39d	lint	2 years ago
Patrick Devine	ccdf0b2a44	Move the parser back + handle utf16 files (#4533 )	2 years ago
Michael Yang	63bc884e25	types/model: fix parser for empty values	2 years ago
Michael Yang	119589fcb3	rename parser to model/file	2 years ago
Michael Yang	bd8eed57fc	fix parser name	2 years ago
Michael Yang	176ad3aa6e	parser: add commands format	2 years ago
Michael Yang	8907bf51d2	fix multiline	2 years ago
Michael Yang	abe614c705	tests	2 years ago
Michael Yang	c0a00f68ae	refactor modelfile parser	2 years ago
Patrick Devine	7c40a67841	Save and load sessions (#2063 )	3 years ago
Patrick Devine	238ac5e765	Add unit tests for Parser (#1815 )	3 years ago

27 Commits (493385eb3e811ebbb49c6a23d6db7c39885bbb89)