Browse Source

Update api.md (#3705)

jmorganca/llama-cpp-8960fe8
Sri Siddhaarth 2 years ago
committed by GitHub
parent
commit
e6f9bfc0e8
No known key found for this signature in database GPG Key ID: B5690EEEBB952194
  1. 2
      docs/api.md

2
docs/api.md

@ -90,7 +90,7 @@ The final response in the stream also includes additional data about the generat
- `load_duration`: time spent in nanoseconds loading the model
- `prompt_eval_count`: number of tokens in the prompt
- `prompt_eval_duration`: time spent in nanoseconds evaluating the prompt
- `eval_count`: number of tokens the response
- `eval_count`: number of tokens in the response
- `eval_duration`: time in nanoseconds spent generating the response
- `context`: an encoding of the conversation used in this response, this can be sent in the next request to keep a conversational memory
- `response`: empty if the response was streamed, if not streamed, this will contain the full response

Loading…
Cancel
Save