mirror of https://gitee.com/namelin2022/ollama
Browse Source
this is in part to "pay" for #10452, which doubled the default context length. The combination isn't fully neutral though, because even though the old 4x2k limit and the new 2x4k limit are memory equivalent, the 1x fallback is larger with 4kjmorganca/cuda-compression-none
committed by
GitHub
1 changed files with 1 additions and 1 deletions
Loading…
Reference in new issue