mirror of https://gitee.com/namelin2022/ollama
Browse Source
In some cases, we can't find a cache slot when using sliding window attention. It would be helpful in this (and other cases) to know what the batch size is. Bug #10127jmorganca/cuda-compression-none
committed by
Jesse Gross
1 changed files with 1 additions and 1 deletions
Loading…
Reference in new issue