mirror of https://gitee.com/namelin2022/ollama
Browse Source
Reporting params.NumGPULayers can be misleading because it is the requested number of layers, not the actual number that is loaded. While they are often the same, there are cases where they might mismatch, such as if the GPU backend is missing.mxyng/quant
committed by
Jesse Gross
1 changed files with 11 additions and 9 deletions
Loading…
Reference in new issue