Browse Source

Add env var so podman will map cuda GPUs

Without this env var, podman's GPU logic doesn't map the GPU through
jmorganca/testing
Daniel Hiltgen 2 years ago
parent
commit
794a916a72
  1. 1
      Dockerfile

1
Dockerfile

@ -132,6 +132,7 @@ ENV OLLAMA_HOST 0.0.0.0
ENV PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64
ENV NVIDIA_DRIVER_CAPABILITIES=compute,utility
ENV NVIDIA_VISIBLE_DEVICES=all
ENTRYPOINT ["/bin/ollama"]
CMD ["serve"]

Loading…
Cancel
Save