>>110196442
I have this same setup, but with 3060 + 3090
The trick is to install cuda and container-toolkit from nvidia, see below and picrel
root@gpu01:/etc/apt/sources.list.d# cat cuda-debian13-x86_64.list nvidia-container-toolkit.list
deb [signed-by=/usr/share/keyrings/cuda-archive-keyring.gpg] https://developer.download.nvidia.com/compute/cuda/repos/debian13/x86_64/ /
deb [signed-by=/usr/share/keyrings/nvidia-container-toolkit-keyring.gpg] https://nvidia.github.io/libnvidia-container/stable/deb/$(ARCH) /
#deb [signed-by=/usr/share/keyrings/nvidia-container-toolkit-keyring.gpg] https://nvidia.github.io/libnvidia-container/experimental/deb/$(ARCH) /