Fedora 38 and Nvidia CUDA Toolkit

Thanks Jeff !

Sorry for the delayed reply, been hectic. The reason I’ve installed the Nvidia recommended is because I need the additional tools included with Nvidia Toolkit, which is an additional 7GB install over the ones and a lot of the AI projects require a binary called nvcc which only comes with the cuda toolkit.

I mean on paper the Non free repo provides cuda installation and running nvidia-smi showed that I had cuda v 12.2 or 12.3 (I can’t remember now), so it looked like it should work but when you actually try to do anything like compile or run some cuda specific code, it falls flat.

Is there a reason you are using fedora 38 and chose to use the cuda-fedora37 repo instead?

  • Yes, nvidia hasn’t rolled a cuda-fedora38 repo afaik yet, so myself and a lot of other Fedorians are having to hack together our drivers in order to get the Cuda toolkit installed. As such there isn’t great documentation (or i’ve not found any yet) that explains how to setup fedora with Nvidia for AI dev with Cuda.

You know what I’m confused as hell about all the nvidia drivers!! I would love a clear path on how to set this all up for what I want to do.

So my current understanding is that options for the nvidia official route are:

  • Nvidia display drivers in package form, no repo
  • Cuda drivers in repo form (great) but only for F37 (not so great!)

RPM Fusion:

  • Drivers in repo form
  • Cuda drivers in repo form
  • No Tookit and no nvcc

Am I right about that? What do you recommend I do?

Btw, I found this very interesting looking github project for nvidia driver setup on Fedora, not sure if you’ve come across it before? However it’s not clear to me yet if they have tookit install options

Thanks bud, appreciate your help! :slight_smile:
Sunny

2 Likes