Help getting EXLA using CUDA. EXLA not identifying CUDA as supported platform

Hello all,

I am trying to get EXLA working with CUDA. I have implemented some defn code using NX, but EXLA is not identifying the CUDA platform.

iex(1)> EXLA.Client.get_supported_platforms
%{host: 12, interpreter: 1}

I have a Nvidia GPU and have followed the CUDA installation steps here: CUDA Installation Guide for Linux

I’m hoping I can get some general troubleshooting advice as I’m not too sure where I should start with this.

Thanks!

I had to set the XLA_TARGET environment variable and rebuild the XLA dependency:

export XLA_TARGET=cuda12
mix deps.compile

I also needed to install

sudo apt-get install libcudnn9-cuda-11
1 Like