BitzFlex

BitzFlex

Does EXLA support the Apple Silicon GPU (MPS)?

Hi!,

I have the Mac Studio and I want to use the GPU on it with EXLA.
I made the project that has config like below.

import Config
config :nx, :default_backend, EXLA.Backend

with iex ,
Nx.tensor [1,2,3,4] ,
it show
[info] TfrtCpuClient created.
#Nx.Tensor<
s64[4]
EXLA.Backend<host:0, 0.1189406505.872022046.161358>
[1, 2, 3, 4]

it seems not use GPU.

And, with below code (to make long Nx calculation) ----
url =
https://pix4free.org/assets/library/2021-01-12/originals/san_francisco_california_golden_gate_bridge_water.jpg

%{body: raw_image} = Req.get!(url)

imageNx = StbImage.read_binary!(raw_image)
            |> StbImage.to_nx()
            |> Nx.reshape({:auto,3})

IO.puts "Started --------"
start_ts =DateTime.utc_now() |> DateTime.to_unix(:second)

KMeans.fit(imageNx,
    num_clusters: 10,
    num_runs: 10,
    max_iterations: 200,
    key: Nx.Random.key(42)
  )

end_ts =DateTime.utc_now() |> DateTime.to_unix(:second)
IO.puts "DONE -- ellapse : #{end_ts - start_ts}"

It takes about 230 seconds, and the Mac Activity Monitor show 0 GPU usage of beam_smp.

Does the EXLA support Apple Silicon GPU ?

Any suggestion will be appreciated..

Thanks,

Most Liked

BitzFlex

BitzFlex

Thank you so much!

Following your advice, adding the “config :nx, :default_defn_options, compiler: EXLA” setting dramatically reduced the computation time.

It went down from 220 seconds to 13 seconds. That’s really amazing.

Thank you once again.

polvalente

polvalente

Nx Core Team

Ah, there’s something else you should also configure, the default defn compiler!

config :nx, :default_defn_options, compiler: EXLA should make your code quite a bit faster too

polvalente

polvalente

Nx Core Team

We don’t currently support mac GPUs unfortunately.
There’s ongoing work on migrating EXLA to an MLIR-based implementation that will in the future enable support, though.

Torchx is closer to that, altough Pytorch still has a few issues to go on the ways of API coverage for Apple Metal.

Last Post!

polvalente

polvalente

Nx Core Team

Awesome!

Where Next?

Popular in Questions Top

lanycrost
Hi everyone! I need implement if…else if…else condition from my elixir code, and anymore of this control flow structures not work proper...
New
Fl4m3Ph03n1x
About me? ( if you have nothing better to do than reading about some random guy in the internet :stuck_out_tongue: ) Hello all, this is ...
New
shijith.k
I am trying to start a new phoenix project with elixir 1.9, but mix phx.new does not work. It says that ** (Mix) The task "phx.new" could...
New
WestKeys
Currently suffering from paralysis by [HTTP client] analysis. This is rather unusual in Elixirland as there tends to be consensus on the ...
New
JorisKok
I have a server on AWS, and was running a load test using artillery. When looking at the Phoenix dashboard I see the Ports going to 100% ...
New
svb
Hi! Currently I want to submit a form by pressing the Enter key. However, since my input field is of type “textarea” this is just adds a...
New
jason.o
In the code below, if the create action is not set to accept “extra_key” as an input, it errors out with a message shown above. Is there ...
New

Other popular topics Top

JeremM34
Hello, how can I check the Phoenix version ? Thanks !
New
vertexbuffer
Hello, can anybody help here..? I have a list of players and I what to delete an element, but every for loop the list is reverting to ori...
New
jononomo
I am trying to figure out how Mix knows whether the environment is test, dev, or prod – where is this set? Thanks.
New
vonH
When I run the Plug and I recompile I wind up having to use Ctrl C to quit iex and start again. Witht the help of rlwrap I can use the cu...
New
vonH
In asking this question I am more interested about the expressiveness of the language itself and less concerned about the availability of...
New
albydarned
Hello all! I am typing this post from my new MacBook Pro with the M1 chip. I’m loving it so far, and will probably use it as my daily dr...
New

We're in Beta

About us Mission Statement