Is Elixir used on supercomputers for high-performance computing (HPC)

It has definitely changed since 2016 because of Nx. It depends on the type of work/algorithms you want to apply, but with Nx you can do numerical computation efficiently on individual nodes (especially if they also have a GPU) and thanks to OTP you can easily communicate between the nodes to coordinate the work. We did that to run some evolutionary algorithms using HPC, published in https://dl.acm.org/doi/10.1145/3512290.3528753 : )

Hi Jonatan,

Thank you very much for your reply!

The paper you are mentioning sounds very interesting, I will try to get my hands on it.

Which supercomputer did you run your HPC code on, if it is a known one: Supercomputing in Europe

Do you know of any other publications, articles or books that have content on Elixir and HPC?

Cheers Patrick

Which supercomputer did you run your HPC code on

Prometheus (Cracow, Poland) : )

Do you know of any other publications, articles or books that have content on Elixir and HPC?

Nothing in particular, especially related to Nx. I think there are a few papers that used Erlang and HPC, like this one, you can check out the author to see if there’s anything relevant for you.

Thank you very much

Dear @josevalim,

@jonatanklosko suggested asking you about the following questions:

Are there any new developments, papers, or use cases for Elixir on supercomputers for HPC?

On another note, are there any open research-related topics (e.g. Master thesis or PhD topics) in the Elixir space?

Thank you very much in advance.

Cheers Patrick

Hi Patrick, the most recent effort that I am aware of is FLAME Slurm: GitHub - marcnnn/flame_slurm_backend: A FLAME Backend for Slurm. · GitHub

I have expressed interest for running the Erlang distribution over RDMA, and if you are either a student or a supervisor interested in taking this forward, you can reach out to me.

Finally, we are preparing to implement GPU-to-GPU operations directly in Nx.