pat_rick

pat_rick

Is Elixir used on supercomputers for high-performance computing (HPC)

High-performance computing (HPC) is the use of supercomputers and parallel computing techniques to solve complex computational problems.

There exists a similar question from June 2016: Erlang/Elixir and supercomputers

I was wondering if there are use cases where Elixir was used for high-performance computing (HPC) on supercomputers, especially due to the years that have gone by since 2016 and the recent developments (Nx, ML and AI use, Livebook, etc.).

Thank you in advance!

Most Liked

jonatanklosko

jonatanklosko

Creator of Livebook

It has definitely changed since 2016 because of Nx. It depends on the type of work/algorithms you want to apply, but with Nx you can do numerical computation efficiently on individual nodes (especially if they also have a GPU) and thanks to OTP you can easily communicate between the nodes to coordinate the work. We did that to run some evolutionary algorithms using HPC, published in https://dl.acm.org/doi/10.1145/3512290.3528753 : )

josevalim

josevalim

Creator of Elixir

Hi Patrick, the most recent effort that I am aware of is FLAME Slurm: GitHub - marcnnn/flame_slurm_backend: A FLAME Backend for Slurm. · GitHub

I have expressed interest for running the Erlang distribution over RDMA, and if you are either a student or a supervisor interested in taking this forward, you can reach out to me.

Finally, we are preparing to implement GPU-to-GPU operations directly in Nx.

jonatanklosko

jonatanklosko

Creator of Livebook

Which supercomputer did you run your HPC code on

Prometheus (Cracow, Poland) : )

Do you know of any other publications, articles or books that have content on Elixir and HPC?

Nothing in particular, especially related to Nx. I think there are a few papers that used Erlang and HPC, like this one, you can check out the author to see if there’s anything relevant for you.

Where Next?

Popular in Questions Top

aadeshere1
I have a another noob question about loop. Since elixir is immutable, while loop is not directly possible. total = 10 while total != 0 ...
New
ovidiubadita
Hey all, I discovered Elixir and I love it. I always wanted to learn a functional programming and I intended to go for Haskell, but afte...
New
johnnyicon
Hi all, I’ve just started learning Elixir and Phoenix Framework, so please pardon my n00bness at this stage. I’m trying to use Postgres...
New
stefanchrobot
What’s the safe way to decode a JSON string into a struct? I want to avoid calling String.to_atom. Jason.decode can give me a map with st...
New
jay1
Why is it that the mnesia database isn’t the most preferred database for use in Elixir/Phoenix?
New
RisingFromAshes
I’ve read in another post that it may be possible with a router helper - but I couldn’t find an appropriate one, and tbh, I’m still just ...
New
nobody
Hi! In PHP: $_SERVER[‘SERVER_ADDR’] - in Elixir? Searched the docs for ip address and the web, no good results. Thanks!
New
script
If I have a string “1000 cfu/ml” . I want to remove the characters and / and space . So the string is like this "1000" What is the ...
New
openscript
Hello! Sorry for this astonishing simple question, but I’m really stuck. I try to set up the intellij-elixir plugin, but I don’t know ho...
New
New

Other popular topics Top

axelson
This post is a wiki (feel free to hit the edit button near the bottom right of this post to add your own changes!) This post collects co...
239 48475 226
New
chrismccord
As promised, the first release candidate of Phoenix 1.3.0 is out! This release focuses on code generators with improved project structure...
New
siddhant3030
Hi, I have to write a raw query for one of my project. But till now I have used ecto queries and don’t have much experience writing raw ...
New
jononomo
I am trying to figure out how Mix knows whether the environment is test, dev, or prod – where is this set? Thanks.
New
josevalim
Hi everyone, One of the features added to Elixir early on to help integration with Erlang code was the idea of overridable function defi...
New
aesmail
Hello guys, I have finally made it. I created an admin interface for a framework. It’s been on my todo list for years and with the curre...
New
hariharasudhan94
I would like to know what is the best IDE for elixir development?
New
AstonJ
Seen any cool LiveView demos, sample apps or examples? Please post them here! :003:
New
jononomo
For some reason my phoenix channels are working for me in my local dev environment, but as soon as I deploy via Docker, I get a 403 error...
New
lanycrost
Hi everyone! I need implement if…else if…else condition from my elixir code, and anymore of this control flow structures not work proper...
New

We're in Beta

About us Mission Statement