pat_rick
High-performance computing (HPC) is the use of supercomputers and parallel computing techniques to solve complex computational problems.
There exists a similar question from June 2016: Erlang/Elixir and supercomputers
I was wondering if there are use cases where Elixir was used for high-performance computing (HPC) on supercomputers, especially due to the years that have gone by since 2016 and the recent developments (Nx, ML and AI use, Livebook, etc.).
Thank you in advance!
Where Next?
Trending in Questions
Other Trending Topics
Latest Livebook Threads
Latest on Elixir Forum
Sponsor Spotlight
We build reliable cloud platforms for business-critical systems.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #library
- #deployment
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #elixirconf
- #channels
- #exunit
- #discussion
- #code-sync
- #podcasts
- #javascript
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #ai
- #elixirconf-us
- #blog-post
- #elixir-ls
- #phoenix_html
- #iex
- #graphql
- #genstage
- #websockets
- #supervisor
- #advent-of-code
- #distillery
- #processes
- #api
- #forms
- #elixirconf-eu
- #metaprogramming
- #hex
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
Catch errors, track performance, monitor hosts and more.
Error tracking, logs, uptime, and Just Enough APM. Built for developers.
Elixir, Erlang & BEAM conferences from Code Sync - join us in 2026!
Practical resources that improve the lives of professional developers.
Producing high quality Elixir screencasts since 2017.
The deployment platform built for Elixir: PaaS ease, VPS control.
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"
Showing Posts 1 to 6- Show Best Posts
- Show All (oldest first)
- Show All (newest first)
jonatanklosko
It has definitely changed since 2016 because of Nx. It depends on the type of work/algorithms you want to apply, but with Nx you can do numerical computation efficiently on individual nodes (especially if they also have a GPU) and thanks to OTP you can easily communicate between the nodes to coordinate the work. We did that to run some evolutionary algorithms using HPC, published in https://dl.acm.org/doi/10.1145/3512290.3528753 : )
pat_rick
Hi Jonatan,
Thank you very much for your reply!
The paper you are mentioning sounds very interesting, I will try to get my hands on it.
Which supercomputer did you run your HPC code on, if it is a known one: Supercomputing in Europe
Do you know of any other publications, articles or books that have content on Elixir and HPC?
Cheers Patrick
jonatanklosko
Prometheus (Cracow, Poland) : )
Nothing in particular, especially related to Nx. I think there are a few papers that used Erlang and HPC, like this one, you can check out the author to see if there’s anything relevant for you.
pat_rick
Thank you very much
pat_rick
Dear @josevalim,
@jonatanklosko suggested asking you about the following questions:
Are there any new developments, papers, or use cases for Elixir on supercomputers for HPC?
On another note, are there any open research-related topics (e.g. Master thesis or PhD topics) in the Elixir space?
Thank you very much in advance.
Cheers Patrick
josevalim
Hi Patrick, the most recent effort that I am aware of is FLAME Slurm: GitHub - marcnnn/flame_slurm_backend: A FLAME Backend for Slurm. · GitHub
I have expressed interest for running the Erlang distribution over RDMA, and if you are either a student or a supervisor interested in taking this forward, you can reach out to me.
Finally, we are preparing to implement GPU-to-GPU operations directly in Nx.