jnnks

jnnks

Looking for interesting topics to write my thesis on, maybe distributed training with Elixir Axon?

Hi everyone,

I just saw the talk about Axon by Sean Moriarity from ElixirConf 2022 (Youtube Video). In the Current Limitations section (around 28:30) the first bullet point is Distributed Learning (planned). How far are you in the planning process? Are there any concrete implementations ongoing?

I am in the last year of my computer science masters degree and am looking for interesting topics to write my thesis about. I was already experimenting with the idea before the video popped up in my feed. This would also be a topic relevant for my employer, so it’s a win-win situation for me :slight_smile:

Let me know, if you are interested.

FYI: @seanmor5 @josevalim

Most Liked

josevalim

josevalim

Creator of Elixir

Here are some ideas from the wishlist:

  • Scholar
    • You can implement some complex algorithms from scikit-learn using Nx. This is novel because not all algorithms have be written in a format that benefits of a tensor compiler and, if you succeed, you should see value perf benefits (plus GPU compilation). I know a student who worked Affinity Propagation to tensors for example as part of their master thesis (in Europe)
  • Nx
    • TVM compiler backend
    • Google IREE backend
  • Something with reinforcement learning? Double cool if you do something with ALE

This list was used to be so big… :slight_smile:

josevalim

josevalim

Creator of Elixir

If anyone is tracking this, I built this Gist with slightly more concrete ideas (which were asked by other students): ideas-2023.md · GitHub

josevalim

josevalim

Creator of Elixir

Distributed learning may refer to both distributed across multiple GPUs and distributed across machines. In either case, I don’t think there is a lot of work ahead of us or - if I had to guess - not enough for a thesis.

Another area of exploration is additional compilers for Nx. We can target TVM, Google IREE’s and others. There are other ideas, but my wishlist is at home. :slight_smile:

Where Next?

Popular in Discussions Top

sashaafm
I’m trying to evaluate the best combo/stack for a BEAM Web app. Right now I’m exploring Yaws a bit, after having dealt with Phoenix for a...
New
pillaiindu
I want to convert a Phoenix LiveView CRUD website to a CRUD mobile app. What do you think is the easiest way to do so?
New
IVR
Hi all, I’ve seen a number of related threads in the past, but I’d still be very curious to hear an up-to-date opinion on this topic. I...
New
saif
Hello everyone, Long time lurker first time poster here. I’ve recently begun working on Elixir full-time again! :raised_hands: It’s been...
New
rower687
Hi all, I’ve been reading a lot about the “let it crash” term and how supervising processes and the whole messaging passing make an elixi...
New
PragTob
Hey everyone, this has been on my mind for some time and I’d love your input on it! TLDR: I feel like maps are superioer for storing and...
New
chulkilee
Here are the list of HTTP client libraries/wrappers, and some thoughts on HTTP client in general. I’d like to hear from others how they w...
New
scouten
I’m looking for a host for the server part of a small (personal) side project that I’m working on. It’s currently written in Node.js and ...
New
dogweather
I wrote this comment on r/haskell, and it’s not popular there. :wink: But I think I’m on to something… Haskell reminds me of Java, and e...
New
Qqwy
Looking at the stacks that existing large companies have used, WhatsApp internally uses Mnesia to store the messages, while Discord uses ...
New

Other popular topics Top

danschultzer
None of the current solutions worked well for me, so I went ahead and built a user management system from scratch. This project took far...
548 29603 241
New
senggen
Erlang/OTP 25 [erts-13.2.2] [source] [64-bit] [smp:8:8] [ds:8:8:10] [async-threads:1] 15:22:35.803 [error] gen_event {lager_file_backend...
New
siddhant3030
Hi, I have to write a raw query for one of my project. But till now I have used ecto queries and don’t have much experience writing raw ...
New
Darmani72
If I have a post route which an argument: post /my_post_route/:my_param1, MyController.my_post_handler How would get the post params ...
New
gshaw
What is the idiomatic way of matching for not nil in Elixir? E.g., First way: defp halt_if_not_signed_in(conn, signed_in_account) when...
New
JeremM34
Hello, how can I check the Phoenix version ? Thanks !
New
msaraiva
Surface is an experimental library built on top of Phoenix LiveView and its new LiveComponent API that aims to provide a more declarative...
564 43757 214
New
josevalim
Hi everyone, One of the features added to Elixir early on to help integration with Erlang code was the idea of overridable function defi...
New
fayddelight
I tried installing elixir 1.11.2 erlang 23.3.4 via asdf in my zsh shell. Enabled the versions locally and globally. When I list them ...
New
JorisKok
I have a server on AWS, and was running a load test using artillery. When looking at the Phoenix dashboard I see the Ports going to 100% ...
New

Latest on Elixir Forum

Elixir Forum

We're in Beta

About us Mission Statement