polvalente
Nx ecosystem 0.12 library updates
Nx, EXLA and Torchx 0.12 have just been published!
This update set comes with the new Nx.block abstraction and the EXLA.CustomCall protocol, which together will allow users to provide native C or CUDA implementations for certain sections of Nx code.
EMLX 0.3 (the official MLX backend for Nx) is also out, with:
- Support for the more recent concurrency model provided by MLX
- EMLX.Fast for a few fused operations (used in the upcoming emlx_axon library, pending Axon and Bumblebee releases in the next few days)
- Support for quantized types
- A zero-copy implementation of `Nx.to_binary/1`.
Most Liked
polvalente
emlx_axon has been published!
By using it (see this benchmark for an example), we can accelerate certain Bumblebee models without rewriting code for performance when using EMLX! For example, the Qwen3-0.6B-4bit model goes from ~10 tokens/s to ~42 tokens/s on my machine just by using the provided Axon node rewrites!
polvalente
@manhvu , @GenericJam was able to run EMLX on device, which means all of Nx can run! We’re working to upstream what he needs so that no patches are needed, just config!
Chapaman
Last Post!
Popular in News & Updates
Other popular topics
Latest on Elixir Forum
Sponsor Spotlight
Supporting innovation across the BEAM ecosystem.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #deployment
- #library
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #channels
- #elixirconf
- #exunit
- #discussion
- #code-sync
- #javascript
- #podcasts
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixir-ls
- #phoenix_html
- #iex
- #blog-post
- #graphql
- #genstage
- #ai
- #websockets
- #supervisor
- #elixirconf-us
- #advent-of-code
- #distillery
- #processes
- #api
- #forms
- #metaprogramming
- #security
- #hex
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Error tracking, logs, uptime, and Just Enough APM. Built for developers.
Practical resources that improve the lives of professional developers.
Producing high quality Elixir screencasts since 2017.
The deployment platform built for Elixir: PaaS ease, VPS control.
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"