onnimonni
Better way to run local embeddings with Apple Metal than Ollama?
I would want to create local phoenix app to allow semantic search for local files.
In order to do this I need to calculate embeddings for my files and I’m wondering if we have good elixir integration for Apple Metal hardware acceleration to calculate the embeddings with nomic-embed-text or should I just use Ollama instead?
How is the MLX support in the current tooling?
Most Liked
polvalente
EMLX with Nx 0.11 should work great for most things.
I have work in progress for even faster execution times, bringing back the original attempts at a compiled mode.
It didn’t work back then because of a bug in Nx that has been solved in the latest release.
Also, with Nx.runtime_call you can interleave external non-Nx code into your Nx computations, so you can do a best-of-both-worlds approach
al2o3cr
There’s emlx, a Metal-powered backend for Nx:
https://github.com/elixir-nx/emlx
Haven’t tried it out lately, though
Popular in Questions
Other popular topics
Latest on Elixir Forum
Sponsor Spotlight
Enabling companies to succeed by building software people love.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #deployment
- #library
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #channels
- #elixirconf
- #exunit
- #discussion
- #code-sync
- #javascript
- #podcasts
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixir-ls
- #phoenix_html
- #iex
- #blog-post
- #graphql
- #genstage
- #ai
- #websockets
- #supervisor
- #elixirconf-us
- #advent-of-code
- #distillery
- #processes
- #forms
- #api
- #metaprogramming
- #security
- #hex
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Error tracking for Elixir devs who love to ship. Start your free account.
Develop your skills with books, videos, and courses.
Producing high quality Elixir screencasts since 2017.
The deployment platform built for Elixir: PaaS ease, VPS control.
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"