onnimonni
I would want to create local phoenix app to allow semantic search for local files.
In order to do this I need to calculate embeddings for my files and I’m wondering if we have good elixir integration for Apple Metal hardware acceleration to calculate the embeddings with nomic-embed-text or should I just use Ollama instead?
How is the MLX support in the current tooling?
Where Next?
Trending in Questions
Other Trending Topics
Latest on Elixir Forum
Sponsor Spotlight
Catch errors, track performance, monitor hosts and more.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #deployment
- #library
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #channels
- #elixirconf
- #exunit
- #discussion
- #code-sync
- #javascript
- #podcasts
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixir-ls
- #blog-post
- #phoenix_html
- #iex
- #graphql
- #ai
- #genstage
- #elixirconf-us
- #websockets
- #supervisor
- #advent-of-code
- #distillery
- #processes
- #api
- #forms
- #metaprogramming
- #security
- #hex
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Error tracking, logs, uptime, and Just Enough APM. Built for developers.
Practical resources that improve the lives of professional developers.
Bringing learning, work and compliance together since 1987.
Producing high quality Elixir screencasts since 2017.
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"
Showing Posts 1 to 4- Show Best Posts
- Show All Posts (oldest first)
- Show All Posts (newest first)
al2o3cr
There’s
emlx, a Metal-powered backend for Nx:https://github.com/elixir-nx/emlx
Haven’t tried it out lately, though
polvalente
EMLX with Nx 0.11 should work great for most things.
I have work in progress for even faster execution times, bringing back the original attempts at a compiled mode.
It didn’t work back then because of a bug in Nx that has been solved in the latest release.
Also, with Nx.runtime_call you can interleave external non-Nx code into your Nx computations, so you can do a best-of-both-worlds approach
onnimonni
The mixing of nx and non nx sound like pure alchemy for me
.
Links to examples would be amazing but I will anyway try it out
polvalente
https://github.com/elixir-nx/nx/blob/7da307c8c0520a0250741bfb3e81d4d98478278c/exla/test/exla/defn/runtime_call_test.exs#L21
There are a few tests where you can get familiarized with the interface. The function docs should be enough, though.