nevakrien

nevakrien

VectorDB in gigalixir - how to do KNN?

So I have been stuck for a alot of time tryi g to figure out how to get a vector db for parge vectors that can do KNN. Its suprisingly complicated to make something like ecto do it.

The reason i am asking specifcly here is that i sont really know how i would go about installing packages with ecto or if thats even a good idea.

Ideally i want somerhing like pgvector which is just made for this sort of quries but i dont mind writing it in pure sql of it can work.

Most Liked

gigatim

gigatim

If you are using Gigalixir’s STANDARD tier database, you can enable the pgvector extension.

gigalixir pg:psql

postgres=> CREATE EXTENSION IF NOT EXISTS vector;
FelisOrion

FelisOrion

I’ve been there, doing KNN inside Ecto/SQL gets painful fast. My advice: let your DB handle persistence, and do the vector math in-memory. I built Vettore, a Rust-backed Elixir lib that does fast cosine/dot KNN (plus HNSW) without wrestling with SQL. You can store vectors + metadata in Postgres (or pgvector if you like), then load them into Vettore on boot, run KNN, and fetch details by IDs from the DB. Simple, fast, and no database gymnastics.

https://github.com/elchemista/vettore

Where Next?

Popular in Questions Top

hariharasudhan94
I would like to know what is the best IDE for elixir development?
New
Darmani72
If I have a post route which an argument: post /my_post_route/:my_param1, MyController.my_post_handler How would get the post params ...
New
greenz1
I have a phoenix application from which a user can download multiple(5-6) files of size 1MB. I couldn’t find anything related to sending ...
New
siddhant3030
Hi, I have to write a raw query for one of my project. But till now I have used ecto queries and don’t have much experience writing raw ...
New
fayddelight
I tried installing elixir 1.11.2 erlang 23.3.4 via asdf in my zsh shell. Enabled the versions locally and globally. When I list them ...
New
JorisKok
I have a server on AWS, and was running a load test using artillery. When looking at the Phoenix dashboard I see the Ports going to 100% ...
New
senggen
Erlang/OTP 25 [erts-13.2.2] [source] [64-bit] [smp:8:8] [ds:8:8:10] [async-threads:1] 15:22:35.803 [error] gen_event {lager_file_backend...
New

Other popular topics Top

Qqwy
Update: How to use the Blogs & Podcasts section You can post links to your blog posts or podcasts either in one of the Official Blog...
3271 130286 1222
New
JeremM34
Hello, how can I check the Phoenix version ? Thanks !
New
jononomo
For some reason my phoenix channels are working for me in my local dev environment, but as soon as I deploy via Docker, I get a 403 error...
New
dokuzbir
I want to highlight html closing tags when i click a html tag. That works in .html files but doesnt work for html.eex templates. How can...
New
Patoshizzle
After calling mix ecto.create I get this error: 17:00:32.162 [error] GenServer #PID<0.412.0> terminating ** (Postgrex.Error) FATAL...
New
jason.o
In the code below, if the create action is not set to accept “extra_key” as an input, it errors out with a message shown above. Is there ...
New

We're in Beta

About us Mission Statement