theshapguy

theshapguy

RAG with Elixir

Hi, I’m trying to build system similar to https://github.com/zylon-ai/private-gpt in Elixir. After looking through multiple resources a RAG four major components

  1. Ingestion
  2. Embeddings
  3. Query
  4. LLM (Prompt using Context Window)

I have written a blog post about it, also have shared the code for this. Currently, the code is very basic and only reads the Reddit S-1 document. I plan to incorporate file uploads, embeddings selectio, llm models selection down the road.

Just wanted to share my learnings to the community and want to see how far I can take Elixir with RAG with this project.

Hackernews

Most Liked

TwistingTwists

TwistingTwists

If you are after creating agents, it might be worthwhile to have a look at prior art

https://github.com/nileshtrivedi/autogen

theshapguy

theshapguy

Definitely Yes!

Currently, I’m just working on the boilerplate code for uploads and embeddings, once that is done it will be easier to accept contributions. Currently the code is pretty basic right now, and just replies to a single file (Reddit S-1 filing)

Where Next?

Popular in Discussions Top

scouten
I’m looking for a host for the server part of a small (personal) side project that I’m working on. It’s currently written in Node.js and ...
New
AstonJ
Please see the new poll here: Which code editor or IDE do you use? (Poll) (2022 Edition) It’s been a while since we first asked this, I...
208 31707 143
New
und0ck3d
Hello everyone! A few days ago I’ve created a topic here about how people were creating CMSs with Elixir and Phoenix. I’ve been studying...
New
tomekowal
Hey guys! I want to create a toy project that shows a chart of temperature over time and updates every 5 seconds. I feel LiveView is per...
New
Fl4m3Ph03n1x
Background A few days ago I was listening to The future of Elixir from Elixir Talks, with Dave Thomas (@pragdave ) and Brian Mitchell. I...
New
marciol
Please, let me know if this kind of discussion already took place in another topic . Hi all, how do you consider if is better to build ...
New
cvkmohan
The upcoming Phoenix 1.6 release looks very interesting. Became a habit to watch the commits - and - what they are bringing in. phx.gen...
New

Other popular topics Top

nobody
Hi! In PHP: $_SERVER[‘SERVER_ADDR’] - in Elixir? Searched the docs for ip address and the web, no good results. Thanks!
New
joaquinalcerro
Hi there, I am working with Ecto-Postgresql and I need to call all of the records from a specific table but the table has 40,000 records...
New
jononomo
I am trying to figure out how Mix knows whether the environment is test, dev, or prod – where is this set? Thanks.
New
lanycrost
Hi everyone! I need implement if…else if…else condition from my elixir code, and anymore of this control flow structures not work proper...
New
openscript
Hello! Sorry for this astonishing simple question, but I’m really stuck. I try to set up the intellij-elixir plugin, but I don’t know ho...
New
bsollish-terakeet
Credo is smart enough to check for (something like) this: assert length(the_list) == 0 with this response: Checking if an enum is empt...
New

We're in Beta

About us Mission Statement