theshapguy

theshapguy

Hi, I’m trying to build system similar to https://github.com/zylon-ai/private-gpt in Elixir. After looking through multiple resources a RAG four major components

  1. Ingestion
  2. Embeddings
  3. Query
  4. LLM (Prompt using Context Window)

I have written a blog post about it, also have shared the code for this. Currently, the code is very basic and only reads the Reddit S-1 document. I plan to incorporate file uploads, embeddings selectio, llm models selection down the road.

Just wanted to share my learnings to the community and want to see how far I can take Elixir with RAG with this project.

Hackernews

Showing Posts 1 to 3

ken-kost

ken-kost

Exciting! Do you accept contributions? I would like to participate.

TwistingTwists

TwistingTwists

If you are after creating agents, it might be worthwhile to have a look at prior art

https://github.com/nileshtrivedi/autogen

theshapguy

theshapguy OP

Definitely Yes!

Currently, I’m just working on the boilerplate code for uploads and embeddings, once that is done it will be easier to accept contributions. Currently the code is pretty basic right now, and just replies to a single file (Reddit S-1 filing)

— All posts loaded —

Where Next? Top

Trending in Discussions Top

AstonJ
As the title says, please share what you’ve been up to with Elixir. Whether that’s been learning it, looking into it, making stuff with i...
2977 91898 914
New
AstonJ
The obligatory hello world thread! Who are you and where are you from? :stuck_out_tongue:
4616 55835 594
New
byu
@chrismccord : I just saw the Extract AGENTS.md from Phoenix.new into phx.new generator commit to the phoenix project. My initial shotgu...
New
arcanemachine
I was working on an Ecto migration and I needed a timestamp. So, for the nth time, I looked up the different data types for timestamps, a...
New
alexslade
Fly’s CEO posted this recently - Turn And Face The Strange · The Fly Blog It says that Fly is going all-in on sprites, which is a worry ...
New
Herve37
We’re evaluating API mocking tools for OpenAPI-based projects and would love to hear what other teams are using. We’re particularly inte...
New
matt-savvy
Is there a word for the ~> symbol used in Version strings? Do you also just call it a Squiggle Arrow™ ?!
New

Other Trending Topics Top

JesseHerrick
Hey, I’m Jesse and I’m the main contributor behind Dexter, a full-featured, lightning-fast Elixir LSP optimized for large codebases. It s...
New
jimsynz
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
mcass19
ExRatatui lets you cook up rich terminal UIs in Elixir, powered by Rust’s ratatui via Rustler NIFs. Build interactive terminal applicatio...
New
netoum
Corex is an accessible, unstyled UI component library for Phoenix that integrates Zag.js state machines using Vanilla JavaScript and Live...
New
Damirados
Hello everyone. After busy few months I am happy to announce v0.1.0 of Emerge & Solve. They are GUI (Emerge) and State management (S...
New
ausimian
Emily is an Elixir library that runs Nx computations on Apple’s MLX. Install it as the default Nx backend and Nx, defn, Axon, Nx.Serving,...
New

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews