brainlid

brainlid

Podcast: Thinking Elixir 185 - InstructorEx for LLMs

Episode 185 of Thinking Elixir. Dive into the world of structured LLM prompting with our latest guest who shares insights on their innovative project, InstructorEx. We’ll explore how this tool is pushing the boundaries of large language models to return structured data, particularly JSON, and the benefits it offers when integrated into existing systems. The conversation takes a deep dive into the challenges and solutions of forcing LLMs to output data in desirable formats using Elixir technology, like Ecto schemas, and what it means to treat an LLM like a digital human, even applying it to tasks like spam detection in emails. Discover the intriguing concept of using a local database as a cache for LLM results. If you’re curious about the intersection of structured data, Python experience transition to Elixir, and the future of LLM integration, this is an episode not to miss. Tune in for these engaging topics and more!

First Post!

shawn_leong

shawn_leong

I was trying to coerce the output completions from OpenAI for my specific use case into a more structured format & was hell-bent not to leave Elixir land.

Was looking for the Elixir equivalent of Output Parsers in Python LangChain & this was super timely and helpful, thank you! :pray:

Would something similar to Output Parsers be on the roadmap for Elixir LangChain?
(I imagine Instructor being one of many outputs that follow some defined behaviour)

Last Post!

brainlid

brainlid

Hi @shawn_leong! I’m hoping that Bumblebee can get support for the same type of output constraint that LlamaCPP supports.

If that can happen, then I’d love to add that to Elixir LangChain.

What type of output parsing were you looking for? When working with OpenAI and ChatGPT, the easiest I’ve found is creating a function that takes the data in the structure you want.

Where Next?

Popular in Podcasts Top

brainlid
We talk with Bram Verburg about an important root certificate expiring at the end of September and how this impacts your Elixir and Erlan...
New
brainlid
In episode 66 of Thinking Elixir, we talk with Kai Wern Choon about his experience tracing performance problems in production. We talk ab...
New
brainlid
In episode 69 of Thinking Elixir, we talk with Dominic Letz about running Elixir on an Android phone in an APK which hosts a LiveView app...
New
brainlid
In episode 73 of Thinking Elixir, we talk with Paul Copplestone, founder and CEO of Supabase. Supabase leverages the power of Elixir, Pos...
New
brainlid
In episode 74 of Thinking Elixir, we talk with mother and daughter team Miki and Kate Rezentes about their experiences learning and worki...
New
brainlid
The 100th episode of Thinking Elixir is spent with José Valim celebrating 10 years of Elixir. We close out our 5-part series talking abou...
New
brainlid
Episode 123 of Thinking Elixir. Creator of the Ash Framework, Zach Daniel, shares how he feels Ecto is such a good tool, that people have...
New

Other popular topics Top

JeremM34
Hello, how can I check the Phoenix version ? Thanks !
New
Qqwy
Original source of discussion: This topic on the Pragmatic Programmers’ Functional Web Development with Elixir, OTP, and Phoenix forum. ...
New
ashish173
I am using Ecto timestamps with postgres, I can see the timestamps() use the :naive_dateime but for my use case I wanted to store the ti...
New
nsuchy
Hi. I’ve noticed that Windows Powershell has it’s own IEX command and you cannot access Elixir’s IEX due to the conflict. This isn’t a cr...
New
alice
Hey, Just curious what are the main benefits of Elixir compared to Clojure? When is Elixir more useful than Clojure and vice versa? Th...
New
TunkShif
This post is an instruction guide to help you setup your Neovim for Elixir development from scratch. It includes general information on h...
274 42716 114
New

We're in Beta

About us Mission Statement