calebjosue
How is the LLM scene with Elixir/Phoenix?
What sort of libraries are available to integrate LLMs into your Phoenix Web Framework applications? e.g. Mistral, since these guys have available these endpoints, I was thinking to just consume those within the app. But I rather post my question, I know one or two things of LangChain, but there is only support for Python and JavaScript.
Thanks!
First Post!
egze
Most Liked
jam
There seem to be a number of libraries. I haven’t explored them in depth but here’s a sampling:
Depends on your needs. Some advocate for just using Req and a GenServer.
olivermt
mikehostetler
Each of these libraries tackles the problem in slightly different ways.
I’m the author of ReqLLM, so I’m a bit biased - but I built it because the more advanced use cases I started building with LLMs, I needed lower-level control.
That said, Langchain is focused on higher level use cases such as chaining - which ReqLLM will not be implementing.
Last Post!
mindreader
I started rolling my own. But reqllm is exactly what I I was shooting for but way better in every way, so I guess I’ll just start using that instead.
Trending in AI / LLMs
Other Trending Topics
Latest Phoenix Threads
Latest on Elixir Forum
Sponsor Spotlight
Supporting innovation across the BEAM ecosystem.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #deployment
- #library
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #channels
- #elixirconf
- #exunit
- #discussion
- #code-sync
- #javascript
- #podcasts
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixir-ls
- #phoenix_html
- #iex
- #blog-post
- #graphql
- #genstage
- #ai
- #websockets
- #elixirconf-us
- #supervisor
- #advent-of-code
- #distillery
- #processes
- #api
- #forms
- #metaprogramming
- #security
- #hex
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Error tracking, logs, uptime, and Just Enough APM. Built for developers.
Producing high quality Elixir screencasts since 2017.
Enabling companies to succeed by building software people love.
The deployment platform built for Elixir: PaaS ease, VPS control.
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"