calebjosue
How is the LLM scene with Elixir/Phoenix?
What sort of libraries are available to integrate LLMs into your Phoenix Web Framework applications? e.g. Mistral, since these guys have available these endpoints, I was thinking to just consume those within the app. But I rather post my question, I know one or two things of LangChain, but there is only support for Python and JavaScript.
Thanks!
Most Liked
jam
There seem to be a number of libraries. I haven’t explored them in depth but here’s a sampling:
Depends on your needs. Some advocate for just using Req and a GenServer.
olivermt
100% reqllm best option imo.
Simply because it is dead simple to alter yourself.
mikehostetler
Each of these libraries tackles the problem in slightly different ways.
I’m the author of ReqLLM, so I’m a bit biased - but I built it because the more advanced use cases I started building with LLMs, I needed lower-level control.
That said, Langchain is focused on higher level use cases such as chaining - which ReqLLM will not be implementing.
Popular in AI / LLMs
Other popular topics
Latest Phoenix Threads
Latest on Elixir Forum
Sponsor Spotlight
Catch errors, track performance, monitor hosts and more.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #deployment
- #library
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #channels
- #elixirconf
- #exunit
- #discussion
- #code-sync
- #javascript
- #podcasts
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixir-ls
- #phoenix_html
- #iex
- #blog-post
- #graphql
- #genstage
- #ai
- #websockets
- #supervisor
- #advent-of-code
- #elixirconf-us
- #distillery
- #processes
- #forms
- #api
- #metaprogramming
- #security
- #performance
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Real-time error tracking, performance insights, and observability for devs.
Develop your skills with books, videos, and courses.
Producing high quality Elixir screencasts since 2017.
Enabling companies to succeed by building software people love.
Courses that'll move you from confusion to "Aha, now I get it!"