How is the LLM scene with Elixir/Phoenix?

[jam]

There seem to be a number of libraries. I haven’t explored them in depth but here’s a sampling:

ReqLLM - Composable LLM client built on Req

Hey everyone! I’m excited to share ReqLLM - a new approach to LLM interactions in Elixir that I’ve been working on. After building agent systems with various LLM clients, I kept running into the same frustrations: they either lacked Elixir’s composability principles or didn’t integrate well with existing HTTP pipelines. Why Another LLM Client? While building out Jido features, I needed a lower-level API for making LLM requests. ReqLLM is built on Req, with each Provider built as a Req plugin t…

Langchain - An Elixir LangChain-like library for integrating with LLMs like ChatGPT

LangChain is short for Language Chain. An LLM, or Large Language Model, is the “Language” part. This library makes it easier for Elixir applications to “chain” or connect different processes, integrations, libraries, services, or functionality together with an LLM. LangChain is a framework for developing applications powered by language models. It enables applications that are: Data-aware: connect a language model to other sources of data Agentic: allow a language model to interact with its …

Responses - LLM library supporting OpenAI's and xAI's Responses API

Responses is a new client library that supports Responses API by OpenAI and xAI. It’s a successor to my previous library openai_responses, which only supported OpenAI - hence the name change. What is Responses API? Conveniently, OpenAI just published a blog titled “Why we built Responses API”. In short, it’s a modern (launched this spring), stateful, multimodal, efficient API, an upgrade to Chat Completions, a de-facto industry standard, that was designed by OpenAI in just a weekend back in 202…

Depends on your needs. Some advocate for just using Req and a GenServer.