sonic182
Llm_composer - Elixir library for building LLM-based applications
Hi everyone, at Doofinder we have been building llm_composer for some new apps, and we thought it could be useful to share it with the community.
llm_composer is an Elixir library that simplifies working with large language models (LLMs) like OpenAI’s GPT, OpenRouter, Ollama, AWS Bedrock, and Google (Gemini).
It provides a streamlined way to build and execute LLM-based applications or chatbots, with features such as:
- Multi-provider support (OpenAI, OpenRouter, Ollama, Bedrock, Google Gemini/Vertex AI).
- System prompts and message history management.
- Streaming responses.
- Function calls with auto-execution.
- Structured outputs with JSON schema validation.
- Built-in cost tracking (currently for OpenRouter).
- Easy extensibility for custom use cases.
A key feature is the provider router that handles failover automatically.
It will use one provider until it fails, then fall back to the next provider in the list, applying an exponential backoff strategy. This makes it resilient in production environments where provider APIs can become temporarily unavailable.
Under the hood, llm_composer uses Tesla as the HTTP client.
For production setups, especially when using streaming, it is recommended to run it with Finch for optimal performance.
More info and docs:
HexDocs: LlmComposer — llm_composer v0.20.0
GitHub:
Most Liked
sonic182
llm_composer v0.16.0 released (Feb 23, 2026)
Quick update since the last post (v0.12.2 / MIT switch) — quite a bit has landed since then.
What’s new in 0.16.0
- New provider:
LlmComposer.Providers.OpenAIResponses— calls OpenAI’s/responsesAPI with support for structured outputs and reasoning (provider/model-specific params passed viarequest_params), normalized into the usualLlmResponseshape. Since it targets the/responsesAPI spec, it also works with compatible providers like x.ai (xAI/Grok), OpenRouter’s responses endpoint, and others. - Typed streaming chunks: new
LlmComposer.StreamChunkstruct + provider-specific parsing turns raw stream events into typed values (:text_delta,:tool_call_delta,:done, …). LlmComposer.FunctionCallExtractors: centralizes function call extraction logic per provider.- Provider-aware
parse_stream_response: now comes in/2and/3arities and returns%StreamChunk{}values instead of raw decoded maps. - Internals refactored to protocol-based adapters (
LlmComposer.ProviderResponse+LlmComposer.ProviderStreamChunk) for cleaner normalization across providers.
Notable releases since 0.12.2
- 0.13.0 (Dec 2025): function-call workflow is now manual/explicit via
FunctionExecutor+FunctionCallHelpers— breaking change, see changelog. - 0.13.1 (Jan 2026): custom HTTP headers support for OpenRouter.
- 0.14.0 (Feb 4): configurable retry/backoff for provider requests.
- 0.14.1 (Feb 9): deep merge fix for nested
request_params(e.g. Google’sgenerationConfig). - 0.14.2 (Feb 10):
LlmResponse.new/3now returns{:error, …}instead of raising on unknown provider formats. - 0.15.0 (Feb 17): configurable
:json_engine(defaults toJSON, falls back toJason); Google provider now preservesadditionalPropertiesin response schemas.
Upgrade
{:llm_composer, "~> 0.16.0"}
Full changelog: llm_composer/CHANGELOG.md at master · doofinder/llm_composer · GitHub
Jskalc
sonic182
We started this lib about a year ago (we’d been using it internally even before that) and only now decided to share it here.
Both libraries aim at the same thing: wrapping LLM APIs behind a unified HTTP client.
The main differences are:
-
HTTP layer: we use Tesla, ReqLLM builds on Req.
-
Routing: llm_composer includes a router with fallback + retries.
-
API style: each library exposes a slightly different way to configure and work with “bots” or requests, so it depends which style you prefer.
Popular in Announcing
Other popular topics
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #deployment
- #library
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #channels
- #elixirconf
- #exunit
- #discussion
- #code-sync
- #javascript
- #podcasts
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixir-ls
- #phoenix_html
- #iex
- #blog-post
- #graphql
- #genstage
- #ai
- #websockets
- #supervisor
- #advent-of-code
- #elixirconf-us
- #distillery
- #processes
- #forms
- #api
- #metaprogramming
- #security
- #performance









