Thanks @darnahsan! Merged!
brainlid
Gonza
Hey guys, have any of you been able to make Langchain work with OpenRouter? It exposes an OpenAI-compatible API but all I’m getting is null. I’m pretty sure it’s hitting the right endpoint and with the right apikey, because those were problems but I got past them.
This is what I got:
ash_ai_demo/config/runtime.exs
config :langchain, openai_key: fn -> System.fetch_env!("OPENROUTER_API_KEY") end
ash_ai_demo/lib/ash_ai_demo/chat/message/changes/respond.ex
%{
llm:
ChatOpenAI.new!(%{
stream: true,
model: "google/gemini-2.0-flash-exp:free",
endpoint: "https://openrouter.ai/api/v1/chat/completions",
custom_context: Map.new(Ash.Context.to_opts(context))
})
}
|> LLMChain.new!()
ash_ai_demo/lib/ash_ai_demo/chat/conversation/changes/generate_name.ex
%{
llm:
ChatOpenAI.new!(%{
model: "google/gemini-2.0-flash-exp:free",
endpoint: "https://openrouter.ai/api/v1/chat/completions",
custom_context: Map.new(Ash.Context.to_opts(context))
}),
verbose?: true
}
|> LLMChain.new!()
logs:
[error] Received error from API: "Expected string, received null"
[error] Error during chat call. Reason: %LangChain.LangChainError{type: nil, message: "Expected string, received null", original: nil}
I followed all the instructions I could find but I’m stuck
0
brainlid
Hi Gonza!
I don’t know. I haven’t used OpenRouter. It may be mostly compatible with OpenAI, or there is an incompatibility in the library. One thing to note is that Ash AI is using v0.3.x of Elixir LangChain and I’m working on v0.4.0 (RC) where there have been many substantial changes. One of which is a detailed verbose_api mode support for OpenAI, which would help debug an issue like this.
1
brainlid
@zachdaniel I hope a new RC 1 will be out soon-ish. That has more significant changes but also more benefits. It’s up to you, but you can wait for that one if that makes works.
1
herisson
Stumbled upon the same issue.
After looking into the request made, it seems the only nil field was the user (nil by default).
To fix that you can specify the user when creating your ChatOpenAI:
ChatOpenAI.new!(%{
api_key: openrouter_api_key,
model: "openrouter/horizon-beta",
endpoint: "https://openrouter.ai/api/v1/chat/completions",
user: "user_name"
})
Hope it helps!
4