The docs on how to stream chat completions make it so clear what’s going on. I was able to implement streaming chat completions in my LiveView in about 15 minutes. Thank you for this excellent work!
ipnon
restlessronin
restlessronin
dlobo
Thanks for an excellent library. We cooked our own, not-so-great implementation and would love to switch to this library. A couple of questions
Since many of OpenAI’s api’s return immediately, but not yet complete (i..e the status is running). I checked the python library and they have a polling mechanism to wait for the status. I dont see the same in the elixir code base. This is true for create_and_run and and also just run
am I missing something?
lobo
restlessronin
@dlobo apologies for the delayed response. i only check the forum from time to time, so I didn’t see this. Apparently i only get immediate notifications if I am tagged in a message.
The library handles run status monitoring through streaming - just pass stream: true when creating a run. The response includes a body_stream field which is an Elixir Stream, allowing you to efficiently process run updates using Elixir’s Stream API for real-time monitoring.
If you need polling (in a non-streamed call), you can implement it using Runs.retrieve/2. Here’s a simple example:
def poll_run(openai, thread_id, run_id, interval \\ 1000) do
case OpenaiEx.Beta.Threads.Runs.retrieve(openai, %{thread_id: thread_id, run_id: run_id}) do
{:ok, %{"status" => status}} when status in ["completed", "failed", "cancelled", "expired"] ->
{:done, status}
{:ok, %{"status" => status}} ->
Process.sleep(interval)
poll_run(openai, thread_id, run_id, interval)
error ->
error
end
end
Let me know if you have any other questions. Please tag me so it doesn’t slip through the cracks again 
restlessronin
restlessronin
I have published v0.9.1 with updates to the Responses and Chat Completion APIs, including CRUD operations.
mikehostetler
Thanks for shipping the Responses Endpoint so quickly! I’ve already integrated it into Jido AI.
restlessronin
published v0.9.2 to allow include query params. Shoutout to @fedme for the PR.
There are small changes to the syntax for some of the Responses and Thread Run endpoints. Please check latest user guide (livebook) if in doubt.
For those who wondered about the lack of tests in the library, the user guide is actually the test suite. It’s run before every version release, so the documentation is always up to date.
restlessronin
published v0.9.3 to fix a task cleanup regression. Shoutout to github user @a-nsassim for opening the issue.