Free LLM inference using various API providers from Elixir

In production we are doing a lot of LLM inference and recently a good chunk of that is free.
I thought I would share with you guys some of the providers and how to use them from Elixir:

Run in Livebook

All models I listed in the notebook are high quality.

2 Likes