Hey, in case anyone need OpenAI library that supports streaming I’m working on one (I use it internally and for production) marinac-dev/openai
Keep in mind it’s not full of features, I developed only the one I use right now but full API support coming in next few days. It’s nice that we have a boom in OpenAi libs 
regex.sh
2
restlessronin
Additional helpers, as in client apis for other language models?
I don’t really know much about LangChain. On first blush it looks interesting, let me take a closer look. Thanks for the pointer.
0
restlessronin
Might be interesting to try to build one of their demo applications entirely in Livebook, to see what’s what.
0
restlessronin
I just added the File endpoint and bumped the version to 0.1.4.
Please note that the API is changing a little from version to version, so if you see weird behaviour check the user guide for the latest version for the right sample code.
Hopefully once all the endpoints are added the API will be more stable. 2 endpoints left to go. Fine Tuning and Moderations.
1
darwin67
darwin67
It’s basically a library that helps you be a better prompt engineer.
Jokes aside, due to the limitation of tokens, context, etc. LangChain is pretty helpful when it can chunk large texts and do a map reduce kind of aggregation.
That’s one use case, and there are more.
1
restlessronin
restlessronin
darwin67
Not sure if that’s the right comparison here.
AutoGPT is an attempt of building an autonomous agent.
LangChain is more like a tool for people who want to use LLMs.
More like a nice helper library / wrapper to make interacting with LLMs easier instead of you having to go develop all the functions yourself to get a better response from models.
1
restlessronin
This functionality seems helpful and worth copying.
Providing an abstraction layer for different LLM’s in Elixir, is interesting, but it’s not the first thing I would do.
Partly, it’s a chicken and egg problem. LangChain can work because all LLM providers already have API bindings in python and node.js. Someone would have to provide those for elixir. Secondly, there will likely be only 2-3 “winners” in the LLM space, and it will be more important to support them comprehensively, rather than supporting every possible LLM partially.
I’d be interested in implementing an application level project like AutoGPT in Elixir, starting with OpenAI, adding the “higher-level” LangChain-like functionality, if it proves necessary. Does that sound interesting?
2