Chat & Discussions>Discussions

AI powered app (with open-source LLMs like Llama) with Elixir, Phoenix, LiveView, and TogetherAI

/phoenix#liveview#ai#req
azyzz228

azyzz228

AI powered app (with open-source LLMs like Llama) with Elixir, Phoenix, LiveView, and TogetherAI

Wrote a simple tutorial on handling HTTP streams and integrating it well with LiveView.

TLDR:

In Elixir world, we are going to have two processes, one for liveview and another process that will handle HTTP call with streams. LiveView will send the prompt and its pid (process id) to the handler, that in turn will spawn a separate process that will make HTTP call and send the chunks of LLM output to the LiveView as the chunks arrive. When the last chunk arrives, we then notify the LiveView that the text generation has finished.

More: AI powered app (with open-source LLMs like Llama) with Elixir, Phoenix, LiveView, and TogetherAI - DEV Community

View thread on forum
/phoenix#liveview#ai#req
3 171 0

Where Next?

View thread on forum
phoenix
liveview
ai
req
Home Chat & Discussions>Discussions
/phoenix#liveview#ai#req
3 171 0
Last post

Popular in Discussions Top

jswny
Chat & Discussions>Discussions

Advantages of umbrella applications?
I would like to better understand what the advantages/disadvantages of umbrella applications are compared to structuring your app as as s...
#umbrella#deployment
64 7179 11
New
PragTob
Chat & Discussions>Discussions

Background job queues: When to use? When not to use? Which one to use?
Hello everyone, I know we had quite some threads (read through lots of them) about background job processing but it remains a hotly deba...
#discussion#job-processing#background_job
76 14567 25
New
Jayshua
Chat & Discussions>Discussions

HTMX - A js library sort of like liveview
I recently came across the javascript library htmx. It reminded me a lot of liveview so I thought the community here might be interested....
/phoenix#liveview
89 10147 26
New
laiboonh
Chat & Discussions>Discussions

React vs Phoenix Liveview
Hi all, I am trying to convince my team to use liveview over the current react. What are some of the points where one should consider us...
/phoenix#react#liveview
33 7272 12
New
mmport80
Chat & Discussions>Discussions

Is Dialyzer worth the effort?
I have put far too much effort into Dialyzer over the last year or so - and basically - I doubt it’s worth the effort. It’s not as easy ...
15 9312 6
New
tmbb
Chat & Discussions>Discussions

Let's discuss Phoenix LiveView
This is a post to discuss the new Phoenix LiveView functionality. From Chris’s talk, it appears that they generate all HTML on the serve...
/phoenix#elixirconf2018#liveview
342 18243 126
New
AstonJ
Chat & Discussions>Discussions

Video Streaming with Elixir/Erlang
Are there any Elixir or Erlang libraries that help with this? I’ve been thinking how streaming services like twitch have exploded recentl...
#erlang#video-streaming
10 10611 6
New
ejpcmac
Chat & Discussions>Discussions

Nix vs asdf for Elixir version management
I have discovered Nix last month and I am currently on my way to migrating to it—both on macOS at home and the full NixOS distrubution at...
#version-managers
39 8511 9
New
jer
Chat & Discussions>Discussions

How do YOU use umbrella apps, and why?
I’ve been using umbrellas for a while, and generally started off (on greenfield projects at least) by isolating subapps based on clearly ...
#umbrella#discussion
46 13475 13
New
Qqwy
Chat & Discussions>Discussions

The issue with the static access operator (the dot)
I would like to spark a discussion about the static access operator: .. For whom does not know: it is used in Elixir to access fields of...
#access#discussion
18 10518 24
New

Other popular topics Top

senggen
Questions & Help>Questions

How to fix *Bad argument in call to erlang:'++'(<<"xxx/crash.log">>, ".3") in lager_rotator_default:rotate_logfile/2 line 84*
Erlang/OTP 25 [erts-13.2.2] [source] [64-bit] [smp:8:8] [ds:8:8:10] [async-threads:1] 15:22:35.803 [error] gen_event {lager_file_backend...
#production#error#log
2 46485 2
New
AstonJ
Chat & Discussions>Polls

Which Neovim configuration distro do you use/recommend? (Poll)
Posting this to see if we can make things easier for people to get into Neovim. If you use Neovim and have a favourite distro please let ...
#polls#code-editors#neovim
79 14414 31
New
Darmani72
Questions & Help>Questions

Params in the URL and body -- how does Phoenix handle them together?
If I have a post route which an argument: post /my_post_route/:my_param1, MyController.my_post_handler How would get the post params ...
/phoenix#params
17 27034 14
New
stefanluptak
Questions & Help>Questions

Using VSCode on multiple monitors
Hello everybody, usually, I use a 29" ultra-wide monitor for VSCode which can easily accomodate explorer (files panel) + file with code ...
#vscode#vscode-elixir
7 17994 6
New
vrod
Questions & Help>Questions

Starship (cross-shell prompt) error - (starship::utils): Executing command "elixir" timed out
I am using the Starship cross-shell prompt – it seems pretty nice, but I get some errors: [WARN] - (starship::utils): Executing command ...
#starship
8 17418 3
New
aalberti333
Questions & Help>Questions

Enum.map over list of key/value pairs with a map as the value
As the title describes, I’m trying to run Enum.map() over a list of key/value pairs, where the value is a map. My data looks like this: ...
#enummap
7 19946 6
New
saif
Chat & Discussions>Discussions

Dialyzer - Function foo/1 has no local return
Hello everyone, Long time lurker first time poster here. I’ve recently begun working on Elixir full-time again! :raised_hands: It’s been...
#dialyzer#type-checking
15 20103 5
New
KronicDeth
News>Announcing

IntelliJ Elixir - Elixir plugin for JetBrain's IntelliJ Platform
Elixir plugin for JetBrain’s IntelliJ Platform (including Rubymine) This is a plugin that adds support for Elixir to JetBrains IntelliJ...
#library#intellij
289 36352 110
New
boundedvariable
Chat & Discussions>Discussions

Can we beat Kafka if we build it in Elixir?
I am going through the kafka architecture. All the features what the kafka is providing are already in Erlang. I would like hear your opi...
#distributed-systems
96 20730 29
New
komlanvi
Questions & Help>Questions

LiveView phx-change attribute does not emit event on input text
Hi everyone, I was playing with phoenix liveView but I run into an issue. I have a form and want to validate each input text when the te...
/phoenix#liveview#input-validation
67 20719 33
New
Back to top

Latest Phoenix Threads

Phoenix Forum ❯

Chat & Discussions>Discussions

Chat Discussions ❯

Latest on Elixir Forum

Elixir Forum ❯

Sponsor Spotlight

WyewWorks

Enabling companies to succeed by building software people love.

Our Sponsors

Dashbit

Build Elixir applications with speed and confidence.

EEF

Supporting innovation across the BEAM ecosystem.

Coders51

We build reliable cloud platforms for business-critical systems.

AppSignal

Catch errors, track performance, monitor hosts and more.

Honeybadger

Error tracking for Elixir devs who love to ship. Start your free account.

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

ElixirCasts

Producing high quality Elixir screencasts since 2017.

WyewWorks

Enabling companies to succeed by building software people love.

Software Mansion

The team behind Membrane, Popcorn, LiveDebugger. Available for hire.

Pragmatic Studio

Courses that'll move you from confusion to "Aha, now I get it!"

View all our sponsors ❯

Categories:

Sub Categories:

Forums

Popular Tags

Our Sponsors

Dashbit

Build Elixir applications with speed and confidence.

EEF

Supporting innovation across the BEAM ecosystem.

Coders51

We build reliable cloud platforms for business-critical systems.

AppSignal

Catch errors, track performance, monitor hosts and more.

Honeybadger

Error tracking for Elixir devs who love to ship. Start your free account.

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

ElixirCasts

Producing high quality Elixir screencasts since 2017.

WyewWorks

Enabling companies to succeed by building software people love.

Software Mansion

The team behind Membrane, Popcorn, LiveDebugger. Available for hire.

Pragmatic Studio

Courses that'll move you from confusion to "Aha, now I get it!"

View all our sponsors ❯

We're in Beta

About us Mission Statement