slouchpie
Greetings, comrades.
I have thoroughly gone through both the RabbitMQ Elixir tutorials (RabbitMQ tutorial - "Hello world!" | RabbitMQ) and the book “Concurrent Data Processing in Elixir”. GenStage is very cool, Flow is very cool and Broadway is very cool.
I have a question for veterans who are well-experienced in both Flow and Broadway. Both are capable of constructing GenStage pipelines but, as far as I can tell, Flow allows for “longer” pipelines with more intricate branching. If using a message broker, it seems like a theoretically “ideal” architecture which would afford maximum future extensibility would be one where Broadway acts as a gateway for Flow.
My question, in short, would be “can Broadway construct pipelines of the same arbitrary length and complexity as Flow”? If not, then could it be said that it is theoretically ideal (when not certain of long-term project requirements) to always use Flow when using Broadway? As I understand, Broadway is concerned about the AMQP side of things, whereas Flow is more concerned with making GenStages do magic concurrency things.
Thanks!
P.S. Flow is really really fun. I am going to try to apply it to caint (Use streams · Issue #5 · peaceful-james/caint · GitHub)
Where Next?
Trending in Questions
Other Trending Topics
Latest on Elixir Forum
Sponsor Spotlight
We build reliable cloud platforms for business-critical systems.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #library
- #deployment
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #elixirconf
- #channels
- #exunit
- #discussion
- #code-sync
- #podcasts
- #javascript
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ai
- #ecto-query
- #elixirconf-us
- #blog-post
- #elixir-ls
- #phoenix_html
- #iex
- #graphql
- #genstage
- #websockets
- #supervisor
- #advent-of-code
- #distillery
- #processes
- #elixirconf-eu
- #api
- #forms
- #metaprogramming
- #hex
Our Sponsors
Build Elixir applications with speed and confidence.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Error tracking, logs, uptime, and Just Enough APM. Built for developers.
Elixir, Erlang & BEAM conferences from Code Sync - join us in 2026!
Practical resources that improve the lives of professional developers.
**Building the future of software with AI, trust, and human connection.**
The deployment platform built for Elixir: PaaS ease, VPS control.
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"
Showing Posts 1 to 4- Show Best Posts
- Show All (oldest first)
- Show All (newest first)
sodapopcan
I’m sorry I don’t have the answer. I’ve never even used Broadway or Flow or GenStage. But I very much enjoyed the reviews of Caint.
slouchpie
Necromancy sneak attack! I have been using these libs for a few days and am now 90% sure that I am right to default to always using flow with broadway, to orchestrate the genstages that process amqp events.
BartOtten
Wow, just the project I was looking for in my attempt to bring a “suite of libs for total localized and translated apps”. Great work.
@paulsabou is also in for LLM Po-files. Great dev I once worked with. Maybe both projects can learn from each other: GitHub - paulsabou/gettext_llm: Elixir Gettext LLM based translation library · GitHub
paulsabou
Thanks @BartOtten