Fl4m3Ph03n1x
Books about GenStage?
GenStage and Flow resources?
I have been hearing about GenStage and Flow, a tool built upon it, for quite some time. I understand it allows us to program in a paradigm that uses stages and flows and has back-pressure included.
However I have a few issues when it comes to adopting them (or even considering it).
There is only the documentation
That’s it. Documentation alone is not enough for me, I don’t learn how to use a technology by simply glossing over the docs. It’s like learning Java by reading only the JavaDocs. Sure someone will be able to do it. I am not that someone. I am dumb as a brick 
Conferences
You may say there are some conferences, but they are completely biased towards using GenStage or Flow and how great they are. I want the complete picture. I want to know when it is a good idea to use it and when it’s not. Like Agents. I know when to use them and when not to use them.
Books
In all the books I have seen, there are no GenState chapters. Only GenServer. I get it that GenServer is a major building block, but when none of the books out there has a chapter about it, it really makes me wonder if we need GenStage at all.
Even today I asked about GenStage to @ElixirCasts and they didn’t reply - it makes me think this is not an interesting topic at all.
Do you guy know of any unbiased GenStage books or resources?
First Post!
shanesveller
Flow isn’t a successor, it’s a tool built on top of the primitives of GenStage. It says so at the top of the repository.
Did this actually need to be a new thread off of your process-mailbox post?
Most Liked
outlog
I only know of the talks
btw José is announcing Broadway tmrw
Announcing Broadway
Broadway is a new open source project by Plataformatec that aims to streamline data processing pipelines. It allows developers to consume data efficiently and concurrently from many systems, such as Amazon SQS, RabbitMQ, Google Cloud PubSub and others.
In this talk, we will discuss how the Broadway architecture connects multiple stages and producers, how it leverages GenStage to provide back-pressure, how we rely on OTP for fault-tolerance, and other features such as batching, rate-limiting, partitioning and more.
outlog
You may also be interested in Flow by Plataformatec. Both Broadway and Flow are built on top of GenStage. Flow is a more general and powerful abstraction than Broadway that focuses on data as a whole, providing features like aggregation, joins, windows, etc. Broadway aims to streamline data pipelines and focuses more on operational features, such as metrics, rate-limiting, and so on.
GitHub - elixir-broadway/broadway: Concurrent and multi-stage data ingestion and data processing with Elixir · GitHub
LostKobrakai
I don’t think you can compare coverage of GenServer and GenStage. One is a integral part of the language’s stdlib, while the other is a third-party package, which happens to be quite good for processing pipelines. It’s a common, but certainly not universal problem to face.
Popular in Chat/Questions
Other popular topics
Latest on Elixir Forum
Sponsor Spotlight
Build Elixir applications with speed and confidence.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #deployment
- #library
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #channels
- #elixirconf
- #exunit
- #discussion
- #code-sync
- #javascript
- #podcasts
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixir-ls
- #phoenix_html
- #iex
- #blog-post
- #graphql
- #genstage
- #ai
- #websockets
- #supervisor
- #elixirconf-us
- #advent-of-code
- #distillery
- #processes
- #api
- #forms
- #metaprogramming
- #security
- #hex
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Error tracking, logs, uptime, and Just Enough APM. Built for developers.
Producing high quality Elixir screencasts since 2017.
Enabling companies to succeed by building software people love.
The deployment platform built for Elixir: PaaS ease, VPS control.
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"