mgwidmann

mgwidmann

I have personally never put a flow application into production so I was wondering what others were doing with regard to measuring and tuning GenStage and Flow specific metrics. I’ve never seen anything specifically targeted at this and from my experience with GenStage/Flow it can be quite challenging to get it right. Beyond normal CPU/Memory metrics and such, what would you use to tune and monitor your flow application?

Basically, I’d like to know what others are doing to 1) Develop and tune their flow application to get the most performance out of it, and 2) Monitor and understand that performance when deployed in production.

A list of metrics I would be interested in would be something along the lines of:

  • For each producer or producer/consumer:
    • Event count buffer - average, p90 and p100
    • Time to generate new events - average & p90
    • Number of events generated - average
    • Demand count buffer - average, p90 and p100
  • For each consumer or producer/consumer:
    • Event counts processed - average, p90
    • Time to process each event - average & p90
    • Some way to determine distribution of work, not sure about this one, is it all one or two workers doing everything or is it evenly spread?

I understand you could simply put a :timer.tc(fn -> end) around each of the implementations (or something fancier with a macro) but I’m curious more about what are people using and what metrics are they tracking to tune and monitor.

Showing Posts 1 to 1

nicholasjhenry

nicholasjhenry

I would very interested to find out what path you took with this. What performance monitoring did you add? Cheers!

— All posts loaded —

Where Next? Top

Trending in Discussions Top

AstonJ
As the title says, please share what you’ve been up to with Elixir. Whether that’s been learning it, looking into it, making stuff with i...
2977 92995 915
New
caslu
I want to open this thread for you all to discuss and help those who really like Ash but are still hesitant to use it in a real project. ...
New
mudasobwa
I am happy to introduce the very α version of the new programming language compiled to BEAM. Welcome Cure. It has literally three kille...
New
GES233
I’m posting this in response to Jose’s recent tweet (Cr. link) : People are sleeping on Elixir for a coding harness: Hot-code swappi...
New
_mfierro
Hello, I wrote Stop My Hand, a Scattergories-like web application using Phoenix/LiveView as my learning project for Elixir (after readin...
New
marciol
It would be helpful to have a list of companies worldwide that hire engineers without prior experience in Elixir. Often, it can be quite ...
New
durvia
Anyone running long-lived stateful processes on BEAM? We’re building an AI agent runtime and would love to compare notes. We’re a small ...
New

Other Trending Topics Top

garrison
Hobbes is a low-level distributed database for the Elixir programming language. Hobbes provides a simple, safe, and scalable storage lay...
New
marciok
Hi there! We created Gust: A task orchestrator inspired by Airflow. For those who have never heard about Aiflow, it’s a Python-based wor...
New
jimsynz
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
Damirados
Hello everyone. After busy few months I am happy to announce v0.1.0 of Emerge & Solve. They are GUI (Emerge) and State management (S...
New
netoum
Corex is an accessible, unstyled UI component library for Phoenix that integrates Zag.js state machines using Vanilla JavaScript and Live...
New
wintermeyer
There are three potential reasons for members of this forum to have a look at https://vutuv.de You are tired or annoyed of LinkedIn. Yo...
New

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews