Lawrence_elixir

Lawrence_elixir

15) ElixirConf EU 2019 - Lessons From Our First Trillion Messages with Flow - John Mertens

@mertonium - Principal Engineer - Shameless tech do-gooder

Lessons From Our First Trillion Messages with Flow

Talk in three words: battle hardened Flow

Abstract
For many Elixir converts, the attraction of Elixir was rooted in the promise of the BEAM concurrency model. The Flow library has made it easy to build concurrent data pipelines utilising the BEAM. The problem is, that while the docs are great, there are not many resources on running Flow-based systems in production. In this talk, John will share the lessons his team learned from processing their first trillion messages through Flow. Attendees will leave with practical knowledge they can apply directly to their applications.

Objectives
Fill in some of the gaps between watching José’s introductory Flow talk and using it to power a highly-concurrent data processing pipeline.

Audience
Developers interested in using Elixir for data pipelines but want to know more about what it is like in a real-world system.

The speaker
John is a problem solver who has spent the majority of his career using his technical skills to have a positive impact on the world around him. Currently he uses Elixir to empower social action at Change.org.

All will be added to the ElixirConf EU 2019 Talks List or via the #elixirConfEU2019 tag.

Where Next?

Popular in Talks Top

AstonJ
#Day 1 ElixirConf 2017 - Day 1 Keynote - Justin Schneck (Discussion thread) ElixirConf 2017 - My Journey from Go to Elixir - Veronica L...
New
axelson
Here’s the last ElixirConf 2017 video of day one! ElixirConf 2017 - Scaling up Elixir at TpT - by @shanti I...
New
axelson
Almost done with posting the Elixir Conf talks! ElixirConf 2017 - Realtime Vehicle Tracking with Elixir and Phoenix - @st23am ...
New
zporter
ElixirConf US 2018 – Breaking Down the User Monolith – Zach Porter Coming from Ruby on Rails, the convention is to have a...
New
axelson
ElixirConf US 2018 – Docker and OTP: Friends or Foes? – Daniel Azuma (@dazuma) Docker is the hot deployment...
New
New
New
AstonJ
Announced in February 2019, Broadway is a new open source tool developed by Plataformatec that aims to streamline data processing pipelin...
New
axelson
by @jon At PagerDuty, we run our systems across many geographic regions to ensure we’re always available, even when you might not be. E...
New
CodeSync
Hologram Building Rich UIs with Elixir Running in the Browser - Bart Blast | ElixirConf EU 2025 Comments welcome! View th...
New

Other popular topics Top

Qqwy
Update: How to use the Blogs & Podcasts section You can post links to your blog posts or podcasts either in one of the Official Blog...
3271 127089 1222
New
vegabook
I’m brand new to Phoenix and I have stripped one of the demo applications to the bone. I just want to get an svg up on the screen. Here i...
New
vonH
When I run the Plug and I recompile I wind up having to use Ctrl C to quit iex and start again. Witht the help of rlwrap I can use the cu...
New
ovidiubadita
Hey all, I discovered Elixir and I love it. I always wanted to learn a functional programming and I intended to go for Haskell, but afte...
New
PeterCarter
There are pre-rolled solutions for other frameworks that do work. However, Phoenix does not seem to have these. Have people had good expe...
New
dokuzbir
I want to highlight html closing tags when i click a html tag. That works in .html files but doesnt work for html.eex templates. How can...
New
joeerl
Hello again - after a longish gap I’ve decided I really must dig into Elixir and see what’s been happening here - so I have a few questio...
New
sen
Hi All, I set a environment variables in dev.exs , like below code. when i start server, how can i set the ${enable} value? thanks. d...
New
AngeloChecked
What learn first? Rust or Elixir Hi Elixir community! I’m here because i want learn a new language. I’m a junior developer and mainly i ...
New
malloryerik
Hi, this is for people who, like me, have had some friction using .html.heex templates in VSCode. The solution seems to be, in a hyphena...
New

Latest on Elixir Forum

We're in Beta

About us Mission Statement