Dancing with Data - Your Guide to ETLs in the small

[ElixirConf]

Dancing with Data - Your Guide to ETLs in the small

Dancing with Data - Your Guide to ETLs in the small

ElixirConf US 2024 - David Bernheisel

Welcome to ElixirConf

Data needs to “grow up” and change over time, so how do you manage that? Observe the evolution of simple functions and how they metamorphose into a larger ETL (Extract-Transform-Load) pipeline. When is Oban helpful? Should I use Broadway? Can I get away with just OTP? Is Postgres truly all I need? Learn the tools that help your data grow up through time without losing your sanity.

good ol’ functions
with functions
Token Pipelines
Flow Pipelines
Oban Workflows
Broadway Pipelines

Comments welcome! View the elixirconf tag for more ElixirConf talks!