ElixirConf 2023 - Zack Kayzer and Stephanie Lane - Unleashing the Power of DAGs with Pacer Workflow

Learning Resources Talks
1

ElixirConf: ElixirConf 2023 - Zack Kayzer and Stephanie Lane - Unleashing the Power of DAGs with Pacer Workflow

Comments welcome! View the elixirconf tag for more ElixirConf talks!

3 Likes
2

For those interested in this, they may be interested in Reactor as well: Read Me — reactor v0.4.1 We extracted out the ideas (well, the ones that were good and general purpose) from Ash.Flow into their own tool that shares a lot of similarities with Pacer. @jimsynz has done some stellar work on that front.

5 Likes
3

Very interesting presentation. Great job! I love the data point oriented flow.

I have been researching the topic of using DAGs for workflows and I have one question to better understand batchers concept. What I see so far (and may be very wrong here): since the node execution order is set by the underlying DAG and topological sort, why the user has to explicitly define what resolvers can run in parallel? In other words: the analysis of DAG dependencies should be able to indicate sets of actions that can be run parallel?

Thank you in advance!