How best to approach a live migration of pipeline segments across BEAM nodes?

I haven’t done this using FBP, or BEAM. So I am drawing my answer from my experience in just database migrations ( postgres ) from one cloud to another with near zero downtime ( very little buffered draining )

The way I have done something similar in the past was via WAL streaming both with a timed syncronization window where queries timed out for a small bit while the buffers drained over.

Proxy stream original B → C to the 2nd B → C

verify 2nd B matches 1st B, then stop sending to 1st B

Kinda like: Blue–green deployment - Wikipedia

Someone told me once it’s a combination of the 2, a Cyan deployment.

If it’s okay to take it offline for maintenance for an hour or 2, that’d be easiest, just imo

In this case, you can use hot code reloading for the GenServer , update its state in the code_change/3 callback, and route requests to the new node.

Thanks everyone for the input! Wanted to share what I ended up implementing.

Already had:

• Remote Output / Remote Input nodes for cross-BEAM communication

• Circuit breaker with message buffering when target unavailable

• Auto-recovery when connection restored

What I added:

• Runtime pipeline modification (add/remove nodes while running)

• Runtime property injection (change node config without restart)

• Dynamic connection changes (rewire targets mid-flow)

The migration approach:

1. Circuit break at the split point (Remote Output buffers messages)

2. Send pipeline segment config (JSON) to target server

3. Start the segment on new server

4. Update Remote Output’s target channel at runtime

5. Buffer drains to new location

Nodes are stateless transformations — state lives in the message flow. So “hot migration” is just runtime topology modification.

Appreciate the discussion!