mudasobwa
Offloading cache to new containers during docker rolling deploy
We have a cluster of 3 nodes in docker containers (AWS, no Kubernetes.)
Each node in a warm state has 200+ dynamically supervised processes with states. Upon rolling deploy, we want to offload these processes to newly started fresh instances.
Is there some kind of “common recommended approach,” or should we simply do that from Application.prep_stop/1 and/or each GenServer.terminate/2 low-level?
Most Liked
mpope
I don’t know if this is standard, but horde exists to distribute processes across nodes and also supports restoring state to other nodes using it’s version of a Supervisor.
mpope
Oh I see, using external storage without serialization. Outside of using Mnesia to write state during termination and read during startup, nothing for me comes to mind. I’d personally try to lean on erlang:term_to_binary/1 to store into a cache and erlang:binary_to_term/1 to load if it absolutely needs to be external. There is a good amount of flexibility there, as you can create a ‘migration’ function to transform the old state into a new state format if needed.
Popular in Questions
Other popular topics
Latest on Elixir Forum
Sponsor Spotlight
Supporting innovation across the BEAM ecosystem.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #deployment
- #library
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #channels
- #elixirconf
- #exunit
- #discussion
- #code-sync
- #javascript
- #podcasts
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixir-ls
- #phoenix_html
- #iex
- #blog-post
- #graphql
- #genstage
- #ai
- #websockets
- #supervisor
- #elixirconf-us
- #advent-of-code
- #distillery
- #processes
- #forms
- #api
- #metaprogramming
- #security
- #hex
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Error tracking for Elixir devs who love to ship. Start your free account.
Practical resources that improve the lives of professional developers.
Develop your skills with books, videos, and courses.
Producing high quality Elixir screencasts since 2017.
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"