sergey-chechaev

sergey-chechaev

Heavy work when starting DinamicSupervisor

Hello, I don’t find any common approach to start heavy work or children’s processes after DynamicSupervisor started. When we restart application or DynamicSupervisor is crash, we need to start DynamicSupervisor children’s processes or do heavy work as the handle_continue function when we use GenServer. In our project, we use start_link for this:

defmodule SomeDynamicSupervisor do

  use DynamicSupervisor
  alias SomeGenServer

  def start_link(_) do
    with link <- DynamicSupervisor.start_link(__MODULE__, %{}, name: __MODULE__) do
      Task.async(fn -> start_child_processors() end)
      link
    end
  end

  def init(_) do
    DynamicSupervisor.init(strategy: :one_for_one, max_restarts: 10)
  end

  def start_child_processors do
    SomeLogic.list_of_ids()
    |> Enum.each(&init_processor/1)
  end

  def init_processor(some_id) do
   
    opts = [name: NameGenerator.processor_registry_name(some_id)]

    DynamicSupervisor.start_child(__MODULE__, %{
      id: "#{SomeGenServer}_#{some_id}",
      start: {SomeGenServer, :start_link, [opts]}
    })
  end
end

What pitfalls does this approach have? Perhaps there is a better way. Can anyone share it with me?

First 6 of 6 Posts! Switch mode

LostKobrakai

LostKobrakai

Why would you use a DynamicSupervisor is instead of a static/normal one here? It feels like a normal supervisor would suite your need better.

sergey-chechaev

sergey-chechaev

I need to create processes dynamically. But it’s not matter. My question what the best practice to start a bunch of children processes when we start DynamicSupervisor.

kwando

kwando

I would nest the DynamicSupervisor under another Supervisor with the strategy :rest_for_one and also add a setup Task after the DynamicSupervisor in that supervisor.

Supervisor(strategy: :rest_for_one)
  |----> DynamicSupervisor
  |----> SetupTask / GenServer

If your DynamicSupervisor crash it will be detected by the Supervisor.

  • It will kill the SetupTask / GenServer
  • restart DynamicSupervisor
  • restart your SetupTask / GenServer
sergey-chechaev

sergey-chechaev

Great, we also considered this option. But we wanted to make it a little easier for understanding and putted the warm-up function to DynamicSupervisor. Also, DynamicSupervisor started by application.ex so supervisor up it if it fails and DynamicSupervisor run warm-up function itself. One best thing that start_link guaranteed that DynamicSupervisor is up.

LostKobrakai

LostKobrakai

Ordering for supervisor children is guaranteed. If the process to start your task is after the DynamicSupervisor child then it will only run once the DynamicSupervisor is indeed successfully started. You’re not making this simpler, by trying to mush together different responsibilities.

sergey-chechaev

sergey-chechaev

Yes, maybe you are right that we need to share responsibility like suggest @kwando:

Supervisor(strategy: :rest_for_one)
  |----> DynamicSupervisor
  |----> SetupTask / GenServer

Where Next?

Trending in Discussions Top

AstonJ
As the title says, please share what you’ve been up to with Elixir. Whether that’s been learning it, looking into it, making stuff with i...
2976 91332 914
New
f0rest8
Hi everyone :waving_hand: Posting here to showcase and announce that Metamorphic is now officially live on a public-facing domain at htt...
New
byu
@chrismccord : I just saw the Extract AGENTS.md from Phoenix.new into phx.new generator commit to the phoenix project. My initial shotgu...
New
arcanemachine
I was working on an Ecto migration and I needed a timestamp. So, for the nth time, I looked up the different data types for timestamps, a...
New
AstonJ
Just a general thread to post chat/news/info relating to AI/ML stuff that may be relevant for Nx now or in the future. Got anything to sh...
New
type1fool
I just stumbled on a newly redesigned elixir-lang.org. :tada: It looks like @Software_Mansion did the work, and I think it is generally a...
New
juhalehtonen
There has been a thread to discuss the Stack Overflow Developer Survey on this forum every year since 2018, so here’s yet another one for...
New

Other Trending Topics Top

JesseHerrick
Hey, I’m Jesse and I’m the main contributor behind Dexter, a full-featured, lightning-fast Elixir LSP optimized for large codebases. It s...
New
jimsynz
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
Damirados
Hello everyone. After busy few months I am happy to announce v0.1.0 of Emerge &amp; Solve. They are GUI (Emerge) and State management (S...
New
ausimian
Emily is an Elixir library that runs Nx computations on Apple’s MLX. Install it as the default Nx backend and Nx, defn, Axon, Nx.Serving,...
New
akoutmos
@hugobarauna and I (Alex Koutmos) have been hard at work on writing a book on Nerves that takes you from simply blinking LEDs to building...
New
zachdaniel
Introducing AshStorage! Attachment and file management that slots directly into your resources :smiling_face_with_sunglasses: I had hope...
New

We're in Beta

About us Mission Statement