sergey-chechaev

sergey-chechaev

Hello, I don’t find any common approach to start heavy work or children’s processes after DynamicSupervisor started. When we restart application or DynamicSupervisor is crash, we need to start DynamicSupervisor children’s processes or do heavy work as the handle_continue function when we use GenServer. In our project, we use start_link for this:

defmodule SomeDynamicSupervisor do

  use DynamicSupervisor
  alias SomeGenServer

  def start_link(_) do
    with link <- DynamicSupervisor.start_link(__MODULE__, %{}, name: __MODULE__) do
      Task.async(fn -> start_child_processors() end)
      link
    end
  end

  def init(_) do
    DynamicSupervisor.init(strategy: :one_for_one, max_restarts: 10)
  end

  def start_child_processors do
    SomeLogic.list_of_ids()
    |> Enum.each(&init_processor/1)
  end

  def init_processor(some_id) do
   
    opts = [name: NameGenerator.processor_registry_name(some_id)]

    DynamicSupervisor.start_child(__MODULE__, %{
      id: "#{SomeGenServer}_#{some_id}",
      start: {SomeGenServer, :start_link, [opts]}
    })
  end
end

What pitfalls does this approach have? Perhaps there is a better way. Can anyone share it with me?

Showing Posts 1 to 6

LostKobrakai

LostKobrakai

Why would you use a DynamicSupervisor is instead of a static/normal one here? It feels like a normal supervisor would suite your need better.

sergey-chechaev

sergey-chechaev OP

I need to create processes dynamically. But it’s not matter. My question what the best practice to start a bunch of children processes when we start DynamicSupervisor.

kwando

kwando

I would nest the DynamicSupervisor under another Supervisor with the strategy :rest_for_one and also add a setup Task after the DynamicSupervisor in that supervisor.

Supervisor(strategy: :rest_for_one)
  |----> DynamicSupervisor
  |----> SetupTask / GenServer

If your DynamicSupervisor crash it will be detected by the Supervisor.

  • It will kill the SetupTask / GenServer
  • restart DynamicSupervisor
  • restart your SetupTask / GenServer
sergey-chechaev

sergey-chechaev OP

Great, we also considered this option. But we wanted to make it a little easier for understanding and putted the warm-up function to DynamicSupervisor. Also, DynamicSupervisor started by application.ex so supervisor up it if it fails and DynamicSupervisor run warm-up function itself. One best thing that start_link guaranteed that DynamicSupervisor is up.

LostKobrakai

LostKobrakai

Ordering for supervisor children is guaranteed. If the process to start your task is after the DynamicSupervisor child then it will only run once the DynamicSupervisor is indeed successfully started. You’re not making this simpler, by trying to mush together different responsibilities.

sergey-chechaev

sergey-chechaev OP

Yes, maybe you are right that we need to share responsibility like suggest @kwando:

Supervisor(strategy: :rest_for_one)
  |----> DynamicSupervisor
  |----> SetupTask / GenServer
— All posts loaded —

Where Next? Top

Trending in Discussions Top

AstonJ
As the title says, please share what you’ve been up to with Elixir. Whether that’s been learning it, looking into it, making stuff with i...
2977 92995 915
New
caslu
I want to open this thread for you all to discuss and help those who really like Ash but are still hesitant to use it in a real project. ...
New
mudasobwa
I am happy to introduce the very α version of the new programming language compiled to BEAM. Welcome Cure. It has literally three kille...
New
GES233
I’m posting this in response to Jose’s recent tweet (Cr. link) : People are sleeping on Elixir for a coding harness: Hot-code swappi...
New
marciol
It would be helpful to have a list of companies worldwide that hire engineers without prior experience in Elixir. Often, it can be quite ...
New
durvia
Anyone running long-lived stateful processes on BEAM? We’re building an AI agent runtime and would love to compare notes. We’re a small ...
New
AstonJ
This might be a bit disturbing for some but it’s happening - computers running on living human neurons. They’ve made them smart enough t...
New

Other Trending Topics Top

marciok
Hi there! We created Gust: A task orchestrator inspired by Airflow. For those who have never heard about Aiflow, it’s a Python-based wor...
New
jimsynz
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
Dmk
Xamal is a deployment tool for Elixir apps that deploys native releases to bare metal servers over SSH. It’s a port of GitHub - basecamp/...
New
Damirados
Hello everyone. After busy few months I am happy to announce v0.1.0 of Emerge &amp; Solve. They are GUI (Emerge) and State management (S...
New
netoum
Corex is an accessible, unstyled UI component library for Phoenix that integrates Zag.js state machines using Vanilla JavaScript and Live...
New
webofbits
Aludel - LLM Evaluation Workbench Aludel is an embeddable Phoenix LiveView dashboard for evaluating and comparing LLM prompts across mult...
New

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews