chokchit

chokchit

How to declare different topics in kafka_ex?

How can I declare diff topics in supervisor using kafka_ex? I already follow this instruction: https://hexdocs.pm/kafka_ex/KafkaEx.ConsumerGroup.html

My code:

children = [
supervisor(
        KafkaEx.ConsumerGroup,
        [
          MyConsumer1,
          "consumer_group_name",
          "my-topic1",
          @opts
        ]
      ),
supervisor(
        KafkaEx.ConsumerGroup,
        [
          MyConsumer2,
          "consumer_group_name",
          "my-topic2",
          @opts
        ]
      )
]

It returns

children = [
      Supervisor.child_spec({MyWorker, arg}, id: :my_worker_1),
      Supervisor.child_spec({MyWorker, arg}, id: :my_worker_2)
    ]

** (Mix) Could not start application myapp: MyApp.Application.start(:normal, []) returned an error: bad child specification, more than one child specification has the id: KafkaEx.ConsumerGroup.
If using maps as child specifications, make sure the :id keys are unique.
If using a module or {module, arg} as child, use Supervisor.child_spec/2 to change the :id, for example:

    children = [
      Supervisor.child_spec({MyWorker, arg}, id: :my_worker_1),
      Supervisor.child_spec({MyWorker, arg}, id: :my_worker_2)
    ]

It suggests that I have to make a different KafkaEx.ConsumerGroup for the id but there’s only one in kafka_ex. Please help. Can’t find any solution. What’s the syntax for that? :frowning:

Marked As Solved

sionide21

sionide21

You need to specify an id for each of the supervisors.

For example:

children = [
supervisor(
        KafkaEx.ConsumerGroup,
        [
          MyConsumer1,
          "consumer_group_name",
          "my-topic1",
          @opts
        ],
        id: "my-topic1"
      ),
supervisor(
        KafkaEx.ConsumerGroup,
        [
          MyConsumer2,
          "consumer_group_name",
          "my-topic2",
          @opts
        ],
        id: "my-topic2"
      )
]

Also Liked

Fl4m3Ph03n1x

Fl4m3Ph03n1x

I believe you’d have to use something like this:

https://hexdocs.pm/kafka_ex/KafkaEx.Protocol.CreateTopics.html

Hope it helps!

Where Next?

Popular in Questions Top

chokchit
** (DBConnection.ConnectionError) connection not available and request was dropped from queue after 2733ms. You can configure how long re...
New
nobody
How to bind a phoenix app to a specific ip address? could not find anything about that, nowhere, unfortunately, but for me this is quite...
New
gshaw
What is the idiomatic way of matching for not nil in Elixir? E.g., First way: defp halt_if_not_signed_in(conn, signed_in_account) when...
New
shahryarjb
Hello, I get Persian date from my client and convert it to normal calendar like this: def jalali_string_to_miladi_english_number(persi...
New
fireproofsocks
Forgive me if this is obvious, but how does one delete a database record WITHOUT selecting it first? Ecto.Repo — Ecto v3.14.0 has exampl...
New
jerry
Good day to you all. I have been struggling to get a query involving like and ilike to work. Can anyone assist me on this, please? pro...
New
stefanchrobot
What’s the safe way to decode a JSON string into a struct? I want to avoid calling String.to_atom. Jason.decode can give me a map with st...
New
alice
Hey, Just curious what are the main benefits of Elixir compared to Clojure? When is Elixir more useful than Clojure and vice versa? Th...
New
Emily
I have VueJS GUIs with the project generated using Webpack. I have Elixir modules that will need to be used by the VueJS GUIs. I forese...
New
shijith.k
I am trying to start a new phoenix project with elixir 1.9, but mix phx.new does not work. It says that ** (Mix) The task "phx.new" could...
New

Other popular topics Top

hariharasudhan94
lets say i have a sample like a = 20; b = 10; if (a > b) do {:ok, "a"} end if (a < b) do {:ok, b} end if (a == b) do {:ok, "equa...
New
Patoshizzle
After calling mix ecto.create I get this error: 17:00:32.162 [error] GenServer #PID<0.412.0> terminating ** (Postgrex.Error) FATAL...
New
jononomo
I am trying to figure out how Mix knows whether the environment is test, dev, or prod – where is this set? Thanks.
New
joeerl
Hello again - after a longish gap I’ve decided I really must dig into Elixir and see what’s been happening here - so I have a few questio...
New
Qqwy
Original source of discussion: This topic on the Pragmatic Programmers’ Functional Web Development with Elixir, OTP, and Phoenix forum. ...
New
Emily
I have VueJS GUIs with the project generated using Webpack. I have Elixir modules that will need to be used by the VueJS GUIs. I forese...
New
grych
Hi folks, Few months ago I have announced the proof-of-concept of the library to manipulate the browsers DOM objects directly from Elixi...
639 52673 488
New
saif
Hello everyone, Long time lurker first time poster here. I’ve recently begun working on Elixir full-time again! :raised_hands: It’s been...
New
Qqwy
Update: How to use the Blogs & Podcasts section You can post links to your blog posts or podcasts either in one of the Official Blog...
3271 127089 1222
New
PeterCarter
There are pre-rolled solutions for other frameworks that do work. However, Phoenix does not seem to have these. Have people had good expe...
New

Latest on Elixir Forum

Elixir Forum

We're in Beta

About us Mission Statement