Kafka_Ex Connection Issue

Questions / Help
1

I’m trying to get started with kafka_ex and can’t seem to even get it configured correctly. I am using the out of the box config with just the broker changed to localhost:2181 (testing locally). When I run my IEX session, I get this error:

22:49:31.422 [debug] Succesfully connected to broker "localhost":2181

22:49:31.442 [error] Receiving data from broker "localhost":2181 failed with :closed

22:49:31.442 [error] Unable to fetch metadata from any brokers.  Timeout is 3000.

22:49:31.454 [info]  Application kafka_ex exited: KafkaEx.start(:normal, []) returned an error: an exception was raised:
    ** (RuntimeError) Unable to fetch metadata from any brokers.  Timeout is 3000.
        (kafka_ex) lib/kafka_ex/server.ex:393: KafkaEx.Server0P9P0.retrieve_metadata/6
        (kafka_ex) lib/kafka_ex/server_0_p_9_p_0.ex:62: KafkaEx.Server0P9P0.kafka_server_init/1
        (stdlib) gen_server.erl:365: :gen_server.init_it/2
        (stdlib) gen_server.erl:333: :gen_server.init_it/6
        (stdlib) proc_lib.erl:247: :proc_lib.init_p_do_apply/3
** (Mix) Could not start application kafka_ex: KafkaEx.start(:normal, []) returned an error: an exception was raised:
    ** (RuntimeError) Unable to fetch metadata from any brokers.  Timeout is 3000.
        (kafka_ex) lib/kafka_ex/server.ex:393: KafkaEx.Server0P9P0.retrieve_metadata/6
        (kafka_ex) lib/kafka_ex/server_0_p_9_p_0.ex:62: KafkaEx.Server0P9P0.kafka_server_init/1
        (stdlib) gen_server.erl:365: :gen_server.init_it/2
        (stdlib) gen_server.erl:333: :gen_server.init_it/6
        (stdlib) proc_lib.erl:247: :proc_lib.init_p_do_apply/3

Any ideas on what I might be doing wrong? Thanks in advance!

2

Hi, silly question, but are you sure your broker is on 2181? As normally it binds to 9092.
The error is what I get when I’ve not started the kafka broker.

3

Not a silly question at all. I totally made this mistake! Thank you for your reply.

[debug] Succesfully connected to broker "localhost":9092
[debug] Establishing connection to broker 0: "172.24.162.59" on port 9092
[debug] Succesfully connected to broker "172.24.162.59":9092
1 Like