mongo
Kafka_ex producers with connection pooling
Using Kafka_ex, I see reference in their docs on how to setup connection pooling with poolboy, but the example is super sparse and assumes a lot of knowledge on how poolboy and kafka_ex interact.
In my case, I have an application that needs to write to a kafka topic, and could use multiple processes to write across partitions. However, Kafka_ex out of the box uses one process to write.
My question is this: does someone have an example using connection pooling that shows the full setup?
Thank you,
-Steve
First Post!
aenglisc
I believe you will need to implement a worker with the KafkaEx.Server behaviour and then just pass it to your poolboy child spec config, something along the lines of:
[
{:name, {:local, @name}},
{:worker_module, App.KafkaWorker},
{:size, @size},
{:max_overflow, @max_overflow}
]
Popular in Questions
Other popular topics
Latest on Elixir Forum
Sponsor Spotlight
Catch errors, track performance, monitor hosts and more.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #deployment
- #library
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #channels
- #elixirconf
- #exunit
- #discussion
- #code-sync
- #javascript
- #podcasts
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixir-ls
- #phoenix_html
- #iex
- #blog-post
- #graphql
- #genstage
- #ai
- #websockets
- #supervisor
- #advent-of-code
- #elixirconf-us
- #distillery
- #processes
- #forms
- #api
- #metaprogramming
- #security
- #performance
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Real-time error tracking, performance insights, and observability for devs.
Develop your skills with books, videos, and courses.
Producing high quality Elixir screencasts since 2017.
The deployment platform built for Elixir: PaaS ease, VPS control.
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"