sheharyarn
I’m using the amazing Oban Web+Pro by @sorentwo in a Phoenix app. Previously the jobs were being executed on every node in my cluster, along with the Oban Web dashboard exposed for admins.
But now we’d like to isolate all jobs to only a few dedicated worker nodes, but keep using Oban Web along with the Phoenix app on the other web nodes to monitor job status across all nodes.
I thought it would be as simple as setting the concurrency of my queues to 0 on the web nodes:
config :my_app, Oban
queues: [
queue_1: 0,
queue_2: 0,
queue_3: 0,
]
But this just raises the following error:
** (Mix) Could not start application my_app: MyApp.Application.start(:normal, []) returned an error: shutdown: failed to start child: Oban
** (EXIT) an exception was raised:
** (ArgumentError) queue :queue_1, local_limit must be greater than 0
(oban 2.13.6) lib/oban/validation.ex:41: Oban.Validation.validate!/2
(oban 2.13.6) lib/oban/config.ex:77: Oban.Config.new/1
(oban 2.13.6) lib/oban.ex:182: Oban.start_link/1
(stdlib 4.0.1) supervisor.erl:414: :supervisor.do_start_child_i/3
(stdlib 4.0.1) supervisor.erl:400: :supervisor.do_start_child/2
(stdlib 4.0.1) supervisor.erl:384: anonymous fn/3 in :supervisor.start_children/2
(stdlib 4.0.1) supervisor.erl:1250: :supervisor.children_map/4
(stdlib 4.0.1) supervisor.erl:350: :supervisor.init_children/2
I’m probably missing a very obvious config option here so looking for help!
Thanks!
Same question also posted to SO: https://stackoverflow.com/questions/75249871/disable-oban-job-execution-on-a-node-with-oban-web-running
Where Next?
Trending in Questions
Other Trending Topics
Latest Oban Threads
Latest on Elixir Forum
Sponsor Spotlight
Master modern tools, write cleaner code, and tackle real-world challenges with Manning books, videos, and courses. Start building today.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #library
- #deployment
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #elixirconf
- #channels
- #exunit
- #discussion
- #code-sync
- #podcasts
- #javascript
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ai
- #ecto-query
- #elixirconf-us
- #blog-post
- #elixir-ls
- #phoenix_html
- #iex
- #graphql
- #genstage
- #websockets
- #supervisor
- #advent-of-code
- #distillery
- #processes
- #elixirconf-eu
- #api
- #forms
- #metaprogramming
- #hex
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Error tracking, logs, uptime, and Just Enough APM. Built for developers.
Master modern tools, write cleaner code, and tackle real-world challenges.
Bringing learning, work and compliance together since 1987.
Producing high quality Elixir screencasts since 2017.
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"
Showing Posts 1 to 3- Show Best Posts
- Show All (oldest first)
- Show All (newest first)
sorentwo
The solution is to set
queues: []on the web nodes and omit the concurrency limit altogether. Or, you can use theonlyoption of DynamicQueues to restrict where queues run without multiple configs.sheharyarn
Thank you for getting back! I do have one follow up question regarding how the Oban Web dashboard picks up which queues to show/monitor if we only specify an empty list
[], and nothing is being executed on that node.Does it look at the queues enabled on other connected nodes in the same cluster or does it check the current database do something like the following:
Or maybe it displays that data separately per each node?
sorentwo
It looks at information across all nodes, not just the current one. You don’t need to run any queues on the web node (and you don’t even need to run the dashboard in the same cluster, as long as it can connect to the database and pubsub).