sezaru
Oban Pro DynamicCron configured at runtime doesn't seem to work
I moved my Oban config to run at runtime (from config.exs to runtime.exs) because I need to load different configurations depending on the release I’m generating.
After that move, I noticed that my cron jobs stopped running at all.
Here is my config:
defmodule Core.Config.Oban do
@moduledoc false
alias Core.Workers.{ProcessPropertyViewCountWorker, ExpireShortUrl}
import Config
def load!(:marketplace) do
plugins =
default_plugins() ++
[
{Oban.Pro.Plugins.DynamicCron,
crontab: [
{"@hourly", ProcessPropertyViewCountWorker, args: %{interval: "1h"}},
{"@daily", ExpireShortUrl}
]}
]
config :core, Oban,
plugins: plugins,
queues: [
sms: 5,
email: 10,
process_images: 3,
expire_short_url: 2,
remove_images: 1,
property_view: 1,
property_over_under_paid: 10,
hubspot_appointment: 1
]
end
def load!(:pacman) do
config :core, Oban,
plugins: default_plugins(),
queues: [
process_data: 1,
process_raw_properties: 10,
process_raw_records: 10
]
end
# Default to marketplace when running on local
def load!(nil), do: load!(:marketplace)
defp default_plugins do
[
{Oban.Pro.Plugins.DynamicLifeline, timeout: :infinity},
{Oban.Pro.Plugins.DynamicPruner,
state_overrides: [
completed: {:max_len, 10_000},
cancelled: {:max_age, :infinity},
discarded: {:max_age, :infinity}
],
timeout: :timer.hours(10)}
]
end
end
as you can see, if release is :marketplace it will add DynamicCron to the config with some crontab jobs.
Here is what the DynamicCron.all/0 returns to me:
iex(marketplace@node1.backend.core)1> Oban.Pro.Plugins.DynamicCron.all
[
%Oban.Pro.Cron{
__meta__: #Ecto.Schema.Metadata<:loaded, "public", "oban_crons">,
name: "Core.Workers.ProcessPropertyViewCountWorker",
expression: "@hourly",
worker: "Core.Workers.ProcessPropertyViewCountWorker",
opts: %{"args" => %{"interval" => "1h"}},
paused: false,
insertions: [~U[2024-05-06 03:00:00.133548Z],
~U[2024-05-06 02:00:00.807445Z], ~U[2024-05-06 01:00:00.546187Z],
~U[2024-05-06 00:00:00.245858Z], ~U[2024-05-05 23:00:00.958641Z],
~U[2024-05-05 22:00:00.703080Z], ~U[2024-05-05 21:00:00.419005Z],
~U[2024-05-05 20:00:00.159163Z], ~U[2024-05-05 19:00:00.832437Z],
~U[2024-05-05 18:00:00.552334Z], ~U[2024-05-05 17:00:00.315184Z],
~U[2024-05-05 16:00:00.985450Z], ~U[2024-05-05 15:00:00.732213Z],
~U[2024-05-05 14:00:00.480575Z], ~U[2024-05-05 13:00:00.163874Z],
~U[2024-05-05 12:00:00.836540Z], ~U[2024-05-05 11:00:00.503022Z],
~U[2024-05-05 10:00:00.225494Z], ~U[2024-05-05 09:00:00.893348Z],
~U[2024-05-05 08:00:00.651463Z], ~U[2024-05-05 07:00:00.365975Z],
~U[2024-05-05 06:00:00.067545Z], ~U[2024-05-05 05:00:00.756578Z],
~U[2024-05-05 04:00:00.464613Z], ~U[2024-05-05 03:00:00.178809Z],
~U[2024-05-05 02:00:00.890213Z], ~U[2024-05-05 01:00:00.612366Z],
~U[2024-05-05 00:00:00.293341Z], ~U[2024-05-04 23:00:00.991272Z],
~U[2024-05-04 22:00:00.735534Z], ~U[2024-05-04 21:00:00.439186Z],
~U[2024-05-04 20:00:00.191324Z], ~U[2024-05-04 19:00:00.885261Z],
~U[2024-05-04 18:00:00.646027Z], ~U[2024-05-04 17:00:00.385363Z],
~U[2024-05-04 16:00:00.109405Z], ~U[2024-05-04 15:00:00.761237Z],
~U[2024-05-04 14:00:00.482335Z], ~U[2024-05-04 13:00:00.066512Z],
~U[2024-05-04 12:00:00.754370Z], ~U[2024-05-04 11:00:00.378746Z],
~U[2024-05-04 10:00:00.103423Z], ...],
lock_version: 2,
parsed: nil,
inserted_at: ~U[2024-04-16 00:34:00.051817Z],
updated_at: ~U[2024-04-16 00:34:00.051817Z]
},
%Oban.Pro.Cron{
__meta__: #Ecto.Schema.Metadata<:loaded, "public", "oban_crons">,
name: "Core.Workers.ExpireShortUrl",
expression: "@daily",
worker: "Core.Workers.ExpireShortUrl",
opts: %{},
paused: false,
insertions: [~U[2024-05-06 00:00:00.245858Z],
~U[2024-05-05 00:00:00.293341Z], ~U[2024-05-04 00:00:00.095649Z],
~U[2024-05-03 00:00:00.529412Z], ~U[2024-05-02 00:00:00.702775Z],
~U[2024-05-01 00:00:00.933030Z], ~U[2024-04-30 00:00:00.478345Z],
~U[2024-04-29 00:00:00.512367Z], ~U[2024-04-28 00:00:00.877888Z],
~U[2024-04-27 00:00:00.490409Z], ~U[2024-04-26 00:00:00.811880Z],
~U[2024-04-25 00:00:00.476959Z], ~U[2024-04-24 00:00:00.775340Z],
~U[2024-04-23 00:00:00.176549Z], ~U[2024-04-22 00:00:00.993786Z],
~U[2024-04-21 00:00:00.715989Z], ~U[2024-04-20 00:00:00.894875Z],
~U[2024-04-19 00:00:00.785755Z], ~U[2024-04-18 00:00:00.085533Z],
~U[2024-04-17 00:00:00.544110Z]],
lock_version: 2,
parsed: nil,
inserted_at: ~U[2024-04-16 00:34:00.053784Z],
updated_at: ~U[2024-04-16 00:34:00.053784Z]
}
]
What I’m doing wrong here?
Marked As Solved
sezaru
Ok, I found the issue, I had another node getting all the jobs running there. Removing that node fixed the issue
2
Also Liked
sorentwo
Oban Core Team
This is a common problem in hybrid setups where some nodes run jobs and others don’t. Common enough that there’s a section in the troubleshooting guide about it.
In short, there are two options:
- Run plugins on all nodes, even on the ones that aren’t executing jobs. Most plugins only run on a single leader node, and they add minimal load.
- Disable nodes that don’t run plugins with
plugins: falseor ensure it isn’t a possible leader withpeer: false.
1
Popular in Questions
In Ruby, I can go:
User.find_by(email: "foobar@email.com").update(email: "hello@email.com")
How can I do something similar in Elixir?
...
New
Could someone help me? I’m making my first elixir program, number guessing game. I can’t figure out how to convert the user’s guess from ...
New
I have a another noob question about loop. Since elixir is immutable, while loop is not directly possible.
total = 10
while total != 0
...
New
I am trying to figure out how Mix knows whether the environment is test, dev, or prod – where is this set?
Thanks.
New
I have seen a lot of code which picks the first element from a list using Enum.at(0) instead of List.first. Is there a reason why people ...
New
Hello everybody,
usually, I use a 29" ultra-wide monitor for VSCode which can easily accomodate explorer (files panel) + file with code ...
New
When I run the Plug and I recompile I wind up having to use Ctrl C to quit iex and start again. Witht the help of rlwrap I can use the cu...
New
In templates/appointment/index.html.eex:
<%= for appointment <- @appointments do %>
<tr>
<td><%= appoi...
New
Hi guys, i’m new in the Elixir world, and i have to say, that i love it!
i’m having some problem to understand anonymous functions with ...
New
In asking this question I am more interested about the expressiveness of the language itself and less concerned about the availability of...
New
Other popular topics
As promised, the first release candidate of Phoenix 1.3.0 is out! This release focuses on code generators with improved project structure...
New
Erlang/OTP 25 [erts-13.2.2] [source] [64-bit] [smp:8:8] [ds:8:8:10] [async-threads:1]
15:22:35.803 [error] gen_event {lager_file_backend...
New
I tried installing
elixir 1.11.2
erlang 23.3.4
via asdf in my zsh shell. Enabled the versions locally and globally.
When I list them ...
New
Hi!
In PHP: $_SERVER[‘SERVER_ADDR’] - in Elixir?
Searched the docs for ip address and the web, no good results.
Thanks!
New
Elixir plugin for JetBrain’s IntelliJ Platform (including Rubymine)
This is a plugin that adds support for Elixir to JetBrains IntelliJ...
New
I’ve got an issue with an app and I’ve no idea of how to troubleshoot it. I’m hoping someone here might have seen something similar.
I p...
New
I am VERY much an elixir newbie. I have taken one elixir course and one phoenix course on Udemy. During that course, I saw the instructor...
New
I am trying to run a deploy with docker and I successfully runned with this command:
docker build -t romenigld/blog-prod .
but when I t...
New
I had some trouble figuring out how to make many-to-many associations work. Once I got it working, I wrote a blog post. Because I’m a nov...
New
Hi everyone!
I need implement if…else if…else condition from my elixir code, and anymore of this control flow structures not work proper...
New
Latest Oban Threads
Latest on Elixir Forum
Sponsor Spotlight
Producing high quality Elixir screencasts since 2017.
Categories:
Sub Categories:
Forums
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Real-time error tracking, performance insights, and observability for devs.
Practical resources that improve the lives of professional developers.
Producing high quality Elixir screencasts since 2017.
The deployment platform built for Elixir: PaaS ease, VPS control.
Courses that'll move you from confusion to "Aha, now I get it!"