Hey,
I am working on adding partitioned rate-limiting to an existing queue with 40k scheduled jobs.
This requires a new arg.
What would be the recommended way of going about this?
Hey,
I am working on adding partitioned rate-limiting to an existing queue with 40k scheduled jobs.
This requires a new arg.
What would be the recommended way of going about this?
First I was thinking if something is possible with queue draining and reinserting jobs with necessary pattern matching in place.
But this didn’t seem to work that well when I tried it.
I am thinking now to do a data migration.
Query the oban jobs table and update the jobs as needed.
This is your best option with only 40k jobs.
Note that jobs without that key will all be processed together as a single partition. If your rate limit is high enough, or it’s not urgent, you can let it plug along.