kanishka

kanishka

When do people choose Oban instead of AWS Lambda for async processing?

Showing Posts 1 to 10

cevado

cevado

Personally, I’d never choose aws lambda.

A serverless approach doesn’t seem to leverage any of the strong points of BEAM, and waiting the startup time of BEAM on such environment is not worth it. So if you’re going serverless, most probably you’re not using elixir.

Oban on the other side can handle running multiple instances of the same service, even if you don’t run your elixir app as a beam cluster.

Just because of that, if your codebase is mainly in elixir, i don’t see any good reasons to use aws lambda.
If you’re dealing with multiple languages or elixir is not your main language, there might be reasons to consider using aws lambda.

edit: and it’s good to keep in mind that oban is not the only way to do background work in elixir. it’s a good one, but there stuff you can handle easily with supervised tasks and other approaches.

dimitarvp

dimitarvp

AWS Lambda is mostly aimed at compiled languages whose binaries start ultra-fast (2ms to 30ms) – think Rust, OCaml, Go, Zig, Nim.

Erlang/Elixir have relatively long startup time – 0.5 to 1.0 seconds – and they are a terrible fit for serverless platforms.

Sebb

Sebb

We have lots of lambdas in python. Startup time is no problem if you keep the lambdas warm.

dimitarvp

dimitarvp

Don’t they get frozen after a bit of inactivity? Maybe that’s what you mean by keeping them warm – you got a background service that pings them every now and then?

thomas.fortes

thomas.fortes

Yeah, you use a timer and ping them every once in a while, it should not be expensive if you plan it well.

That said, AFAIK python has a better startup time than elixir and I agree with you that if you’re using a lot of serverless functions elixir isn’t the best choice.

victorbjorklund

victorbjorklund

Big thing for me is simplicity. One thing I love with elixir is that you can have pretty much everything in your app + PostgreSQL. I use to be much more into microservices and stuff but in the end you just end up spending so much on connecting everything and development becomes so much more complex.

dimitarvp

dimitarvp

Geez, that’s very long. Is it said anywhere exactly how long do they wait until they “freeze” a warmed-up lambda?

csadewa

csadewa

A lot of fine thought here, me personally it’s because:

  1. Simplicity, if you only care about doing basic async processing, elixir / BEAM it self already has tools to do it easily, such as supervised task or process.
  2. For more durable / consistent job, using a dedicated job queue library give better control over retry behavior, uniqueness consideration, worker, etc. over using AWS Lambda + SQS
  3. Avoid vendor lock-in.
  4. Transactional outbox pattern (sending message as part of transaction) could be performed more safely on Oban (rather to SQS directly), because Oban is based on postgres, it could get transactional guarantee of postgres.

That being said, i would probably go with AWS lambda if work i do is:

  1. Pretty complex / hard to do in elixir, enough to justify writing it on another language.
  2. Needing good integration to the rest of AWS ecosystem, such like: Cognito Post-sign up integration, API gateway integration, etc.

Where Next? Top

Trending in Questions Top

stjefim
Hello! Suppose you are building workflow (order / task / payment) processing system with the following requirements: Each workflow con...
New
water
I’m aware of 2 such projects, are there others? git: GitHub - team-alembic/realworld: A fullstack Phoenix LiveView application with back...
New
peck
Hi everyone. My team and I have been working on a fairly modest app based around video streaming and chat, but we’ve landed a customer t...
New
bradley
I really like the adapter patterns that ecto, nebulex, waffle, etc. use and would love find something similar for a key management servic...
New
unaware8150
Hello folks! So at work, we are seeing some situations where we have to define some “fixed” strings that are used across the codebase in...
New
Alvinkariuki
How Can I Optimise Compile Time Dependencies I have been building an elixir application for about 2 years now. Many modules and files ha...
New
leoschweizer
Hi, we run different LLM models across a cluster, with each node loading a configurable subset. Model-specific queues let nodes consume ...
New

Other Trending Topics Top

mudasobwa
I fully migrated to my own harness from Anthropic/Gemini and I think it’s time to share it. Welcome DSH, the DeepSeek Harness, fully writ...
New
KristerV
Hey. Is there anyone here who creates agents in their apps? Not talking about using agents, but creating them. I’m finding it pretty diff...
New
jimsynz
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
juhalehtonen
There has been a thread to discuss the Stack Overflow Developer Survey on this forum every year since 2018, so here’s yet another one for...
New
webofbits
With AI doing more of the implementation work, I’ve been wondering how much coding I should deliberately keep doing myself. My main conc...
#ai
New
budgie
I love Elixir. It’s one of 2 programming languages I’ve ever fallen in love with. But I don’t use it anymore. Serverless was the promis...
New

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews