kanishka

kanishka

When do people choose Oban instead of AWS Lambda for async processing?

First 10 of 15 Posts Switch mode

cevado

cevado

Personally, I’d never choose aws lambda.

A serverless approach doesn’t seem to leverage any of the strong points of BEAM, and waiting the startup time of BEAM on such environment is not worth it. So if you’re going serverless, most probably you’re not using elixir.

Oban on the other side can handle running multiple instances of the same service, even if you don’t run your elixir app as a beam cluster.

Just because of that, if your codebase is mainly in elixir, i don’t see any good reasons to use aws lambda.
If you’re dealing with multiple languages or elixir is not your main language, there might be reasons to consider using aws lambda.

edit: and it’s good to keep in mind that oban is not the only way to do background work in elixir. it’s a good one, but there stuff you can handle easily with supervised tasks and other approaches.

dimitarvp

dimitarvp

AWS Lambda is mostly aimed at compiled languages whose binaries start ultra-fast (2ms to 30ms) – think Rust, OCaml, Go, Zig, Nim.

Erlang/Elixir have relatively long startup time – 0.5 to 1.0 seconds – and they are a terrible fit for serverless platforms.

Sebb

Sebb

We have lots of lambdas in python. Startup time is no problem if you keep the lambdas warm.

dimitarvp

dimitarvp

Don’t they get frozen after a bit of inactivity? Maybe that’s what you mean by keeping them warm – you got a background service that pings them every now and then?

thomas.fortes

thomas.fortes

Yeah, you use a timer and ping them every once in a while, it should not be expensive if you plan it well.

That said, AFAIK python has a better startup time than elixir and I agree with you that if you’re using a lot of serverless functions elixir isn’t the best choice.

victorbjorklund

victorbjorklund

Big thing for me is simplicity. One thing I love with elixir is that you can have pretty much everything in your app + PostgreSQL. I use to be much more into microservices and stuff but in the end you just end up spending so much on connecting everything and development becomes so much more complex.

dimitarvp

dimitarvp

Geez, that’s very long. Is it said anywhere exactly how long do they wait until they “freeze” a warmed-up lambda?

csadewa

csadewa

A lot of fine thought here, me personally it’s because:

  1. Simplicity, if you only care about doing basic async processing, elixir / BEAM it self already has tools to do it easily, such as supervised task or process.
  2. For more durable / consistent job, using a dedicated job queue library give better control over retry behavior, uniqueness consideration, worker, etc. over using AWS Lambda + SQS
  3. Avoid vendor lock-in.
  4. Transactional outbox pattern (sending message as part of transaction) could be performed more safely on Oban (rather to SQS directly), because Oban is based on postgres, it could get transactional guarantee of postgres.

That being said, i would probably go with AWS lambda if work i do is:

  1. Pretty complex / hard to do in elixir, enough to justify writing it on another language.
  2. Needing good integration to the rest of AWS ecosystem, such like: Cognito Post-sign up integration, API gateway integration, etc.

Where Next? Top

Trending in Questions Top

stjefim
Hello! Suppose you are building workflow (order / task / payment) processing system with the following requirements: Each workflow con...
New
jonnycharles
I’m in search of an Elixir library that offers PDF generation capabilities similar to Ruby’s Prawn. While there have been discussions abo...
New
spammy
I’m looking to build a personal workflow to quickly deploy web applications written in elixir/phoenix, for local consumption (ie not on t...
New
dli
Before I dive in myself, did anyone successfully sprinkle Hologram into their existing LiveView app? Looking for hints regarding: Addi...
New
bottlenecked
Hi all, I wanted to ask how the community is dealing with post-release steps. Today we have Ecto migrations, which make sure that the db...
New
roeland
Kia ora, We have been using elixir-google-api to connect to Google Drive. However, with the updates to Tesla due to CVEs this is now bro...
New
rahultumpala
Hello, I have an Elixir backend that implements a custom protocol over TCP. I want to load test the backend and assess the performance o...
New

Other Trending Topics Top

JesseHerrick
Hey, I’m Jesse and I’m the main contributor behind Dexter, a full-featured, lightning-fast Elixir LSP optimized for large codebases. It s...
New
jimsynz
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
Damirados
Hello everyone. After busy few months I am happy to announce v0.1.0 of Emerge & Solve. They are GUI (Emerge) and State management (S...
New
netoum
Corex is an accessible, unstyled UI component library for Phoenix that integrates Zag.js state machines using Vanilla JavaScript and Live...
New
ausimian
Emily is an Elixir library that runs Nx computations on Apple’s MLX. Install it as the default Nx backend and Nx, defn, Axon, Nx.Serving,...
New
juhalehtonen
There has been a thread to discuss the Stack Overflow Developer Survey on this forum every year since 2018, so here’s yet another one for...
New

We're in Beta

About us Mission Statement