nathanl

nathanl

I’m working on a DockYard blog post idea and would like some input / examples from your experience.

Because it uses Cowboy, Phoenix spawns one cheap process per incoming request, and these are pre-emptively scheduled. This means that doing blocking work in one request doesn’t interfere with other requests, unlike in web frameworks where you have a limited number of server threads available. So the decision of whether to block vs use a background task is purely about user experience, not about keeping your site up.

Being able to block can let you do things more simply. Eg, import an uploaded CSV in a normal request cycle. Could be a background job, but doesn’t have to be.

It can also allow things that would be hard / impossible otherwise. Eg, in one project I know of, there are encrypted images in S3 that can’t be referenced directly from an <img> tag because the browser won’t be able to access them, so those image requests get proxied through Phoenix, which has access and can send down the unencrypted data. The client doesn’t even need to know the S3 bucket or key.

Have you seen other examples where being able to do blocking work in the request cycle is helpful?

Showing Posts 1 to 6

Nicd

Nicd

I think you mean pre-emptively scheduled, otherwise blocking would be very bad indeed. :slight_smile:

I have one API route that takes the user’s data and generates a big CSV file out of it. It can take a long time and be CPU intensive. I like that I don’t have to fork it out to a background task, but instead I can just handle it in the request directly. The client sets a longer timeout and shows a progress indicator for that route to take care of the user experience.

nathanl

nathanl OP

Yes, that was what I meant. :blush: Can’t seem to edit it now, though.

tmbb

tmbb

You have to be very careful with this. If you call a function from the controller action, and the user disconnects from the server while the function runs, the function will be interrupted. You should run long-running tasks under a different sueprvised process so that things keep working on the server even if the client disconnects. The Task module contains functions that help you do this and retrieve the result as if everything were aynchronous

nathanl

nathanl OP

That’s an extremely good point, thank you.

nathanl

nathanl OP

@tmbb I relayed your point to @chrismccord and Jason Goldberger, and they pointed out that you could async_nolink a task and block the controller response until you got a result; that doesn’t have the simplicity of “just do it inline”, but it does mean that for the client, getting the response is as simple as “request and wait for the response”.

tmbb

tmbb

That solution is exactly what I use

— All posts loaded —

Where Next? Top

Trending in Discussions Top

cblavier
Hey there, It’s been more than a year since we started using LiveView as our main UI library and building a whole library of UI componen...
515 12931 101
New
wmnnd
Hey folks, I wanted to share with you a project I’ve been working on for a while: It’s an Open Source (AGPLv3) newsletter tool. Think Ma...
New
raa-ziq
Hi everyone :waving_hand: I wanted to share something I’ve been building — NowBlind, a random chat app designed to help people discover ...
New
sntran
In my third year of college, around 2010, I found Erlang. A few years later, I found Elixir. I liked the ideas at once: many small proces...
New
Ganna
Hi everyone, I have 8 years of production experience with Erlang/OTP and I’m just starting to get to know Elixir. What would you learn f...
New
gtcode
I’ve been tinkering with Lynx (by José) via hold_ledger. I used AI to write the code, a separate specification, the tests, and the Lean p...
New
AstonJ
A remark @Garrison made… ..has already inspired a thread for the technical side of reclaiming our internet, but there is of course anot...
New

Other Trending Topics Top

dominicletz
Hey there, I haven’t seen a list of useful Elixir specific skills for the popular AI tools yet so I’m starting one here with my first. ...
New
mudasobwa
I fully migrated to my own harness from Anthropic/Gemini and I think it’s time to share it. Welcome DSH, the DeepSeek Harness, fully writ...
New
KristerV
Hey. Is there anyone here who creates agents in their apps? Not talking about using agents, but creating them. I’m finding it pretty diff...
New
OndrejValenta
(I just needed to vent somewhere and LinkedIn is full of hope, or hype, I’m not sure which exactly) AI dream has many faces, but general...
New
kip
Localize is the next generation localisation library for Elixir. Think of it as ex_cldr version 3.0. The first version will be released ...
New
webofbits
With AI doing more of the implementation work, I’ve been wondering how much coding I should deliberately keep doing myself. My main conc...
#ai
New

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews