When I first came to Elixir, this was one of the biggest questions I had.

I think it would be really beneficial if there were a few blog posts and open source projects that went over a few production-ready solutions to handle cases like this. I think it would really help people using Elixir who are coming over from Rails or other stacks with the “web app + worker + redis” mentality.

Some of the use cases could be:

• You don’t care about the response
• You do care about the response
• You need it to persist across beam reloads
• Handle rate limiting (X per minute style)
• Handle retries (constant or exponential back-offs) and hooks for custom things to happen on error

If you do it like this (without a job processing library, which is fine) keep the things in mind that are described in this article from Chris McCord Phoenix Tips and Tricks - DockYard under the title “Avoid Task.async if you don’t plan to task.await”. The summary is that if you want to use Task.async to process your CSV file, hook it into it’s own Task.Supervisor so that it is isolated from the controller.

Here is another thread that might help @beto:

Best regards,