bhougland18
How to do massive concurrent http requests?
Hello, can anyone point me to an article/post on how to do concurrent requests in Elixir? Here is an article where the author uses python:
I am also interested in how you would limit the processes to a certain number as to not overwhelm the server or hit a rate limit.
Thanks!
Trending in Questions
Other Trending Topics
Latest on Elixir Forum
Sponsor Spotlight
Producing high quality Elixir screencasts since 2017.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #deployment
- #library
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #channels
- #elixirconf
- #exunit
- #discussion
- #code-sync
- #javascript
- #podcasts
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixir-ls
- #phoenix_html
- #iex
- #blog-post
- #graphql
- #genstage
- #ai
- #elixirconf-us
- #websockets
- #supervisor
- #advent-of-code
- #distillery
- #processes
- #api
- #forms
- #metaprogramming
- #hex
- #performance
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Error tracking, logs, uptime, and Just Enough APM. Built for developers.
Develop your skills with books, videos, and courses.
Bringing learning, work and compliance together since 1987.
Producing high quality Elixir screencasts since 2017.
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"
First 4 of 4 Posts
joey_the_snake
What about
Task.async_stream: Task — Elixir v1.12.3bhougland18
I will check it out, I am just getting into Elixir. In fact, Elixir in Action is in the mail as we speak. I guess my question arises because Python has to do it this way, but it seams Elixir has more option available for concurrency and I want to get an idea of the best approach for this common task.
joey_the_snake
async_streamis the most standard way to to concurrent tasks with a limit on the concurrency, as far as I know. There are a few version of themTask.async_streamTask.Supervisor.async_streamTask.Supervisor.async_stream_no_linkBut to say which one is “best” depends on your situation. You would need to learn more about Elixir to know if you want supervision or linking.
bhougland18
Thank you! I just want to play with something until the book gets here. I appreciate the nudge in the right direction.