Pistrie

Pistrie

Why are streams better for large collections if you still need to enumerate over the entire stream?

I’m reading the documentation page, but it’s not landing. A stream basically defines how you want to go over the collection, without actually executing it at that time. Nothing happens until you enumerate over it.

This is where I get lost. What is the point of the stream if you still need to enumerate over it with Enum? I can understand it a bit better if you don’t want to enumerate over the entire stream, but what if you do want to do that? Are you better off skipping the stream altogether?

Given this example (slightly modified from the documentation):

iex> range = 1..1_000_000
iex> stream = Stream.map(range, & &1)
iex> Enum.map(stream, & &1)          
[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22,
 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42,
 43, 44, 45, 46, 47, 48, 49, 50, ...]

Here the entire stream is being enumerated over, so why not just use map and skip the stream?

Marked As Solved

josevalim

josevalim

Creator of Elixir

It depends on how many operations you want to perform. If it is a single map, it is likely that the stream is slower. But if you want to map, filter, reduce, etc, each Enum operation will build a new list, the Stream will traverse once. for comprehensions are highly optimized too. If you feel the docs could be clearer, a PR is welcome!

Where Next?

Popular in Questions Top

vegabook
I’m brand new to Phoenix and I have stripped one of the demo applications to the bone. I just want to get an svg up on the screen. Here i...
New
9mm
I am constructing a JSON object (map) and I need to conditionally set a field. I’m trying to write proper elixir-way code… and I’m at a l...
New
komlanvi
Hi everyone, I was playing with phoenix liveView but I run into an issue. I have a form and want to validate each input text when the te...
New
aalberti333
As the title describes, I’m trying to run Enum.map() over a list of key/value pairs, where the value is a map. My data looks like this: ...
New
siddhant3030
Hi, I have to write a raw query for one of my project. But till now I have used ecto queries and don’t have much experience writing raw ...
New
freewebwithme
Using vs code and installed ElixirLS: support and debugger. And I got an error popped up on start up says Failed to run ‘elixir’ comma...
New
Patoshizzle
After calling mix ecto.create I get this error: 17:00:32.162 [error] GenServer #PID<0.412.0> terminating ** (Postgrex.Error) FATAL...
New

Other popular topics Top

rms.mrcs
Hi, I need to transform a list of numbers into a map where the keys are the indexes and the values are the original values of the list. ...
New
grych
Hi folks, Few months ago I have announced the proof-of-concept of the library to manipulate the browsers DOM objects directly from Elixi...
639 54006 488
New
vonH
When I run the Plug and I recompile I wind up having to use Ctrl C to quit iex and start again. Witht the help of rlwrap I can use the cu...
New
vonH
In asking this question I am more interested about the expressiveness of the language itself and less concerned about the availability of...
New
gshaw
What is the idiomatic way of matching for not nil in Elixir? E.g., First way: defp halt_if_not_signed_in(conn, signed_in_account) when...
New
sen
Hi All, I set a environment variables in dev.exs , like below code. when i start server, how can i set the ${enable} value? thanks. d...
New

We're in Beta

About us Mission Statement