Palindrome

Palindrome

How to get Stream to run?

Hi there,

I’ve got the following function to read from a CSV file and insert the data into the address table of my database.

  def process_csv_file(%User{type: "customer"} = customer, file) do
    File.stream!(file)
    |> Stream.map(& &1)
    |> CSV.decode(separator: ?;, headers: false)
    |> Stream.map(fn x ->
      case x do
        {:ok, [name, address, zip_code, city, country]} ->
          create_address(customer, %{
            name: name,
            address_one: address,
            zip_code: zip_code,
            city: city,
            country: country
          })

        _ ->
          IO.puts("Something went wrong...")
      end
    end)
    |> Stream.run()
  end

If I try to run it, it returns :ok and nothing happens.

But if I use Enum instead of Stream, everything runs fine. What am I doing wrong here? :slight_smile:

(In this case it isn’t very important, it’s just a small file. But I’m hoping to learn something from this.)

Most Liked

kelvinst

kelvinst

Taking the answer from the docs for Stream.run/1:

This is useful when a stream needs to be run, for side effects, and there is no interest in its return result.

Examples

Open up a file, replace all # by % and stream to another file without loading the whole file in memory:

File.stream!("/path/to/file")
|> Stream.map(&String.replace(&1, "#", "%"))
|> Stream.into(File.stream!("/path/to/other/file"))
|> Stream.run()

One might prefer Stream.run over Enum.map when the expected result of the stream iterations is the side effect itself, so it does not have to return any value, and in that case, it would just discard the iteration results, which might be more efficient for most cases (like the example the docs gave).

That’s not the case for your function there, as far as I understand, as you want to process a CSV and return a list of addresses from it.

Last Post!

kelvinst

kelvinst

I see, so you don’t want the actual list of new addresses then? AFAIK it should work with Stream.run() then. When you say “nothing happens” you mean the addresses are not being created?

Where Next?

Popular in Questions Top

vegabook
I’m brand new to Phoenix and I have stripped one of the demo applications to the bone. I just want to get an svg up on the screen. Here i...
New
vonH
In asking this question I am more interested about the expressiveness of the language itself and less concerned about the availability of...
New
belgoros
I’m not a pro in using Regex and can’t figure out why the following behaviour happens, especially if we take into account the difference ...
New
siddhant3030
Hi, I have to write a raw query for one of my project. But till now I have used ecto queries and don’t have much experience writing raw ...
New
WestKeys
Currently suffering from paralysis by [HTTP client] analysis. This is rather unusual in Elixirland as there tends to be consensus on the ...
New
fayddelight
I tried installing elixir 1.11.2 erlang 23.3.4 via asdf in my zsh shell. Enabled the versions locally and globally. When I list them ...
New
svb
Hi! Currently I want to submit a form by pressing the Enter key. However, since my input field is of type “textarea” this is just adds a...
New

Other popular topics Top

nobody
Hi! In PHP: $_SERVER[‘SERVER_ADDR’] - in Elixir? Searched the docs for ip address and the web, no good results. Thanks!
New
JeremM34
Hello, how can I check the Phoenix version ? Thanks !
New
sen
Hi All, I set a environment variables in dev.exs , like below code. when i start server, how can i set the ${enable} value? thanks. d...
New
sergio_101
I am VERY much an elixir newbie. I have taken one elixir course and one phoenix course on Udemy. During that course, I saw the instructor...
New
Patoshizzle
After calling mix ecto.create I get this error: 17:00:32.162 [error] GenServer #PID<0.412.0> terminating ** (Postgrex.Error) FATAL...
New
TunkShif
This post is an instruction guide to help you setup your Neovim for Elixir development from scratch. It includes general information on h...
274 42533 114
New

We're in Beta

About us Mission Statement