hscspring

hscspring

How to read text into a dictionary

I have some data like:



---
title1
line1
line2
---
title2
line1
line2

and i want a structure of :

%{title1: [title1/line1, title1/line2], title2: [title2/line1, title2/line2}

Here is my code, but i cannot get the dict:

defmodule Index do
    @spliter "---"
    def build_custom_index(index_path) do
        {:ok, contents} = File.read(index_path)
        contents \
        |> String.split(@spliter, trim: true)
        |> Stream.map( &(String.split(&1, "\n", trim: true)) )
        |> Stream.filter( &(Enum.count(&1) > 0) )
        |> Enum.each( fn group -> 
            [head | tail] = group
            tail \
            |> Enum.each( fn line -> 
                new_line = head <> "/" <> line
            end)
        end)
    end
end

This is actually my first Elixir program, I have searched several materials but still in trouble.

I have used Python before.

Would anyone help… many thanks.

Most Liked

benwilson512

benwilson512

Author of Craft GraphQL APIs in Elixir with Absinthe

Hey @hscspring welcome! The main thing to remember with Elixir is that you should always be thinking about returning values. You can never mutate data, so if you want something different than you have now, you need to construct some kind of function that will return the changed data. Here’s an example from your code:

tail \
|> Enum.each( fn line -> 
  new_line = head <> "/" <> line
end)

Here, instead of doing each and trying to create some new variable outside the function, use

new_lines = Enum.map(tail, fn line -> head <> "/" <> line end)

Which takes the tail list and returns a new list where the function has been applied to each item.

Overall you need two do two things: iterate through the groups, and maintain a dictionary. I’m going to show you two different ways to do this.

The first way will be to build a recursive function that walks through the groups “manually”:

defmodule Index do
  @spliter "---"
  
  def index_from_file(index_path) do
    {:ok, contents} = File.read(index_path)
    build_index(contents)
  end

  def build_index(contents) do
    contents
    |> String.split(@spliter, trim: true)
    |> Stream.map(&String.split(&1, "\n", trim: true))
    |> Stream.filter(&(Enum.count(&1) > 0))
    |> index_groups(%{})
  end
  
  defp index_groups([], index) do
    index
  end

  defp index_groups([group | groups], index) do
    [title | items] = group
    items = Enum.map(items, fn item -> head <> "/" <> line)
    index = Map.put(index, title, items)
    index_groups(groups, index)
  end
end

As a simple thing, note that I split the idea of reading from a file from building the index. This is a common pattern in Elixir, where you try to maximize the number of functions that are “pure” and don’t depend on external inputs or outputs.

The main thing though is the recursive build_index function. It takes the list of groups as a first arg, and then the dictionary as the second arg. If there are no groups, then it just returns the index. If there is a group, it uses Map.put to return a new index containing the updated rows, and then recursively passes remaining groups and the update index to itself.

This pattern is so common that there’s the handy Enum — Elixir v1.20.2 function:

  def build_index(contents) do
    contents
    |> String.split(@spliter, trim: true)
    |> Stream.map(&String.split(&1, "\n", trim: true))
    |> Stream.filter(&(Enum.count(&1) > 0))
    |> Enum.reduce(%{}, fn group, index ->
      [title | items] = group
      items = Enum.map(items, fn item -> head <> "/" <> line)
      Map.put(index, title, items)
    end)
  end

There are a bunch of other little changes that could be done to the code, but hopefully this helps introduce the core concepts around iterating through data and returning new data. Enum.each/2 is honestly used pretty rarely, it’s only useful when you want to do some kind of side effect and you don’t care about keeping the result.

hauleth

hauleth

I haven’t tested it, but this should work. Just remember that content need to be list of lines.

def build(content), do: do_build(content, nil, [])

defp do_build([], agg), do: Map.new(agg)
defp do_build(["---", title | rest], agg) do
  {entries, rest} = content(rest)

  do_build(rest, [{title, entries} | agg])
end

defp content(data, agg \\ [])
defp content([], agg), do: {Enum.reverse(agg), []}
defp content(["---" | _] = rest, agg), do: {Enum.reverse(agg), rest}
defp content([entry | rest], agg), do: content(rest, [entry | agg])
hscspring

hscspring

It’s really kind of you, I’ve gotten that. That’s quite interesting, thank you again.

Where Next?

Popular in Questions Top

sen
Hi All, I set a environment variables in dev.exs , like below code. when i start server, how can i set the ${enable} value? thanks. d...
New
aadeshere1
I have a another noob question about loop. Since elixir is immutable, while loop is not directly possible. total = 10 while total != 0 ...
New
Kurisu
For example for a current url like http://localhost:4000/cosmetic/products?_utf8=✓&amp;query=perfume&amp;page=2, I would like to get: ...
New
qwerescape
Is there a way to get the call stack or stack trace at any point in the code? Not from exceptions, but an expression that returns how the...
New
skosch
To my knowledge, put_in, Map.update etc. all have the one limitation of not automatically creating intermediate keys when needed (for exa...
New
shahryarjb
Hello, I have map which I want to convert it to string like this: the map: %{last_name: "tavakkoli", name: "shahryar"} the string I ne...
New
jononomo
I am trying to figure out how Mix knows whether the environment is test, dev, or prod – where is this set? Thanks.
New
Fl4m3Ph03n1x
About me? ( if you have nothing better to do than reading about some random guy in the internet :stuck_out_tongue: ) Hello all, this is ...
New
vrod
I am using the Starship cross-shell prompt – it seems pretty nice, but I get some errors: [WARN] - (starship::utils): Executing command ...
New
dblack
I’ve got an issue with an app and I’ve no idea of how to troubleshoot it. I’m hoping someone here might have seen something similar. I p...
New

Other popular topics Top

New
albydarned
Hello all! I am typing this post from my new MacBook Pro with the M1 chip. I’m loving it so far, and will probably use it as my daily dr...
New
Patoshizzle
After calling mix ecto.create I get this error: 17:00:32.162 [error] GenServer #PID&lt;0.412.0&gt; terminating ** (Postgrex.Error) FATAL...
New
josevalim
Hi everyone, One of the features added to Elixir early on to help integration with Erlang code was the idea of overridable function defi...
New
jay1
Why is it that the mnesia database isn’t the most preferred database for use in Elixir/Phoenix?
New
aesmail
Hello guys, I have finally made it. I created an admin interface for a framework. It’s been on my todo list for years and with the curre...
New
fayddelight
I tried installing elixir 1.11.2 erlang 23.3.4 via asdf in my zsh shell. Enabled the versions locally and globally. When I list them ...
New
AstonJ
Please see the new poll here: Which code editor or IDE do you use? (Poll) (2022 Edition) It’s been a while since we first asked this, I...
208 31142 143
New
nobody
Hi! In PHP: $_SERVER[‘SERVER_ADDR’] - in Elixir? Searched the docs for ip address and the web, no good results. Thanks!
New
lanycrost
Hi everyone! I need implement if…else if…else condition from my elixir code, and anymore of this control flow structures not work proper...
New

We're in Beta

About us Mission Statement