hakarabakara
Replacing placeholders in a string from CSV values
Hi,
My application accepts a string input and dynamic values from an uploaded CSV file and should generate a response based on the csv.
The string has placeholders have corresponding values in the CSV under the headers.
I was wondering whether there is a more efficient way of reading the stream once to perform the whole operation as opposed to fetching columns which are in the first row then streaming through the file again replacing the occurrence of the header in the string.
Most Liked
amnu3387
template =
"hi #name, you have scored #physics in physics, #chemistry in chemistry and #maths in maths"
input = """
name,maths,chemistry,physics
James Ortega,44,14,49
Eula Garrett,26,74,16
Emily Marsh,47,22,73
Tommy Jenkins,37,54,55
Ronnie Nash,54,04,31
"""
[headers] =
input
|> NimbleCSV.RFC4180.parse_string(skip_headers: false)
|> Enum.take(1)
replacement_hs =
headers
|> Enum.map(fn header -> "#" <> header end)
input
|> NimbleCSV.RFC4180.parse_string(skip_headers: true)
|> Enum.map(fn row ->
Enum.zip_reduce(row, replacement_hs, template, fn col_val, header, acc ->
String.replace(acc, header, col_val)
end)
end)
The only reasons to use NimbleCSV here is because sometimes there can be escaped separation characters and if you have a streamable source it’s just easier to get it working. Using @mindok example but with a string I would just map the headers into their replacement tokens ("#some_header") and then brute force the replacements unless it turned out to be slower than acceptable at which maybe compiling a custom regex could be faster.
Sebb
Definitely use a CSV-parser. I just wanted to keep it simple.
I like your little template-engine, but maybe its not really beginner-friendly (and it doesn’t address the selection of the template by CSV header).
my solution with nimble
def load(csv) do
[header | rows] = NimbleCSV.RFC4180.parse_string(csv, skip_headers: false)
Enum.map(rows, fn row -> sentence(row, header) end)
end
defp sentence([name, email, balance], ["name", "email", "balance"]) do
"#{name}, you owe us #{balance} this month. Please see your statement here #{email}"
end
defp sentence([other, header], ["other", "header"]) do
"#{other}, ... #{header} ..."
end
@mnussbaumer’s solution is better because you don’t need to write code for the templates, could even put them in a json if you want. Just create a map header -> template from which to select the template you need.
Sebb
Still not sure what you want, is it this?
test "sentences" do
data = """
name,email,balance
Francis Waters,jolir@jalih.mz,$1810.08
Ina Thomas,duzzigip@hizjos.cl,$5639.13
George Cortez,siw@jijol.ma,$222.81
Oscar Nguyen,ov@rici.nu,$7167.56
Wayne Campbell,nad@tuj.jp,$964.14
"""
rows = String.split(data, "\n")
Enum.map(rows, fn line -> line |> String.split(",") |> sentence() end)
end
defp sentence([name, email, balance]) do
"#{name}, you owe us #{balance} this month. Please see your statement here #{email}"
end
defp sentence(_), do: ""
["name, you owe us balance this month. Please see your statement here email",
"Francis Waters, you owe us $1810.08 this month. Please see your statement here jolir@jalih.mz",
"Ina Thomas, you owe us $5639.13 this month. Please see your statement here duzzigip@hizjos.cl",
"George Cortez, you owe us $222.81 this month. Please see your statement here siw@jijol.ma",
"Oscar Nguyen, you owe us $7167.56 this month. Please see your statement here ov@rici.nu",
"Wayne Campbell, you owe us $964.14 this month. Please see your statement here nad@tuj.jp",
""]
Popular in Questions
Other popular topics
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #deployment
- #library
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #channels
- #elixirconf
- #exunit
- #discussion
- #code-sync
- #javascript
- #podcasts
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixir-ls
- #phoenix_html
- #iex
- #blog-post
- #graphql
- #genstage
- #ai
- #websockets
- #supervisor
- #advent-of-code
- #elixirconf-us
- #distillery
- #processes
- #forms
- #api
- #metaprogramming
- #security
- #performance








