ityonemo
Every year I help my friend with his taxes, he has an itinerary of places that he’s been to for work and I scrape the google maps API to get driving distances. This year I did it in elixir. The major challenge is figuring out how to load external libraries (CSV, JSON) into an .exs script (no framework). Mix isn’t like python-pip (and that’s a really good thing TM) but every once in a while you just want it to do what you want it to. I can’t say that what I did is necessary “best practice”, but after a lot of hemming and hawwing, I figured out a reasonable solution. I’m leaving it here to hopefully help/inspire other people that need to do something quick 'n dirty.:
# fail early if no filename is provided.
[filename] = System.argv()
File.exists?(filename) || raise "bad filename."
file_root = Path.basename(filename, ".csv")
#
# before running, install jason and csv.
#
# mix archive.install hex jason 1.1.2
# mix archive.install hex csv 2.3.1
# mix archive.install hex parallel_stream 1.0.6
#
# load up all of the libraries.
~w(jason 1.1.2 csv 2.3.1 parallel_stream 1.0.6)
|> Enum.chunk_every(2)
|> Enum.map(fn [lib, ver] -> "~/.mix/archives/#{lib}-#{ver}/#{lib}-#{ver}/ebin" end)
|> Enum.map(&Path.expand/1)
|> Enum.map(&Code.prepend_path/1)
# make sure the libraries are there.
Code.ensure_compiled(Jason)
Code.ensure_compiled(CSV)
# marshall the address into a dict.
addresses = "addresses.csv"
|> File.stream!
|> CSV.decode!
|> Enum.map(&List.to_tuple/1)
|> Enum.into(%{})
# read the paths.
driving_lines = filename
|> File.stream!
|> CSV.decode!
# check that they are all kosher
driving_lines
|> Stream.with_index
|> Enum.each(fn
{_, 0} -> :ok
{[_, start_name, dest_name | _], line} ->
:erlang.is_map_key(start_name, addresses) || raise "bad line #{line + 1}, #{start_name}"
:erlang.is_map_key(dest_name, addresses) || raise "bad line #{line + 1}, #{dest_name}"
_ -> :ok
end)
# this time I will remember to deactivate this API key
api_key = "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
# generate the curl query Mostly just using google's API.
curl_query = fn start_addr, dest_addr ->
start_http = Regex.replace(~r/\s/, start_addr, "+")
dest_http = Regex.replace(~r/\s/, dest_addr, "+")
"https://maps.googleapis.com/maps/api/distancematrix/json?units=imperial&origins=#{start_http}&destinations=#{dest_http}&key=#{api_key}"
end
{rows, _} = driving_lines
|> Stream.reject(fn [_, a, b | _] -> a == "" || b == "" end) # get rid of empty lines.
|> Stream.with_index
|> Enum.map_reduce(%{}, fn
# ignore the first line, which is just for fun titles.
{line, 0}, acc -> {line, acc}
# if our start and destination are cached, then use that instead.
{[r, start_name, dest_name | _], _}, acc when
:erlang.is_map_key({start_name, dest_name}, acc) ->
start_addr = addresses[start_name]
dest_addr = addresses[dest_name]
{[r, start_addr, dest_addr, acc[{start_name, dest_name}]], acc}
{[r, start_name, dest_name | _], _}, acc ->
# dereference the stard and destination addresses from our dictionary.
start_addr = addresses[start_name]
dest_addr = addresses[dest_name]
# run the curl command
{res, _} = System.cmd("curl", ["--stderr", "/dev/null", curl_query.(start_addr, dest_addr)])
# destructure google's insane JSON here.
v = case Jason.decode!(res) do
%{"rows" => [%{"elements" => [%{"distance" => %{"text" => distance}}]}]} ->
# of course the string has "mi" attached to it. Strip it out.
{v, _} = Float.parse(distance); v
_ -> "?"
end
# put the line back together, this time with full addresses and distances for the IRS.
# cache the result into our accumulator map.
{[r, start_addr, dest_addr, v], Map.put(acc, {start_name, dest_name}, v)}
# lines which don't conform to our dogma get released
{line, _}, acc -> {line, acc}
end)
# encode back into CSV.
rows
|> CSV.encode
|> Stream.into(File.stream!(file_root <> "-finished.csv"))
|> Stream.run
Trending in Discussions
A little off-topic, but I feel like people here have a good head on their shoulders.
I used to be quite good at making software. Was luc...
New
There has been a thread to discuss the Stack Overflow Developer Survey on this forum every year since 2018, so here’s yet another one for...
New
Hi there! :wave:
@frigidcode and I (but mostly him) have been running an Elixir Book club, we’re almost done with Designing Elixir Syste...
New
I love Elixir. It’s one of 2 programming languages I’ve ever fallen in love with.
But I don’t use it anymore.
Serverless was the promis...
New
Lately I’ve been thinking about how to organize components as a LiveView application grows. One of the pain points I’ve found (for myself...
New
What IDE or editor are you using for Elixir development?
Personally, I use Zed, and I really like it, but sometimes I wish there were a ...
New
I just stumbled on a newly redesigned elixir-lang.org. :tada: It looks like @Software_Mansion did the work, and I think it is generally a...
New
Other Trending Topics
Hey. Is there anyone here who creates agents in their apps? Not talking about using agents, but creating them. I’m finding it pretty diff...
New
I fully migrated to my own harness from Anthropic/Gemini and I think it’s time to share it. Welcome DSH, the DeepSeek Harness, fully writ...
New
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
Emily is an Elixir library that runs Nx computations on Apple’s MLX. Install it as the default Nx backend and Nx, defn, Axon, Nx.Serving,...
New
In 2021 I started a new library called Tempo with the objective of modelling time as a set of intervals - not as instants. In 2022 I gave...
New
(I just needed to vent somewhere and LinkedIn is full of hope, or hype, I’m not sure which exactly)
AI dream has many faces, but general...
New
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #library
- #deployment
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #elixirconf
- #channels
- #exunit
- #discussion
- #code-sync
- #podcasts
- #javascript
- #onsite
- #dialyzer
- #docker
- #authentication
- #ai
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #blog-post
- #elixirconf-us
- #elixir-ls
- #phoenix_html
- #iex
- #graphql
- #genstage
- #websockets
- #supervisor
- #advent-of-code
- #distillery
- #processes
- #elixirconf-eu
- #api
- #forms
- #security
- #metaprogramming










Showing Posts 1 to 6- Show Best Posts
- Show All (oldest first)
- Show All (newest first)
LostKobrakai
You can put .exs files in a mix project and run them using
mix run script.exs. That’ll start the script with all dependencies of the mix project present.ityonemo
who’s got time to make a mix project =D
dimitarvp
Is this a joke?
mix new your_projectis all it takes.AndyL
Also you can put a shebang in the file,
chmod a+rx <yourfile>and just run it standalone like a bash script (without the dependencies).NobbZ
Please do not do that! That can cause a lot of nasty to debug errors when you happen to develop an application that has direct or transient dependencies to one of this packages!
The proper way is to create a mix project, specify dependencies and compile it into an escript!
I prefer this way:
ityonemo
Yeah escript is a better option.