marcin

marcin

How to parse CSV into typed terms?

Hi!

I’d like to parse a CSV rows into typed elements, without knowing what is the schema (column order) of the CSV.

In ruby the CSV library will parse strings into types. In Elixir, both csv and nimble_csv libraries produce string values, and the caller is responsible for casting them into other types (integer, decimal, date-times).

For integer and decimal columns, I can detect if they contain just numbers and decimal point – with regexp or maybe binary matching?
For dates I have no idea how to proceed. I’m aware that date time format is not specified by rfc4180 – files I am parsing have dates in format: “2016-12-01 10:36:29.772554”.

What would you recommend? I am surprised this seemingly simple problem doesn’t have an obvious solution!

m.

Marked As Solved

peerreynders

peerreynders

Am I missing something?

iex(1)> NaiveDateTime.from_iso8601("2016-12-01 10:36:29.772554")
{:ok, ~N[2016-12-01 10:36:29.772554]}

That date can then be “enhanced” with DateTime.from_naive/3.

Also Liked

LostKobrakai

LostKobrakai

Probably because it’s only “seemingly simple”. I can remember cursing at PHP’s strtotime a few times, because parsing dates without knowing the format is hardly more then guesswork and hoping for the best. If you know the format though you should be able to use timex to parse it.

Where Next?

Popular in Questions Top

marius95
Hello everyone, I try to use an Javascript Event Handler in my root.html.leex file. Therefore I created a function in the app.js file: ...
New
Kurisu
For example for a current url like http://localhost:4000/cosmetic/products?_utf8=✓&query=perfume&page=2, I would like to get: ...
New
skosch
To my knowledge, put_in, Map.update etc. all have the one limitation of not automatically creating intermediate keys when needed (for exa...
New
vac
Hi, I’m quite new in Elixir and I’m trying to format a string to a PEM format. I have the certificate value like MIIDBTCCAe2...... and I...
New
JorisKok
I have a server on AWS, and was running a load test using artillery. When looking at the Phoenix dashboard I see the Ports going to 100% ...
New
stefanchrobot
What’s the safe way to decode a JSON string into a struct? I want to avoid calling String.to_atom. Jason.decode can give me a map with st...
New
Lily
In templates/appointment/index.html.eex: <%= for appointment <- @appointments do %> <tr> <td><%= appoi...
New
vrod
I am using the Starship cross-shell prompt – it seems pretty nice, but I get some errors: [WARN] - (starship::utils): Executing command ...
New
srinivasu
How to handle excepions in elixir? Suppose i have A, B, C ,D, E modules. and each module has get() function. A.get() method will call t...
New
dotdotdotPaul
Okay, I’m having a heck of a time trying to figure out how to best handle the validation of belongs_to associations in Ecto. I’m sure I’...
New

Other popular topics Top

danschultzer
None of the current solutions worked well for me, so I went ahead and built a user management system from scratch. This project took far...
548 29377 241
New
Harrisonl
We have an ECS cluster with 4 services, where each task joins a single cluster, via discovery ECS discovery service. Currently when I de...
New
TunkShif
This post is an instruction guide to help you setup your Neovim for Elixir development from scratch. It includes general information on h...
274 41539 114
New
skosch
To my knowledge, put_in, Map.update etc. all have the one limitation of not automatically creating intermediate keys when needed (for exa...
New
chrismccord
As promised, the first release candidate of Phoenix 1.3.0 is out! This release focuses on code generators with improved project structure...
New
chrismccord
This release brings a number of exciting features, including integration with the new Phoenix LiveDashboard and Phoenix LiveView. There h...
New
dblack
I’ve got an issue with an app and I’ve no idea of how to troubleshoot it. I’m hoping someone here might have seen something similar. I p...
New
rms.mrcs
Hi, I need to transform a list of numbers into a map where the keys are the indexes and the values are the original values of the list. ...
New
joaquinalcerro
Hi there, I am working with Ecto-Postgresql and I need to call all of the records from a specific table but the table has 40,000 records...
New
hariharasudhan94
I would like to know what is the best IDE for elixir development?
New

We're in Beta

About us Mission Statement