arpan

arpan

Csv2Sql - Load csv files to database(Web UI and Postgres Support)

CSV2SQL - Blazing fast csv to database loader!

Hi, I have been working on a side project for quite some time now. I had earlier posted about this project here, since then I have improved the codebase and I have added some additional features to this project.

Basically, Csv2Sql is a fast fully automated tool that can load huge CSV files into a MySQL or PostgreSQL database very easily.

It now comes with a dashboard web UI that runs using phoenix live view. So, now we can use the app easily using either the web interface or using the command line. I have separated out the core application and this new phoenix web app and created an umbrella project.

Heres a GIF of the application in action:

The web interface also much easy to use and configure and gives much detailed information about the progress of the app as it processes the CSV files one by one. Also, I have added support for Postgres now.

I have tested the app on by Ubuntu x86_64 system, Please create an issue with details of your OS distribution, architecture(for example, x86_64 or ARM) and ABI (for example, musl or gnu) if the app does not run on your system.

I would love any feedback or suggestions, please do give it a try, you can find all details on installation and usage here in this repository. If you face any issues feel free to create an issue.

Thanks, have a good day! :slight_smile:

Where Next?

Popular in Discussions Top

mbenatti
Following https://github.com/tbrand/which_is_the_fastest |> https://raw.githubusercontent.com/tbrand/which_is_the_fastest/master/imgs...
New
ben-pr-p
In general I’ve been sticking to this community style guide GitHub - christopheradams/elixir_style_guide: A community driven style guide ...
New
PragTob
Hey everyone, this has been brewing in my head some time and it came up again while reading Adopting Elixir. GenServers, supervisors et...
New
boundedvariable
I am going through the kafka architecture. All the features what the kafka is providing are already in Erlang. I would like hear your opi...
New
New
tmbb
This is a post to discuss the new Phoenix LiveView functionality. From Chris’s talk, it appears that they generate all HTML on the serve...
342 18595 126
New
thojanssens1
It would be nice to be able to define a redirect from one route to another from the router.ex file. E.g.: redirect "/", UserController, ...
New

Other popular topics Top

nobody
Hi! In PHP: $_SERVER[‘SERVER_ADDR’] - in Elixir? Searched the docs for ip address and the web, no good results. Thanks!
New
joaquinalcerro
Hi there, I am working with Ecto-Postgresql and I need to call all of the records from a specific table but the table has 40,000 records...
New
jononomo
I am trying to figure out how Mix knows whether the environment is test, dev, or prod – where is this set? Thanks.
New
hariharasudhan94
I would like to know what is the best IDE for elixir development?
New
alice
Hey, Just curious what are the main benefits of Elixir compared to Clojure? When is Elixir more useful than Clojure and vice versa? Th...
New
siddhant3030
Hi, I have to write a raw query for one of my project. But till now I have used ecto queries and don’t have much experience writing raw ...
New

We're in Beta

About us Mission Statement