jeffyzooom

jeffyzooom

Hi all,

I’ve been working on RustyCSV, a CSV parser and encoder for Elixir backed by Rust NIFs. Version 0.4.0 is now available.

The goal is to provide a drop-in replacement for NimbleCSV 1.3.0 for both parsing and encoding. NimbleCSV is an excellent pure-Elixir option. RustyCSV is for people who are comfortable using a precompiled Rust NIF to get some additional performance on very large CSV files.

The usual NimbleCSV functions are supported, including parse_string/2, parse_stream/2, parse_enumerable/2, dump_to_iodata/2, and dump_to_stream/1.

The 0.4.0 release adds stricter CSV validation, compatible encoding return shapes, Rustler 0.38, and verification on Elixir 1.20 with OTP 29.

I also ran NimbleCSV 1.3.0’s upstream tests against RustyCSV. The behavior matches across all 21 tests. Exact error messages differ in four cases because RustyCSV reports byte offsets without including the original CSV content.

I’d appreciate feedback from anyone willing to try it

Hex: rusty_csv | Hex

Documentation: RustyCSV v0.4.0 — Documentation

Showing Posts 1 to 3

LostKobrakai

LostKobrakai

Binary chunk streaming | ✅ arbitrary chunks | ❌ line-delimited only

That’s not a correct assessment. NimbleCSV can stream arbitrary chunks using to_line_stream/1 - an API even referenced later in the same README. You just need to explicitly opt into the overhead of handling such. No need to do that if e.g. you’re already reading a line stream from a file.

jeffyzooom

jeffyzooom OP

You’re right. I overlooked to_line_stream/1 when I wrote that comparison.

I’ve corrected the README. RustyCSV accepts arbitrary binary chunks directly through parse_stream/2; NimbleCSV supports them by passing the chunks through to_line_stream/1 first. Existing line-delimited streams can go straight to parse_stream/2 in both.

Thanks for catching that.

dimitarvp

dimitarvp

With respect, both your comments read like LLM-generated.

— All posts loaded —

Where Next? Top

Trending in Announcing Top

wojtekmach
Hey everyone! Req is an HTTP client for Elixir that I’ve been working on for quite some time. There is already a lot of HTTP clients out...
New
handnot2
Samly can be used to enable SAML 2.0 Single Sign On in a Plug/Phoenix application. This library uses Erlang esaml to provide plug enabl...
New
woylie
Flop is an Elixir library that applies filtering, ordering and pagination parameters to your Ecto queries. offset-based pagination with...
New
MRdotB
I needed to reuse React components from my Chrome extension in my Phoenix/LiveView backend. I noticed that for Svelte/Vue, there are live...
New
garrison
Hobbes is a low-level distributed database for the Elixir programming language. Hobbes provides a simple, safe, and scalable storage lay...
New
marciok
Hi there! We created Gust: A task orchestrator inspired by Airflow. For those who have never heard about Aiflow, it’s a Python-based wor...
New
fuelen
Hi all! I want to present a small library which provides a mix task for generating an Entity-Relationship Diagram for Ecto schemas. You...
New

Other Trending Topics Top

nseaSeb
Hello, I know there is an approach for handling lists that allows for optimized traversal, but I can’t recall the specific method (somet...
New
mudasobwa
I am happy to introduce the very α version of the new programming language compiled to BEAM. Welcome Cure. It has literally three kille...
New
AstonJ
This showed up on my feed.. anyone heard of it? Just hype? Ox Alpha is a reasoning model designed for coding, sustained ag...
New
sergio
It’s not that it’s vocabulary is too advanced. It’s something worse. I get lost trying to follow even a paragraph written by Claude. It’...
New
sorenone
Today we’re releasing Oban for Python. Not an Oban client in Python. Not a pythonx wrapper embedded in Elixir. Nope, it’s a fully operati...
New
akoutmos
@hugobarauna, Dr. Dimitrios Koutmos (my brother) and I (Alex Koutmos) have been hard at work on writing a book on how you can use Elixir ...
New

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews