sax

sax

Hello! This is a little late in terms of years since shipping, but I just realized that I’d never shared exceed, which is a library for creating Excel spreadsheets from streams. Maybe it will be helpful for others.

When generating smallish spreadsheets (100s of thousands of rows), it performs about 30-40% as quickly as elixlsx. When you get to millions of rows on cheap/small infrastructure, it catches up. One of the best features is that, with chunked output from a Phoenix controller, file download can start almost immediately without having to wait for the entire file to be completely generated.

Recently I’ve spent time improving performance, and benchmarking it against elixlsx, which is a fantastic library. We wrote ours after working on a project that created multi-GB spreadsheets containing tens of millions of rows, where we didn’t want to pay the cost of building the entire spreadsheet in memory.

https://github.com/synchronal/exceed

Showing Posts 1 to 1

sax

sax OP

Regarding performance, I think that it could be a lot faster if we replaced the XML generation with simpler string interpolation, like elixlsx does, rather than the current way which uses a lot of nested iodata to be passed to the XmlStream library. I would be happy to be proven wrong (please do and file PRs!), but I think I’m at the limit of what can be eked out without rewriting the XML generation and/or zipping.

I think an extremely fast (binary vs iodata) stream-based XML generator would be a nice thing to have, but don’t really have the time to do it right now without some sort of sponsorship.

— All posts loaded —

Where Next? Top

Trending in Announcing Top

woylie
Flop is an Elixir library that applies filtering, ordering and pagination parameters to your Ecto queries. offset-based pagination with...
New
MRdotB
I needed to reuse React components from my Chrome extension in my Phoenix/LiveView backend. I noticed that for Svelte/Vue, there are live...
New
woylie
I released Doggo, a collection of unstyled Phoenix components. https://github.com/woylie/doggo Features Unstyled Phoenix components....
New
JesseHerrick
Hey, I’m Jesse and I’m the main contributor behind Dexter, a full-featured, lightning-fast Elixir LSP optimized for large codebases. It s...
New
marciok
Hi there! We created Gust: A task orchestrator inspired by Airflow. For those who have never heard about Aiflow, it’s a Python-based wor...
New
anuaralfetahe
Hello Published a new library - ProcessHub! ProcessHub is a library designed to manage process distribution within the Elixir cluster. ...
New
rodloboz
I’ve started working on a new library to run SQL queries and do basic business intelligence. Think “Blazer for Elixir.” Currently it fe...
New

Other Trending Topics Top

mudasobwa
I am happy to introduce the very α version of the new programming language compiled to BEAM. Welcome Cure. It has literally three kille...
New
mhanberg
Hi everyone! The first release candidate for the Expert language server project is now available! We’ve published a press release detai...
New
webofbits
With AI doing more of the implementation work, I’ve been wondering how much coding I should deliberately keep doing myself. My main conc...
#ai
New
AstonJ
This showed up on my feed.. anyone heard of it? Just hype? Ox Alpha is a reasoning model designed for coding, sustained ag...
New
bartblast
Hey folks, I just published a post about Hologram’s funding and where the project goes next - the short version: Curiosum as Main Spons...
New
CodeSync
:microphone: ElixirConf 2026 - Call for Talks is open! We’re heading to Chicago :united_states: :round_pushpin: In person + virtual :d...
New

Latest on Elixir Forum

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews