sax
Hello! This is a little late in terms of years since shipping, but I just realized that I’d never shared exceed, which is a library for creating Excel spreadsheets from streams. Maybe it will be helpful for others.
When generating smallish spreadsheets (100s of thousands of rows), it performs about 30-40% as quickly as elixlsx. When you get to millions of rows on cheap/small infrastructure, it catches up. One of the best features is that, with chunked output from a Phoenix controller, file download can start almost immediately without having to wait for the entire file to be completely generated.
Recently I’ve spent time improving performance, and benchmarking it against elixlsx, which is a fantastic library. We wrote ours after working on a project that created multi-GB spreadsheets containing tens of millions of rows, where we didn’t want to pay the cost of building the entire spreadsheet in memory.
Where Next?
Trending in Announcing
Other Trending Topics
Latest on Elixir Forum
Sponsor Spotlight
Enabling companies to succeed by building software people love.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #deployment
- #library
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #elixirconf
- #channels
- #exunit
- #discussion
- #code-sync
- #javascript
- #podcasts
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixir-ls
- #blog-post
- #ai
- #elixirconf-us
- #phoenix_html
- #iex
- #graphql
- #genstage
- #websockets
- #supervisor
- #advent-of-code
- #distillery
- #processes
- #api
- #forms
- #hex
- #security
- #metaprogramming
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Error tracking, logs, uptime, and Just Enough APM. Built for developers.
Practical resources that improve the lives of professional developers.
Bringing learning, work and compliance together since 1987.
The deployment platform built for Elixir: PaaS ease, VPS control.
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"
Showing Posts 1 to 1- Show Best Posts
- Show All (oldest first)
- Show All (newest first)
sax
Regarding performance, I think that it could be a lot faster if we replaced the XML generation with simpler string interpolation, like elixlsx does, rather than the current way which uses a lot of nested iodata to be passed to the XmlStream library. I would be happy to be proven wrong (please do and file PRs!), but I think I’m at the limit of what can be eked out without rewriting the XML generation and/or zipping.
I think an extremely fast (binary vs iodata) stream-based XML generator would be a nice thing to have, but don’t really have the time to do it right now without some sort of sponsorship.