hauleth
It is library created by me and @abc3. It is simple client for DuckDB, but with small twist when compared with other libraries out there - instead of using NIFs it uses port instead. That provides greater stability (as issues in DuckDB or loaded libraries will not cause issues for BEAM) and provides better OS-level management (as for example OOM killer will kill only port instead of whole BEAM VM).
Right now implementation is quite suboptimal (it do not support response streaming, as it is quite problematic on DuckDB side) and it uses JSON as a transport encoding between Elixir and Rust (yeah, port is implemented in Rust). Hopefully it will be resolved in near future.
It also is built on top of db_connection, so it should be possible to write Ecto integration, but right now it is not implemented (and if it will be implemented, it will be external library).
Where Next?
Trending in Announcing
Other Trending Topics
Latest on Elixir Forum
Sponsor Spotlight
Elixir, Erlang & messaging conferences from Code Sync. Next up: ElixirConf US (10–11 Sep) & Code BEAM Europe (21–22 Oct), Haarlem + online.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #library
- #deployment
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #elixirconf
- #channels
- #exunit
- #discussion
- #code-sync
- #podcasts
- #javascript
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #blog-post
- #elixirconf-us
- #elixir-ls
- #ai
- #phoenix_html
- #iex
- #graphql
- #genstage
- #websockets
- #supervisor
- #advent-of-code
- #distillery
- #processes
- #api
- #forms
- #hex
- #security
- #metaprogramming
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Error tracking, logs, uptime, and Just Enough APM. Built for developers.
Practical resources that improve the lives of professional developers.
Master modern tools, write cleaner code, and tackle real-world challenges.
**Building the future of software with AI, trust, and human connection.**
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"
Showing Posts 1 to 3- Show Best Posts
- Show All (oldest first)
- Show All (newest first)
garrison
Oh nice! Given the sorts of analytical queries DuckDB is intended for I had long thought a NIF seemed like a bad idea. Especially since it has a bit of a reputation for OOM in some cases!
The port approach makes a lot more sense to me.
dimitarvp
Awesome. Have you considered writing a blog post about lessons learned on how to integrate with
db_connection?hauleth
I can consider it, though there weren’t any major bumps in the process. But I can try to write some small article about that.
db_connectionis pretty straightforward, so it isn’t that hard to come up with something.