MartinElvar
I’m trying to decompress a zstd compressed file using the Elixir, and the library GitHub - chenzhuoyu/elixir-zstd: Elixir binding of the Zstandard library · GitHub
I’ve tried the following
{:ok, content} = File.read("myfile")
<<header :: binary-size(12), remainder :: binary>> = content
{:ok, orig} = ExZstd.simple_decompress(remainder)
-> ** (MatchError) no match of right hand side value: {:error, 'Unable to determain decompressed size'}
There er no problems when running the zstd command from the terminal.
I’ve also trying the streaming solution, found in the test example.
https://github.com/chenzhuoyu/elixir-zstd/blob/master/test/ex_zstd_test.exs
But i fail to see how i get the tail, when the data is from a file, and not a compression stream.
Any who can help me out, or should i simply resort to calling the zstd command directly from my code.
Where Next?
Trending in Questions
Other Trending Topics
Latest on Elixir Forum
Sponsor Spotlight
Phoenix, LiveView, multimedia pipelines, distributed systems. 400 engineers, Elixir since 2017. Available for hire.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #deployment
- #library
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #channels
- #elixirconf
- #exunit
- #discussion
- #code-sync
- #javascript
- #podcasts
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixir-ls
- #blog-post
- #phoenix_html
- #iex
- #graphql
- #ai
- #genstage
- #elixirconf-us
- #websockets
- #supervisor
- #advent-of-code
- #distillery
- #processes
- #api
- #forms
- #metaprogramming
- #security
- #hex
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Error tracking, logs, uptime, and Just Enough APM. Built for developers.
Practical resources that improve the lives of professional developers.
Bringing learning, work and compliance together since 1987.
Producing high quality Elixir screencasts since 2017.
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"
First 6 of 6 Posts
sribe
I don’t know this library, but I bet you need to pass the whole file contents in rather than discarding the header.
MartinElvar
That is a header that we manually put in, in the the (rust) program that actually produces the file.
It only works in the terminal, if i remove the header we wrap it in.
OvermindDL1
Well with that error it’s failing on line:
https://github.com/chenzhuoyu/elixir-zstd/blob/b0f045b0d195f116eee317701ee4517bf16ebf57/c_src/nif_ex_zstd.c#L476
Are you sure it is an actual zstd file? Have you tried writing out the file and skipping the header to a file and using the zstd program at that point?
sribe
Ah, ok
MartinElvar
Yes, i’ve have tried writing
remainderto a file, and then decompress it withzstd -d myfile.zstno problem. Maybe it’s version mismatch.OvermindDL1
It’s possible, it doesn’t look like that library links a built in zstd library but rather just whatever is available on the system. Maybe try a little hoist program to confirm that, like python with ffi for a quick link and test or so?