Flyers
Hi,
I’m trying to unzip an uploaded file and store the compressed files to my database. I’ve a working process but I’ve just discovered that files with non ascii chars in names are stored weirdly in my postgres database.
How I unzip and save file is :
with {:ok, handle} <- :zip.zip_open(path, [{:cwd, path_name}]),
{:ok, file_names} = :zip.zip_get(handle) do
try do
filter_hidden_files(file_names)
|> to_plug_upload()
|> to_multi(user, kind, Multi.new())
|> Repo.transaction()
after
:zip.zip_close(handle)
end
end
defp filter_hidden_files(_, files \\ [])
defp filter_hidden_files([], files) do
files
end
defp filter_hidden_files([file | tail], files) do
filename = Path.basename(file)
case String.first(filename) === "." do
true -> filter_hidden_files(tail, files)
false -> filter_hidden_files(tail, files ++ [file])
end
end
defp to_plug_upload(_, uploads \\ [])
defp to_plug_upload([], uploads) do
uploads
end
defp to_plug_upload([file | tail], uploads) do
upload = %Plug.Upload{
content_type: MIME.from_path(file),
filename: Path.basename(file),
path: to_string(file)
}
to_plug_upload(tail, uploads ++ [upload])
end
defp to_multi([], %User{}, _kind, multi) do
multi
end
defp to_multi(
[file | tail],
%User{entity_name: entity_name} = user,
kind,
multi
) do
attrs = %{
brand: entity_name,
name: file,
kind: kind,
file_hash: file_hash(file),
file_name: file.filename
}
m =
%Media{}
|> Media.changeset(attrs)
to_multi(tail, user, kind, multi |> Multi.insert(file.filename, m))
end
When I try to upload and save a file called 2809575_xxléàî.jpg I get the following saved in database 2809575_xxleÌaÌiÌ.jpg?63728256310
I think there is an encoding problem when reading files using erlang :zip module.
Thanks.
Trending in Questions
Hello!
Suppose you are building workflow (order / task / payment) processing system with the following requirements:
Each workflow con...
New
Hi all,
I’m working on a Phoenix project where I need to make external HTTP requests and I’m trying to choose between Req and HTTPoison....
New
How do I tell Hologram not to escape HTML when substituting into templates?
{Textile.render(@product.long_description)}
escapes the HTM...
New
I’d like to create a file with 600 permissions (rw-------), but there’s a race condition if I create it and then change the permissions. ...
New
Hi,
we run different LLM models across a cluster, with each node loading a configurable subset. Model-specific queues let nodes consume ...
New
Is there a way to import record definitions in the iex shell for pretty printing (similar to the rr command in the erl shell)? This woul...
New
When I use Mix.install with a git dependency, using git@github.com:... how do I change the SSH identity used?
I’ve got two Github accoun...
New
Other Trending Topics
Hey there,
I haven’t seen a list of useful Elixir specific skills for the popular AI tools yet so I’m starting one here with my first.
...
New
Hi everyone :waving_hand:
I wanted to share something I’ve been building — NowBlind, a random chat app designed to help people discover ...
New
I fully migrated to my own harness from Anthropic/Gemini and I think it’s time to share it. Welcome DSH, the DeepSeek Harness, fully writ...
New
Hey. Is there anyone here who creates agents in their apps? Not talking about using agents, but creating them. I’m finding it pretty diff...
New
(I just needed to vent somewhere and LinkedIn is full of hope, or hype, I’m not sure which exactly)
AI dream has many faces, but general...
New
Localize is the next generation localisation library for Elixir. Think of it as ex_cldr version 3.0. The first version will be released ...
New
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #library
- #deployment
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #elixirconf
- #channels
- #exunit
- #code-sync
- #discussion
- #podcasts
- #javascript
- #onsite
- #dialyzer
- #docker
- #authentication
- #ai
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #elixirconf-us
- #blog-post
- #ecto-query
- #elixir-ls
- #phoenix_html
- #iex
- #graphql
- #genstage
- #websockets
- #supervisor
- #advent-of-code
- #distillery
- #elixirconf-eu
- #processes
- #security
- #api
- #forms
- #performance










Showing Posts 1 to 1- Show Best Posts
- Show All (oldest first)
- Show All (newest first)
NobbZ
As far as I know, ZIP does not enforce any encoding of filenames, it is just saved as it comes from the operating system as raw bytes.
So how well non-asciis get carried over depends on where you zip and where you unzip, but as one does not use non-ascii in filenames, this in not a problem at all
If you know the encoding used by the “zipper”, then you should be able to use iconv like tools to transfer in any encoding you like.
Also remember, that you get double trouble if the encoding in the database differs from the encoding of data you write to it.