Max
Hi,
i use the following code to generate a csv file. The code itself works. The problem are special chars / umlauts.
-
if i use :utf8 i get the file, but special chars like €, öäü are written like €, ü, …
-
if i don´t use :utf8 it works as long as there are no special chars in a row like €, –, … . Then it breaks with the error
erlang error: :no_translationfile = File.open!(System.tmp_dir()<>"/"<>filename, [:write, :utf8]) users = get_users(conn, params) |> Repo.all |> CSV.encode(separator: ?;) |> Enum.each(&IO.write(file, &1))
Thanks!
Where Next?
Trending in Questions
Other Trending Topics
Latest on Elixir Forum
Sponsor Spotlight
Supporting innovation across the BEAM ecosystem.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #deployment
- #library
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #channels
- #elixirconf
- #exunit
- #discussion
- #code-sync
- #javascript
- #podcasts
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixir-ls
- #blog-post
- #phoenix_html
- #iex
- #graphql
- #ai
- #genstage
- #elixirconf-us
- #websockets
- #supervisor
- #advent-of-code
- #distillery
- #processes
- #api
- #forms
- #metaprogramming
- #security
- #hex
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Error tracking, logs, uptime, and Just Enough APM. Built for developers.
Develop your skills with books, videos, and courses.
Bringing learning, work and compliance together since 1987.
The deployment platform built for Elixir: PaaS ease, VPS control.
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"
Showing Posts 1 to 10- Show Best Posts
- Show All Posts (oldest first)
- Show All Posts (newest first)
NobbZ
When you write using utf8 make sure you use it for reading as well. As you describe it, it seems as if your reader uses latin1 aka iso-8859-1
NobbZ
I just realize that you get data from db, maybe it’s not utf8 in there, elixir will not convert.
voughtdq
Are you using MySQL or MariaDB? They use latin1 as their default apparently.
Max
None of them. Postgres 9.6 on AWS RDS. Default settings.
Max
AWS RDS with postgres 9.6 is set to utf8. Not sure what to change in code.
NobbZ
So what do you use to display the output?
Max
Excel 2016. I know you can set encoding on import. But at the end i need a file which can be opened without doing anything. Our users don´t know how do import a csv in excel.
NobbZ
Then you will have 3 options:
If the customer doesn’t know how to do, it is not your fault. Also it is not your fault, that excel doesn’t use utf8 as default import encoding. Even worse, depending on the system locale, excel may assume different default encodings (thats why I told you to restrict yourself to US-ASCII, which is a subset of all encodings used by MS I already encountered in the wild).
So two things that aren’t even your fault, that you can’t do anything about, but your customer tries to blame you?
Max
Mhm, i know how to generate a csv. But as fas as i know i can´t set encoding in the file(?). I don´t know how to generate a xls file. But thanks for your input and time.
And yes, the customers blame me
We have strange customers.
NobbZ
Maybe you can use
elixlsx?