mblagusz

mblagusz

Upon upgrading to Erlang 26, I noticed that the protoc-gen-elixir plugin to the protobuf compiler no longer works. The plugin starts off by reading :stdio as a binary stream, and decoding the contents:

    # See https://groups.google.com/forum/#!topic/elixir-lang-talk/T5enez_BBTI.
    :io.setopts(:standard_io, encoding: :latin1)

    # Read the standard input that protoc feeds us.
    bin = binread_all!(:stdio)

    request = Protobuf.Decoder.decode(bin, Google.Protobuf.Compiler.CodeGeneratorRequest)

The binread_all!() function calls IO.binread(), and this succeeds sometimes, fails with {:error, :collect_chars} at other times, and reads a truncated file in yet other situations, depending on the exact input args to protoc. This all works with Erlang 25 / Elixir 1.14, and with the Python protoc plugin.

Minimal Test Case

With Elixir 1.14, Erlang 25:

$ echo -n $'\xDF\xBE' | elixir -e ':io.setopts(:standard_io, [{:encoding, :latin1}]); IO.binread(:standard_io, :eof) |> IO.inspect()'
"\x{7FE}"

With Elixir 1.15 / Erlang 26.0.2:

$ echo -n $'\xDF\xBE' | elixir -e ':io.setopts(:standard_io, [{:encoding, :latin1}]); IO.binread(:standard_io, :eof) |> IO.inspect()'
{:error, :collect_chars}

I see similar results using :file.read() instead of IO.binread(). Any idea if this is a known issue?

#io

Showing Posts 1 to 3

al2o3cr

al2o3cr

This issue sounds related:

https://github.com/erlang/otp/issues/7230

mblagusz

mblagusz OP

Okay, so someone did implement Jose’s proposed fix, of adding a kernel argument to set the stdin encoding: Fix problems when reading from stdin and "-noshell" was passed to erl (or used through an escript) by garazdawi · Pull Request #7384 · erlang/otp · GitHub

But how would I specify kernel arguments in an escript?

mblagusz

mblagusz OP

So far I’ve been able to use this as a workaround:

export ERL_AFLAGS='-kernel standard_io_encoding latin1'

It’s a little awkward since it has to be specified at runtime, not escript build time. I think I can do the same thing with emu_args, but haven’t tried it yet.

— All posts loaded —

Where Next? Top

Trending in Questions Top

Blokh
Hey guys, I’ve got a huge CSV ( around 10 GB ) that needs to be processed hourly Do you guys have any suggestions what is the best prac...
New
RSP87
I’m working on a project that simulates the bumbl example in the programming phoenix book. It acts almost like an email client. We have a...
New
kszambelanczyk
Hello! Could someone please give me a help/sample code, how to delete a file from s3 using waffle/waffle_ecto from Phoenix app. I creat...
New
RemyXRenard
I’m seeing that a list inside a Kino.DataTable will be interpreted as a charlist, even if the Kino.configure() is set to charlists: :as_l...
New
velrest
So my question is quite simple and i have found no conclusive answer on forum, google or AI. Should we use :erlang.float for Integer to ...
New
samoloth
Hi, I’ve just set up an application with ash_authentication. There is only magic link strategy for now, so there is no confirmation add o...
New
FlyingNoodle
If a change or preparation module uses Ash.Changeset.get_argument/2 or Ash.Query.get_argument/2 (or any of the other get_argument functio...
New

Other Trending Topics Top

mudasobwa
I am happy to introduce the very α version of the new programming language compiled to BEAM. Welcome Cure. It has literally three kille...
New
garrison
Hobbes is a low-level distributed database for the Elixir programming language. Hobbes provides a simple, safe, and scalable storage lay...
New
marciok
Hi there! We created Gust: A task orchestrator inspired by Airflow. For those who have never heard about Aiflow, it’s a Python-based wor...
New
jimsynz
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
Dmk
Xamal is a deployment tool for Elixir apps that deploys native releases to bare metal servers over SSH. It’s a port of GitHub - basecamp/...
New
Damirados
Hello everyone. After busy few months I am happy to announce v0.1.0 of Emerge & Solve. They are GUI (Emerge) and State management (S...
New

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews