Optimizations in the upcoming Erlang/OTP 26

erlangforums · April 19, 2023, 3:02pm

EFS Thread: New blog post about the optimizations in the upcoming Erlang/OTP 26 - Erlang Blog - Erlang Programming Language Forum - Erlang Forums

AstonJ · April 19, 2023, 11:00pm

Moved to a dedicated thread as this is well worth a read

Also quoting @rvirding from EFS:

al2o3cr · April 20, 2023, 12:30am

The base64 improvements look impressive; one bummer is I don’t see an equivalent to omitting Base.decode64’s ignore: :whitespace option - :base64.decode/2’s docs mention it always strips whitespace.

OTOH it looks like the implementation in Base has been recently refactored with a link to the the blog post that the one at the top of this thread updates for OTP 26, so those improvements to binary matching + construction should apply automatically

github.com/elixir-lang/elixir

Make Base encoding/decoding 100%/25% faster respectively

committed 02:15PM - 19 Jun 22 UTC

josevalim

+599 -680

decode16, in particular, is 50% faster, as we don't need to handle padding. We …also reduce the .beam size from 330kb to 80kb. This is achieved by building look tables, as described in https://www.erlang.org/blog/type-based-optimizations-in-the-jit/ For decoding, we build a sparse lookup table with nils in it. The tables are still small (less than 80 elements) and we have to check for nils, but that's more efficient than the previous approach as well. The code is also simpler, as we rely less on macros and more on dynamic code generation. Closes #11866.

nhpip · April 21, 2023, 6:27pm

I’m going to have to try it against protobuf.