Erlang dependency compiled with wrong Erlang version

nahoj · January 16, 2024, 3:28pm

Hello, I’m a newcomer to both Elixir and Erlang and I’ve run into an issue and I hope someone here can help me.

When using mix compile I seem to be getting a compatibility error, that the beam file is compiled for a later version of the runtime system.


16:05:42.441 [error] beam/beam_load.c(184): Error loading module luerl:

This BEAM file was compiled for a later version of the runtime system than the current (Erlang/OTP 25).

To fix this, please re-compile this module with an Erlang/OTP 25 compiler.

(Use of opcode 181; this emulator supports only up to 180.)

A simple cleanup of deps/ and _build/ will recover from the issue, but that isn’t desired.

I’ve isolated it to only show up on Elixir version 1.15.x using below Erlang/OTP


mix --version

Erlang/OTP 25 [erts-13.2.2.3] [source] [64-bit] [smp:20:20] [ds:20:20:10] [async-threads:1] [jit:ns]

Mix 1.15.7 (compiled with Erlang/OTP 24)

I’ve created a sample repository https://github.com/JohanKarlbergg/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe and put a command in the README reproduce the issue.

I’ve tried to search for similar issues without success.

Eiji · January 16, 2024, 4:11pm

Because this is not considered as an issue. The message is clear enough and as you said there is solution of cleanup which you know without searching. In such case if people know something without searching they don’t create any issue and just your question is not common.

Keep in mind that on the forum many users reading your post have no idea how you think like they have no idea why recompiling all dependencies is not desired for you. As you said recompiling all dependencies is of course good idea and people do it by default in almost all cases - at least those I am aware of. However if for some reason you don’t want to compile all dependencies then you can simply recompile just one.

mix deps.compile dep_name --force

You need to improve your documentation research skills. What’s may be interesting is mix help task which lists all tasks available and mix help task.name which shows the documentation for said task. I believe that deps.compile is obvious naming, so there is no need to describe what it does. Finally the documentation in mix help deps.compile should be enough clear for you.

Personally I recommend reading documentation a lot. Of course not to remember everything, but to more or less know where you can find some information and also you may find lots of interesting things that would be helpful for you now or in near future and you were just was not aware of their existence. The common mistake is to not read Erlang documentation assuming that Elixir core is all what you need. For example I have found :erlang.term_to_binary/1 and :erlang.binary_to_term/1 very useful. This is pretty basic and simple to understand thing new developers have completely no idea about.

Edit: As @kokolegorille said firstly you need to fix the problem with your Elixir installation. After this you can use mix deps.compile to recompile only those dependencies you want.

nahoj · January 16, 2024, 4:14pm

After some further debugging it seems luerl might be the issue. When I pin it to 1.1.0 I have no issue.

kokolegorille · January 16, 2024, 4:16pm

How did You install Elixir and Erlang? With asdf?

You have an Elixir version for OTP24, but You have OTP25

You need to change the Elixir version to be OTP 25

Latest for now is OTP 26…

tj0 · January 16, 2024, 4:25pm

This is a rather curious problem. I could not re-create it with luerl 1.0 as given in the repo. And I added luerl 1.0 to one of my own projects without error.

Did you download a pre-compiled luerl from somewhere @nahoj ? The only other way I can think this might happen is that you installed erlang, tried luerl. Upgraded something installing elixir. And then ran into this problem.

elixir --version
Erlang/OTP 26 [erts-14.2.1] [source] [64-bit] [smp:8:8] [ds:8:8:10] [async-threads:1] [jit:ns]

Elixir 1.15.7 (compiled with Erlang/OTP 26)

nahoj · January 16, 2024, 4:29pm

Hey, I did not download luerl from somewhere. I use asdf to manage elixir/erlang.

In the mix.lock file it is version 1.1.1, I should have had the same in mix.exs.

I’m also unable to re-create this with luerl 1.0.

tj0 · January 16, 2024, 4:33pm

Hmmm…that makes sense. So the only logical explanation I can think of is if you installed multiple versions of erlang or elixir? Otherwise, I have no idea how this could possibly occur.

Edit: Also, I’m super-curious how you ended up on luerl as a starting point as a newcomer to Elixir/Erlang?

Eiji · January 16, 2024, 4:45pm

You need to use an Elixir version with -otp-25 suffix if you use Erlang version 25.

LostKobrakai · January 16, 2024, 4:49pm

While it’s certainly to be preferred that’s not completely correct. You need that for elixir to integrate with OTP 25 features, but using an elixir version compiled with an older otp version should generally work.

Eiji · January 16, 2024, 5:02pm

Should work or maybe could work? Should sounds like it’s supported and therefore such behaviour looks like a bug. I guess it could work, but since it’s not supported it’s recommended to make an update in order to avoid such problems now and in the future.

dimitarvp · January 16, 2024, 5:07pm

Should, yes, but I’d never recommend it.

LostKobrakai · January 16, 2024, 5:20pm

It’s “should” afaik. In the end elixir becomes precompiled beam files, which are forward compatible to newer OTP versions.

I also don’t think the issue here is due to the elixir installation being used. If you use OTP 25 and elixir compiled with otp 24, both won’t magically use a new opcode introduced in OTP 26. It’s more likely a mess either with switching OTP versions or even more with switching otp versions and having dependencies, which keep build artifacts within deps/ instead of only within _build/. That happens with some erlang dependencies (more likely on old ones though).

The stated cleaning of deps/ and _build resolving the issue would certainly favor that theory. Generally clearing _build should already be enough.

dimitarvp · January 16, 2024, 5:55pm

Some Erlang libraries have pre-compilation phases where they generate files inside their own directories. That’s why deleting deps is also generally recommended.

al2o3cr · January 16, 2024, 8:52pm

Could be you had a out-of-date comp_opts.mk file in deps/luerl - it’s generated when the package is installed and contains the Erlang version:

github.com

rvirding/luerl/blob/develop/get_comp_opts.escript#L13


      
          %% Define a number of compiler options. We first work out the current
          %% Erlang version and from the we can define the various options.
          
          %% Define the makefile variables HAS_MAPS, HAS_FULL_KEYS,
          %% NEW_REC_CORE, NEW_RAND, HAS_FLOOR, HAS_CEIL and NEW_STACKTRACE
          %% depending on version of Erlang.
          
          main(_) ->
              Version = otp_release(),
              CompOpts = comp_opts(Version),
              file:write_file("comp_opts.mk", "COMP_OPTS = " ++ CompOpts ++ "\n").
          
          %% Get the release number.
          %% We have stolen the idea and most of the code from rebar3.
          
          otp_release() ->
              case erlang:system_info(otp_release) of
                  [$R,N1|Rest] when is_integer(N1) ->
                      %% If OTP <= R16, take the digits.
                      [N1|Rest];
                  Rel ->

Installing a higher version will naturally generate a new file in its directory in deps

nahoj · January 17, 2024, 7:13am

I had this thought also, but I never got further with it and if I compile with DEBUG=1 it suggests that the options is correct, see below.

To emphasize, I’m aware that it might be strange to recompile one dependency, this is only done in order to reproduce the “issue”.

rm -rf _build/ deps && mix deps.get && mix compile --force && DEBUG=1 mix deps.compile luerl --force && mix compile --force

Resolving Hex dependencies...
Resolution completed in 0.013s
Unchanged:
  luerl 1.1.1
* Getting luerl (Hex package)
===> Analyzing applications...
===> Compiling luerl
Compiling 1 file (.ex)
Generated foo app
===> Expanded command sequence to be run: []
===> Running provider: do
===> Expanded command sequence to be run: [app_discovery,{bare,compile}]
===> Running provider: app_discovery
===> Found top-level apps: [luerl]
	using config: [{src_dirs,["src"]},{lib_dirs,["apps/*","lib/*","."]}]
===> Running provider: {bare,compile}
===> Compile (untagged)
===> Running hooks for compile in app luerl (/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl) with configuration:
===> 	{pre_hooks, []}.
===> Running hooks for erlc_compile in app luerl (/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl) with configuration:
===> 	{pre_hooks, []}.
===> Analyzing applications...
===> Compiling luerl
===> compile options: {erl_opts, [debug_info,
                                  {d,'ERLANG_VERSION',"25.3.2.6"},
                                  {d,'HAS_MAPS',true},
                                  {d,'HAS_FULL_KEYS',true},
                                  {d,'NEW_REC_CORE',true},
                                  {d,'NEW_RAND',true},
                                  {d,'NEW_BOOL_GUARD',true},
                                  {d,'HAS_FLOOR',true},
                                  {d,'HAS_CEIL',true},
                                  {d,'NEW_STACKTRACE',true},
                                  {d,'EEP48',true}]}.
===> files to analyze ["/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_sandbox.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_comp_lint.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_comp_env.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_heap.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_comp.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_lib_math.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_lib_utf8.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_init.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_comp_peep.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_anno.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_lib_os.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/ttdict.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_lib_string.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_old.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/Elixir.Luerl.New.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_comp_vars.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_lib_basic.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_util.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_new.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_lib_os_date.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_comp_locf.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_lib_bit32.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_lib_package.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_lib_io.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_comp_normalise.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_lib.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_shell.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_parse_exp.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_lib_debug.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_emul.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_scan.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_lib_table.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/ttsets.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_parse.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/Elixir.Luerl.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_app.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_comp_cg.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_sup.erl",
                       "/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl/src/luerl_lib_string_format.erl"]
===> Running hooks for erlc_compile in app luerl (/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl) with configuration:
===> 	{post_hooks, []}.
===> Running hooks for app_compile in app luerl (/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl) with configuration:
===> 	{pre_hooks, []}.
===> Running hooks for app_compile in app luerl (/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl) with configuration:
===> 	{post_hooks, []}.
===> Running hooks for compile in app luerl (/home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/deps/luerl) with configuration:
===> 	{post_hooks, []}.
Compiling 1 file (.ex)

08:09:22.501 [error] beam/beam_load.c(184): Error loading module luerl:
  This BEAM file was compiled for a later version of the runtime system than the current (Erlang/OTP 25).
  To fix this, please re-compile this module with an Erlang/OTP 25 compiler.
  (Use of opcode 181; this emulator supports only up to 180.)



08:09:22.501 [error] Loading of /home/01e3c763592bbc85568a28a81ae6f5f732d8d183f7f533080a0998e7229127fe/_build/dev/lib/luerl/ebin/luerl.beam failed: :badfile

warning: :luerl.dofile/2 is undefined (module :luerl is not available or is yet to be defined)
  lib/foo.ex:3: Foo.bar/0

warning: :luerl.init/0 is undefined (module :luerl is not available or is yet to be defined)
  lib/foo.ex:3: Foo.bar/0

Generated foo app

If I instead only run the command below, which doesn’t recompile luerl it works as expected. It also works if I instead use luerl version 1.1.0 as previously pointed out.

rm -rf _build/ deps && mix deps.get && mix compile --force && mix compile --force

Versions

mix -v
Erlang/OTP 25 [erts-13.2.2.3] [source] [64-bit] [smp:20:20] [ds:20:20:10] [async-threads:1] [jit:ns]

Mix 1.15.7 (compiled with Erlang/OTP 25)