gmile

gmile

Cross-platform specific error when installing latest hex

It seems like downloading latest hex when building for a non-native platform is broken :thinking:

I have the following Dockerfile:

FROM hexpm/elixir:1.16.2-erlang-26.2.3-alpine-3.19.1
RUN apk add git
RUN mix archive.install github hexpm/hex branch latest --force

Using M-series MacBook if I build it for amd64 architecture, I get an error:

docker buildx build --platform linux/amd64 --file ./Dockerfile --no-cache --progress plain .
# ...
3.067 ==> hex
3.069 Error while loading project :"new package" at /tmp/mix-local-installer-fetcher-3T_JSQ/deps/new package
3.080 ** (ArgumentError) could not call Module.put_attribute/3 because the module Hex.MixProject is already compiled
3.080     (elixir 1.16.2) lib/module.ex:2360: Module.assert_not_readonly!/2
3.080     (elixir 1.16.2) lib/module.ex:2041: Module.__put_attribute__/5
3.080     /tmp/mix-local-installer-fetcher-3T_JSQ/deps/new package/mix.exs:172: (module)
3.080     (stdlib 5.2.1) lists.erl:1599: :lists.foldl_1/3
Full output
#0 building with "mybuilder" instance using docker-container driver

#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 171B done
#1 DONE 0.0s

#2 [internal] load metadata for docker.io/hexpm/elixir:1.16.2-erlang-26.2.3-alpine-3.19.1
#2 DONE 0.4s

#3 [internal] load .dockerignore
#3 transferring context: 2B done
#3 DONE 0.0s

#4 [1/3] FROM docker.io/hexpm/elixir:1.16.2-erlang-26.2.3-alpine-3.19.1@sha256:aed90d87c95d2cb41b2fc589b781ceca11d5faf6e533b89587e741943274a4e7
#4 resolve docker.io/hexpm/elixir:1.16.2-erlang-26.2.3-alpine-3.19.1@sha256:aed90d87c95d2cb41b2fc589b781ceca11d5faf6e533b89587e741943274a4e7 done
#4 CACHED

#5 [2/3] RUN apk add git
#5 0.046 fetch https://dl-cdn.alpinelinux.org/alpine/v3.19/main/x86_64/APKINDEX.tar.gz
#5 0.240 fetch https://dl-cdn.alpinelinux.org/alpine/v3.19/community/x86_64/APKINDEX.tar.gz
#5 0.428 (1/9) Installing brotli-libs (1.1.0-r1)
#5 0.455 (2/9) Installing c-ares (1.27.0-r0)
#5 0.474 (3/9) Installing libunistring (1.1-r2)
#5 0.503 (4/9) Installing libidn2 (2.3.4-r4)
#5 0.523 (5/9) Installing nghttp2-libs (1.58.0-r0)
#5 0.545 (6/9) Installing libcurl (8.5.0-r0)
#5 0.570 (7/9) Installing libexpat (2.6.2-r0)
#5 0.593 (8/9) Installing pcre2 (10.42-r2)
#5 0.619 (9/9) Installing git (2.43.0-r0)
#5 0.690 Executing busybox-1.36.1-r15.trigger
#5 0.699 OK: 24 MiB in 35 packages
#5 DONE 0.7s

#6 [3/3] RUN mix archive.install github hexpm/hex branch latest --force
#6 0.720 * Getting new package (https://github.com/hexpm/hex.git - origin/latest)
#6 1.340 remote: Enumerating objects: 13806, done.
remote: Counting objects: 100% (1261/1261), done.
remote: Compressing objects: 100% (661/661), done.
#6 1.756 remote: Total 13806 (delta 757), reused 966 (delta 542), pack-reused 12545
#6 2.124 ==> hex
#6 2.125 Error while loading project :"new package" at /tmp/mix-local-installer-fetcher-jW0twA/deps/new package
#6 2.141 ** (ArgumentError) could not call Module.put_attribute/3 because the module Hex.MixProject is already compiled
#6 2.141     (elixir 1.16.2) lib/module.ex:2360: Module.assert_not_readonly!/2
#6 2.141     (elixir 1.16.2) lib/module.ex:2041: Module.__put_attribute__/5
#6 2.141     /tmp/mix-local-installer-fetcher-jW0twA/deps/new package/mix.exs:172: (module)
#6 2.141     (stdlib 5.2.1) lists.erl:1599: :lists.foldl_1/3
#6 ERROR: process "/bin/sh -c mix archive.install github hexpm/hex branch latest --force" did not complete successfully: exit code: 1
------
 > [3/3] RUN mix archive.install github hexpm/hex branch latest --force:
remote: Counting objects: 100% (1261/1261), done.
remote: Compressing objects: 100% (661/661), done.
1.756 remote: Total 13806 (delta 757), reused 966 (delta 542), pack-reused 12545
2.124 ==> hex
2.125 Error while loading project :"new package" at /tmp/mix-local-installer-fetcher-jW0twA/deps/new package
2.141 ** (ArgumentError) could not call Module.put_attribute/3 because the module Hex.MixProject is already compiled
2.141     (elixir 1.16.2) lib/module.ex:2360: Module.assert_not_readonly!/2
2.141     (elixir 1.16.2) lib/module.ex:2041: Module.__put_attribute__/5
2.141     /tmp/mix-local-installer-fetcher-jW0twA/deps/new package/mix.exs:172: (module)
2.141     (stdlib 5.2.1) lists.erl:1599: :lists.foldl_1/3
------
WARNING: No output specified with docker-container driver. Build result will only remain in the build cache. To push result image into registry use --push or to load image into docker use --load
Dockerfile:3
--------------------
   1 |     FROM hexpm/elixir:1.16.2-erlang-26.2.3-alpine-3.19.1
   2 |     RUN apk add git
   3 | >>> RUN mix archive.install github hexpm/hex branch latest --force
   4 |
--------------------
ERROR: failed to solve: process "/bin/sh -c mix archive.install github hexpm/hex branch latest --force" did not complete successfully: exit code: 1
docker system info
docker system info
Client:
 Version:    25.0.5
 Context:    orbstack
 Debug Mode: false
 Plugins:
  buildx: Docker Buildx (Docker Inc.)
    Version:  v0.13.1
    Path:     /Users/eugene/.docker/cli-plugins/docker-buildx
  compose: Docker Compose (Docker Inc.)
    Version:  v2.24.5
    Path:     /Users/eugene/.docker/cli-plugins/docker-compose

Server:
 Containers: 46
  Running: 11
  Paused: 0
  Stopped: 35
 Images: 94
 Server Version: 25.0.5
 Storage Driver: overlay2
  Backing Filesystem: btrfs
  Supports d_type: true
  Using metacopy: false
  Native Overlay Diff: true
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: cgroupfs
 Cgroup Version: 2
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local splunk syslog
 Swarm: inactive
 Runtimes: runc io.containerd.runc.v2
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: 7c3aca7a610df76212171d200ca3811ff6096eb8
 runc version: 51d5e94601ceffbbd85688df1c928ecccbfa4685
 init version: de40ad0
 Security Options:
  seccomp
   Profile: builtin
  cgroupns
 Kernel Version: 6.7.11-orbstack-00143-ge6b82e26cd22
 Operating System: OrbStack
 OSType: linux
 Architecture: aarch64
 CPUs: 16
 Total Memory: 7.747GiB
 Name: orbstack
 ID: 6930304f-aa9c-4f94-ab8f-65e34ab70164
 Docker Root Dir: /var/lib/docker
 Debug Mode: false
 Experimental: false
 Insecure Registries:
  127.0.0.0/8
 Live Restore Enabled: false
 Product License: Community Engine
 Default Address Pools:
   Base: 192.168.215.0/24, Size: 24
   Base: 192.168.228.0/24, Size: 24
   Base: 192.168.247.0/24, Size: 24
   Base: 192.168.207.0/24, Size: 24
   Base: 192.168.167.0/24, Size: 24
   Base: 192.168.107.0/24, Size: 24
   Base: 192.168.237.0/24, Size: 24
   Base: 192.168.148.0/24, Size: 24
   Base: 192.168.214.0/24, Size: 24
   Base: 192.168.165.0/24, Size: 24
   Base: 192.168.227.0/24, Size: 24
   Base: 192.168.181.0/24, Size: 24
   Base: 192.168.158.0/24, Size: 24
   Base: 192.168.117.0/24, Size: 24
   Base: 192.168.155.0/24, Size: 24
   Base: 192.168.147.0/24, Size: 24
   Base: 192.168.229.0/24, Size: 24
   Base: 192.168.183.0/24, Size: 24
   Base: 192.168.156.0/24, Size: 24
   Base: 192.168.97.0/24, Size: 24
   Base: 192.168.171.0/24, Size: 24
   Base: 192.168.186.0/24, Size: 24
   Base: 192.168.216.0/24, Size: 24
   Base: 192.168.242.0/24, Size: 24
   Base: 192.168.166.0/24, Size: 24
   Base: 192.168.239.0/24, Size: 24
   Base: 192.168.223.0/24, Size: 24
   Base: 192.168.164.0/24, Size: 24
   Base: 192.168.163.0/24, Size: 24
   Base: 192.168.172.0/24, Size: 24
   Base: 172.17.0.0/16, Size: 16
   Base: 172.18.0.0/16, Size: 16
   Base: 172.19.0.0/16, Size: 16
   Base: 172.20.0.0/14, Size: 16
   Base: 172.24.0.0/14, Size: 16
   Base: 172.28.0.0/14, Size: 16

I get a similar error if I attempt to build an image for arm64 using my amd64 linux box:

docker buildx build --platform linux/arm64 --file ./Dockerfile --no-cache --progress plain .
# ...
7.858 ==> hex
7.860 Error while loading project :"new package" at /tmp/mix-local-installer-fetcher-Zs6laA/deps/new package
7.920 ** (ArgumentError) could not call Module.put_attribute/3 because the module Hex.MixProject is already compiled
7.920     (elixir 1.16.2) lib/module.ex:2360: Module.assert_not_readonly!/2
7.920     (elixir 1.16.2) lib/module.ex:2041: Module.__put_attribute__/5
7.920     /tmp/mix-local-installer-fetcher-Zs6laA/deps/new package/mix.exs:171: (module)
7.920     (stdlib 5.2.1) lists.erl:1599: :lists.foldl_1/3
------
WARNING: No output specified with docker-container driver. Build result will only remain in the build cache. To push result image into registry use --push or to load image into docker use --load
Dockerfile:3
--------------------
   1 |     FROM hexpm/elixir:1.16.2-erlang-26.2.3-alpine-3.19.1
   2 |     RUN apk add git
   3 | >>> RUN mix archive.install github hexpm/hex branch latest --force
   4 |
--------------------
ERROR: failed to solve: process "/dev/.buildkit_qemu_emulator /bin/sh -c mix archive.install github hexpm/hex branch latest --force" did not complete successfully: exit code: 1
Full output
docker buildx build --platform linux/arm64 --file ./Dockerfile --no-cache --progress plain .
#0 building with "nice_pare" instance using docker-container driver

#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 171B done
#1 DONE 0.0s

#2 [internal] load metadata for docker.io/hexpm/elixir:1.16.2-erlang-26.2.3-alpine-3.19.1
#2 DONE 1.1s

#3 [internal] load .dockerignore
#3 transferring context: 2B done
#3 DONE 0.0s

#4 [1/3] FROM docker.io/hexpm/elixir:1.16.2-erlang-26.2.3-alpine-3.19.1@sha256:aed90d87c95d2cb41b2fc589b781ceca11d5faf6e533b89587e741943274a4e7
#4 resolve docker.io/hexpm/elixir:1.16.2-erlang-26.2.3-alpine-3.19.1@sha256:aed90d87c95d2cb41b2fc589b781ceca11d5faf6e533b89587e741943274a4e7 done
#4 CACHED

#5 [2/3] RUN apk add git
#5 0.083 fetch https://dl-cdn.alpinelinux.org/alpine/v3.19/main/aarch64/APKINDEX.tar.gz
#5 0.930 fetch https://dl-cdn.alpinelinux.org/alpine/v3.19/community/aarch64/APKINDEX.tar.gz
#5 2.010 (1/9) Installing brotli-libs (1.1.0-r1)
#5 2.179 (2/9) Installing c-ares (1.27.0-r0)
#5 2.328 (3/9) Installing libunistring (1.1-r2)
#5 2.499 (4/9) Installing libidn2 (2.3.4-r4)
#5 2.592 (5/9) Installing nghttp2-libs (1.58.0-r0)
#5 2.678 (6/9) Installing libcurl (8.5.0-r0)
#5 2.818 (7/9) Installing libexpat (2.6.2-r0)
#5 2.903 (8/9) Installing pcre2 (10.42-r2)
#5 3.032 (9/9) Installing git (2.43.0-r0)
#5 3.500 Executing busybox-1.36.1-r15.trigger
#5 3.560 OK: 26 MiB in 35 packages
#5 DONE 3.7s

#6 [3/3] RUN mix archive.install github hexpm/hex branch latest --force
#6 3.672 * Getting new package (https://github.com/hexpm/hex.git - origin/latest)
#6 5.031 remote: Enumerating objects: 13806, done.
remote: Counting objects: 100% (1261/1261), done.
remote: Compressing objects: 100% (641/641), done.
#6 5.986 remote: Total 13806 (delta 759), reused 993 (delta 562), pack-reused 12545
#6 8.020 ==> hex
#6 8.027 Error while loading project :"new package" at /tmp/mix-local-installer-fetcher-XN3HMA/deps/new package
#6 8.142 ** (ArgumentError) could not call Module.put_attribute/3 because the module Hex.MixProject is already compiled
#6 8.142     (elixir 1.16.2) lib/module.ex:2360: Module.assert_not_readonly!/2
#6 8.142     (elixir 1.16.2) lib/module.ex:2041: Module.__put_attribute__/5
#6 8.142     /tmp/mix-local-installer-fetcher-XN3HMA/deps/new package/mix.exs:171: (module)
#6 8.142     (stdlib 5.2.1) lists.erl:1599: :lists.foldl_1/3
#6 ERROR: process "/dev/.buildkit_qemu_emulator /bin/sh -c mix archive.install github hexpm/hex branch latest --force" did not complete successfully: exit code: 1
------
 > [3/3] RUN mix archive.install github hexpm/hex branch latest --force:
remote: Counting objects: 100% (1261/1261), done.
remote: Compressing objects: 100% (641/641), done.
5.986 remote: Total 13806 (delta 759), reused 993 (delta 562), pack-reused 12545
8.020 ==> hex
8.027 Error while loading project :"new package" at /tmp/mix-local-installer-fetcher-XN3HMA/deps/new package
8.142 ** (ArgumentError) could not call Module.put_attribute/3 because the module Hex.MixProject is already compiled
8.142     (elixir 1.16.2) lib/module.ex:2360: Module.assert_not_readonly!/2
8.142     (elixir 1.16.2) lib/module.ex:2041: Module.__put_attribute__/5
8.142     /tmp/mix-local-installer-fetcher-XN3HMA/deps/new package/mix.exs:171: (module)
8.142     (stdlib 5.2.1) lists.erl:1599: :lists.foldl_1/3
------
WARNING: No output specified with docker-container driver. Build result will only remain in the build cache. To push result image into registry use --push or to load image into docker use --load
Dockerfile:3
--------------------
   1 |     FROM hexpm/elixir:1.16.2-erlang-26.2.3-alpine-3.19.1
   2 |     RUN apk add git
   3 | >>> RUN mix archive.install github hexpm/hex branch latest --force
   4 |
--------------------
ERROR: failed to solve: process "/dev/.buildkit_qemu_emulator /bin/sh -c mix archive.install github hexpm/hex branch latest --force" did not complete successfully: exit code: 1
docker system info
Client: Docker Engine - Community
 Version:    25.0.0
 Context:    default
 Debug Mode: false
 Plugins:
  buildx: Docker Buildx (Docker Inc.)
    Version:  v0.12.1
    Path:     /usr/libexec/docker/cli-plugins/docker-buildx
  compose: Docker Compose (Docker Inc.)
    Version:  v2.24.1
    Path:     /usr/libexec/docker/cli-plugins/docker-compose

Server:
 Containers: 15
  Running: 3
  Paused: 0
  Stopped: 12
 Images: 41
 Server Version: 25.0.0
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Using metacopy: false
  Native Overlay Diff: true
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: systemd
 Cgroup Version: 2
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local splunk syslog
 Swarm: error
  NodeID:
  Error: error while loading TLS certificate in /var/lib/docker/swarm/certificates/swarm-node.crt: certificate (1 - iuqe6aimrunn6atv7y4ldcftn) not valid after Sun, 04 Feb 2024 09:18:00 UTC, and it is currently Wed, 14 Feb 2024 16:37:01 CET: x509: certificate has expired or is not yet valid:
  Is Manager: false
  Node Address: 100.126.118.102
 Runtimes: io.containerd.runc.v2 runc
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: a1496014c916f9e62104b33d1bb5bd03b0858e59
 runc version: v1.1.11-0-g4bccb38
 init version: de40ad0
 Security Options:
  apparmor
  seccomp
   Profile: builtin
  cgroupns
 Kernel Version: 5.15.0-94-generic
 Operating System: Ubuntu 22.04.3 LTS
 OSType: linux
 Architecture: x86_64
 CPUs: 16
 Total Memory: 15GiB
 Name: eugene-pc
 ID: 48396c2d-4102-4b10-aa73-6744cad10683
 Docker Root Dir: /var/lib/docker
 Debug Mode: false
 Experimental: false
 Insecure Registries:
  127.0.0.0/8
 Live Restore Enabled:

Any ideas what might be happening here? :thinking:

Most Liked

gmile

gmile

After encountering this problem, I decided to document everything I discovered, but chose not to dig further at the moment… So no, didn’t manage to solve this.

I’ll speculate that the problem here is at the intersection of Erlang / qemu, since qemu is typically used by docker buildx to build images across platforms. And if so, it wouldn’t be the first time specific version of Erlang / qemu is affected by this… See: [arm64+otp 25+qemu] `mix local.hex --force` hangs - although there, the problem is even worse, e.g. a segmentation fault. But I am not 100% sure if the two issues are related

Where Next?

Popular in Questions Top

sergio
In Ruby, I can go: User.find_by(email: "foobar@email.com").update(email: "hello@email.com") How can I do something similar in Elixir? ...
New
Tee
can someone please explain to me how Enum.reduce works with maps
New
JulienCorb
I am trying to implement my new.html.eex file to create new posts on my website. new.html.eex: <h1>Create Post</h1> <...
New
minhajuddin
I have seen a lot of code which picks the first element from a list using Enum.at(0) instead of List.first. Is there a reason why people ...
New
vac
Hi, I'm quite new in Elixir and I'm trying to format a string to a PEM format. I have the certificate value like MIIDBTCCAe2...... and ...
New
freewebwithme
Using vs code and installed ElixirLS: support and debugger. And I got an error popped up on start up says Failed to run ‘elixir’ comma...
New
romenigld
I am trying to run a deploy with docker and I successfully runned with this command: docker build -t romenigld/blog-prod . but when I t...
New
Brian
What is the proper way to load a module from a file in to IEX? In the python world, doing something like this pretty standard: from ....
New
PeterCarter
There are pre-rolled solutions for other frameworks that do work. However, Phoenix does not seem to have these. Have people had good expe...
New
jononomo
For some reason my phoenix channels are working for me in my local dev environment, but as soon as I deploy via Docker, I get a 403 error...
New

Other popular topics Top

sorentwo
Hello! tl;dr Announcing Oban, an Ecto based job processing library with a focus on reliability and historical observability. After spen...
985 42842 311
New
grych
Hi folks, Few months ago I have announced the proof-of-concept of the library to manipulate the browsers DOM objects directly from Elixi...
639 52238 488
New
chrismccord
This release brings a number of exciting features, including integration with the new Phoenix LiveDashboard and Phoenix LiveView. There h...
New
bsollish-terakeet
Credo is smart enough to check for (something like) this: assert length(the_list) == 0 with this response: Checking if an enum is empt...
New
baxterw3b
Hi guys, i’m new in the Elixir world, and i have to say, that i love it! i’m having some problem to understand anonymous functions with ...
New
KronicDeth
Elixir plugin for JetBrain’s IntelliJ Platform (including Rubymine) This is a plugin that adds support for Elixir to JetBrains IntelliJ...
289 35953 110
New
boundedvariable
I am going through the kafka architecture. All the features what the kafka is providing are already in Erlang. I would like hear your opi...
New
nsuchy
Hi. I’ve noticed that Windows Powershell has it’s own IEX command and you cannot access Elixir’s IEX due to the conflict. This isn’t a cr...
New
shijith.k
I am trying to start a new phoenix project with elixir 1.9, but mix phx.new does not work. It says that ** (Mix) The task "phx.new" could...
New
komlanvi
Hi everyone, I was playing with phoenix liveView but I run into an issue. I have a form and want to validate each input text when the te...
New

We're in Beta

About us Mission Statement