mikl

mikl

We’ve recently started seeing our CI jobs failing due to mix deps.get hanging. It stalls for an hour, then the CI job gets a timeout, our script looks like this:

$ mix local.hex --force --if-missing
$ mix local.rebar --force --if-missing
$ mix hex.repo add oban https://getoban.pro/repo --fetch-public-key ${OBAN_KEY_FINGERPRINT} --auth-key ${OBAN_LICENSE_KEY}
$ mix deps.get

This is with Gitlab CI, using the hexpm/elixir:1.17.3-erlang-26.2.5.4-debian-bookworm-20241016-slim docker image.

Is there any way to see where it is getting stuck? mix help deps.get does not list any verbose or debugging flags.

Showing Posts 1 to 5

jeroenbourgois

jeroenbourgois

Can you curl the package from within CI? Maybe try that just to verify the credentials in the url are correct? Something like:

curl -I https://getoban.pro/repo --fetch-public-key ${OBAN_KEY_FINGERPRINT} --auth-key ${OBAN_LICENSE_KEY}

mikl

mikl OP

It works about half the time, so the credentials must be right. And if they were wrong, Hex would throw an error message, not just hanging.

sorentwo

sorentwo

Oban Core Team

Authenticating and fetching from the getoban.pro repo shouldn’t time out. However, we’ve heard about network trouble from CI instances in the past.

Try switching to the newer, globally distributed repo instead: https://repo.oban.pro. That will be served closer to your CI servers and should have better connectivity guarantees.

mikl

mikl OP

I’m far from certain that it’s the Oban repo causing mix deps.get to hang, changing the URL didn’t help at least. Wish I could find a way to see what is causing it to hang.

axelson

axelson

Scenic Core Team

What does MIX_DEBUG=true mix deps.get show? It should print output kind of like:

> MIX_DEBUG=true mix deps.get
-> Running mix loadconfig (inside Rewrite.MixProject)
<- Ran mix loadconfig in 0ms
-> Running mix deps.get (inside Rewrite.MixProject)
-> Running mix archive.check (inside Rewrite.MixProject)
<- Ran mix archive.check in 0ms
Resolving Hex dependencies...
Resolution completed in 0.038s
Unchanged:
  benchee 1.3.1
  benchee_dsl 0.5.3
  bunt 1.0.0
  credo 1.7.8
  deep_merge 1.0.0
  dialyxir 1.4.4
  earmark_parser 1.4.41
  erlex 0.2.7
  ex_doc 0.34.2
  excoveralls 0.18.3
  file_system 1.0.1
  fss 0.1.1
  glob_ex 0.1.10
  jason 1.4.4
  kino 0.14.2
  makeup 1.1.2
  makeup_elixir 0.16.2
  makeup_erlang 1.0.1
  nimble_parsec 1.4.0
  sourceror 1.7.0
  statistex 1.0.0
  table 0.1.2
  text_diff 0.1.0
All dependencies are up to date
<- Ran mix deps.get in 469ms

Another thing you could check is MIX_PROFILE=deps.get mix deps.get. Although I’m not sure if that’ll help if mix deps.get hangs forever.

Example output
> MIX_PROFILE=deps.get mix deps.get
-> Profiling mix deps.get (inside Rewrite.MixProject)
Resolving Hex dependencies...
Resolution completed in 0.064s
Unchanged:
  benchee 1.3.1
  benchee_dsl 0.5.3
  bunt 1.0.0
  credo 1.7.8
  deep_merge 1.0.0
  dialyxir 1.4.4
  earmark_parser 1.4.41
  erlex 0.2.7
  ex_doc 0.34.2
  excoveralls 0.18.3
  file_system 1.0.1
  fss 0.1.1
  glob_ex 0.1.10
  jason 1.4.4
  kino 0.14.2
  makeup 1.1.2
  makeup_elixir 0.16.2
  makeup_erlang 1.0.1
  nimble_parsec 1.4.0
  sourceror 1.7.0
  statistex 1.0.0
  table 0.1.2
  text_diff 0.1.0
All dependencies are up to date

Profile results of #PID<0.114.0>
#                                                                              CALLS     %  TIME µS/CALL
Total                                                                          67945 100.0 84998    0.13
:digraph.delete/1                                                                  2  0.00     0    0.00
:digraph.set_type/2                                                                2  0.00     0    0.00
:digraph.check_type/3                                                              2  0.00     0    0.00
:digraph.new/0                                                                     2  0.00     0    0.00
Hex.Registry.Server.open/1                                                         1  0.00     0    0.00
Hex.Registry.Server.open/0                                                         1  0.00     0    0.00
:digraph_utils.forest/3                                                            2  0.00     0    0.00
:erlang.setelement/3                                                               3  0.00     0    0.00
:erlang.monotonic_time/1                                                           2  0.00     0    0.00
:erlang.atom_to_list/1                                                             1  0.00     0    0.00
List.flatten/1                                                                     1  0.00     0    0.00
Path.relative_to_cwd/1                                                             8  0.00     0    0.00
Path.dirname/1                                                                     1  0.00     0    0.00
Hex.Solver.Constraints.Range.include/1                                             5  0.00     0    0.00
:eval_bits.expr_grp/3                                                              1  0.00     0    0.00
Map.new/1                                                                          1  0.00     0    0.00
Map.merge/3                                                                        1  0.00     0    0.00
Map.drop_keys/2                                                                    3  0.00     0    0.00
anonymous fn/1 in Hex.RemoteConverger.packages_from_requests/1                     8  0.00     0    0.00
Hex.RemoteConverger."-fun.request_to_dependency/1-"/1                              8  0.00     0    0.00
anonymous fn/1 in Hex.RemoteConverger.verify_input/2                               8  0.00     0    0.00
Hex.RemoteConverger."-fun.verify_repo/1-"/1                                        1  0.00     0    0.00
Hex.RemoteConverger.with_children/2                                                1  0.00     0    0.00
Hex.RemoteConverger.verify_resolved/2                                              1  0.00     0    0.00
Hex.RemoteConverger.verify_prefetches/1                                            1  0.00     0    0.00
Hex.RemoteConverger.verify_otp_app_names/1                                         1  0.00     0    0.00
Hex.RemoteConverger.verify_input/2                                                 1  0.00     0    0.00
Hex.RemoteConverger.verify_deps/2                                                  1  0.00     0    0.00
Hex.RemoteConverger.unlock_deps/2                                                  1  0.00     0    0.00
Hex.RemoteConverger.print_success/2                                                1  0.00     0    0.00
Hex.RemoteConverger.print_dependency_group/2                                       4  0.00     0    0.00
Hex.RemoteConverger.print_category/1                                               1  0.00     0    0.00
Hex.RemoteConverger.packages_from_requests/1                                       1  0.00     0    0.00
Hex.RemoteConverger.normalize_resolved/1                                           1  0.00     0    0.00
Hex.RemoteConverger.lock_merge/2                                                   1  0.00     0    0.00
Hex.RemoteConverger.group_dependency_changes/2                                     1  0.00     0    0.00
Hex.RemoteConverger.do_with_children/2                                             1  0.00     0    0.00
Hex.RemoteConverger.dep_info_from_lock/1                                           1  0.00     0    0.00
Hex.RemoteConverger.add_apps_to_resolved/2                                         1  0.00     0    0.00
Kernel.__info__/1                                                                  6  0.00     0    0.00
System.normalize_time_unit/1                                                       2  0.00     0    0.00
:lists.mergel/2                                                                    4  0.00     0    0.00
:lists.do_flatten/2                                                                5  0.00     0    0.00
:lists.flatten/1                                                                   1  0.00     0    0.00
:erl_eval.exprs/6                                                                  3  0.00     0    0.00
:erl_eval.empty_fun_used_vars/0                                                    3  0.00     0    0.00
Mix.Dep.Umbrella.unloaded/0                                                        1  0.00     0    0.00
:logger_server.check_level/1                                                       2  0.00     0    0.00

<MANY MORE LINES>

:erlang.binary_to_atom/2                                                        7370  1.59  1352    0.18
:erl_scan.scan_string_no_col/5                                                 24921  1.63  1389    0.06
:gen.do_call/4                                                                  2194  1.83  1554    0.71
:io_lib_format.build_small/1                                                   17526  2.22  1887    0.11
:erlang.atom_to_binary/1                                                       15111  2.22  1888    0.12
:io_lib_format.collect/2                                                       17526  2.44  2075    0.12
:io_lib_format.build_limited/5                                                 17526  2.62  2228    0.13
:elixir_aliases.do_concat/2                                                    14316  2.77  2357    0.16
:erts_internal.prepare_loading/2                                                  38 16.22 13784  362.74

Profile done over 1270 matching functions

It was a little tricky to find, but here is where that is documented: Mix — Mix v1.20.2
It was tricky because as far as I can tell:

  • mix help won’t print that out as help text
  • mix has a manpage but it isn’t installed on my system (where I use asdf)
  • Searching hexdocs.pm for MIX_DEBUG doesn’t yield any results because it actually seems to search for all mentions of mix or debug and there are a lot of those

I found the docs because I already knew there was a MIX_DEBUG environment variable, so I downloaded Elixir’s source code and searched via git grep.

One last thing. If you have the dependencies, i.e. you’ve cached the deps/, ~/.mix, ~/.hex then you can add HEX_OFFLINE=true to skip contracting hex.pm (that’s documented at mix hex.config — Hex v2.5.0)

— All posts loaded —

Where Next? Top

Trending in Questions Top

stjefim
Hello! Suppose you are building workflow (order / task / payment) processing system with the following requirements: Each workflow con...
New
jonnycharles
I’m in search of an Elixir library that offers PDF generation capabilities similar to Ruby’s Prawn. While there have been discussions abo...
New
spammy
I’m looking to build a personal workflow to quickly deploy web applications written in elixir/phoenix, for local consumption (ie not on t...
New
dli
Before I dive in myself, did anyone successfully sprinkle Hologram into their existing LiveView app? Looking for hints regarding: Addi...
New
roeland
Kia ora, We have been using elixir-google-api to connect to Google Drive. However, with the updates to Tesla due to CVEs this is now bro...
New
bottlenecked
Hi all, I wanted to ask how the community is dealing with post-release steps. Today we have Ecto migrations, which make sure that the db...
New
rahultumpala
Hello, I have an Elixir backend that implements a custom protocol over TCP. I want to load test the backend and assess the performance o...
New

Other Trending Topics Top

JesseHerrick
Hey, I’m Jesse and I’m the main contributor behind Dexter, a full-featured, lightning-fast Elixir LSP optimized for large codebases. It s...
New
jimsynz
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
mcass19
ExRatatui lets you cook up rich terminal UIs in Elixir, powered by Rust’s ratatui via Rustler NIFs. Build interactive terminal applicatio...
New
Damirados
Hello everyone. After busy few months I am happy to announce v0.1.0 of Emerge &amp; Solve. They are GUI (Emerge) and State management (S...
New
netoum
Corex is an accessible, unstyled UI component library for Phoenix that integrates Zag.js state machines using Vanilla JavaScript and Live...
New
ausimian
Emily is an Elixir library that runs Nx computations on Apple’s MLX. Install it as the default Nx backend and Nx, defn, Axon, Nx.Serving,...
New

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews