NobbZ
We are curretnly trying to reduce the amount of compute units used by our CI.
Thats why I split out mix deps.get && mix compile into a job that produces artifacts, which then can get used in the follow up jobs to save up some compute time.
This seems to work well in theory, and as we have 5 jobs based on the build output, we expect roughly 3 equivalents of mix compile to be saved.
Sadly, it appears that in the subsequent jobs, the project itself is still built each time.
So far, the effect of extracting the build into a previous step is therefore barely better than caching.
To comparision see this, where the 2 apps in the umbrella are built anew:
While the previous step does properly build it here as well:
The downloaded artifacts have all the BEAM modules and application manfests as I would expect them.
Has anyone an idea how to get this working, without doing the repeated compilation of the projects application again and again?
This repeated builds of the project members seems to be one of the most costly factors in the CI.
Where Next?
Trending in Questions
Other Trending Topics
Latest on Elixir Forum
Sponsor Spotlight
Phoenix, LiveView, multimedia pipelines, distributed systems. 400 engineers, Elixir since 2017. Available for hire.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #library
- #deployment
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #elixirconf
- #channels
- #exunit
- #discussion
- #code-sync
- #podcasts
- #javascript
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #ai
- #podcasts-by-brainlid
- #ecto-query
- #blog-post
- #elixirconf-us
- #elixir-ls
- #phoenix_html
- #iex
- #graphql
- #genstage
- #websockets
- #supervisor
- #advent-of-code
- #distillery
- #processes
- #elixirconf-eu
- #api
- #forms
- #security
- #metaprogramming
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Elixir, Erlang & BEAM conferences from Code Sync - join us in 2026!
Practical resources that improve the lives of professional developers.
Master modern tools, write cleaner code, and tackle real-world challenges.
The deployment platform built for Elixir: PaaS ease, VPS control.
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"
Showing Posts 1 to 2- Show Best Posts
- Show All (oldest first)
- Show All (newest first)
D4no0
I’ve noticed this too happening in my CI pipelines. I have the feeling that this is related to the
rebar3. In my logs I could see recompilation of libraries that were not part of mix.In a few OSS projects, I saw that some folk was caching
.mix(in your case/root/.mix/) folder too, have you tried doing that?NobbZ
Thanks for the input, sadly this doesn’t change much, the recompilation in the later jobs still happens, while at the same time, the build step succesfully builds nothing if no actual code changes happened (but the steps after it still do!)