schnittchen
Excessive recompilations when nothing substantially changed
Hi,
I’m trying to track down why my testing experience is such a pain because there’s always many files being compiled… I’ve used the inotify trick from Understanding Elixir's recompilation · Milhouse to see which files these are (is there a simpler way?) and tried to understand from mix xref why those files were compiled.
So there’s runtime, compile time and exports dependencies, I learned from mix help xref. So when I do a trivial change like adding a newline in a source file, only compile time dependencies should trigger a recompile.
If I change file A, all files having a (transitive) compile time dependency on A would need to be recompiled.
This lead me to use mix xref graph --label compile --only-direct because my reasoning is that this would show me all non-transitive compile time dependencies, and I should be able to traverse from the changed file to every compiled file via a graph node connection in the output of this command.
Here’s a snippet from the output, the email.ex file has only one dependency shown.
lib/my_app/email.ex
└── lib/my_app/views/mailer_view.ex (compile)
The email file was recompiled when I made a trivial change in a file which, according to mix xref (with the invocation above), was not connected at all to the email file.
I must have some misconception here.
Most Liked
schnittchen
Thanks for the advice, I quickly found the culprit:
I had compile time dependencies from the router to two controllers. Because those controllers had a transitive run time dependency back to the router (redirects using route helpers) and from there to every other controller, changing any controller required the router to be recompiled.
The fix:
# change this:
get "/", MyApp.FooController, :index
# to this:
scope alias: MyApp do
get "/", FooController, :show
end
simply because now the fully qualified module name of the controller it no longer present in the router.
Two other things I did/tried:
elixirc_options: [verbose: true]
in the project/0 callback of the MixFile, which made the effective dependency chain more obvious.
I also tried setting
config :phoenix, :plug_init_mode, :runtime
not only in dev mode, but in test mode as well, assuming that plug initialization would otherwise happen at compile time and that that would also be the case for the controllers being routed to (since they are plugs as well), but I was wrong here, the default :compile does not make all controllers compile time dependencies of the router.
schnittchen
I got tired of analyzing the output of mix xref so I wrote a thing… If you run into this problem please check out GitHub - schnittchen/why_did_recompile and help me improve it
axelson
Have you given DepViz a try?
I spoke about it at Code BEAM BR last year (in english): https://www.codebeambr.com/video/12
That is not quite accurate, an alias will only cause a run-time dependency. However, compile-time dependencies are transitive so if A->compile-time->B and B->run-time->C, then when C changes, A will need to be recompiled.







