And on top of that, there is the whole Elixir standard library and the modules in your libraries, that will only be loaded when use the first time, and most likely are not loaded when your app boots.
This is precisely why you can do mix test --trace --preload-modules
, as the loading does skew test measurement times.