This is most likely related to loading of the modules. The VM can run in two modes: interactive that loads modules on first use and embedded that requires loading all the modules explicitly. The first is used by things like mix and iex and the later by releases. The slowness of the first test you see is most likely related to this lazy loading of the modules.
2 Likes
