Hello everyone,

I’m trying to run ExUnit tests from the shell, and I almost got it working:

iex(2)> ExUnit.start(autorun: false)                                                                            
:ok
iex(3)> test_file = "test/sample_test.exs"
"test/sample_test.exs"
iex(4)> Mix.Compilers.Test.require_and_run([test_file], ["test"], formatters: [ExUnit.CLIFormatter])

........

Finished in 3.6 seconds
8 tests, 0 failures
{:ok, %{excluded: 0, failures: 0, skipped: 0, total: 8}}

So far so good, but the second run of Mix.Compilers.Test.require_and_run/3 doesn’t seem to do anything:

iex(5)> Mix.Compilers.Test.require_and_run([test_file], ["test"], formatters: [ExUnit.CLIFormatter])

Finished in 0.00 seconds
0 failures

{:ok, %{excluded: 0, failures: 0, skipped: 0, total: 0}}

It looks like the test compiler caches the test results. If that’s the case, can it be forced to invalidate it and run the tests from scratch again?