How to rerun only failed tests?

Questions / Help
,
1

Is it any similar to mix test --failed?

1 Like
2

There is no such a thing.

But you can use mix test --stale to run all tests that depend on your changed code.

In case of failures all tests that were run in the last run will be repeated until you get a successfull run.

1 Like
3

This exact feature was added a few weeks ago. In fact, it was added by Myron Marston (who had implemented the behavior in rspec originally).

Here is the PR for the second half https://github.com/elixir-lang/elixir/pull/7373, it is an awesome demonstration of open source collaboration.

4 Likes
4

But it seems not to be in elixir 1.6.3. I can’t find it in the changelog. Also I wasn’t able to locate the newly added files on the 1.6.3 tag.

5

Sorry, I should have been clearer. It has hit master, but it hasn’t been released. I believe it is targeted at the 1.7 release. Then again, I had nothing to do with the PR and don’t plan the releases, so take that cum grano salis.

1 Like
6

I do this with a custom test formatter (a copy of ExUnit.CLIFormatter) that saves the filenames of the failed tests in the handle_cast function that deals with test failures.

You can get the failed test file and line number from that function by pattern matching:

  def handle_cast({:test_finished, %ExUnit.Test{tags: %{file: file, line: line}, state: {:failed, failures}} = test}, config) do

I add those to the config, and then in print_suite I read them out of the config and save them to a file.

I then have a mix task called retest that runs mix test with the contents of that file as arguments. Note that when passing multiple test files to mix test, you cannot include line numbers (at least in Elixir 1.5).

Then, when I have failures, I just run retest over and over until I’ve fixed all the failures.

2 Likes
7

Probably a bit late to the party :smiley: .

You can now run only the previously failed tests by running mix test --failed
Documentation can be found here

3 Likes