One thing you can try is to run those particular tests as:
elixir --erl "+T 9" -S mix test path/to/test/file
And see if it reproduces the issue more frequently. Basically, we need a mechanism to reproduce the issue consistently so we can investigate the root cause and work on a fix.