Hey,
I was having the same issue in my project. I rely on mix test --no-start because of my dependency on local-cluster; in my case, I got the previous quiet output in my tests by configuring the Logger module at runtime in test_helpers.exs, adding a Logger.configure([level: :warning]) call.
