katafrakt

katafrakt

Suppose I have a code like this:

defmodule Spy do
  @analytics Application.compile_env!(:spy, :analytics)

  def create_article(params) do
    case insert_article(params) do
      {:ok, article} ->
        @analytics.record(:article_created, article)
        if params.published, do: @analytics.record(:article_published, article)
      
      {:error, error} -> {:error, error}
    end
  end

  defp insert_article(params) do
    id = :rand.uniform(1000)
    {:ok, Map.put(params, :id, id)}
  end
end

A typical tests for it would look like this:

defmodule SpyTest do
  use ExUnit.Case
  import Hammox

  defmock(AnalyticsMock, for: Analytics)

  test "old approach: not published" do
    expect(AnalyticsMock, :record, fn :article_created, payload ->
      assert payload.title == "Test"
      :ok
    end)

    Spy.create_article(%{title: "Test", published: false})
  end

  test "old approach: published" do
    expect(AnalyticsMock, :record, fn :article_created, payload ->
      assert payload.title == "Test"
      :ok
    end)

    expect(AnalyticsMock, :record, fn :article_published, payload ->
      assert payload.title == "Test"
      :ok
    end)

    Spy.create_article(%{title: "Test", published: true})
  end
end

While this of course works, it provides a couple disadvantages in my opinion:

  • You don’t follow “arrange-act-assert”, as you actually assert at the beginning
  • In case of testing for publish, you have to add both expectations in a single test case, otherwise you’d get an error.

As a result, I’ve been thinking about bending Hammox to my will a bit and force it to act more like a spy, where I record the interactions somehow and assert about them in the end. Of course, it should ideally work with async tests.

I came up with something like this:

defmodule SpyTest do
  use ExUnit.Case
  import Hammox

  defmock(AnalyticsMock, for: Analytics)

  defmodule AnalyticsStub do
    @behaviour Analytics
    def record(event, payload) do
      send(self(), {:analytics, event, payload})
    end
  end

  describe "new approach" do
    setup do
      stub_with(AnalyticsMock, AnalyticsStub)
      :ok
    end

    test "not published" do
      Spy.create_article(%{title: "Test", published: false})
      assert_received({:analytics, :article_created, payload})
      assert payload.id > 0
    end

    test "published - record creation" do
      Spy.create_article(%{title: "Test", published: true})
      assert_received({:analytics, :article_created, _})
    end

    test "published - record publish" do
      Spy.create_article(%{title: "Test", published: true})
      assert_received({:analytics, :article_published, _})
    end
  end
end

To me it reads much better and I wonder: is someone using an approach like this already? Or maybe there’s a different tool for that? If not, could it be a terrible idea for some reason I don’t yet see?

It might need some setup to ensure the process inbox is empty before running the test, but it is doable and aside from that?

Showing Posts 1 to 2

schneebyte

schneebyte

That sounds like trace based testing - Testing System/Unit Behaviour Using Traces/Logs/Signals

The example might be easier to test if its decoupled and the create_article just publishes an event {:article_created, article} that your analytics stuff (or your tests) can subscribe to.

katafrakt

katafrakt OP

Yes, I read that topic later tonight, thinking that it might be what I’m after :wink:

As for publishing event - sure, but I’d want to “spy” on this event bus to check what was pushed to it anyway. So it’s in a way the same problem, but with a different module.

— All posts loaded —

Where Next? Top

Trending in Questions Top

katta
I having some trouble figuring out if I have set myself too strict of standards for my production server. Currently I can handle 75% of r...
New
brecabral
Documentation While reading the Scoped Routes section, I noticed that the documentation currently refers to a problem without explainin...
New
nseaSeb
Hello, I know there is an approach for handling lists that allows for optimized traversal, but I can’t recall the specific method (somet...
New
kpanic
Hi everyone, I am toying with the idea of building a “match maker” for giving personal help to people that wants to start coding. I sta...
New
velrest
So my question is quite simple and i have found no conclusive answer on forum, google or AI. Should we use :erlang.float for Integer to ...
New
asweet-confluent
I recently noticed that Elixir’s Logger defaults its primary log level to :debug when no :logger, :level application configuration is pre...
New
apz
I’m new to elixir and just tried to install the elixirLS extension for VScode(ium) and it is throwing some errors that I would like help ...
New

Other Trending Topics Top

GenericJam
Edit: 2026 May 15 - This post is archived. Mob is alive!! Main docs: mob v0.7.11 — Documentation A bit of explanation for the slightly c...
New
JesseHerrick
Hey, I’m Jesse and I’m the main contributor behind Dexter, a full-featured, lightning-fast Elixir LSP optimized for large codebases. It s...
New
mudasobwa
I am happy to introduce the very α version of the new programming language compiled to BEAM. Welcome Cure. It has literally three kille...
New
garrison
Hobbes is a low-level distributed database for the Elixir programming language. Hobbes provides a simple, safe, and scalable storage lay...
New
mhanberg
Hi everyone! The first release candidate for the Expert language server project is now available! We’ve published a press release detai...
New
budgie
A little off-topic, but I feel like people here have a good head on their shoulders. I used to be quite good at making software. Was luc...
New

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews