ExUnit - Generate test cases dynamically inside a describe block

Not sure if it will always work, but you could try moving your API call outside of any setup block, and assign the array of values to a module attribute. Then for value <- @values do the test definition. Test name may need to be unique. Because test files are .exs the api call would run when you run the tests I think.

But I would probably use one test, eventually you could compute what would be expected vs actual for all test inputs and then compare a big map to have always a complete diff in the assertion

There is no such feature in ExUnit, I am a trying to write something like that, but for now what you can do is:

for value <- YourModule.generate_test_data() do
  test "check if #{value} is frindricated" do
    assert frindricated?(unquote(value))
  end
end

Alternatively you can do:

setup_all do
  {:ok, values: YourModule.generate_test_data()}
end

test "check if all values are frindricated", %{values: values} do
  assert Enum.all?(values, &frindricated?/1)
end

Or you can use test tags for that:

@tag values: YourModule.generate_test_data()
test "check if all values are frindricated", %{values: values} do
  assert Enum.all?(values, &frindricated?/1)
end

yup, basically what I suggested but these examples look like they will compile