I need a framework for integration testing in ELixir.
It seems that ExUnit lacks the creation of folders, HTML files, and complete isolation of tests, and logging of when something goes wrong exactly when.
So I was thinking using common test from Erlang which is made for black box/whitebox testing.
THere is a package commoner, I tried it, but it is full of warning and old.
So I run ct_run directly on an erlang test suite.
Then I think I run Elixir programs from Erlang as external processes.
Is this a good way to go ?
Isn’t it better to use a framework like python that is also common for integration testing ?
What kind of integration tests are we talking about? What framework you are already using and what kind of application you want to test?
These are pretty strong claims, from which most are completely wrong, have you read the official documentation before getting started? It is also wise to read documentation of the libraries/frameworks you are using, as most of them have guides and utilities for testing.
Can you elaborate on what you mean by this? Why would a language level test framework make HTML files? What even do you need an HTML file for in your test?
Tangentially if you are looking for a temporary file / folder package for making files that get cleaned up check out Briefly Usage Guide — briefly v0.5.1
Integration testing is needed to run my elixir application inside systemd --user, using server mock (nodejs). And to run 1000 tests during a long time in different orders, and to generate data and run. I do not really need common test. I could do exactly the same thing in ruby or python, it is like shell scripting. But I need the folder that keeps track of temporary files and I need html reports.
Depending on the use-case, ExUnit can be used for integration tests, after all this is a fully-fledged test suite that starts the entire application. The specific requirements outlined in that article don’t seem to be something of industry standard, at least I’ve never seen it done like this where I worked at, so I’m not sure you can expect this to be fully officially supported.
From what you are writing you are most probably looking for an external tool to do this kind of testing and from elixir side all you have to do is start your server?
The gap between ExUnit and Erlang-common test is similar to the gap between Eunit and COmmont test in 100% Erlang.
So you can see better what I mean since it is better documented after many years in use.
However, I could do my stuff in Python. That seems simpler and more current.
I would need to run Elixir external programs from Erlang so that would be the same.
I more and more start to think Python would be better than running common test.
To answer you about the need of HTML,
in the continuous integration, instead of having a long long that end success or fail, you can have a web page that details shich tests failed in a structured way, and you can also list the tests in a nice way with requirements.
