tox does not generate error messages

[damorim]

Please check how to capture error messages when running tox. I forgot to configure the JS engines in my environment (add binaries under js_engines) and could not see any indication of what was happening besides a FAIL in test cases.

[igor-simoes]

I wrote a script that checks if radamsa and the engines are installed on environment (before run our tests).
Keep updating this issue if you (or me) encounter new problems on tox.

[damorim]

Thanks. That's good.

But what I meant was to see meaningful error messages if something bad if a test fails. I think what we should do is to separate two kinds of executions: regression_tests and fuzzing. In regression_test it is fine if multiple tests fail. it indicates a problem in our infrastructure and if that happens it we should not proceed with fuzzing, which should depend on that target (using make terminology). In the fuzzing target, no test should fail. A failing execution indicates that something is broken in our infrastructure--we should stop immediately.