[PATCH] Add a TEST-OP-TEST-FAILURE condition for test libraries to sub-class

[Mark Evenson]

> On Sep 15, 2019, at 05:07, Vladimir Sedach <vas at oneofus.la> wrote:
> 
> Hello!
> 
> I recently wrote a script to run FiveAM tests for one of my
> libraries on many different implementations on your own machine:
> https://gitlab.common-lisp.net/uri-template/uri-template2/blob/master/run-tests.lisp
> 
> It would be really nice if I did not have to copy-paste that script
> to my other libraries, and instead could contribute a generalized
> version to Roswell (on which the script is based) and have it work
> for any project using any test library.
> 
> What I would like to be able to do, for any system:
> 
> (handler-case (asdf:test-system "system")
>  (asdf:test-op-test-failure (condition)
>    (princ condition uiop:*stderr*)
>    (uiop:quit 1)))

[Last year for Emotiq][emotiq] I implemented such a proposal as [asdf-test-harness][] to the maturity needed for us to use as part of Continuout Integration for all our commits.

Each flavor of testing framework needs to write a simple adaptor that returns a condition containing a boolean indicating success or failure and the testing framework specific results.  

It’s been a while so please press me on the claim that my code would be more mature, as it has been enough time that I don’t remember writing the code at the moment…

[emotiq]:             https://github.com/easye/emotiq/
[asdf-test-harness]:  https://github.com/easye/asdf-test-harness/