Disambiguate test diagnostics
From Test Anything Protocol
Contents |
[edit] Status
This proposal is largely supplanted by the TAP diagnostic syntax and the TAP meta information. It is considered to be rejected.
[edit] For
[edit] Against
- Schwern 23:47, 4 September 2007 (BST)
- AndyArmstrong 00:04, 5 September 2007 (BST)
- Adrianh 16:48, 9 September 2007 (BST)
[edit] Proposal
Currently we output diagnostic messages from tests like:
not ok 5 - got a fribble # got: ack # expected: fribble
and non-test related diagnostics like:
# begin foo tests ok 1 - made foo ok 2 - destroyed foo
in the same way.
This makes it impossible for TAP parsers to associate test diagnostics with the tests that caused them.
It would be nice if we could disambiguate the two cases so we could, for example, have a GUI test running that could show/hide the diagnostics associated with particular test failures.
Suggested solution: Use "##" as the prefix for test related diagnostics, with the rule that they always relate to the previous test. So you would have something like:
# begin foo tests ok 1 - made foo ok 2 - destroyed foo not ok 5 - got a fribble ## got: ack ## expected: fribble
