Assertions are named dynamically

From Test Anything Protocol

Jump to: navigation, search

[edit] Critique

MediaWiki's automated testing produces output like this:

   * HTML nested bullet list, open tags (bug 5497)  [Has never passed]
   * HTML nested ordered list, open tags (bug 5497)  [Has never passed]
   * Fuzz testing: image with bogus manual thumbnail  [Introduced between 08-Apr-2007 07:15:22, 1.10alpha (r21099) and 25-Apr-2007 07:15:46, 1.10alpha 

That implies that each test assertion has a permanent identifier that allows it to be tracked across test runs.

TAP assertions have a test number which will change if assertions are added or removed before it and descriptive text which may change at the whim of whoever wrote the test.

[edit] Answer

The numbers are purely an accounting thing, not an identifier. Don't use them as such on pain of pain.

The Mediawiki "permanent identifiers" appear to be human readable, user entered strings associated with a test. Sounds a lot like a TAP description. How does Mediawiki prevent them from being changed? Apply the same technique to TAP descriptions.

That said, there is a drive to have some sort of globally unique test identifier to allow it to be tracked across multiple test runs. We don't know what form this will take but it will most likely be a field just for cross-run identification rather than having descriptions play double duty.

--Schwern 20:05, 13 April 2008 (BST) ghd straighteners outlet so good

Personal tools