GNU bug report logs - #20716
TAP Protocol skip is not recognized.

Message received at submit <at> debbugs.gnu.org:

Received: (at submit) by debbugs.gnu.org; 1 Jun 2015 22:07:59 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Jun 01 18:07:58 2015
Received: from localhost ([127.0.0.1]:36461 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1YzXsE-0003Fu-8P
	for submit <at> debbugs.gnu.org; Mon, 01 Jun 2015 18:07:58 -0400
Received: from eggs.gnu.org ([208.118.235.92]:41921)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <aschwarz1309@HIDDEN>) id 1YzXsB-0003Fb-Hl
 for submit <at> debbugs.gnu.org; Mon, 01 Jun 2015 18:07:56 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <aschwarz1309@HIDDEN>) id 1YzXs5-0005fg-96
 for submit <at> debbugs.gnu.org; Mon, 01 Jun 2015 18:07:50 -0400
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org
X-Spam-Level: *
X-Spam-Status: No, score=1.1 required=5.0 tests=BAYES_50,
 FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FROM,T_DKIM_INVALID autolearn=disabled
 version=3.3.2
Received: from lists.gnu.org ([2001:4830:134:3::11]:57451)
 by eggs.gnu.org with esmtp (Exim 4.71)
 (envelope-from <aschwarz1309@HIDDEN>) id 1YzXs5-0005fc-5Z
 for submit <at> debbugs.gnu.org; Mon, 01 Jun 2015 18:07:49 -0400
Received: from eggs.gnu.org ([2001:4830:134:3::10]:55421)
 by lists.gnu.org with esmtp (Exim 4.71)
 (envelope-from <aschwarz1309@HIDDEN>) id 1YzXs3-0001o3-Us
 for bug-automake@HIDDEN; Mon, 01 Jun 2015 18:07:49 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <aschwarz1309@HIDDEN>) id 1YzXs0-0005eH-Hf
 for bug-automake@HIDDEN; Mon, 01 Jun 2015 18:07:47 -0400
Received: from nm12-vm8.access.bullet.mail.gq1.yahoo.com
 ([216.39.63.220]:38522) by eggs.gnu.org with esmtp (Exim 4.71)
 (envelope-from <aschwarz1309@HIDDEN>) id 1YzXs0-0005dy-6o
 for bug-automake@HIDDEN; Mon, 01 Jun 2015 18:07:44 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=att.net; s=s1024;
 t=1433196462; bh=Izcg2PzfHbwr2nPc0RrdxSYqZ1cx3o4y8t1pm2UxpVM=;
 h=From:To:Subject:Date:From:Subject;
 b=gjvDTSS9GPtnnqoFRtIzDyYor33DQdOPFTds8gP1d0iNUzBrdPLIN2Z6imgajpZFwBFR0JEYeQ0Ygg1Br7XAYbaNAlWCOgMOvN9rWfKvOXKdqmt5gcG2gvZNFTeCOCfNfNrkQCoBjihPuyTVVnVgdLb3kvJiLjXth+8RpXazW3s=
Received: from [216.39.60.176] by nm12.access.bullet.mail.gq1.yahoo.com with
 NNFMP; 01 Jun 2015 22:07:42 -0000
Received: from [98.138.226.240] by tm12.access.bullet.mail.gq1.yahoo.com with
 NNFMP; 01 Jun 2015 22:07:42 -0000
Received: from [127.0.0.1] by smtp111.sbc.mail.ne1.yahoo.com with NNFMP;
 01 Jun 2015 22:07:42 -0000
X-Yahoo-Newman-Id: 129785.17779.bm@HIDDEN
X-Yahoo-Newman-Property: ymail-3
X-YMail-OSG: Fm3xjxkVM1kxHYVstc9Z2n.gIJW7n2abCJIwOynSnH5iZlb
 hsBwk1Chdu4V3CVPCDPPz96EJoqoU4sTADSpLXJ4hU3GX.a4qpKjd1rnfxYU
 EgI27CKnP_gyPjx1N3dtLNHXFaoUkRexPl5AjlcXtKDpFiTeM68cZ_3hJT7v
 pBb.533J5Rzru5bXgBWcyd6dQCiSsbDJyCcq2GQtEXaqWZJtRQaiFDEFi3vu
 T6U14Dw8pva_HooMjBj36LAVCFnwq8bFXil2Or5zhTNpo4M_StRF5F2d5SEc
 isg6Zwj0Bvu5HytT1EcDRBu.JXEt98qsp_Bw2s4hIs9fyWzTcubMyMcCXTxQ
 MOApOTTk.B_EqLk1GnWlYn0L3gJBXxd4WDMDT1KrTW346MAZVN0u91xQBjfZ
 K116ZG_rypbjZUhn7JB3uzxyLEj3dN9UgAjS38i1nD_u7LIRScvvUnYkqlnW
 ccJ0cxY1jo6IQqRfpqOduKU0w50H0l0nmEiZoj2pk3ZuSA5bb_.5JhJ1n_P2
 Mu.IKW5KVsTTnRR35QAxIOpYjDQBkcRT.KoEPoXrvg8CcEug4aql6
X-Yahoo-SMTP: 0z5TJLmswBDohOc2QznCIeoaEiEalQiTSMLFNdKdTt4t
From: "Arthur Schwarz" <aschwarz1309@HIDDEN>
To: <bug-automake@HIDDEN>
Subject: TAP Protocol skip is not recognized.
Date: Mon, 1 Jun 2015 15:07:41 -0700
Message-ID: <AE36878613BF40F7B517E2E6A2314068@HPDV7TNotebook>
MIME-Version: 1.0
Content-Type: text/plain;
	charset="us-ascii"
Content-Transfer-Encoding: 7bit
X-Mailer: Microsoft Office Outlook 11
X-MimeOLE: Produced By Microsoft MimeOLE V6.1.7601.17609
Thread-Index: AdCct2FCGPhIAsXfRIm2r63+5rzmhw==
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 3.x
X-detected-operating-system: by eggs.gnu.org: Error: Malformed IPv6 address
 (bad octet value).
X-Received-From: 2001:4830:134:3::11
X-Spam-Score: -4.7 (----)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -4.7 (----)

http://testanything.org/

DIRECTIVES

Directives are special notes that follow a # on the test line. Only two are
currently defined: TODO and SKIP. Note that these two keywords are not
case-sensitive.

The tap-driver.sh does accept 'ok # skip' but requires 'ok # SKIP'. The TAP
standard says that skip is not case sensitive (it is case insensitive?).

It is reported as XPASS (because TAP_LOG_DRIVER_FLAGS = --expect-failure
yes) but a test-plan of 1..0 is reported as SKIP. This seems inconsistent. 

If I have
    1..1
    ok # SKIP

Is reported as

XPASS: test2.tap 1
=================================
Testsuite summary for test 0.5
=================================
# TOTAL: 1
# PASS:  0
# SKIP:  0
# XFAIL: 0
# FAIL:  0
# XPASS: 1
# ERROR: 0
=================================
See src/test-suite.log
================================

test2.trs
:global-test-result: FAIL
:recheck: yes
:copy-in-global-log: yes
:test-result: XPASS

while
    1..0

Is reported as

SKIP: test2.tap
=================================
Testsuite summary for test 0.5
=================================
# TOTAL: 1
# PASS:  0
# SKIP:  1
# XFAIL: 0
# FAIL:  0
# XPASS: 0
# ERROR: 0
=================================

Test2.tap
:global-test-result: SKIP
:recheck: no
:copy-in-global-log: yes
:test-result: SKIP

And what is also interesting is that the output is also different. No
test-suite.log file (seems ok except I would expect some indication) and,
since this is the TAP protocol, I would expect that Diagnostics would be
captured in a test-suite.log as is indicated in the ':copy-in-global-log:'
yes metadata tag.