X-Loop: help-debbugs@HIDDEN Subject: bug#20716: TAP Protocol skip is not recognized. Resent-From: "Arthur Schwarz" <aschwarz1309@HIDDEN> Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> Resent-CC: bug-automake@HIDDEN Resent-Date: Mon, 01 Jun 2015 22:08:02 +0000 Resent-Message-ID: <handler.20716.B.143319647912522 <at> debbugs.gnu.org> Resent-Sender: help-debbugs@HIDDEN X-GNU-PR-Message: report 20716 X-GNU-PR-Package: automake X-GNU-PR-Keywords: To: 20716 <at> debbugs.gnu.org X-Debbugs-Original-To: <bug-automake@HIDDEN> Received: via spool by submit <at> debbugs.gnu.org id=B.143319647912522 (code B ref -1); Mon, 01 Jun 2015 22:08:02 +0000 Received: (at submit) by debbugs.gnu.org; 1 Jun 2015 22:07:59 +0000 Received: from localhost ([127.0.0.1]:36461 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1YzXsE-0003Fu-8P for submit <at> debbugs.gnu.org; Mon, 01 Jun 2015 18:07:58 -0400 Received: from eggs.gnu.org ([208.118.235.92]:41921) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from <aschwarz1309@HIDDEN>) id 1YzXsB-0003Fb-Hl for submit <at> debbugs.gnu.org; Mon, 01 Jun 2015 18:07:56 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from <aschwarz1309@HIDDEN>) id 1YzXs5-0005fg-96 for submit <at> debbugs.gnu.org; Mon, 01 Jun 2015 18:07:50 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: * X-Spam-Status: No, score=1.1 required=5.0 tests=BAYES_50, FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FROM,T_DKIM_INVALID autolearn=disabled version=3.3.2 Received: from lists.gnu.org ([2001:4830:134:3::11]:57451) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from <aschwarz1309@HIDDEN>) id 1YzXs5-0005fc-5Z for submit <at> debbugs.gnu.org; Mon, 01 Jun 2015 18:07:49 -0400 Received: from eggs.gnu.org ([2001:4830:134:3::10]:55421) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from <aschwarz1309@HIDDEN>) id 1YzXs3-0001o3-Us for bug-automake@HIDDEN; Mon, 01 Jun 2015 18:07:49 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from <aschwarz1309@HIDDEN>) id 1YzXs0-0005eH-Hf for bug-automake@HIDDEN; Mon, 01 Jun 2015 18:07:47 -0400 Received: from nm12-vm8.access.bullet.mail.gq1.yahoo.com ([216.39.63.220]:38522) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from <aschwarz1309@HIDDEN>) id 1YzXs0-0005dy-6o for bug-automake@HIDDEN; Mon, 01 Jun 2015 18:07:44 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=att.net; s=s1024; t=1433196462; bh=Izcg2PzfHbwr2nPc0RrdxSYqZ1cx3o4y8t1pm2UxpVM=; h=From:To:Subject:Date:From:Subject; b=gjvDTSS9GPtnnqoFRtIzDyYor33DQdOPFTds8gP1d0iNUzBrdPLIN2Z6imgajpZFwBFR0JEYeQ0Ygg1Br7XAYbaNAlWCOgMOvN9rWfKvOXKdqmt5gcG2gvZNFTeCOCfNfNrkQCoBjihPuyTVVnVgdLb3kvJiLjXth+8RpXazW3s= Received: from [216.39.60.176] by nm12.access.bullet.mail.gq1.yahoo.com with NNFMP; 01 Jun 2015 22:07:42 -0000 Received: from [98.138.226.240] by tm12.access.bullet.mail.gq1.yahoo.com with NNFMP; 01 Jun 2015 22:07:42 -0000 Received: from [127.0.0.1] by smtp111.sbc.mail.ne1.yahoo.com with NNFMP; 01 Jun 2015 22:07:42 -0000 X-Yahoo-Newman-Id: 129785.17779.bm@HIDDEN X-Yahoo-Newman-Property: ymail-3 X-YMail-OSG: Fm3xjxkVM1kxHYVstc9Z2n.gIJW7n2abCJIwOynSnH5iZlb hsBwk1Chdu4V3CVPCDPPz96EJoqoU4sTADSpLXJ4hU3GX.a4qpKjd1rnfxYU EgI27CKnP_gyPjx1N3dtLNHXFaoUkRexPl5AjlcXtKDpFiTeM68cZ_3hJT7v pBb.533J5Rzru5bXgBWcyd6dQCiSsbDJyCcq2GQtEXaqWZJtRQaiFDEFi3vu T6U14Dw8pva_HooMjBj36LAVCFnwq8bFXil2Or5zhTNpo4M_StRF5F2d5SEc isg6Zwj0Bvu5HytT1EcDRBu.JXEt98qsp_Bw2s4hIs9fyWzTcubMyMcCXTxQ MOApOTTk.B_EqLk1GnWlYn0L3gJBXxd4WDMDT1KrTW346MAZVN0u91xQBjfZ K116ZG_rypbjZUhn7JB3uzxyLEj3dN9UgAjS38i1nD_u7LIRScvvUnYkqlnW ccJ0cxY1jo6IQqRfpqOduKU0w50H0l0nmEiZoj2pk3ZuSA5bb_.5JhJ1n_P2 Mu.IKW5KVsTTnRR35QAxIOpYjDQBkcRT.KoEPoXrvg8CcEug4aql6 X-Yahoo-SMTP: 0z5TJLmswBDohOc2QznCIeoaEiEalQiTSMLFNdKdTt4t From: "Arthur Schwarz" <aschwarz1309@HIDDEN> Date: Mon, 1 Jun 2015 15:07:41 -0700 Message-ID: <AE36878613BF40F7B517E2E6A2314068@HPDV7TNotebook> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Office Outlook 11 X-MimeOLE: Produced By Microsoft MimeOLE V6.1.7601.17609 Thread-Index: AdCct2FCGPhIAsXfRIm2r63+5rzmhw== X-detected-operating-system: by eggs.gnu.org: GNU/Linux 3.x X-detected-operating-system: by eggs.gnu.org: Error: Malformed IPv6 address (bad octet value). X-Received-From: 2001:4830:134:3::11 X-Spam-Score: -4.7 (----) X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -4.7 (----) http://testanything.org/ DIRECTIVES Directives are special notes that follow a # on the test line. Only two are currently defined: TODO and SKIP. Note that these two keywords are not case-sensitive. The tap-driver.sh does accept 'ok # skip' but requires 'ok # SKIP'. The TAP standard says that skip is not case sensitive (it is case insensitive?). It is reported as XPASS (because TAP_LOG_DRIVER_FLAGS = --expect-failure yes) but a test-plan of 1..0 is reported as SKIP. This seems inconsistent. If I have 1..1 ok # SKIP Is reported as XPASS: test2.tap 1 ================================= Testsuite summary for test 0.5 ================================= # TOTAL: 1 # PASS: 0 # SKIP: 0 # XFAIL: 0 # FAIL: 0 # XPASS: 1 # ERROR: 0 ================================= See src/test-suite.log ================================ test2.trs :global-test-result: FAIL :recheck: yes :copy-in-global-log: yes :test-result: XPASS while 1..0 Is reported as SKIP: test2.tap ================================= Testsuite summary for test 0.5 ================================= # TOTAL: 1 # PASS: 0 # SKIP: 1 # XFAIL: 0 # FAIL: 0 # XPASS: 0 # ERROR: 0 ================================= Test2.tap :global-test-result: SKIP :recheck: no :copy-in-global-log: yes :test-result: SKIP And what is also interesting is that the output is also different. No test-suite.log file (seems ok except I would expect some indication) and, since this is the TAP protocol, I would expect that Diagnostics would be captured in a test-suite.log as is indicated in the ':copy-in-global-log:' yes metadata tag.
Content-Disposition: inline Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Mailer: MIME-tools 5.503 (Entity 5.503) Content-Type: text/plain; charset=utf-8 X-Loop: help-debbugs@HIDDEN From: help-debbugs@HIDDEN (GNU bug Tracking System) To: "Arthur Schwarz" <aschwarz1309@HIDDEN> Subject: bug#20716: Acknowledgement (TAP Protocol skip is not recognized.) Message-ID: <handler.20716.B.143319647912522.ack <at> debbugs.gnu.org> References: <AE36878613BF40F7B517E2E6A2314068@HPDV7TNotebook> X-Gnu-PR-Message: ack 20716 X-Gnu-PR-Package: automake Reply-To: 20716 <at> debbugs.gnu.org Date: Mon, 01 Jun 2015 22:08:02 +0000 Thank you for filing a new bug report with debbugs.gnu.org. This is an automatically generated reply to let you know your message has been received. Your message is being forwarded to the package maintainers and other interested parties for their attention; they will reply in due course. Your message has been sent to the package maintainer(s): bug-automake@HIDDEN If you wish to submit further information on this problem, please send it to 20716 <at> debbugs.gnu.org. Please do not send mail to help-debbugs@HIDDEN unless you wish to report a problem with the Bug-tracking system. --=20 20716: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D20716 GNU Bug Tracking System Contact help-debbugs@HIDDEN with problems
GNU bug tracking system
Copyright (C) 1999 Darren O. Benham,
1997 nCipher Corporation Ltd,
1994-97 Ian Jackson.