Received: (at 20693) by debbugs.gnu.org; 29 May 2015 22:15:26 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Fri May 29 18:15:26 2015 Received: from localhost ([127.0.0.1]:60905 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1YySYo-00044B-CS for submit <at> debbugs.gnu.org; Fri, 29 May 2015 18:15:26 -0400 Received: from nm8-vm2.access.bullet.mail.bf1.yahoo.com ([216.109.114.177]:57453) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from <aschwarz1309@HIDDEN>) id 1YySYm-00043y-Bh for 20693 <at> debbugs.gnu.org; Fri, 29 May 2015 18:15:25 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=att.net; s=s1024; t=1432937719; bh=DQ+QAVqw0Jmrl0EsOlWm4L2Z8GFD9/i2wXbn5+n/8Aw=; h=From:To:Cc:References:In-Reply-To:Subject:Date:From:Subject; b=SnwUdeDt17PDQfV5bserdFs4XaHc6j62bYqpkHYr0azojPfBdTCJruAp5lmTPsL5Jokaau1lZI10mveSAWlye6syioM9QVbwjtdW/4BvbiJSMjAqAfzUWuYM9fpRi/u910Eo1MpmcoTOHviDvs9DYX4KSXUrkrS2rCvdBGRQeM8= Received: from [66.196.81.162] by nm8.access.bullet.mail.bf1.yahoo.com with NNFMP; 29 May 2015 22:15:19 -0000 Received: from [98.138.226.241] by tm8.access.bullet.mail.bf1.yahoo.com with NNFMP; 29 May 2015 22:15:19 -0000 Received: from [127.0.0.1] by smtp112.sbc.mail.ne1.yahoo.com with NNFMP; 29 May 2015 22:15:18 -0000 X-Yahoo-Newman-Id: 876895.32270.bm@HIDDEN X-Yahoo-Newman-Property: ymail-3 X-YMail-OSG: Ch_2RT0VM1neXmldjBeGrsOYO7TLbbWJiyEd2AifwRcpvbU 3Ey8h1k5xuFV7BmNQrgT9iS8vR2jnlj5X_OEs0oxBJ6UhIz7BwMpSilWWtKh 1Ih7dOdoP65dtq3QVMTnIbkm7AItG3Sk8S8C7mVwgj4RF48MLTueHOyUAchn t6rgjrgUNUx0Kq6skKweyP9mRhvGi7fSZTpjQuiLYk_AZ.XNcoWK0cGPOHhD PKoxrTrHKjGMtFXjQNtoOt9GmB8p1lDlJhkwXVXOtqFgdrHgao_rJuVXLtlB yPwC5ORgNO1qS_D8EtWOTRbziucgHR9pTqVq5OZ6oI7Iq81HaXVNDAet.Smy asNCOELN911q8m.3jM.d9SxLTajf6E3w3a588qkAgaK_Khq2v1tqwHqXSv40 dcuJP2Lm82XLJWxjrE1Cr5qiCPhV9WbH8u8WWQ4vHB0fntYv0LJBt59HCn4J xb8I8Twq8ixyRYIz3jgrkpRgSvT2SmAdSF4dZZCgMwFk0DiEjY2hFK3Sv9.c y370CF1T0W.J9.QgIPvUrRdAvkuT3nTVoNbywH0tHVA-- X-Yahoo-SMTP: 0z5TJLmswBDohOc2QznCIeoaEiEalQiTSMLFNdKdTt4t From: "Arthur Schwarz" <aschwarz1309@HIDDEN> To: "'Nick Bowler'" <nbowler@HIDDEN> References: <88E8A9325FEB4AF482785AD592E22EA3@2600kPC> <20150529171127.GA27194@HIDDEN> In-Reply-To: <20150529171127.GA27194@HIDDEN> Subject: RE: bug#20693: SKIP not counted in TAP Date: Fri, 29 May 2015 15:15:14 -0700 Message-ID: <C9B2480AC4E04A96AD88D3E88EA263AB@HPDV7TNotebook> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Office Outlook 11 Thread-Index: AdCaMqH1uS9ziMH5SJijZa6IB48RugAKGqBw X-MimeOLE: Produced By Microsoft MimeOLE V6.1.7601.17609 X-Spam-Score: 0.3 (/) X-Debbugs-Envelope-To: 20693 Cc: 20693 <at> debbugs.gnu.org X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: 0.3 (/) -----Original Message-----In a way, because... > skip > ok > PASS: test2.tap 1 > not ok > FAIL: test2.tap 2 > 1..2 ... it is your program's output that does not follow the specification. There are two basic styles of skipping in TAP. You can skip a single test result: ok 1 # skip reason or you can use the plan line to indicate that the entire test program is to be skipped: 1..0 # skip reason Sorry to be such a pimple, but I just tried: ========== script ========== #!/bin/bash echo test2.tap "$# [ $@ ]" >> test2.log echo I am a tap script >> test2.log echo 1..3 echo ok echo not ok echo ok 3 # skip reason ========== which yielded ========== PASS: test2.tap 1 FAIL: test2.tap 2 PASS: test2.tap 3 ================================= Testsuite summary for test 0.5 ================================= # TOTAL: 3 # PASS: 2 # SKIP: 0 # XFAIL: 0 # FAIL: 1 # XPASS: 0 # ERROR: 0 ================================ See src/test-suite.log ================================ ========== and ========== I would have expected a 'skip' not a PASS! And the comment isn't output w/wo TAP_LOG_DRIVER_FLAGS=--comments. However, 1..0 works if there is no test output, as in the output only containing 1..0 and nothing else. More than one test yields errors (# UNPLANNED). If this is an error on my part (which it may well be) then I am confused about your comment above.
bug-automake@HIDDEN:bug#20693; Package automake.
Full text available.
Received: (at 20693) by debbugs.gnu.org; 29 May 2015 21:49:50 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Fri May 29 17:49:50 2015
Received: from localhost ([127.0.0.1]:60900 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.80)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1YySA1-0003So-4k
for submit <at> debbugs.gnu.org; Fri, 29 May 2015 17:49:49 -0400
Received: from nm12-vm2.access.bullet.mail.bf1.yahoo.com
([216.109.114.241]:48840) by debbugs.gnu.org with esmtp (Exim 4.80)
(envelope-from <aschwarz1309@HIDDEN>) id 1YyS9y-0003SZ-Rz
for 20693 <at> debbugs.gnu.org; Fri, 29 May 2015 17:49:47 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=att.net; s=s1024;
t=1432936181; bh=KRK4dV4csKIkBYrXKyku78Cc94pMGP/sKI3AgJLhvdc=;
h=From:To:Cc:References:In-Reply-To:Subject:Date:From:Subject;
b=ZpCFLQjRJtDokYsP1lOBnip67tRlh7aWI1BPOHDeJBKMZiCSfgwv1a1cxrwSY0WMIi4iEdmN2NFxtZ14itT77ZrJG+kkubyKi7veD4hLEe+DA783jB5cAtP9O7ZZ1aykQv6Dsf5L28ETOIA2RmMkuG6MkCf4VTYIuMhPUTluIKg=
Received: from [66.196.81.162] by nm12.access.bullet.mail.bf1.yahoo.com with
NNFMP; 29 May 2015 21:49:41 -0000
Received: from [98.138.226.242] by tm8.access.bullet.mail.bf1.yahoo.com with
NNFMP; 29 May 2015 21:49:41 -0000
Received: from [127.0.0.1] by smtp113.sbc.mail.ne1.yahoo.com with NNFMP;
29 May 2015 21:49:41 -0000
X-Yahoo-Newman-Id: 253100.22130.bm@HIDDEN
X-Yahoo-Newman-Property: ymail-3
X-YMail-OSG: lCYuUG0VM1npolRUbsTKwPAOqo68k7CVyb9TWLPhlnDGguX
P.xrphJ4TlZD30TyajWjD.LBGhyuTgdJ5PDK5FldtOtN5XiVcVVypf0WHWMI
ahHhRiEDQQ4t0mYDll3QtGuAu7lRUDAgPVVKxIHpTa3fjbSR37BR1XP6A5bW
u..IoNyCRCPJPYQQ7b.Nu1a3Ce2SnO_Q6SiUJ3q.8Gj3wveuwFG5RVg.i3zY
ddcNPT9QVxJwQDzXmsUn5AmmQhIBmRKH2q0UaUJyN6yrSZ6T9y154bz5qp8n
kqdBRYGbrD.XWX5TQxN.YoGbse__lCBDAqLzQDiMLY.aDCmcPbAtmGY16JTM
wNn3yTYd6vyJvVHL8x7Wi4cXqByb0DwDdUCt4YZM4HRa1PmHLzWmPiOqCK6T
IVvfu0MXTbjW7i1Xi2D3qqvHYA4ayrWIMQ24K5Ogkh.65ImwJUEG0zxBW0.3
bDI67ksMU4.2MTtWcLuqPmvWy7jV7CIC.OrN9nYRaUNaSy4_zXSqlTwMQvjs
82re0.c47yLJ0ZSlUPcLpjbX411tYBTSspllXUSN9RQ--
X-Yahoo-SMTP: 0z5TJLmswBDohOc2QznCIeoaEiEalQiTSMLFNdKdTt4t
From: "Arthur Schwarz" <aschwarz1309@HIDDEN>
To: "'Nick Bowler'" <nbowler@HIDDEN>
References: <88E8A9325FEB4AF482785AD592E22EA3@2600kPC>
<20150529171127.GA27194@HIDDEN>
In-Reply-To: <20150529171127.GA27194@HIDDEN>
Subject: RE: bug#20693: SKIP not counted in TAP
Date: Fri, 29 May 2015 14:49:37 -0700
Message-ID: <CAD7DDAC9D25416EBEF8105AC5C9876A@HPDV7TNotebook>
MIME-Version: 1.0
Content-Type: text/plain;
charset="us-ascii"
Content-Transfer-Encoding: 7bit
X-Mailer: Microsoft Office Outlook 11
Thread-Index: AdCaMqH1uS9ziMH5SJijZa6IB48RugAHXHkQ
X-MimeOLE: Produced By Microsoft MimeOLE V6.1.7601.17609
X-Spam-Score: 0.3 (/)
X-Debbugs-Envelope-To: 20693
Cc: 20693 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: 0.3 (/)
Thanks Nick;
But doesn't this mean that tap-driver.sh didn't report a violation to the
TAP standard? And why is my output intermixed in the .trs file? If 'skip'
below is illegal, why isn't it tagged? (I think that multiline comments need
leading whitespace?)
As another issue, I looked at the awk code and have some potential revisions
below. I know very little about awk but I think the resultant code is faster
in that the 'is_first_read = 1' is not necessary and consequent checks for
each line input are unnecessary.
As to your (sly and underhanded) comment about awk being defined (and I
should read it), well, in this case I agree. But in general where something
is important to the issue at hand obligating the user to read every relevant
manual bearing on the issue I feel is burdensome and unnecessary. I
understand the problems with following 'other peoples manuals' and burden
that that places on the maintenance staff, but requiring that readers of the
Automake User's Manual read the Autoconf, Automake, make, TAP standards,
bash for 'env' and etc. is needless. My opinion is that some of the material
in these (and other manuals) which have a direct bearing on Automake should
have more than a reference to Yet Another Manual. This issue directly bears
on, for example, TAP, where a few wise words from the Master's Of The
Universe will go a long way being productive. But, this is an opinion. Oh, I
am doing some writing for Section 15 of the Automake Manual to say that I am
putting some effort is providing an alternative viewpoint.
===================== tap-driver.sh =====================
## --------- ##
## PARSING ##
## --------- ##
st = getline
nextline = $0; # I have no idea what $0 does.
if (st < 0) # I/O error.
abort("in input loop: only one input line")
}
do
{
# Involutions required so that we are able to read the exit status
# from the last input line.
# Copy any input line verbatim into the log file.
o o o
st = getline
curline = nextline
nextline = $0
$0 = curline
while(st >= 0)
if (st < 0) # I/O error.
fatal("I/O error while reading from input stream")
}
On 2015-05-29 08:15 -0700, Arthur Schwarz wrote:
> skip causes the following issues:
> 1: It is not reported.
> 2: It is not summarized.
> 3: It must be subtracted from the plan (tests run), and
> 4: The .log file has TAP generated output and the test data intermixed.
>
> I think this is against the TAP definition?
In a way, because...
> skip
> ok
> PASS: test2.tap 1
> not ok
> FAIL: test2.tap 2
> 1..2
... it is your program's output that does not follow the specification.
There are two basic styles of skipping in TAP. You can skip a single
test result:
ok 1 # skip reason
or you can use the plan line to indicate that the entire test program is
to be skipped:
1..0 # skip reason
Regards,
--
Nick Bowler, Elliptic Technologies (http://www.elliptictech.com/)
bug-automake@HIDDEN:bug#20693; Package automake.
Full text available.Received: (at 20693) by debbugs.gnu.org; 29 May 2015 17:12:28 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Fri May 29 13:12:28 2015 Received: from localhost ([127.0.0.1]:60817 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1YyNpb-0005Ee-Fg for submit <at> debbugs.gnu.org; Fri, 29 May 2015 13:12:27 -0400 Received: from mx5.gridway.net ([74.216.186.162]:34447 helo=mx5r.gridway.net) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from <nbowler@HIDDEN>) id 1YyNpY-0005EN-U1 for 20693 <at> debbugs.gnu.org; Fri, 29 May 2015 13:12:25 -0400 Received: from delivery.mygridway.net (delivery.mygridway.net [72.1.205.180]) by mx5r.gridway.net (8.14.3/8.14.3/Debian-9.4) with ESMTP id t4THBKiD010923 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NOT); Fri, 29 May 2015 13:12:17 -0400 Received: from mail.ellipticsemi.com (24.114.47.98) by delivery.mygridway.net (172.17.12.4) with Microsoft SMTP Server (TLS) id 14.3.224.2; Fri, 29 May 2015 13:11:25 -0400 Date: Fri, 29 May 2015 13:11:27 -0400 From: Nick Bowler <nbowler@HIDDEN> To: Arthur Schwarz <aschwarz1309@HIDDEN> Subject: Re: bug#20693: SKIP not counted in TAP Message-ID: <20150529171127.GA27194@HIDDEN> References: <88E8A9325FEB4AF482785AD592E22EA3@2600kPC> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: <88E8A9325FEB4AF482785AD592E22EA3@2600kPC> Organization: Elliptic Technologies Inc. User-Agent: Mutt/1.5.23 (2014-03-12) X-Originating-IP: [24.114.47.98] X-Spam-Score: undef - relay 72.1.205.180 marked with skip_spam_scan X-CanIt-Geo: ip=72.1.205.180; country=CA; region=Ontario; city=Ottawa; latitude=45.4167; longitude=-75.7000; http://maps.google.com/maps?q=45.4167,-75.7000&z=6 X-CanItPRO-Stream: base:outbound (inherits from base:default) X-Canit-Stats-ID: Bayes signature not available X-Scanned-By: CanIt (www . roaringpenguin . com) on 207.107.149.162 X-Spam-Score: 0.9 (/) X-Debbugs-Envelope-To: 20693 Cc: 20693 <at> debbugs.gnu.org X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: 0.9 (/) On 2015-05-29 08:15 -0700, Arthur Schwarz wrote: > skip causes the following issues: > 1: It is not reported. > 2: It is not summarized. > 3: It must be subtracted from the plan (tests run), and > 4: The .log file has TAP generated output and the test data intermixed. > > I think this is against the TAP definition? In a way, because... > skip > ok > PASS: test2.tap 1 > not ok > FAIL: test2.tap 2 > 1..2 ... it is your program's output that does not follow the specification. There are two basic styles of skipping in TAP. You can skip a single test result: ok 1 # skip reason or you can use the plan line to indicate that the entire test program is to be skipped: 1..0 # skip reason Regards, -- Nick Bowler, Elliptic Technologies (http://www.elliptictech.com/)
bug-automake@HIDDEN:bug#20693; Package automake.
Full text available.Received: (at submit) by debbugs.gnu.org; 29 May 2015 15:15:46 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Fri May 29 11:15:45 2015 Received: from localhost ([127.0.0.1]:60768 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1YyM0e-0000nU-L2 for submit <at> debbugs.gnu.org; Fri, 29 May 2015 11:15:45 -0400 Received: from eggs.gnu.org ([208.118.235.92]:45101) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from <aschwarz1309@HIDDEN>) id 1YyM0b-0000nF-9a for submit <at> debbugs.gnu.org; Fri, 29 May 2015 11:15:41 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from <aschwarz1309@HIDDEN>) id 1YyM0U-00081A-LB for submit <at> debbugs.gnu.org; Fri, 29 May 2015 11:15:35 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: * X-Spam-Status: No, score=1.1 required=5.0 tests=BAYES_50, FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FROM,T_DKIM_INVALID autolearn=disabled version=3.3.2 Received: from lists.gnu.org ([2001:4830:134:3::11]:40555) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from <aschwarz1309@HIDDEN>) id 1YyM0U-000812-J5 for submit <at> debbugs.gnu.org; Fri, 29 May 2015 11:15:34 -0400 Received: from eggs.gnu.org ([2001:4830:134:3::10]:58589) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from <aschwarz1309@HIDDEN>) id 1YyM0T-0004Z2-Ce for bug-automake@HIDDEN; Fri, 29 May 2015 11:15:34 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from <aschwarz1309@HIDDEN>) id 1YyM0P-0007wv-Ch for bug-automake@HIDDEN; Fri, 29 May 2015 11:15:33 -0400 Received: from nm2-vm5.access.bullet.mail.bf1.yahoo.com ([216.109.114.92]:33826) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from <aschwarz1309@HIDDEN>) id 1YyM0P-0007wp-8M for bug-automake@HIDDEN; Fri, 29 May 2015 11:15:29 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=att.net; s=s1024; t=1432912528; bh=szp/713sjiC8/nzHtOACutgtQtzPX5dUtTG25wvtNEc=; h=From:To:Subject:Date:From:Subject; b=gkyLt7U3w1KFACIsLdktt72uQhjSdfaMIYVMVlQUonS85uueJuNxLmG2mn4Ezm/dqRAyRqNRX8ALnaUXmrttZShPbPwiBLFpEdf8faZ0X3n++CdewfZpbAEOLvkspnX3NQASlVC3uX+vmeXcZSByNEsnc2wOPMnwaqdExAWlNoo= Received: from [66.196.81.160] by nm2.access.bullet.mail.bf1.yahoo.com with NNFMP; 29 May 2015 15:15:28 -0000 Received: from [98.138.104.97] by tm6.access.bullet.mail.bf1.yahoo.com with NNFMP; 29 May 2015 15:15:28 -0000 Received: from [127.0.0.1] by smtp117.sbc.mail.ne1.yahoo.com with NNFMP; 29 May 2015 15:15:28 -0000 X-Yahoo-Newman-Id: 433509.89215.bm@HIDDEN X-Yahoo-Newman-Property: ymail-3 X-YMail-OSG: bhifQIIVM1n52Fcr7nNm3AFRcaqZHJb4I.BaWdZnEsJfuHO WvYdFW2DiBS8C.AnYBq3RW0rhh3Ot3pAdDDTCj8NfOL7KpzRL5nyL80._HPE b3sqvyjGs8zmWPYoZKLVxuKgR5NRxuT5AnbfzpAQZx8Ix0xPX8Sxsn31ODpY .jJw3TbmSXGS__Snr7DSvruYKq96.YEbT1HAbdUessRuCYuMH8Me7jnoi0hP hSxKU92.wAqKoweFoYK6dmdjzy1e5L5z5HyDZfOTJor2bZDsvH0PExTjxxKH w2nhX7k.TbqMUcaOl8YELybVK3ZBJa06pxT9ybgIM5vVkA0o0G5hxO0Sax9y 30u4O.X8sdRW.36WS9zlb387.kqGsFKxc_.UlLDTErfvXZvw_IdqhO1DeeNX ycvO8SKoUa53pY1.iJy2q_H7DmO4t7667WVqkJiXbUhBg2Fzqfe0dOEMo5Cm fZq0GsJZ0vmejzTiDfb7FIzC9khelPvzn7rTvxSsjUgkmtHBlS1vbMGCcFmg D6v1_Ibhpf8XbaCGPGDcEdSRdjqCZ00.Ln2sM7Ae8 X-Yahoo-SMTP: 0z5TJLmswBDohOc2QznCIeoaEiEalQiTSMLFNdKdTt4t From: "Arthur Schwarz" <aschwarz1309@HIDDEN> To: <bug-automake@HIDDEN> Subject: SKIP not counted in TAP Date: Fri, 29 May 2015 08:15:15 -0700 Message-ID: <88E8A9325FEB4AF482785AD592E22EA3@2600kPC> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable X-Mailer: Microsoft Office Outlook 11 Thread-Index: AdCaIkQaF9P3B5iNTc+fjpidDW8Prw== X-MimeOLE: Produced By Microsoft MimeOLE V6.1.7601.17609 X-detected-operating-system: by eggs.gnu.org: GNU/Linux 3.x X-detected-operating-system: by eggs.gnu.org: Error: Malformed IPv6 address (bad octet value). X-Received-From: 2001:4830:134:3::11 X-Spam-Score: -4.7 (----) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -4.7 (----) I think this is an error. skip causes the following issues: 1: It is not reported. 2: It is not summarized. 3: It must be subtracted from the plan (tests run), and 4: The .log file has TAP generated output and the test data intermixed. I think this is against the TAP definition? =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D = output = =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D PASS: test2.tap 1 FAIL: test2.tap 2 =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D Testsuite summary for test 0.5 =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D # TOTAL: 2 # PASS: 1 # SKIP: 0 # XFAIL: 0 # FAIL: 1 # XPASS: 0 # ERROR: 0 =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D See src/test-suite.log =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D = test-suite.log = =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D test 0.5: src/test-suite.log =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D # TOTAL: 2 # PASS: 1 # SKIP: 0 # XFAIL: 0 # FAIL: 1 # XPASS: 0 # ERROR: 0 .. contents:: :depth: 2 FAIL: test2 =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D skip ok PASS: test2.tap 1 not ok FAIL: test2.tap 2 1..2 =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D = program = =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D =A0 ## Process this file with automake to produce Makefile.in # select testing format AUTOMAKE_OPTIONS =3D parallel-tests=20 EXTRA_DIST =3D tap-driver.sh # test options TEST_EXTENSIONS =3D .tap TAP_LOG_DRIVER =3D env AM_TAP_AWK=3D'$(AWK)' $(SHELL) = ./tap-driver.sh # Testing=20 check_SCRIPTS =3D test2.tap TESTS =3D test2.tap test2.tap: echo '#!/bin/bash' > test2.tap echo 'echo test2.tap "$$# [ $$@ ]" >> test2.log' >> test2.tap echo "echo I am a tap script >> test2.log" >> test2.tap echo echo '1..2' >> test2.tap echo echo 'ok' >> test2.tap echo echo 'not ok' >> test2.tap echo echo 'skip' >> test2.tap chmod +x test2.tap CLEANFILES =3D $(test_SOURCES)
"Arthur Schwarz" <aschwarz1309@HIDDEN>:bug-automake@HIDDEN.
Full text available.bug-automake@HIDDEN:bug#20693; Package automake.
Full text available.
GNU bug tracking system
Copyright (C) 1999 Darren O. Benham,
1997 nCipher Corporation Ltd,
1994-97 Ian Jackson.