GNU bug report logs - #11745
the new test-suite summary is confusing

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: automake; Reported by: Alexandre Duret-Lutz <adl@HIDDEN>; dated Tue, 19 Jun 2012 17:06:02 UTC; Maintainer for automake is bug-automake@HIDDEN.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 19 Jun 2012 17:05:22 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue Jun 19 13:05:22 2012
Received: from localhost ([127.0.0.1]:48859 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.72)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1Sh1rl-00040v-JR
	for submit <at> debbugs.gnu.org; Tue, 19 Jun 2012 13:05:22 -0400
Received: from eggs.gnu.org ([208.118.235.92]:57841)
	by debbugs.gnu.org with esmtp (Exim 4.72)
	(envelope-from <aduret@HIDDEN>) id 1Sh1dx-0003gi-Ia
	for submit <at> debbugs.gnu.org; Tue, 19 Jun 2012 12:51:06 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <aduret@HIDDEN>) id 1Sh1aY-0008Kx-Vi
	for submit <at> debbugs.gnu.org; Tue, 19 Jun 2012 12:47:42 -0400
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org
X-Spam-Level: 
X-Spam-Status: No, score=-6.9 required=5.0 tests=BAYES_00,FREEMAIL_FROM,
	RCVD_IN_DNSWL_HI,T_DKIM_INVALID autolearn=unavailable version=3.3.2
Received: from lists.gnu.org ([208.118.235.17]:53283)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <aduret@HIDDEN>) id 1Sh1aY-0008Kq-Ph
	for submit <at> debbugs.gnu.org; Tue, 19 Jun 2012 12:47:34 -0400
Received: from eggs.gnu.org ([208.118.235.92]:46954)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <aduret@HIDDEN>) id 1Sh1aX-00080P-2W
	for bug-automake@HIDDEN; Tue, 19 Jun 2012 12:47:34 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <aduret@HIDDEN>) id 1Sh1aV-0008K5-1P
	for bug-automake@HIDDEN; Tue, 19 Jun 2012 12:47:32 -0400
Received: from mail-ob0-f169.google.com ([209.85.214.169]:61747)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <aduret@HIDDEN>) id 1Sh1aU-0008JZ-Qs
	for bug-automake@HIDDEN; Tue, 19 Jun 2012 12:47:30 -0400
Received: by obbtb8 with SMTP id tb8so4820365obb.0
	for <bug-automake@HIDDEN>; Tue, 19 Jun 2012 09:47:28 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
	h=mime-version:sender:from:date:x-google-sender-auth:message-id
	:subject:to:content-type;
	bh=r9EX669BDuFAaCRTo+PRrizkkz4ZG8qhUmpptmBq/6g=;
	b=ZSCZiK2x7Q128cLL7WePQVLsgbEEYrPfyvEp+FYhLb+PXQs94GgEAYoPqGGpTRH9Of
	+s08fWGn4XSI/aRF6kH3OpqumaZjMbtaY1jGSNyj7rQ2zS/YCG9GGgGcSiZ/ECMgiAyJ
	PtA2TWARihbnnKcK5KJ5WMORz7tnqtQ3kyMbyAr8zTr1gc1HqPkSx2BcI4HAOtJydL14
	l/0syoQBg2WXXE7oGXekYxMvzbo3VuEy/VJT2fTCQ+EcXlt+jc/gfkEDrPAHH28HYNCz
	Lw9BA0Ue5OhY/LSL0z4QZPnwjI8lJREYLyppibno6u1jbq6SMCeGRj83x0qyDgKxIfcn
	D2dQ==
Received: by 10.182.45.72 with SMTP id k8mr20522776obm.51.1340124447796; Tue,
	19 Jun 2012 09:47:27 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.182.13.10 with HTTP; Tue, 19 Jun 2012 09:47:07 -0700 (PDT)
From: Alexandre Duret-Lutz <adl@HIDDEN>
Date: Tue, 19 Jun 2012 18:47:07 +0200
X-Google-Sender-Auth: Yh9TkLgF5gQo0qecf8It9k7ePCM
Message-ID: <CA+Xfj9TGV+dznCf5szPH8R8KVzQaVgh9iw7Os7X_xHLrQch_Nw@HIDDEN>
Subject: the new test-suite summary is confusing
To: bug-automake@HIDDEN
Content-Type: text/plain; charset=ISO-8859-1
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 3)
X-Received-From: 208.118.235.17
X-Spam-Score: -6.1 (------)
X-Debbugs-Envelope-To: submit
X-Mailman-Approved-At: Tue, 19 Jun 2012 13:05:19 -0400
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.13
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
	<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
	<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Sender: debbugs-submit-bounces <at> debbugs.gnu.org
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
X-Spam-Score: -6.1 (------)

Hi!

I have a project that contains 8 different test-suites, each in its
own directory.  Some test suite are big, other are small, but they
test different parts of the project and I like being able to run "make
check" in the relevant directory.  They are run sequentially (with
SUBDIRS) when "make check" is run from the top-level.

I upgraded to Automake 1.12.1 to discover the each of these test-suite
now displays a huge summary like:

============================================================================
Testsuite summary for spot 0.9.1a
============================================================================
# TOTAL: 2
# PASS:  2
# SKIP:  0
# XFAIL: 0
# FAIL:  0
# XPASS: 0
# ERROR: 0
============================================================================

Instead of the older one-line summary I'm used too.

I can live with the extra verbosity, but I find the initial header
saying "Testsuite summary for spot 0.9.1a" in each of the test suites
very confusing.  The above in definitely *not* a testsuite summary for
the project, it's only a test summary for one directory.

I think the easiest fix would be to change the header to just
"Testsuite summary", without mentioning the package.

Another option could be to let the test-suite be named in Makefile.am.
Maybe introduce
    TESTS_DISPLAY_NAME = $(PACKAGE_STRING)
and use
    echo "Testsuite summary for $(TESTS_DISPLAY_NAME)"
so that people with multiple test-suites can give them different names.

-- 
Alexandre Duret-Lutz




Acknowledgement sent to Alexandre Duret-Lutz <adl@HIDDEN>:
New bug report received and forwarded. Copy sent to bug-automake@HIDDEN. Full text available.
Report forwarded to bug-automake@HIDDEN:
bug#11745; Package automake. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Fri, 31 Oct 2014 17:00:04 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.