GNU bug report logs - #67312
feature request: avoid creating logs for no tests

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: dejagnu; Severity: wishlist; Reported by: Tom Tromey <tom@HIDDEN>; Owned by: jcb62281@HIDDEN; dated Mon, 20 Nov 2023 23:13:01 UTC; Maintainer for dejagnu is bug-dejagnu@HIDDEN.
Changed bug title to 'feature request: avoid creating logs for no tests' from 'feature request: avoid creating logs when there are no' Request was from Jacob Bachmeyer <jcb62281@HIDDEN> to control <at> debbugs.gnu.org. Full text available.

Message received at 67312 <at> debbugs.gnu.org:


Received: (at 67312) by debbugs.gnu.org; 22 Nov 2023 04:10:37 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue Nov 21 23:10:37 2023
Received: from localhost ([127.0.0.1]:57825 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1r5eZQ-0001vQ-SO
	for submit <at> debbugs.gnu.org; Tue, 21 Nov 2023 23:10:37 -0500
Received: from mail-oi1-x236.google.com ([2607:f8b0:4864:20::236]:54336)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <jcb62281@HIDDEN>) id 1r5eZO-0001vB-BY
 for 67312 <at> debbugs.gnu.org; Tue, 21 Nov 2023 23:10:35 -0500
Received: by mail-oi1-x236.google.com with SMTP id
 5614622812f47-3b6f4d8ddccso3228401b6e.0
 for <67312 <at> debbugs.gnu.org>; Tue, 21 Nov 2023 20:10:31 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=gmail.com; s=20230601; t=1700626225; x=1701231025; darn=debbugs.gnu.org;
 h=content-transfer-encoding:in-reply-to:references:subject:cc:to
 :mime-version:user-agent:reply-to:from:date:message-id:from:to:cc
 :subject:date:message-id:reply-to;
 bh=cNcRklE8fi6Y3E3uPYuqW4BfAT74yweYKWsV3GV//eY=;
 b=CA79yZffTY2bMpKLYLELOQEUAta7uBk62qyCy71ErznqnmA2VvS+UF97haJd1BHxBi
 j0KjsCLnud97XOycBmsJenfIHqOLIvoKxKBsCphBDLGYXFCjOW4Zc5P+cTSpAOpWKHw0
 8XrSmPQ8KlmZE3+oBynJc0vGr7EFIfiP5wOOVISds5/BR31ZRA/dab2muTQqFUc/CHHQ
 fcNwlRbrBPLvQkerHTpPy0WHizoOQT2A98QStTmjir7SYfCuzpwTWlYyRIafEeZxYKXL
 09rVKfiigr0afKbgL9zD6oIX9h0JiTE0YZiKgFmM8mtgpawFqEv5I0adviCXYKtmCp3A
 LL8A==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20230601; t=1700626225; x=1701231025;
 h=content-transfer-encoding:in-reply-to:references:subject:cc:to
 :mime-version:user-agent:reply-to:from:date:message-id
 :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to;
 bh=cNcRklE8fi6Y3E3uPYuqW4BfAT74yweYKWsV3GV//eY=;
 b=luMBK7uKnTN8SuYGOvkX3KEPxuXRCc1qvp14gu46/KqtwMu446ZT03WVyHxLRXXxha
 8OrIH5CAtpSWAQ1uC3K8zrXYeQCzZHs4x0x8laAVI+AkOz2l89yPsCU3CVedaXDgB+ND
 VOUC4AJ0JJCRqT8dmmZIrq40hX4yzS1OVutR4ofFtEnk4hk6dXNaGay72P+wtVgNF1CP
 PuTdTn70l1lR28SJaQlXYxMNdvlstIop2EcreIt/WLCGyZ2ElD4oszgbEr2j1sBxba4I
 9nA0/wLcVFO/HtDsn5cDKHba5Uo1exH9wC/HYDJP6+y52Fk/EfsRYCfjxsZcl/wZy5uz
 HWiA==
X-Gm-Message-State: AOJu0YzVukaXVlqu8bQu6ZIxi1ts7DvZZtO+pbggntPdDeFaahTVn16F
 /xf4i9kKD0ZRUSRkyx2eVngY4Uf16MY=
X-Google-Smtp-Source: AGHT+IFTfV2KeXu03O57RXSnm79ObeA8Urvw7ARzqYrvR734AmhybvdC3G9DNSnJfkPlwHk0Yuo6sQ==
X-Received: by 2002:a05:6808:1407:b0:3b8:3801:8f7a with SMTP id
 w7-20020a056808140700b003b838018f7amr1701804oiv.23.1700626225622; 
 Tue, 21 Nov 2023 20:10:25 -0800 (PST)
Received: from [127.0.0.1] ([70.133.144.43]) by smtp.gmail.com with ESMTPSA id
 be36-20020a05680821a400b003b3ec15d8ebsm1910844oib.5.2023.11.21.20.10.25
 (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256);
 Tue, 21 Nov 2023 20:10:25 -0800 (PST)
Message-ID: <655D7F2F.6040607@HIDDEN>
Date: Tue, 21 Nov 2023 22:10:23 -0600
From: Jacob Bachmeyer <jcb62281@HIDDEN>
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US;
 rv:1.8.1.22) Gecko/20090807 MultiZilla/1.8.3.4e SeaMonkey/1.1.17
 Mnenhy/0.7.6.0
MIME-Version: 1.0
To: Tom Tromey <tom@HIDDEN>
Subject: Re: bug#67312: dejagnu creates testrun.{sum,log}
References: <87edgkyq70.fsf@HIDDEN> <655C0DD0.7020109@HIDDEN>
 <87a5r7yzpg.fsf@HIDDEN>
In-Reply-To: <87a5r7yzpg.fsf@HIDDEN>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Score: -1.7 (-)
X-Debbugs-Envelope-To: 67312
Cc: 67312 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Reply-To: jcb62281@HIDDEN
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.7 (--)

Tom Tromey wrote:
> Jacob> Are the produced files empty?  I will consider if there might be a
> Jacob> good way to detect a completely bogus run (example:  no test scripts
> Jacob> found at all) and bail out early without creating logfiles, but this
> Jacob> issue seems to be a valid use case that is misfiring in your
> Jacob> situation.
>
> They aren't zero-length but they don't contain any useful information at
> all.  You can easily try it yourself by "cd /tmp; runtest".

Indeed, running runtest in an empty directory produces useless 
(boilerplate) log and summary files.  The testsuite has (nominally) been 
located before the logs are opened, but DejaGnu currently has a big ball 
of mud around actually finding and running the tests and does not check 
for test files until after the logs have been opened.

Fixing this has been added to my TODO list, and extracting the "find 
tests" stage from "find and run tests" will be needed for the planned 
future native parallel testing support in any case.  This will require 
some fairly extensive overhauls in runtest.exp to separate that step and 
effectively plan tests before running them instead of just running 
them.  I am also planning to expand tool handling at some point, 
eventually allowing multiple --tool options to be given in a single run; 
the effect will be equivalent to consecutive runtest invocations, but 
may have better performance in parallel mode, since that would allow 
testing of different tools to overlap.

Until then, I will carry this bug report as a feature request.


-- Jacob





Information forwarded to bug-dejagnu@HIDDEN:
bug#67312; Package dejagnu. Full text available.
Severity set to 'wishlist' from 'normal' Request was from Jacob Bachmeyer <jcb62281@HIDDEN> to control <at> debbugs.gnu.org. Full text available.
Changed bug title to 'feature request: avoid creating logs when there are no' from 'dejagnu creates testrun.{sum,log}' Request was from Jacob Bachmeyer <jcb62281@HIDDEN> to control <at> debbugs.gnu.org. Full text available.
Owner recorded as jcb62281@HIDDEN Request was from Jacob Bachmeyer <jcb62281@HIDDEN> to control <at> debbugs.gnu.org. Full text available.

Message received at 67312 <at> debbugs.gnu.org:


Received: (at 67312) by debbugs.gnu.org; 21 Nov 2023 13:59:23 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue Nov 21 08:59:23 2023
Received: from localhost ([127.0.0.1]:55521 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1r5RHe-0000TS-TC
	for submit <at> debbugs.gnu.org; Tue, 21 Nov 2023 08:59:23 -0500
Received: from omta40.uswest2.a.cloudfilter.net ([35.89.44.39]:41109)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <tom@HIDDEN>) id 1r5RHb-0000TE-KG
 for 67312 <at> debbugs.gnu.org; Tue, 21 Nov 2023 08:59:21 -0500
Received: from eig-obgw-5005a.ext.cloudfilter.net ([10.0.29.234])
 by cmsmtp with ESMTPS
 id 56gtrWKvqL9Ag5RHSrkR4a; Tue, 21 Nov 2023 13:59:10 +0000
Received: from box5379.bluehost.com ([162.241.216.53]) by cmsmtp with ESMTPS
 id 5RHRrJ5Bw1b9N5RHRrR8ex; Tue, 21 Nov 2023 13:59:09 +0000
X-Authority-Analysis: v=2.4 cv=FLYIesks c=1 sm=1 tr=0 ts=655cb7ad
 a=ApxJNpeYhEAb1aAlGBBbmA==:117 a=ApxJNpeYhEAb1aAlGBBbmA==:17
 a=OWjo9vPv0XrRhIrVQ50Ab3nP57M=:19 a=dLZJa+xiwSxG16/P+YVxDGlgEgI=:19
 a=BNY50KLci1gA:10 a=Qbun_eYptAEA:10 a=RrMkDmJZQl6fHe2ZQLsA:9
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=tromey.com; 
 s=default;
 h=Content-Type:MIME-Version:Message-ID:In-Reply-To:Date:References
 :Subject:Cc:To:From:Sender:Reply-To:Content-Transfer-Encoding:Content-ID:
 Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc
 :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe:
 List-Post:List-Owner:List-Archive;
 bh=31AMI3E0myDGLRqieCVMV35H2AVB3DusyGRfnPiU+ew=; b=LtE7dinfSPxWmMFwyhSDjBrpPC
 deJs9AgZPQ+zySDpnS98nuehUxljnL7ndX4XdTgABE7T4hoF9swf5X5oOTi9ZoUispmd8rN1jSdi1
 3uNOKo4OjiGj8q+atbTbBliWC;
Received: from 97-122-77-73.hlrn.qwest.net ([97.122.77.73]:56726 helo=prentzel)
 by box5379.bluehost.com with esmtpsa (TLS1.2) tls
 TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96.2)
 (envelope-from <tom@HIDDEN>) id 1r5RHQ-0034M5-2z;
 Tue, 21 Nov 2023 06:59:08 -0700
From: Tom Tromey <tom@HIDDEN>
To: Jacob Bachmeyer <jcb62281@HIDDEN>
Subject: Re: bug#67312: dejagnu creates testrun.{sum,log}
References: <87edgkyq70.fsf@HIDDEN> <655C0DD0.7020109@HIDDEN>
X-Attribution: Tom
Date: Tue, 21 Nov 2023 06:59:23 -0700
In-Reply-To: <655C0DD0.7020109@HIDDEN> (Jacob Bachmeyer's message of "Mon, 
 20 Nov 2023 19:54:24 -0600")
Message-ID: <87a5r7yzpg.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain
X-AntiAbuse: This header was added to track abuse,
 please include it with any abuse report
X-AntiAbuse: Primary Hostname - box5379.bluehost.com
X-AntiAbuse: Original Domain - debbugs.gnu.org
X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12]
X-AntiAbuse: Sender Address Domain - tromey.com
X-BWhitelist: no
X-Source-IP: 97.122.77.73
X-Source-L: No
X-Exim-ID: 1r5RHQ-0034M5-2z
X-Source: 
X-Source-Args: 
X-Source-Dir: 
X-Source-Sender: 97-122-77-73.hlrn.qwest.net (prentzel) [97.122.77.73]:56726
X-Source-Auth: tom+tromey.com
X-Email-Count: 2
X-Org: HG=bhshared;ORG=bluehost;
X-Source-Cap: ZWx5bnJvYmk7ZWx5bnJvYmk7Ym94NTM3OS5ibHVlaG9zdC5jb20=
X-Local-Domain: yes
X-CMAE-Envelope: MS4xfMtf4OrSVo3yi6Jz2cCyzNnzopPa/D1Wscg3YGcUrbVVS/Rh4w0IGABgEOplR60cWMzqAFQH0+jVCNkcihUfKDfG3RJtcJshp8cMYbSk0QMKsB9KNqa/
 v7xv7VBOQDY04bVnpKoSCw9ThhfLVejYBwGSc2c8xJkvB2XLgzFMvwJWhU6tQzaCCojs2utZ6ypxndEOPj5+3oHDQM45CO4Von8=
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: 67312
Cc: 67312 <at> debbugs.gnu.org, Tom Tromey <tom@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Jacob> Are the produced files empty?  I will consider if there might be a
Jacob> good way to detect a completely bogus run (example:  no test scripts
Jacob> found at all) and bail out early without creating logfiles, but this
Jacob> issue seems to be a valid use case that is misfiring in your
Jacob> situation.

They aren't zero-length but they don't contain any useful information at
all.  You can easily try it yourself by "cd /tmp; runtest".

Tom




Information forwarded to bug-dejagnu@HIDDEN:
bug#67312; Package dejagnu. Full text available.

Message received at 67312 <at> debbugs.gnu.org:


Received: (at 67312) by debbugs.gnu.org; 21 Nov 2023 01:54:41 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Nov 20 20:54:41 2023
Received: from localhost ([127.0.0.1]:54865 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1r5FyL-0006W5-0V
	for submit <at> debbugs.gnu.org; Mon, 20 Nov 2023 20:54:41 -0500
Received: from mail-oi1-x22a.google.com ([2607:f8b0:4864:20::22a]:43100)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <jcb62281@HIDDEN>) id 1r5FyG-0006Vp-5r
 for 67312 <at> debbugs.gnu.org; Mon, 20 Nov 2023 20:54:39 -0500
Received: by mail-oi1-x22a.google.com with SMTP id
 5614622812f47-3b6ccaf0516so2936872b6e.0
 for <67312 <at> debbugs.gnu.org>; Mon, 20 Nov 2023 17:54:33 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=gmail.com; s=20230601; t=1700531668; x=1701136468; darn=debbugs.gnu.org;
 h=content-transfer-encoding:in-reply-to:references:subject:cc:to
 :mime-version:user-agent:reply-to:from:date:message-id:from:to:cc
 :subject:date:message-id:reply-to;
 bh=35NiH6ZpDIlRLZNIzawHYz4T6RZ+44VJTIudnHslSU4=;
 b=GseyognygXqimyN35OIAWXB8F+678fCyWUddPigrtVvY2JSZyV8gKs+MweTMBB+jHr
 ZebUUFEiEydvQb4Ie0AX150vIutnFkU/nGz+c8PsdH1T6pWmECFGZw8hxlg7dFokaJbO
 iLb8UeGbCxwW8mg5Suhi6STry6fQNsLEKc20gpDOLa81zg793ebfoyHAUqeA1c/rQbzc
 zDrfb+jt0uRwI/AexnywS/UDe8FGZrn5iSg1WjcXWTket8PyE05uXJa4C/EhwSoIvIN8
 F+iroT3F5tZ9F3os/xZtKHIdHrihgZBNAUARf0CSl32YcCqA9KPaJvXSz0sB0R9t00Fk
 11Iw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20230601; t=1700531668; x=1701136468;
 h=content-transfer-encoding:in-reply-to:references:subject:cc:to
 :mime-version:user-agent:reply-to:from:date:message-id
 :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to;
 bh=35NiH6ZpDIlRLZNIzawHYz4T6RZ+44VJTIudnHslSU4=;
 b=HkT5HmMaIL0s8K2tKFLoACk8tKGqJRCXyY8Eg5w41aaEkF2nwE8bAxwBHIDOawTNUe
 N3q8N+v0A+LWlTKhL6/epJS1/oZlB208EHMyIUuQ1Pyj139x2xGXXtvC/z7R4f8RT+0a
 PuSpxvlWJSqgGuWst/tH/ko5Pxef6j/YVD+LI/8W9+RiIahvlqPwqc1/vr67rSZeBEza
 J36oD7WzRYu/YEi8l5GRRQDv6ZD09oPkCsU7TOY18m2m/pfgBh8+m+cB9srWLcJ9FyES
 d8Ntb7q8zcu5CKcYtQ9XyiJo16RnZ62viGgLkpT9h03oxwVuwou9TLy233NPy670i8rz
 weBg==
X-Gm-Message-State: AOJu0YyXlgx7lKTeeiWMttlzU9QxWNArFg6AxDSYDGAun6KrOf8qTyrL
 XXBU8dgzS/g7t+b8RlUsW1o=
X-Google-Smtp-Source: AGHT+IEWWNpQKN/QvD4qi6mAxhIfmz637bveTR0x7gAcIAM5FmUBIvJsPJ1tSHjRMHvZkq9J2VOtbg==
X-Received: by 2002:a05:6808:23ce:b0:3af:a80c:420 with SMTP id
 bq14-20020a05680823ce00b003afa80c0420mr582274oib.7.1700531667819; 
 Mon, 20 Nov 2023 17:54:27 -0800 (PST)
Received: from [127.0.0.1] ([70.133.144.43]) by smtp.gmail.com with ESMTPSA id
 c18-20020aca1c12000000b003a43759b9cdsm1459163oic.29.2023.11.20.17.54.26
 (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256);
 Mon, 20 Nov 2023 17:54:27 -0800 (PST)
Message-ID: <655C0DD0.7020109@HIDDEN>
Date: Mon, 20 Nov 2023 19:54:24 -0600
From: Jacob Bachmeyer <jcb62281@HIDDEN>
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US;
 rv:1.8.1.22) Gecko/20090807 MultiZilla/1.8.3.4e SeaMonkey/1.1.17
 Mnenhy/0.7.6.0
MIME-Version: 1.0
To: Tom Tromey <tom@HIDDEN>
Subject: Re: bug#67312: dejagnu creates testrun.{sum,log}
References: <87edgkyq70.fsf@HIDDEN>
In-Reply-To: <87edgkyq70.fsf@HIDDEN>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Score: -1.7 (-)
X-Debbugs-Envelope-To: 67312
Cc: 67312 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Reply-To: jcb62281@HIDDEN
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.7 (--)

Tom Tromey wrote:
> I've noticed that if I run 'runtest' in the wrong directory -- for
> example in the source directory rather than the appropriate build
> directory -- dejagnu will create files testrun.log and testrun.sum.
>
> In this case these files are not actually useful.
>
> And, runtest already emits some warnings about this:
>
> prentzel. runtest 
> WARNING: testsuite is not in a testsuite/ directory.
> WARNING: Couldn't find the global config file.
> WARNING: No tool specified
>
> I think it would be nicer if, when dejagnu notices that the environment
> is unsuitable (like, no tool specified), then it should just print
> errors and exit -- without creating these files.

Each of the warnings mentioned is a warning and not an error because, 
while those indicate that something is probably wrong, there may be 
testsuites out there using them.  The lack of a testsuite/ directory 
violates a long-documented requirement, but 1.6.3 is the first release 
that actually checks that in order to resolve an ambiguity between 
recursive and non-recursive Automake-generated Makefiles.  (Several 
DejaGnu tests in the Automake testsuite had to be patched to fix exactly 
the misuse that triggers that warning, so there may be other testsuites 
out there that do not properly use testsuite/.  The ambiguity concerns 
whether srcdir is "testsuite" itself or its parent.)  The global config 
file is part of site configuration, is expected to define remote 
targets, and is actually optional if built-in defaults are sufficient, 
as they usually are for the "unix" target.  Lastly, while failure to 
specify a tool produces a warning, it is a valid invocation of runtest.

The problem with bailing out in this case is that failing to specify a 
tool is a valid (legacy, possibly deprecated) use:  it means to run all 
tests (for all tools) in the testsuite.  Writing log and summary files 
as if a tool named "testrun" was tested is the long-standing behavior in 
this case and there is actually explicit code in lib/framework.exp to 
support this.  (That code may also mean that a tool literally named 
"testrun" cannot actually be tested...)

Of the three warnings, the lack of a testsuite/ directory is the best 
candidate to upgrade to a hard error since it has seemingly always been 
a documented requirement, but all previous releases would silently 
accept a testsuite not using that directory, so moving directly to 
"ERROR:  no testsuite/ directory found.  Stop." is too much to do on a 
point release.

Are the produced files empty?  I will consider if there might be a good 
way to detect a completely bogus run (example:  no test scripts found at 
all) and bail out early without creating logfiles, but this issue seems 
to be a valid use case that is misfiring in your situation.


-- Jacob





Information forwarded to bug-dejagnu@HIDDEN:
bug#67312; Package dejagnu. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 20 Nov 2023 23:12:50 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Nov 20 18:12:50 2023
Received: from localhost ([127.0.0.1]:54821 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1r5DRh-0002Ih-Ri
	for submit <at> debbugs.gnu.org; Mon, 20 Nov 2023 18:12:50 -0500
Received: from lists.gnu.org ([2001:470:142::17]:37412)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <tom@HIDDEN>) id 1r5DRe-0002IS-Jx
 for submit <at> debbugs.gnu.org; Mon, 20 Nov 2023 18:12:48 -0500
Received: from eggs.gnu.org ([2001:470:142:3::10])
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <tom@HIDDEN>) id 1r5DRW-0006pQ-KU
 for bug-dejagnu@HIDDEN; Mon, 20 Nov 2023 18:12:38 -0500
Received: from omta034.useast.a.cloudfilter.net ([44.202.169.33])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <tom@HIDDEN>) id 1r5DRT-000839-8a
 for bug-dejagnu@HIDDEN; Mon, 20 Nov 2023 18:12:38 -0500
Received: from eig-obgw-6007a.ext.cloudfilter.net ([10.0.30.247])
 by cmsmtp with ESMTPS
 id 5BpqrOjuSjtZ35DRKrVd4L; Mon, 20 Nov 2023 23:12:26 +0000
Received: from box5379.bluehost.com ([162.241.216.53]) by cmsmtp with ESMTPS
 id 5DRErhoffqmEo5DREr8DTS; Mon, 20 Nov 2023 23:12:20 +0000
X-Authority-Analysis: v=2.4 cv=P+8pOwMu c=1 sm=1 tr=0 ts=655be7d4
 a=ApxJNpeYhEAb1aAlGBBbmA==:117 a=ApxJNpeYhEAb1aAlGBBbmA==:17
 a=OWjo9vPv0XrRhIrVQ50Ab3nP57M=:19 a=dLZJa+xiwSxG16/P+YVxDGlgEgI=:19
 a=BNY50KLci1gA:10 a=Qbun_eYptAEA:10 a=VwJtq0nCfB0pN8G9rVwA:9
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=tromey.com; 
 s=default;
 h=Content-Type:MIME-Version:Message-ID:Date:Subject:To:From:Sender
 :Reply-To:Cc:Content-Transfer-Encoding:Content-ID:Content-Description:
 Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:
 In-Reply-To:References:List-Id:List-Help:List-Unsubscribe:List-Subscribe:
 List-Post:List-Owner:List-Archive;
 bh=ugifTlalspQhRPbX5E9fWncD6FBOTWsU1bk/yGtHXxk=; b=ImB2qy8D39LkC5PBk5bdZsT31B
 VoMfiOe11n4aM7B/GYTlyAzeGud1AHiurm112/baYjatkBw2v215we/HeO0h0sqOMkQ3jDBBNjlo8
 8Q1tFNZ7UDF/rHpcKlHP2hCZg;
Received: from 97-122-77-73.hlrn.qwest.net ([97.122.77.73]:39486 helo=prentzel)
 by box5379.bluehost.com with esmtpsa (TLS1.2) tls
 TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96.2)
 (envelope-from <tom@HIDDEN>) id 1r5DRE-000tR5-0d;
 Mon, 20 Nov 2023 16:12:20 -0700
From: Tom Tromey <tom@HIDDEN>
To: bug-dejagnu@HIDDEN
Subject: dejagnu creates testrun.{sum,log}
X-Attribution: Tom
Date: Mon, 20 Nov 2023 16:12:35 -0700
Message-ID: <87edgkyq70.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain
X-AntiAbuse: This header was added to track abuse,
 please include it with any abuse report
X-AntiAbuse: Primary Hostname - box5379.bluehost.com
X-AntiAbuse: Original Domain - gnu.org
X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12]
X-AntiAbuse: Sender Address Domain - tromey.com
X-BWhitelist: no
X-Source-IP: 97.122.77.73
X-Source-L: No
X-Exim-ID: 1r5DRE-000tR5-0d
X-Source: 
X-Source-Args: 
X-Source-Dir: 
X-Source-Sender: 97-122-77-73.hlrn.qwest.net (prentzel) [97.122.77.73]:39486
X-Source-Auth: tom+tromey.com
X-Email-Count: 1
X-Org: HG=bhshared;ORG=bluehost;
X-Source-Cap: ZWx5bnJvYmk7ZWx5bnJvYmk7Ym94NTM3OS5ibHVlaG9zdC5jb20=
X-Local-Domain: yes
X-CMAE-Envelope: MS4xfO/KoQmfQfXjCIMvgaKvoo6XkGs8UrkrU/L15+YaJS0KGSnRgUNgR7Mj0ObJ37lZfCLEzudvRmz7bdNMBX9gn7bflwvI1cGgsSZYeNdGOHTWwIEVGJIc
 HlMRH6vttFx6WMtHq4cSENocuj5mFzNiaGZdZ95GpC8Htyysr/UFs+pFbc03XkqE5CqYiJJek4ogeQ==
Received-SPF: permerror client-ip=44.202.169.33; envelope-from=tom@HIDDEN;
 helo=omta034.useast.a.cloudfilter.net
X-Spam_score_int: -18
X-Spam_score: -1.9
X-Spam_bar: -
X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
 DKIM_VALID=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001,
 SPF_HELO_NONE=0.001, SPF_PASS=-0.001,
 T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

I've noticed that if I run 'runtest' in the wrong directory -- for
example in the source directory rather than the appropriate build
directory -- dejagnu will create files testrun.log and testrun.sum.

In this case these files are not actually useful.

And, runtest already emits some warnings about this:

prentzel. runtest 
WARNING: testsuite is not in a testsuite/ directory.
WARNING: Couldn't find the global config file.
WARNING: No tool specified

I think it would be nicer if, when dejagnu notices that the environment
is unsuitable (like, no tool specified), then it should just print
errors and exit -- without creating these files.

thanks
Tom




Acknowledgement sent to Tom Tromey <tom@HIDDEN>:
New bug report received and forwarded. Copy sent to bug-dejagnu@HIDDEN. Full text available.
Report forwarded to bug-dejagnu@HIDDEN:
bug#67312; Package dejagnu. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Wed, 22 Nov 2023 23:15:01 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.