GNU bug report logs - #48113
Self-test timeout functionality

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: automake; Severity: wishlist; Reported by: Simon Josefsson <simon@HIDDEN>; dated Fri, 30 Apr 2021 09:25:02 UTC; Maintainer for automake is bug-automake@HIDDEN.
Changed bug title to 'Self-test timeout functionality' from 'Module suggestion: timeout' Request was from Simon Josefsson <simon@HIDDEN> to control <at> debbugs.gnu.org. Full text available.
Severity set to 'wishlist' from 'normal' Request was from Simon Josefsson <simon@HIDDEN> to control <at> debbugs.gnu.org. Full text available.

Message received at 48113 <at> debbugs.gnu.org:


Received: (at 48113) by debbugs.gnu.org; 2 May 2021 07:30:39 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sun May 02 03:30:39 2021
Received: from localhost ([127.0.0.1]:41152 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1ld6Yo-00087e-Nq
	for submit <at> debbugs.gnu.org; Sun, 02 May 2021 03:30:39 -0400
Received: from uggla.sjd.se ([178.174.241.107]:47688)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <simon@HIDDEN>)
 id 1ld6Yn-000850-0B; Sun, 02 May 2021 03:30:37 -0400
DKIM-Signature: v=1; a=ed25519-sha256; q=dns/txt; c=relaxed/relaxed;
 d=josefsson.org; s=ed2101; h=Content-Type:MIME-Version:Message-ID:In-Reply-To
 :Date:References:Subject:Cc:To:From:Sender:Reply-To:Content-Transfer-Encoding
 :Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender:
 Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:
 List-Subscribe:List-Post:List-Owner:List-Archive;
 bh=/6GRbEIPiU3gADLHY05BJ840RHapUg03KSgK0V1q9+I=; t=1619940637; x=1621150237;
 b=2BPKUxJaDyZ6ejZqJnfMd4/cPfl0Bqy7asJbi6K9OfS8UzBe4qN7gd6IGdqNGe6uGyrZqT59tG
 dlUXmW8eR7Ag==;
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed;
 d=josefsson.org; s=rsa2101; h=Content-Type:MIME-Version:Message-ID:
 In-Reply-To:Date:References:Subject:Cc:To:From:Sender:Reply-To:
 Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date:
 Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id:
 List-Help:List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive;
 bh=/6GRbEIPiU3gADLHY05BJ840RHapUg03KSgK0V1q9+I=; t=1619940637; x=1621150237;
 b=wlf1d+IL8RZrVRWoNgbjx8rzFR/cMtrEJvWENp97mOnjmRKZlk8D1B5TxX3jT2zpgcMsMnBxhL
 4g3w+0rpBBaxJ9Yzs+tfmEFbWFfnsc4uoH89ikATiFL1xHjwai67JJ7vZGm6CuJhx/3pbY7FRTqP/
 BP5VkOCkbMHjO9oVxdO4E+bP7OZKsdkle2TZq5u+Dx7JV6SGSIpegISoKqnkub8tbuXAzAIHJLnub
 2DkoHdkLczRVVHEm4UyhTzRTkLuTG9ni+ae03LI3id35GZuVdHqN+1D14axPZv52fc7kVZF+O98PT
 czaBRKeVUlBUOiRRSedJy8AJTwA36nslVK/o23km8D3+EVj7vNP7kQKVRbPJct+WEYMwPBaUngmWE
 95+UiRdQYEg2sLPsiBVM8oF+YlbZcD1BkpsTuIkpt8eL3FpCXr6NRIqhrjvV2c2doKPshzGun/
 ;
Received: from [2001:9b1:41ac:ff00:f047:8306:af6:1c20] (port=34166 helo=latte)
 by uggla.sjd.se with esmtpsa
 (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92)
 (envelope-from <simon@HIDDEN>)
 id 1ld6Yf-0001Hx-Ec; Sun, 02 May 2021 07:30:29 +0000
From: Simon Josefsson <simon@HIDDEN>
To: Karl Berry <karl@HIDDEN>
Subject: Re: bug#48113: Module suggestion: timeout
References: <878s50dt1n.fsf@HIDDEN>
 <202105012113.141LD0kr031717@HIDDEN>
OpenPGP: id=B1D2BD1375BECB784CF4F8C4D73CF638C53C06BE;
 url=https://josefsson.org/key-20190320.txt
X-Hashcash: 1:22:210502:bug-gnulib@HIDDEN::svpqh+5Xs2FutOgH:A4AQ
X-Hashcash: 1:22:210502:bruno@HIDDEN::92Qtlg6Wt+/fpJ9t:KIQe
X-Hashcash: 1:22:210502:48113 <at> debbugs.gnu.org::tXrBUDMapvTd0CR8:F7R4
X-Hashcash: 1:22:210502:karl@HIDDEN::W2PIvf9/yBA8kL6H:OogE
X-Hashcash: 1:22:210502:marc.nieper@HIDDEN::vLUwx6kBrpQIqMPa:RQzk
Date: Sun, 02 May 2021 09:30:29 +0200
In-Reply-To: <202105012113.141LD0kr031717@HIDDEN> (Karl Berry's
 message of "Sat, 1 May 2021 15:13:00 -0600")
Message-ID: <87lf8x8uei.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.1 (gnu/linux)
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="=-=-=";
 micalg=pgp-sha256; protocol="application/pgp-signature"
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: 48113
Cc: marc.nieper+gnu@HIDDEN, bug-gnulib@HIDDEN, bruno@HIDDEN,
 48113 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

--=-=-=
Content-Type: text/plain
Content-Transfer-Encoding: quoted-printable

severity 48113 wishlist
retitle 48113 Self-test timeout functionality
thanks

Karl Berry <karl@HIDDEN> writes:

>     What do bug-automake people think?
>
> For myself, I have no objection to sprinkling timeout commands through
> the Automake test infrastructure wherever appropriate. It's not ever
> going to rise to the top of my own list of things to do, though, so if
> it's going to happen, you or someone will have to write the patch.
>
> Of course I don't speak for Jim, but from what he's said in the past,
> I suspect he is in a similar situation.

Thanks for confirming that it isn't an obviously bad idea.  Tagging this
as a wishlist bug, and improving the bug title a bit.

> No one else has come forward to work on Automake, despite my plea
> (https://lists.gnu.org/archive/html/automake/2021-03/msg00018.html),
> so I guess that's where we are.

Ah right -- I'll see if I can help in any way, but will respond
separately.

>     the functionality could be opt-in initially,=20
>
> Certainly.
>
>     and then after a few years become the default behaviour.
>
> Personally, I think it should be opt-in forever. People could easily
> have test suites that need to run for days. I prefer not to
> unnecessarily break compatibility.

Yes, I probably agree with this -- chosing the default timeout setting
is difficult as it will most likely just cause problems for some people
with long-running tests, and not solve the initial problem for some
other people (that have small projects and a timeout of 5 minutes is
what you want).  Better leave this up the each project to decide.

/Simon

--=-=-=
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----

iHUEARYIAB0WIQSjzJyHC50xCrrUzy9RcisI/kdFogUCYI5VFQAKCRBRcisI/kdF
ogSiAQCDDlSGTlcSevOOZVtgqv38cnxmp7nNWlBdGRjaRh9+2QD9FSi8d49LhtdO
tstzQr2ChO8kyeq9jM7tUBbtdlD4GQ8=
=HtRV
-----END PGP SIGNATURE-----
--=-=-=--




Information forwarded to bug-automake@HIDDEN:
bug#48113; Package automake. Full text available.

Message received at 48113 <at> debbugs.gnu.org:


Received: (at 48113) by debbugs.gnu.org; 1 May 2021 21:13:08 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sat May 01 17:13:08 2021
Received: from localhost ([127.0.0.1]:38433 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1lcwvE-0005cU-96
	for submit <at> debbugs.gnu.org; Sat, 01 May 2021 17:13:08 -0400
Received: from freefriends.org ([96.88.95.60]:34140)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <karl@HIDDEN>) id 1lcwvC-0005cO-9a
 for 48113 <at> debbugs.gnu.org; Sat, 01 May 2021 17:13:06 -0400
X-Envelope-From: karl@HIDDEN
Received: from freefriends.org (freefriends.org [96.88.95.60])
 by freefriends.org (8.14.7/8.14.7) with ESMTP id 141LD1T8031720
 (version=TLSv1/SSLv3 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); 
 Sat, 1 May 2021 15:13:01 -0600
Received: (from apache@localhost)
 by freefriends.org (8.14.7/8.14.7/Submit) id 141LD0kr031717;
 Sat, 1 May 2021 15:13:00 -0600
Date: Sat, 1 May 2021 15:13:00 -0600
Message-Id: <202105012113.141LD0kr031717@HIDDEN>
From: Karl Berry <karl@HIDDEN>
To: simon@HIDDEN
Subject: Re: bug#48113: Module suggestion: timeout
In-Reply-To: <878s50dt1n.fsf@HIDDEN>
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: 48113
Cc: marc.nieper+gnu@HIDDEN, bug-gnulib@HIDDEN, bruno@HIDDEN,
 48113 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

    What do bug-automake people think?

For myself, I have no objection to sprinkling timeout commands through
the Automake test infrastructure wherever appropriate. It's not ever
going to rise to the top of my own list of things to do, though, so if
it's going to happen, you or someone will have to write the patch.

Of course I don't speak for Jim, but from what he's said in the past,
I suspect he is in a similar situation.

No one else has come forward to work on Automake, despite my plea
(https://lists.gnu.org/archive/html/automake/2021-03/msg00018.html),
so I guess that's where we are.
    
    the functionality could be opt-in initially, 

Certainly.

    and then after a few years become the default behaviour.

Personally, I think it should be opt-in forever. People could easily
have test suites that need to run for days. I prefer not to
unnecessarily break compatibility.

Thanks,
Karl




Information forwarded to bug-automake@HIDDEN:
bug#48113; Package automake. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 30 Apr 2021 09:47:33 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Fri Apr 30 05:47:33 2021
Received: from localhost ([127.0.0.1]:57526 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1lcPkD-0007OI-Cx
	for submit <at> debbugs.gnu.org; Fri, 30 Apr 2021 05:47:33 -0400
Received: from lists.gnu.org ([209.51.188.17]:46884)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <marc.nieper@HIDDEN>) id 1lcPk9-0007O9-OE
 for submit <at> debbugs.gnu.org; Fri, 30 Apr 2021 05:47:31 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10]:52712)
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <marc.nieper@HIDDEN>)
 id 1lcPk9-000446-Ca; Fri, 30 Apr 2021 05:47:29 -0400
Received: from mail-pg1-x52c.google.com ([2607:f8b0:4864:20::52c]:36571)
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128)
 (Exim 4.90_1) (envelope-from <marc.nieper@HIDDEN>)
 id 1lcPk7-00072p-PR; Fri, 30 Apr 2021 05:47:29 -0400
Received: by mail-pg1-x52c.google.com with SMTP id j7so39656948pgi.3;
 Fri, 30 Apr 2021 02:47:27 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;
 h=mime-version:references:in-reply-to:from:date:message-id:subject:to
 :cc; bh=QGvZAHJqtY2NkQLTq1VXf/onqlXnwtll1/HfbItHfAk=;
 b=XCysvC8NQCumJE/RVCYUL8SDrEDe4au7wCgvJxU6uiLDT2NFHzYoYGglY0aAIbc4Z+
 a531ozqXOT5ZF+2AigJoiA6EFivxwYaIYBgFZujaIBUcf4rQBEZTx5GXeTWgw7n1um4s
 4VYThgB8JnJlN03YECQkLNHiNUrYhQy9gbR0X1wXgsJy1qnbAFabu4OnJDtIZzRbeTbw
 IXfLe/AX1gzUGi1KoSOjKRg/Uh3JJJHnel+pf49VP/J4GgLlruZhf+hU+vKcNZCJWnwY
 r/wNdHUhar2WRpMtgUvlcWDW2g6GOaLC+LgDtLnDZSZ+xi3hJMN6reL9qi1rb+glJ1SU
 feDA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:mime-version:references:in-reply-to:from:date
 :message-id:subject:to:cc;
 bh=QGvZAHJqtY2NkQLTq1VXf/onqlXnwtll1/HfbItHfAk=;
 b=lagJkoYxIkVAVUWkbhL/1BydWfLO5SJgTTswNFWU5+/bjkENwIxFjWJ5nPXYzi1dvK
 jWjiX5h2whKGEh9Thar+2ksb8w2gTAllz+IouHPf5prswi7XqLV8jtgE21eAbHNOCGus
 yaID9TG9jpjh6WMTKKYQYnmezjzzYylFu9tPLawRVK5eyDs444w2MifEU8RoBnAQN8ps
 e5ARTcuAoaUsVRh5eMryKbieXeM9p3QxkJJNffWZgXq3tAsbTSJw0s7qGTOSD3agaWst
 hTusGg3xOBzbU5yJCzBmB/KcLmW6MP50HXlGo1/U0X7UlDfnQrM6XIm8KtFHaKIVD05V
 hWMg==
X-Gm-Message-State: AOAM530hsBCJT2iJvShUBdORVdCH5iR3N+n1ik5o7HAPO1Iz/hS/JaMU
 1dMUeulF270zP77vuyT/VCo+gRdGPA7TV5nrcf8=
X-Google-Smtp-Source: ABdhPJxcY9Cub7x4FRJpsEApOP4C1Gma2qz3c62vYYrl1RvxP4iQUotffwGsRIumCt+KTJksxhzcePuiAlpY111a/wM=
X-Received: by 2002:a05:6a00:1742:b029:27a:218b:5a85 with SMTP id
 j2-20020a056a001742b029027a218b5a85mr4346961pfc.64.1619776045773; Fri, 30 Apr
 2021 02:47:25 -0700 (PDT)
MIME-Version: 1.0
References: <CAEYrNrToxH2y85z2Qmu1bbws6F4f4d-Vuv_CrBE0ZX6LPpoLTg@HIDDEN>
 <1734109.oLkUVmKVoB@omega> <878s50dt1n.fsf@HIDDEN>
 <CAEYrNrQigrZNQOksiiawOuPZriyx99edkjaM3pw3wnyddDqvrw@HIDDEN>
 <874kfods5n.fsf@HIDDEN>
In-Reply-To: <874kfods5n.fsf@HIDDEN>
From: =?UTF-8?Q?Marc_Nieper=2DWi=C3=9Fkirchen?= <marc.nieper+gnu@HIDDEN>
Date: Fri, 30 Apr 2021 11:47:14 +0200
Message-ID: <CAEYrNrTFsAAQM=23Ow4=-z1HJsPzFrfnc8PywbjVGaO=o=K+Hw@HIDDEN>
Subject: Re: Module suggestion: timeout
To: Simon Josefsson <simon@HIDDEN>
Content-Type: multipart/alternative; boundary="000000000000d2f71205c12d7f84"
Received-SPF: pass client-ip=2607:f8b0:4864:20::52c;
 envelope-from=marc.nieper@HIDDEN; helo=mail-pg1-x52c.google.com
X-Spam_score_int: -10
X-Spam_score: -1.1
X-Spam_bar: -
X-Spam_report: (-1.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
 DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001,
 FREEMAIL_REPLY=1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001,
 SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=no autolearn_force=no
X-Spam_action: no action
X-Spam-Score: -0.3 (/)
X-Debbugs-Envelope-To: submit
Cc: bug-automake@HIDDEN,
 =?UTF-8?Q?Marc_Nieper=2DWi=C3=9Fkirchen?= <marc.nieper+gnu@HIDDEN>,
 "bug-gnulib@HIDDEN List" <bug-gnulib@HIDDEN>, Bruno Haible <bruno@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.3 (--)

--000000000000d2f71205c12d7f84
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Adding timeout to all build operations automatically is probably too much
and too intrusive.

But in any case, it should be easy to add such a timeout to certain build
operations (e.g. downloading, running a compiler for which the halting
problem cannot be solved, testing a production binary, ...).

Am Fr., 30. Apr. 2021 um 11:43 Uhr schrieb Simon Josefsson <
simon@HIDDEN>:

> Marc Nieper-Wi=C3=9Fkirchen <marc.nieper+gnu@HIDDEN> writes:
>
> > Moreover, use cases for a baked-in timeout are not restricted to tests.
> For
> > example, I may want to restrict the build time of certain components in
> > situations where a logical error may lead to infinite build times (a
> simple
> > example is that of a Scheme compiler used as a build tool; thanks to
> > Turing-completeness of Scheme macros, such a build may not terminate).
>
> This makes me believe even stronger that the functionality ought to be
> provided by automake natively -- it seems the desired functionality is
> not only timeouts for self-tests but timeouts for all operations.
>
> Implementing this for self-tests in automake would probably be quite
> simple, but implementing it for all operations is probably more
> complicated.  Maybe it should be two separate features.  I have wanted
> timeouts for self-tests but rarely for building.  If the second is more
> complicated to implement, maybe starting with the first will be
> sufficient and useful.
>
> /Simon
>

--000000000000d2f71205c12d7f84
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div class=3D"gmail_default" style=3D"font-family:monospac=
e">Adding timeout to all build operations automatically is probably too muc=
h and too intrusive.</div><div class=3D"gmail_default" style=3D"font-family=
:monospace"><br></div><div class=3D"gmail_default" style=3D"font-family:mon=
ospace">But in any case, it should be easy to add such a timeout to certain=
 build operations (e.g. downloading, running a compiler for which the halti=
ng problem cannot be solved, testing a production binary, ...).<br></div></=
div><br><div class=3D"gmail_quote"><div dir=3D"ltr" class=3D"gmail_attr">Am=
 Fr., 30. Apr. 2021 um 11:43=C2=A0Uhr schrieb Simon Josefsson &lt;<a href=
=3D"mailto:simon@HIDDEN">simon@HIDDEN</a>&gt;:<br></div><bloc=
kquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:=
1px solid rgb(204,204,204);padding-left:1ex">Marc Nieper-Wi=C3=9Fkirchen &l=
t;<a href=3D"mailto:marc.nieper%2Bgnu@HIDDEN" target=3D"_blank">marc.nie=
per+gnu@HIDDEN</a>&gt; writes:<br>
<br>
&gt; Moreover, use cases for a baked-in timeout are not restricted to tests=
. For<br>
&gt; example, I may want to restrict the build time of certain components i=
n<br>
&gt; situations where a logical error may lead to infinite build times (a s=
imple<br>
&gt; example is that of a Scheme compiler used as a build tool; thanks to<b=
r>
&gt; Turing-completeness of Scheme macros, such a build may not terminate).=
<br>
<br>
This makes me believe even stronger that the functionality ought to be<br>
provided by automake natively -- it seems the desired functionality is<br>
not only timeouts for self-tests but timeouts for all operations.<br>
<br>
Implementing this for self-tests in automake would probably be quite<br>
simple, but implementing it for all operations is probably more<br>
complicated.=C2=A0 Maybe it should be two separate features.=C2=A0 I have w=
anted<br>
timeouts for self-tests but rarely for building.=C2=A0 If the second is mor=
e<br>
complicated to implement, maybe starting with the first will be<br>
sufficient and useful.<br>
<br>
/Simon<br>
</blockquote></div>

--000000000000d2f71205c12d7f84--




Information forwarded to bug-automake@HIDDEN:
bug#48113; Package automake. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 30 Apr 2021 09:43:30 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Fri Apr 30 05:43:30 2021
Received: from localhost ([127.0.0.1]:57506 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1lcPgI-0007HT-CX
	for submit <at> debbugs.gnu.org; Fri, 30 Apr 2021 05:43:30 -0400
Received: from lists.gnu.org ([209.51.188.17]:44230)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <simon@HIDDEN>) id 1lcPgH-0007HM-Hz
 for submit <at> debbugs.gnu.org; Fri, 30 Apr 2021 05:43:29 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10]:52016)
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <simon@HIDDEN>)
 id 1lcPgH-0002nj-6S; Fri, 30 Apr 2021 05:43:29 -0400
Received: from uggla.sjd.se ([2001:9b1:8633::107]:58178)
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <simon@HIDDEN>)
 id 1lcPgD-0004an-Mt; Fri, 30 Apr 2021 05:43:28 -0400
DKIM-Signature: v=1; a=ed25519-sha256; q=dns/txt; c=relaxed/relaxed;
 d=josefsson.org; s=ed2101; h=Content-Type:MIME-Version:Message-ID:In-Reply-To
 :Date:References:Subject:Cc:To:From:Sender:Reply-To:Content-Transfer-Encoding
 :Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender:
 Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:
 List-Subscribe:List-Post:List-Owner:List-Archive;
 bh=Zh0UzYToCeSepbLZUCMLcWfW/WtVPY+JeOQLLtfQLMU=; t=1619775804; x=1620985404;
 b=lIwCD76IKPu0rbww7aJfB8lbthlECJNMjybs2k8HoZmttDszy+fTa9wcX3Sz/LH6NJsw+R6W5c
 12YAE/n0rEDg==;
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed;
 d=josefsson.org; s=rsa2101; h=Content-Type:MIME-Version:Message-ID:
 In-Reply-To:Date:References:Subject:Cc:To:From:Sender:Reply-To:
 Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date:
 Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id:
 List-Help:List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive;
 bh=Zh0UzYToCeSepbLZUCMLcWfW/WtVPY+JeOQLLtfQLMU=; t=1619775804; x=1620985404;
 b=mKOhamVJXda3Gcdt7JQ715G/5yPSTrXwr23NZRADNMPCKGitmDnCXZTuriBsSairM3XPqh7M+B
 EI4yh/Xll0/AePVRp3Wfi4yKFkyaPDRIkHkvRnJ3HvRDmznkvmmvZjzaHUp/aQYmUoQAS7dD8f7Ba
 kOlo0dIp1y1ztf4OvRYkQmO+7C1KIzZjQLIh/yBpoe8OsXqlnxzEffP6XA7jW4Z6hkVaaxRLV54JC
 6qZjTHbVT2mK+dmgi81xE5B+nRTsCEnDJbMRrGYcPMK/5FP2E6dEbgx1xqnMn4YE73PzjrxGK9M8i
 KCWbnkbP41XYNrIV8uM6Lf1q3BgLgvoCQY9Tm7fl/UT4+hfKM5WGeI37FC6qjPrcy0K96V5RtrGQP
 +5gBeKp4SmF4ut44QHH0D4qvOsqtCkQq3DAC+BGgAvR3/QUrT4UoIyQURcYocERLVH3OI9PEas
 ;
Received: from [2001:9b1:41ac:ff00:6052:f957:257:b242] (port=38046 helo=latte)
 by uggla.sjd.se with esmtpsa
 (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92)
 (envelope-from <simon@HIDDEN>)
 id 1lcPg5-0002X2-30; Fri, 30 Apr 2021 09:43:17 +0000
From: Simon Josefsson <simon@HIDDEN>
To: Marc =?iso-8859-1?Q?Nieper-Wi=DFkirchen?= <marc.nieper+gnu@HIDDEN>
Subject: Re: Module suggestion: timeout
References: <CAEYrNrToxH2y85z2Qmu1bbws6F4f4d-Vuv_CrBE0ZX6LPpoLTg@HIDDEN>
 <1734109.oLkUVmKVoB@omega> <878s50dt1n.fsf@HIDDEN>
 <CAEYrNrQigrZNQOksiiawOuPZriyx99edkjaM3pw3wnyddDqvrw@HIDDEN>
OpenPGP: id=B1D2BD1375BECB784CF4F8C4D73CF638C53C06BE;
 url=https://josefsson.org/key-20190320.txt
X-Hashcash: 1:22:210430:bug-automake@HIDDEN::BrQ2e6BHhzbBj6op:0QMt
X-Hashcash: 1:22:210430:bruno@HIDDEN::xHqOXnNNQXZBG5nF:6D0d
X-Hashcash: 1:22:210430:bug-gnulib@HIDDEN::bw4poLytrSF0+fIJ:9LYs
X-Hashcash: 1:22:210430:marc.nieper@HIDDEN::owlWNpLJ0PhiLFS3:G6yu
Date: Fri, 30 Apr 2021 11:43:16 +0200
In-Reply-To: <CAEYrNrQigrZNQOksiiawOuPZriyx99edkjaM3pw3wnyddDqvrw@HIDDEN>
 ("Marc \=\?iso-8859-1\?Q\?Nieper-Wi\=DFkirchen\=22's\?\= message of "Fri,
 30 Apr 2021 11:37:45 +0200")
Message-ID: <874kfods5n.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.1 (gnu/linux)
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="=-=-=";
 micalg=pgp-sha256; protocol="application/pgp-signature"
Received-SPF: pass client-ip=2001:9b1:8633::107;
 envelope-from=simon@HIDDEN; helo=uggla.sjd.se
X-Spam_score_int: -20
X-Spam_score: -2.1
X-Spam_bar: --
X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
 DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_HELO_PASS=-0.001,
 SPF_PASS=-0.001 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: -1.4 (-)
X-Debbugs-Envelope-To: submit
Cc: "bug-gnulib@HIDDEN List" <bug-gnulib@HIDDEN>, bug-automake@HIDDEN,
 Bruno Haible <bruno@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.4 (--)

--=-=-=
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable

Marc Nieper-Wi=DFkirchen <marc.nieper+gnu@HIDDEN> writes:

> Moreover, use cases for a baked-in timeout are not restricted to tests. F=
or
> example, I may want to restrict the build time of certain components in
> situations where a logical error may lead to infinite build times (a simp=
le
> example is that of a Scheme compiler used as a build tool; thanks to
> Turing-completeness of Scheme macros, such a build may not terminate).

This makes me believe even stronger that the functionality ought to be
provided by automake natively -- it seems the desired functionality is
not only timeouts for self-tests but timeouts for all operations.

Implementing this for self-tests in automake would probably be quite
simple, but implementing it for all operations is probably more
complicated.  Maybe it should be two separate features.  I have wanted
timeouts for self-tests but rarely for building.  If the second is more
complicated to implement, maybe starting with the first will be
sufficient and useful.

/Simon

--=-=-=
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----

iHQEARYIAB0WIQSjzJyHC50xCrrUzy9RcisI/kdFogUCYIvRNAAKCRBRcisI/kdF
ohf5APiPyDP7UjnDXj9lSXQJ7eIdN0XleLxNy9CR9CKOr3bJAQCW5lIM3h1cixTM
DiFYe0tGRiWMslcrtgRfjM9sHh+3CA==
=irSl
-----END PGP SIGNATURE-----
--=-=-=--




Information forwarded to bug-automake@HIDDEN:
bug#48113; Package automake. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 30 Apr 2021 09:38:10 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Fri Apr 30 05:38:09 2021
Received: from localhost ([127.0.0.1]:57498 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1lcPb7-00079o-BC
	for submit <at> debbugs.gnu.org; Fri, 30 Apr 2021 05:38:09 -0400
Received: from lists.gnu.org ([209.51.188.17]:41376)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <marc.nieper@HIDDEN>) id 1lcPb5-00079h-Av
 for submit <at> debbugs.gnu.org; Fri, 30 Apr 2021 05:38:08 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10]:51220)
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <marc.nieper@HIDDEN>)
 id 1lcPb2-0001OA-1G; Fri, 30 Apr 2021 05:38:05 -0400
Received: from mail-pf1-x42a.google.com ([2607:f8b0:4864:20::42a]:33779)
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128)
 (Exim 4.90_1) (envelope-from <marc.nieper@HIDDEN>)
 id 1lcPax-0001aE-AN; Fri, 30 Apr 2021 05:38:03 -0400
Received: by mail-pf1-x42a.google.com with SMTP id h11so8448351pfn.0;
 Fri, 30 Apr 2021 02:37:57 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;
 h=mime-version:references:in-reply-to:from:date:message-id:subject:to
 :cc; bh=q3JCcqqj9fe6Qbbvfz8vwr7cvH0n8fkxq++xrsmnriQ=;
 b=uSBP6zeywj6e+GZrWUt/blvN0RXHEQMPUmajWMb6JHkemAdExHl3YqcR7IGmptSrK4
 4mstbWZ7U3Euiep574gJ0iNJq7e6nZqBbYJhBUrkh4QhehFF5dijHeYTTD7Sa6NM8Nb5
 FLuRmd0xkiiVnNURvYxQFvzI/LCYQRT58OpaW4UxErbHyMF/lv+sFHRnmMRFRFrXovvF
 z35TNCpI8qAiMaWk1m2t2f5QDG+S46qkxgzmwt1HaJavJ2mNd0gyMJuvZNtvIhZhKBC0
 wDKHNg32SBDP5iL+fARvcIHy1FNHdYJR5LUBFsrOJoD+3X35dk1sht87nv+6sNHBUOPH
 iMaA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:mime-version:references:in-reply-to:from:date
 :message-id:subject:to:cc;
 bh=q3JCcqqj9fe6Qbbvfz8vwr7cvH0n8fkxq++xrsmnriQ=;
 b=CGEEAXYOWpB8E3UpiF5lISoTsg+6C2CviTCiYea5Ssw2Yf1rnrDen67/Vc2TR/G5iO
 F/B1vm5z72MniPWwz2uVUMjo6NqCKWHbLEkPATyDqK/fYUcyLcY08SKpAPw6Oym0MH6r
 9yKffMQDqWvS0RZjJzIcBlRt1ttrsFkck0ltTfQOb8Jy7WvCn3K/h1c7x6aoTEx5dvEG
 Zzkz6aiZL6Kgs4/0Tsil3UA0KA/0a5fOXDPkU747vMiRAzxhGSCZphaPXpYhg3RiMfZd
 5exKDhJfua55XzBggmov2YO/3EOOdSZxaKMe3PsRKx4tA1dTpRdfY1ZItamVbPDi69Lj
 7DCg==
X-Gm-Message-State: AOAM532SfgpCKF0g9msGQ2g3RAS/AdV+z4yWiK7TBEJH9WBurZBOnDiR
 JXObOZ+hgHh0Q7CxZE/A2xMkjmuEAGKAbXqyNCU=
X-Google-Smtp-Source: ABdhPJxOPXeR4BP0O0tTBeQqnAoheBJic7sOYwcoviTMLOlqjDnoNwvKjxCph+Y4yEEtdkd8rHBmT5+U2gVLW21P8E0=
X-Received: by 2002:a65:4281:: with SMTP id j1mr3816082pgp.348.1619775476798; 
 Fri, 30 Apr 2021 02:37:56 -0700 (PDT)
MIME-Version: 1.0
References: <CAEYrNrToxH2y85z2Qmu1bbws6F4f4d-Vuv_CrBE0ZX6LPpoLTg@HIDDEN>
 <1734109.oLkUVmKVoB@omega> <878s50dt1n.fsf@HIDDEN>
In-Reply-To: <878s50dt1n.fsf@HIDDEN>
From: =?UTF-8?Q?Marc_Nieper=2DWi=C3=9Fkirchen?= <marc.nieper+gnu@HIDDEN>
Date: Fri, 30 Apr 2021 11:37:45 +0200
Message-ID: <CAEYrNrQigrZNQOksiiawOuPZriyx99edkjaM3pw3wnyddDqvrw@HIDDEN>
Subject: Re: Module suggestion: timeout
To: Simon Josefsson <simon@HIDDEN>
Content-Type: multipart/alternative; boundary="000000000000e9192a05c12d5d89"
Received-SPF: pass client-ip=2607:f8b0:4864:20::42a;
 envelope-from=marc.nieper@HIDDEN; helo=mail-pf1-x42a.google.com
X-Spam_score_int: -20
X-Spam_score: -2.1
X-Spam_bar: --
X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
 DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001,
 HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001,
 SPF_PASS=-0.001 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: -1.3 (-)
X-Debbugs-Envelope-To: submit
Cc: "bug-gnulib@HIDDEN List" <bug-gnulib@HIDDEN>, bug-automake@HIDDEN,
 Bruno Haible <bruno@HIDDEN>,
 =?UTF-8?Q?Marc_Nieper=2DWi=C3=9Fkirchen?= <marc.nieper+gnu@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.3 (--)

--000000000000e9192a05c12d5d89
Content-Type: text/plain; charset="UTF-8"

Dear Bruno, dear Simon,

thank you for your replies.

I understand that valgrind-tests and the proposed "timeout-tests" solution
are not completely equivalent. Nevertheless, I still think that some
timeout functionality provided by Gnulib would be useful.

Bruno's solution

**
#if HAVE_DECL_ALARM
  /* Declare failure if test takes too long, by using default abort
     caused by SIGALRM.  */
  int alarm_value = 600;
  signal (SIGALRM, SIG_DFL);
  alarm (alarm_value);
#endif
**

works for unit tests that have been written specifically for the project.
It doesn't help, though, if I want to test (production) binaries that are
to be installed because I generally don't want testing code inside them.

Moreover, use cases for a baked-in timeout are not restricted to tests. For
example, I may want to restrict the build time of certain components in
situations where a logical error may lead to infinite build times (a simple
example is that of a Scheme compiler used as a build tool; thanks to
Turing-completeness of Scheme macros, such a build may not terminate).

Marc

Am Fr., 30. Apr. 2021 um 11:24 Uhr schrieb Simon Josefsson <
simon@HIDDEN>:

> Bruno Haible <bruno@HIDDEN> writes:
>
> > So, I don't think the "let's treat timeout like valgrind" approach is
> going
> > to work. Instead, you need to design a way to deal with timeouts,
> independently.
>
> Hi!  I think Marc's request for functionality to introduce timeouts for
> self-tests is a good one.  However I reach the same conclusion as Bruno,
> that having a module like valgrind-tests is probably not the best way to
> solve it.  To me, having a timeout seems like an essential feature of a
> self-test framework.  I know automake isn't primarily a self-test
> framework, but it has concepts for it and the test framework has been
> improved significantly over the years, so I think adding a timeout
> functionality to automake makes sense.  What do bug-automake people
> think?
>
> The functionality could be conditioned on the coreutils 'timeout' tool,
> and if that tool exists, and appears to work, running all self-tests
> under that tool could be done automatically.  The default self-test
> timeout be quite generous (say 17 hours?) but it should be easy to
> modify both by end-user and project developer.  If we want to be
> conservative, the functionality could be opt-in initially, and then
> after a few years become the default behaviour.
>
> Thoughts?
>
> /Simon
>

--000000000000e9192a05c12d5d89
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div class=3D"gmail_default" style=3D"font-family:monospac=
e">Dear Bruno, dear Simon,</div><div class=3D"gmail_default" style=3D"font-=
family:monospace"><br></div><div class=3D"gmail_default" style=3D"font-fami=
ly:monospace">thank you for your replies.</div><div class=3D"gmail_default"=
 style=3D"font-family:monospace"><br></div><div class=3D"gmail_default" sty=
le=3D"font-family:monospace">I understand that valgrind-tests and the propo=
sed &quot;timeout-tests&quot; solution are not completely equivalent. Never=
theless, I still think that some timeout functionality provided by Gnulib w=
ould be useful.</div><div class=3D"gmail_default" style=3D"font-family:mono=
space"><br></div><div class=3D"gmail_default" style=3D"font-family:monospac=
e">
Bruno&#39;s solution</div><div class=3D"gmail_default" style=3D"font-family=
:monospace"><br></div><div class=3D"gmail_default" style=3D"font-family:mon=
ospace">**</div><div class=3D"gmail_default" style=3D"font-family:monospace=
">#if HAVE_DECL_ALARM<br>
=C2=A0 /* Declare failure if test takes too long, by using default abort<br=
>
=C2=A0 =C2=A0 =C2=A0caused by SIGALRM.=C2=A0 */<br>
=C2=A0 int alarm_value =3D 600;<br>
=C2=A0 signal (SIGALRM, SIG_DFL);<br>
=C2=A0 alarm (alarm_value);<br>
#endif <br></div><div class=3D"gmail_default" style=3D"font-family:monospac=
e">**</div><div class=3D"gmail_default" style=3D"font-family:monospace"><br=
></div><div class=3D"gmail_default" style=3D"font-family:monospace">works f=
or unit tests that have been written specifically for the project. It doesn=
&#39;t help, though, if I want to test (production) binaries that are to be=
 installed because I generally don&#39;t want testing code inside them.</di=
v><div class=3D"gmail_default" style=3D"font-family:monospace"><br></div><d=
iv class=3D"gmail_default" style=3D"font-family:monospace">Moreover, use ca=
ses for a baked-in timeout are not restricted to tests. For example, I may =
want to restrict the build time of certain components in situations where a=
 logical error may lead to infinite build times (a simple example is that o=
f a Scheme compiler used as a build tool; thanks to Turing-completeness of =
Scheme macros, such a build may not terminate).<br></div><div class=3D"gmai=
l_default" style=3D"font-family:monospace"><br></div><div class=3D"gmail_de=
fault" style=3D"font-family:monospace">Marc<br></div></div><br><div class=
=3D"gmail_quote"><div dir=3D"ltr" class=3D"gmail_attr">Am Fr., 30. Apr. 202=
1 um 11:24=C2=A0Uhr schrieb Simon Josefsson &lt;<a href=3D"mailto:simon@jos=
efsson.org">simon@HIDDEN</a>&gt;:<br></div><blockquote class=3D"gmai=
l_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,20=
4,204);padding-left:1ex">Bruno Haible &lt;<a href=3D"mailto:bruno@HIDDEN=
" target=3D"_blank">bruno@HIDDEN</a>&gt; writes:<br>
<br>
&gt; So, I don&#39;t think the &quot;let&#39;s treat timeout like valgrind&=
quot; approach is going<br>
&gt; to work. Instead, you need to design a way to deal with timeouts, inde=
pendently.<br>
<br>
Hi!=C2=A0 I think Marc&#39;s request for functionality to introduce timeout=
s for<br>
self-tests is a good one.=C2=A0 However I reach the same conclusion as Brun=
o,<br>
that having a module like valgrind-tests is probably not the best way to<br=
>
solve it.=C2=A0 To me, having a timeout seems like an essential feature of =
a<br>
self-test framework.=C2=A0 I know automake isn&#39;t primarily a self-test<=
br>
framework, but it has concepts for it and the test framework has been<br>
improved significantly over the years, so I think adding a timeout<br>
functionality to automake makes sense.=C2=A0 What do bug-automake people<br=
>
think?<br>
<br>
The functionality could be conditioned on the coreutils &#39;timeout&#39; t=
ool,<br>
and if that tool exists, and appears to work, running all self-tests<br>
under that tool could be done automatically.=C2=A0 The default self-test<br=
>
timeout be quite generous (say 17 hours?) but it should be easy to<br>
modify both by end-user and project developer.=C2=A0 If we want to be<br>
conservative, the functionality could be opt-in initially, and then<br>
after a few years become the default behaviour.<br>
<br>
Thoughts?<br>
<br>
/Simon<br>
</blockquote></div>

--000000000000e9192a05c12d5d89--




Information forwarded to bug-automake@HIDDEN:
bug#48113; Package automake. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 30 Apr 2021 09:24:20 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Fri Apr 30 05:24:20 2021
Received: from localhost ([127.0.0.1]:57479 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1lcPNk-0006m7-GM
	for submit <at> debbugs.gnu.org; Fri, 30 Apr 2021 05:24:20 -0400
Received: from lists.gnu.org ([209.51.188.17]:45108)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <simon@HIDDEN>) id 1lcPNg-0006lx-Sr
 for submit <at> debbugs.gnu.org; Fri, 30 Apr 2021 05:24:19 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10]:48926)
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <simon@HIDDEN>)
 id 1lcPNg-0007su-Hq; Fri, 30 Apr 2021 05:24:16 -0400
Received: from uggla.sjd.se ([2001:9b1:8633::107]:57488)
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <simon@HIDDEN>)
 id 1lcPNd-00022R-KG; Fri, 30 Apr 2021 05:24:16 -0400
DKIM-Signature: v=1; a=ed25519-sha256; q=dns/txt; c=relaxed/relaxed;
 d=josefsson.org; s=ed2101; h=Content-Type:MIME-Version:Message-ID:In-Reply-To
 :Date:References:Subject:Cc:To:From:Sender:Reply-To:Content-Transfer-Encoding
 :Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender:
 Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:
 List-Subscribe:List-Post:List-Owner:List-Archive;
 bh=KOCNKlN9UKYLDJsKpK5mWEBPef0g8unG9KYA9AqhaGk=; t=1619774647; x=1620984247;
 b=1RQHgbNaUb/35CSV91Wsk1KZuses1E7jRDFTCJW9/S8oQfVz4zIVUC2Tcm0AWx7YcyZn8tElin
 uqfiIJcxBsDg==;
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed;
 d=josefsson.org; s=rsa2101; h=Content-Type:MIME-Version:Message-ID:
 In-Reply-To:Date:References:Subject:Cc:To:From:Sender:Reply-To:
 Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date:
 Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id:
 List-Help:List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive;
 bh=KOCNKlN9UKYLDJsKpK5mWEBPef0g8unG9KYA9AqhaGk=; t=1619774647; x=1620984247;
 b=XUF57Il5NXSXZumDumf2DrC7VW37LWf7SAiyA6ch5D/ogvNBlj2DSYK+Jp4OboRedgfSBByabE
 XTaobpCizyjgtrRpPB/EcOgAt2Ud8e7prdS0isfMeXF8FiRC1FwDTXVLLw1md4iKAnVbRvRe4IHvB
 +PybqiFJE3WxeO64Lprt/Nlb024Kv3o8dz0177YVrrwwC21A6I0icmgVsuTlCpuoShmkFu97K5cSv
 K/e3rEykGyYd/DCsDobLXkW9GffG6gww7S6NzWhtRrx0imaUc9999Nwt0/jZ6qSWS6bFB3paHrGIM
 wEOLH604Z9lKLoZr+0GjkHKmZm7aJgdIWGM2FcuUflvQmbICh9hWsvWlzgeC/XsyN488WvHJERGjU
 B7OdUxdKt6PXDA9fHayU+5SKU2hKAhdC4XX3NmK0DMflwxMV6b4DIu9LDFyaC9cDYHi69r+lOI
 ;
Received: from [2001:9b1:41ac:ff00:6052:f957:257:b242] (port=37742 helo=latte)
 by uggla.sjd.se with esmtpsa
 (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92)
 (envelope-from <simon@HIDDEN>)
 id 1lcPNU-0000zM-JV; Fri, 30 Apr 2021 09:24:04 +0000
X-Hashcash: 1:22:210430:bug-automake@HIDDEN::h4VjgWPlpVskG65K:wsvp
From: Simon Josefsson <simon@HIDDEN>
To: Bruno Haible <bruno@HIDDEN>
Subject: Re: Module suggestion: timeout
References: <CAEYrNrToxH2y85z2Qmu1bbws6F4f4d-Vuv_CrBE0ZX6LPpoLTg@HIDDEN>
 <1734109.oLkUVmKVoB@omega>
OpenPGP: id=B1D2BD1375BECB784CF4F8C4D73CF638C53C06BE;
 url=https://josefsson.org/key-20190320.txt
X-Hashcash: 1:22:210430:bruno@HIDDEN::7j9yWyP0dbbyy161:549
X-Hashcash: 1:22:210430:bug-gnulib@HIDDEN::xbWAxOlBCFG5Xa24:Fb/0
X-Hashcash: 1:22:210430:marc.nieper+gnu@HIDDEN::itz/lBksf/3OjcXx:IzKZ
Date: Fri, 30 Apr 2021 11:24:04 +0200
In-Reply-To: <1734109.oLkUVmKVoB@omega> (Bruno Haible's message of "Thu, 29
 Apr 2021 16:19:23 +0200")
Message-ID: <878s50dt1n.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.1 (gnu/linux)
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="=-=-=";
 micalg=pgp-sha256; protocol="application/pgp-signature"
Received-SPF: pass client-ip=2001:9b1:8633::107;
 envelope-from=simon@HIDDEN; helo=uggla.sjd.se
X-Spam_score_int: -20
X-Spam_score: -2.1
X-Spam_bar: --
X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
 DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_HELO_PASS=-0.001,
 SPF_PASS=-0.001 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: -1.4 (-)
X-Debbugs-Envelope-To: submit
Cc: Marc =?iso-8859-1?Q?Nieper-Wi=DFkirchen?= <marc.nieper+gnu@HIDDEN>,
 bug-automake@HIDDEN, bug-gnulib@HIDDEN
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.4 (--)

--=-=-=
Content-Type: text/plain

Bruno Haible <bruno@HIDDEN> writes:

> So, I don't think the "let's treat timeout like valgrind" approach is going
> to work. Instead, you need to design a way to deal with timeouts, independently.

Hi!  I think Marc's request for functionality to introduce timeouts for
self-tests is a good one.  However I reach the same conclusion as Bruno,
that having a module like valgrind-tests is probably not the best way to
solve it.  To me, having a timeout seems like an essential feature of a
self-test framework.  I know automake isn't primarily a self-test
framework, but it has concepts for it and the test framework has been
improved significantly over the years, so I think adding a timeout
functionality to automake makes sense.  What do bug-automake people
think?

The functionality could be conditioned on the coreutils 'timeout' tool,
and if that tool exists, and appears to work, running all self-tests
under that tool could be done automatically.  The default self-test
timeout be quite generous (say 17 hours?) but it should be easy to
modify both by end-user and project developer.  If we want to be
conservative, the functionality could be opt-in initially, and then
after a few years become the default behaviour.

Thoughts?

/Simon

--=-=-=
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----

iHUEARYIAB0WIQSjzJyHC50xCrrUzy9RcisI/kdFogUCYIvMtAAKCRBRcisI/kdF
om14AQCXnOBspKT/IpkVwC/4r3v5vL/QlydF4+VbC9Ft6YCsdwEA53OeF4eusvdL
BPv2B8ggNDJhcB/C+G+JQYYlhThqJgo=
=7+7v
-----END PGP SIGNATURE-----
--=-=-=--




Acknowledgement sent to Simon Josefsson <simon@HIDDEN>:
New bug report received and forwarded. Copy sent to bug-automake@HIDDEN. Full text available.
Report forwarded to bug-automake@HIDDEN:
bug#48113; Package automake. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Sun, 2 May 2021 07:45:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.