GNU bug report logs - #34519
Test "colors" fails on Debian/ppc64el

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: diffutils; Reported by: Santiago Vila <sanvila@HIDDEN>; merged with #25402, #36488; dated Mon, 18 Feb 2019 01:03:01 UTC; Maintainer for diffutils is bug-diffutils@HIDDEN.
Did not alter fixed versions and reopened. Request was from Debbugs Internal Request <help-debbugs@HIDDEN> to internal_control <at> debbugs.gnu.org. Full text available.
Merged 25402 34519 36488. Request was from Paul Eggert <eggert@HIDDEN> to control <at> debbugs.gnu.org. Full text available.
Merged 34519 36488. Request was from Paul Eggert <eggert@HIDDEN> to control <at> debbugs.gnu.org. Full text available.

Message received at 34519 <at> debbugs.gnu.org:


Received: (at 34519) by debbugs.gnu.org; 28 Aug 2021 15:29:44 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sat Aug 28 11:29:44 2021
Received: from localhost ([127.0.0.1]:54835 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1mK0H6-0006BF-S7
	for submit <at> debbugs.gnu.org; Sat, 28 Aug 2021 11:29:44 -0400
Received: from mx.kolabnow.com ([95.128.36.42]:57010)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <bauermann@HIDDEN>) id 1mK0H1-0006Ax-DX
 for 34519 <at> debbugs.gnu.org; Sat, 28 Aug 2021 11:29:40 -0400
Received: from localhost (unknown [127.0.0.1])
 by ext-mx-out002.mykolab.com (Postfix) with ESMTP id E01601254;
 Sat, 28 Aug 2021 17:29:28 +0200 (CEST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kolabnow.com; h=
 content-type:content-type:content-transfer-encoding:mime-version
 :references:in-reply-to:message-id:date:date:subject:subject
 :from:from:received:received:received; s=dkim20160331; t=
 1630164568; x=1631978969; bh=Pi6G7sXHmwscYrB5KZ7caUNEfuhqXaJTsPj
 /WGUg9Zc=; b=RwibeL8Iz/8ry3bvrtBPhJarGYGHfpubD9oD4R6uQQycm5yPQUB
 Pkn9q3dLZEzhqb1jDwYYeuYFGfUBOYIgCPmB0rQ8Fklqcriv6WQhVJ7kbIDMJHS9
 D8VYJoCzF5zHRtQe8ob8q88Mks7H4ljAPzt+Szctc7ay2QqpBbSGHFNtmPjSFCCg
 wZhfKZqf11ut9E7sYmx+Z4sXj+tLrrDpjboVjBlB+KGNkk7C2w7XpNnhARa/sifO
 yZDmIItp1QmQmNEjQeqhJ3x1dnVBdh4Ah+J8cat5TcrR4qLu/bwHpKomMsfjjR58
 45P9OtnD0TNiJ2SuJfPPgjU/PKfunK6/YpzN+n4qWMTeiDs3O5xnbKUzbiDAqSsn
 8D3+qRDZCJ6ub+MKxyp8tYEIQ1tx2GPRYzn0+UYKAyCRiSPxtdaPTMBo66rqNFL5
 m3iB3fLY6YX55gL7+6W48PH0l1Gy2H+81Nobulpd/HkV/1Qf7bxn8wBGoowE+nJS
 7VpnFsyzW2wUj3MtYD43EwJwkaOitNJFUIeAbgUYJxjWyJbjv8KiEXWlOj4VAaw2
 OXp3j069Aeu2XppZD9irtVzT2nv+3hSwD+zYYS57dSt5pDy1dMQWfihoYbqT5XRN
 gmrskELeXDckJRPCesBcDXwNNiIibfLaZE2ObQ8gxZBm9jM2EImUm0sc=
X-Virus-Scanned: amavisd-new at mykolab.com
X-Spam-Flag: NO
X-Spam-Score: -1.9
X-Spam-Level: 
X-Spam-Status: No, score=-1.9 tagged_above=-10 required=5
 tests=[BAYES_00=-1.9] autolearn=ham autolearn_force=no
Received: from mx.kolabnow.com ([127.0.0.1])
 by localhost (ext-mx-out002.mykolab.com [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id FrZ35j78E8f3; Sat, 28 Aug 2021 17:29:28 +0200 (CEST)
Received: from int-mx003.mykolab.com (unknown [10.9.13.3])
 by ext-mx-out002.mykolab.com (Postfix) with ESMTPS id 3AA1CB46;
 Sat, 28 Aug 2021 17:29:27 +0200 (CEST)
Received: from ext-subm002.mykolab.com (unknown [10.9.6.2])
 by int-mx003.mykolab.com (Postfix) with ESMTPS id 40DEA3504;
 Sat, 28 Aug 2021 17:29:24 +0200 (CEST)
From: Thiago Jung Bauermann <bauermann@HIDDEN>
To: 34519 <at> debbugs.gnu.org
Subject: Re: [bug-diffutils] bug#34519: Test "colors" fails on Debian/ppc64el
Date: Sat, 28 Aug 2021 12:29:17 -0300
Message-ID: <1657750.94seSsIaSJ@popigai>
In-Reply-To: <588c7101-5d51-78f1-e79c-f89c69c3b804@HIDDEN>
References: <alpine.DEB.2.20.1902180147100.13056@HIDDEN>
 <588c7101-5d51-78f1-e79c-f89c69c3b804@HIDDEN>
MIME-Version: 1.0
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain; charset="UTF-8"
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 34519
Cc: =?ISO-8859-1?Q?Fr=E9d=E9ric?= Bonnard <frediz@HIDDEN>,
 Santiago Vila <sanvila@HIDDEN>, Paul Eggert <eggert@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Hello,

Em ter=C3=A7a-feira, 27 de agosto de 2019, =C3=A0s 19:06:21 -03, Paul Egger=
t=20
escreveu:
> Santiago Vila wrote:
> > In tests/colors there was a race condition which I tried to fix
> > by adding a "sleep 1", like this:
> >=20
> > mkfifo fifo
> > printf '%1000000s-a' > a
> > printf '%1000000s-b' > b
> > head -c 10 < fifo > /dev/null &
> > sleep 1
> > diff --color=3Dalways ---presume-output-tty a b > fifo
> > test $? =3D 141 || fail=3D1
>=20
> Sorry, but what is the race condition, and why would adding 'sleep 1'
> help? The test should work regardless of whether 'diff' starts before
> 'head' does.
>=20
> Are fifos broken on your system somehow?
>=20
> Can you use 'strace -f' to see what syscalls are going wrong in 'head'
> and/or 'diff'?

I still see this problem on powerpc64le-linux with version 3.8.

There was a great analysis of the problem made by Fr=C3=A9d=C3=A9ric Bonnar=
d (whom I=20
took the liberty of copying on this message. I hope it=E2=80=99s ok), and a=
lso a=20
tentative fix by him which would need to be assessed by someone more=20
knowledgeable of the diffutils code:

https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=3D922552#19

In short: it=E2=80=99s not a problem in the test. It=E2=80=99s a bug in the=
 signal handling=20
code that was added to support the =E2=80=98--color=E2=80=99 option.

=46or some reason, it=E2=80=99s particularly easy to hit on powerpc64le-lin=
ux. With=20
=46r=C3=A9d=C3=A9ric=E2=80=99s patch I can=E2=80=99t hit it anymore.

=2D-=20
Thanks,
Thiago






Information forwarded to bug-diffutils@HIDDEN:
bug#34519; Package diffutils. Full text available.

Message received at 34519 <at> debbugs.gnu.org:


Received: (at 34519) by debbugs.gnu.org; 27 Aug 2019 22:06:30 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue Aug 27 18:06:30 2019
Received: from localhost ([127.0.0.1]:49521 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1i2jbi-0002Jx-Lj
	for submit <at> debbugs.gnu.org; Tue, 27 Aug 2019 18:06:30 -0400
Received: from zimbra.cs.ucla.edu ([131.179.128.68]:44074)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <eggert@HIDDEN>) id 1i2jbh-0002Je-8Q
 for 34519 <at> debbugs.gnu.org; Tue, 27 Aug 2019 18:06:29 -0400
Received: from localhost (localhost [127.0.0.1])
 by zimbra.cs.ucla.edu (Postfix) with ESMTP id 0DC831600C6;
 Tue, 27 Aug 2019 15:06:23 -0700 (PDT)
Received: from zimbra.cs.ucla.edu ([127.0.0.1])
 by localhost (zimbra.cs.ucla.edu [127.0.0.1]) (amavisd-new, port 10032)
 with ESMTP id 1jNtzTejMUDM; Tue, 27 Aug 2019 15:06:22 -0700 (PDT)
Received: from localhost (localhost [127.0.0.1])
 by zimbra.cs.ucla.edu (Postfix) with ESMTP id 55D7B1600EC;
 Tue, 27 Aug 2019 15:06:22 -0700 (PDT)
X-Virus-Scanned: amavisd-new at zimbra.cs.ucla.edu
Received: from zimbra.cs.ucla.edu ([127.0.0.1])
 by localhost (zimbra.cs.ucla.edu [127.0.0.1]) (amavisd-new, port 10026)
 with ESMTP id PjQDHj2MUIsx; Tue, 27 Aug 2019 15:06:22 -0700 (PDT)
Received: from [192.168.1.9] (cpe-23-242-74-103.socal.res.rr.com
 [23.242.74.103])
 by zimbra.cs.ucla.edu (Postfix) with ESMTPSA id 2CCA41600C6;
 Tue, 27 Aug 2019 15:06:22 -0700 (PDT)
Subject: Re: [bug-diffutils] bug#34519: Test "colors" fails on Debian/ppc64el
To: Santiago Vila <sanvila@HIDDEN>
References: <alpine.DEB.2.20.1902180147100.13056@HIDDEN>
From: Paul Eggert <eggert@HIDDEN>
Organization: UCLA Computer Science Department
Message-ID: <588c7101-5d51-78f1-e79c-f89c69c3b804@HIDDEN>
Date: Tue, 27 Aug 2019 15:06:21 -0700
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101
 Thunderbird/60.8.0
MIME-Version: 1.0
In-Reply-To: <alpine.DEB.2.20.1902180147100.13056@HIDDEN>
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Language: en-US
Content-Transfer-Encoding: 7bit
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: 34519
Cc: 34519 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

Santiago Vila wrote:
> In tests/colors there was a race condition which I tried to fix
> by adding a "sleep 1", like this:
> 
> mkfifo fifo
> printf '%1000000s-a' > a
> printf '%1000000s-b' > b
> head -c 10 < fifo > /dev/null &
> sleep 1
> diff --color=always ---presume-output-tty a b > fifo
> test $? = 141 || fail=1

Sorry, but what is the race condition, and why would adding 'sleep 1' help? The 
test should work regardless of whether 'diff' starts before 'head' does.

Are fifos broken on your system somehow?

Can you use 'strace -f' to see what syscalls are going wrong in 'head' and/or 
'diff'?




Information forwarded to bug-diffutils@HIDDEN:
bug#34519; Package diffutils. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 18 Feb 2019 01:02:55 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sun Feb 17 20:02:55 2019
Received: from localhost ([127.0.0.1]:51868 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1gvXKg-0006uB-Q4
	for submit <at> debbugs.gnu.org; Sun, 17 Feb 2019 20:02:55 -0500
Received: from eggs.gnu.org ([209.51.188.92]:46028)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <sanvila@HIDDEN>) id 1gvXKf-0006tw-6m
 for submit <at> debbugs.gnu.org; Sun, 17 Feb 2019 20:02:53 -0500
Received: from lists.gnu.org ([209.51.188.17]:51297)
 by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32)
 (Exim 4.71) (envelope-from <sanvila@HIDDEN>) id 1gvXKV-0005ma-Ku
 for submit <at> debbugs.gnu.org; Sun, 17 Feb 2019 20:02:45 -0500
Received: from eggs.gnu.org ([209.51.188.92]:60398)
 by lists.gnu.org with esmtp (Exim 4.71)
 (envelope-from <sanvila@HIDDEN>) id 1gvXKU-00069V-QV
 for bug-diffutils@HIDDEN; Sun, 17 Feb 2019 20:02:43 -0500
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org
X-Spam-Level: 
X-Spam-Status: No, score=-0.0 required=5.0 tests=BAYES_40,RCVD_IN_DNSWL_NONE
 autolearn=disabled version=3.3.2
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <sanvila@HIDDEN>) id 1gvXKN-0005lI-HD
 for bug-diffutils@HIDDEN; Sun, 17 Feb 2019 20:02:37 -0500
Received: from zmta01.unex.es ([158.49.17.55]:51680)
 by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32)
 (Exim 4.71) (envelope-from <sanvila@HIDDEN>) id 1gvXKG-0005kK-C7
 for bug-diffutils@HIDDEN; Sun, 17 Feb 2019 20:02:29 -0500
Received: from localhost (localhost [127.0.0.1])
 by zmta01.unex.es (Postfix) with ESMTP id 29C1C60057
 for <bug-diffutils@HIDDEN>; Mon, 18 Feb 2019 01:57:19 +0100 (CET)
Received: from zmta01.unex.es ([127.0.0.1])
 by localhost (zmta01.servicios.unex.es [127.0.0.1]) (amavisd-new, port 10032)
 with ESMTP id 1MP0Ll14gzbo for <bug-diffutils@HIDDEN>;
 Mon, 18 Feb 2019 01:57:16 +0100 (CET)
Received: from localhost (localhost [127.0.0.1])
 by zmta01.unex.es (Postfix) with ESMTP id 3A21E60059
 for <bug-diffutils@HIDDEN>; Mon, 18 Feb 2019 01:57:16 +0100 (CET)
X-Virus-Scanned: amavisd-new at zmta01.siue
Received: from zmta01.unex.es ([127.0.0.1])
 by localhost (zmta01.servicios.unex.es [127.0.0.1]) (amavisd-new, port 10026)
 with ESMTP id 4iqPI652gwXi for <bug-diffutils@HIDDEN>;
 Mon, 18 Feb 2019 01:57:16 +0100 (CET)
Received: from zproxy01.unex.es (zproxy01.servicios.unex.es [10.254.208.61])
 by zmta01.unex.es (Postfix) with ESMTPS id 0E87760057
 for <bug-diffutils@HIDDEN>; Mon, 18 Feb 2019 01:57:16 +0100 (CET)
Received: from localhost (localhost [127.0.0.1])
 by zproxy01.unex.es (Postfix) with ESMTP id 019CB80A30
 for <bug-diffutils@HIDDEN>; Mon, 18 Feb 2019 01:57:16 +0100 (CET)
Received: from zproxy01.unex.es ([127.0.0.1])
 by localhost (zproxy01.servicios.unex.es [127.0.0.1]) (amavisd-new, port 10032)
 with ESMTP id Y2BySg7FImnQ for <bug-diffutils@HIDDEN>;
 Mon, 18 Feb 2019 01:57:15 +0100 (CET)
Received: from localhost (localhost [127.0.0.1])
 by zproxy01.unex.es (Postfix) with ESMTP id 8AA1480A45
 for <bug-diffutils@HIDDEN>; Mon, 18 Feb 2019 01:57:15 +0100 (CET)
X-Virus-Scanned: amavisd-new at zproxy01.siue
Received: from zproxy01.unex.es ([127.0.0.1])
 by localhost (zproxy01.servicios.unex.es [127.0.0.1]) (amavisd-new, port 10026)
 with ESMTP id r4vLvLKLmh16 for <bug-diffutils@HIDDEN>;
 Mon, 18 Feb 2019 01:57:15 +0100 (CET)
Received: from tulipan.isla-invisible.es (tulipan.isla-invisible.es
 [185.92.222.134])
 by zproxy01.unex.es (Postfix) with ESMTPSA id 4ED0880A30
 for <bug-diffutils@HIDDEN>; Mon, 18 Feb 2019 01:57:10 +0100 (CET)
Received: by tulipan.isla-invisible.es (Postfix, from userid 1000)
 id 18B301700; Mon, 18 Feb 2019 01:57:09 +0100 (CET)
Received: from localhost (localhost [127.0.0.1])
 by tulipan.isla-invisible.es (Postfix) with ESMTP id 0C0FC103E
 for <bug-diffutils@HIDDEN>; Mon, 18 Feb 2019 01:57:09 +0100 (CET)
Date: Mon, 18 Feb 2019 01:57:09 +0100 (CET)
From: Santiago Vila <sanvila@HIDDEN>
To: bug-diffutils@HIDDEN
Subject: Test "colors" fails on Debian/ppc64el
Message-ID: <alpine.DEB.2.20.1902180147100.13056@HIDDEN>
User-Agent: Alpine 2.20 (DEB 67 2015-01-07)
MIME-Version: 1.0
Content-Type: text/plain; charset=US-ASCII
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic]
X-Received-From: 158.49.17.55
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x
X-Spam-Score: 1.0 (+)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.0 (/)

Hello.

I've just uploaded diffutils 3.7 for Debian unstable (hopefully to be
part of Debian 10, since it contains only small fixes).

But there is a problem: The build in the ppc64el autobuilder failed:

https://buildd.debian.org/status/logs.php?pkg=diffutils&ver=1%3A3.7-1&arch=ppc64el

In tests/colors there was a race condition which I tried to fix
by adding a "sleep 1", like this:

mkfifo fifo
printf '%1000000s-a' > a
printf '%1000000s-b' > b
head -c 10 < fifo > /dev/null &
sleep 1
diff --color=always ---presume-output-tty a b > fifo
test $? = 141 || fail=1

It is possible that the "head" command takes (sometimes) more than one second to
complete on ppc64el?

Are there any other places in the test where a race condition could be
happening?

Thanks.




Acknowledgement sent to Santiago Vila <sanvila@HIDDEN>:
New bug report received and forwarded. Copy sent to bug-diffutils@HIDDEN. Full text available.
Report forwarded to bug-diffutils@HIDDEN:
bug#34519; Package diffutils. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Sun, 29 Aug 2021 22:00:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.