GNU logs - #16951, boring messages

Message sent to bug-gzip@HIDDEN:

Subject: bug#16951: zless error under ulimit -v
Resent-From: Jaroslaw Weglinski <jaroslaw.weglinski@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gzip@HIDDEN
Resent-Date: Thu, 06 Mar 2014 16:47:01 +0000
Resent-Message-ID: <handler.16951.B.139412437431136 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: 16951 <at> debbugs.gnu.org
Message-ID: <53189157.7050505@HIDDEN>
Date: Thu, 06 Mar 2014 16:16:39 +0100
From: Jaroslaw Weglinski <jaroslaw.weglinski@HIDDEN>
User-Agent: Mozilla/5.0 (Windows NT 5.1;
 rv:24.0) Gecko/20100101 Thunderbird/24.3.0
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
Precedence: list
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>

Greetings!
gzip 1.3.5 (Scientific Linux release 5.6), when using zless under
virtual memory limit, gzip teminates and goes defunc when hitting limit,
and then less does not propagate error (from user's perspective it looks
like proper end of decompression).

> [test@esb-dev ~]$ ulimit -v 100000
> [test@esb-dev ~]$ ulimit -v
> 100000

> $ ps -ef| grep ^test
> test     31062 27.4  0.2  99968 37292 pts/5    S+   16:11   0:15 less /tmp/pomiary.txt.gz
> test     31063 15.8  0.0      0     0 pts/5    Z+   16:11   0:08 [gzip] <defunct>

and less's output (no sign of error):
> 12285443946;13/11/15 10:15:00,000;198591;
> 12285443946;13/11/15 10:30:00,000;199028;
> 12285443946;13/11/15 10:45:00,000;199223;
> 12285443946;13/11/15 11:00:00,000;199342;
> 12285443946;13/11/15 11:15:00,000;199395;
> 12285443946;13/11/15 11:30:00,000;199420;
> 12285443946;13/11/15 11:45:00,000;199443;
> 12285443946;13/11/15 12:00:00,000;199769;
> /tmp/pomiary.txt.gz lines ?-?/? (END)


regards,
J. Weglinski

Message sent:

Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-Mailer: MIME-tools 5.503 (Entity 5.503)
Content-Type: text/plain; charset=utf-8
X-Loop: help-debbugs@HIDDEN
From: help-debbugs@HIDDEN (GNU bug Tracking System)
To: Jaroslaw Weglinski <jaroslaw.weglinski@HIDDEN>
Subject: bug#16951: Acknowledgement (zless error under ulimit -v)
Message-ID: <handler.16951.B.139412437431136.ack <at> debbugs.gnu.org>
References: <53189157.7050505@HIDDEN>
X-Gnu-PR-Message: ack 16951
X-Gnu-PR-Package: gzip
Reply-To: 16951 <at> debbugs.gnu.org
Date: Thu, 06 Mar 2014 16:47:02 +0000

Thank you for filing a new bug report with debbugs.gnu.org.

This is an automatically generated reply to let you know your message
has been received.

Your message is being forwarded to the package maintainers and other
interested parties for their attention; they will reply in due course.

Your message has been sent to the package maintainer(s):
 bug-gzip@HIDDEN

If you wish to submit further information on this problem, please
send it to 16951 <at> debbugs.gnu.org.

Please do not send mail to help-debbugs@HIDDEN unless you wish
to report a problem with the Bug-tracking system.

--=20
16951: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D16951
GNU Bug Tracking System
Contact help-debbugs@HIDDEN with problems

Message sent to bug-gzip@HIDDEN:

Subject: bug#16951: zless error under ulimit -v
Resent-From: Paul Eggert <eggert@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gzip@HIDDEN
Resent-Date: Thu, 06 Mar 2014 21:49:01 +0000
Resent-Message-ID: <handler.16951.B16951.13941425199269 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: Jaroslaw Weglinski <jaroslaw.weglinski@HIDDEN>,  16951 <at> debbugs.gnu.org
Cc: bug-less@HIDDEN
Message-ID: <5318ED33.40402@HIDDEN>
Date: Thu, 06 Mar 2014 13:48:35 -0800
From: Paul Eggert <eggert@HIDDEN>
Organization: UCLA Computer Science Department
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
 rv:24.0) Gecko/20100101 Thunderbird/24.3.0
MIME-Version: 1.0
References: <53189157.7050505@HIDDEN>
In-Reply-To: <53189157.7050505@HIDDEN>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
Precedence: list
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>

Thanks for the bug report.  This bug occurs because 'less' ignores the 
exit status of gzip.  That is, 'less' uses the LESSOPEN environment 
variable to discover that gzip is the input processor, and uses gzip, 
but when it calls pclose on the resulting stream it discards the exit 
status returned by pclose.  'less' should inspect the exit status and 
report an error in that case.

I'll CC: this email to bug-less@HIDDEN to give its developer a 
heads-up.  Mark, the original bug report is here:

http://bugs.gnu.org/16951

Message sent to bug-gzip@HIDDEN:

Subject: bug#16951: zless error under ulimit -v
Resent-From: Mark Nudelman <markn@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gzip@HIDDEN
Resent-Date: Thu, 06 Mar 2014 22:53:01 +0000
Resent-Message-ID: <handler.16951.B16951.139414638016697 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: Paul Eggert <eggert@HIDDEN>,  Jaroslaw Weglinski <jaroslaw.weglinski@HIDDEN>, 16951 <at> debbugs.gnu.org
Message-ID: <5318F82B.8020909@HIDDEN>
Date: Thu, 06 Mar 2014 14:35:23 -0800
From: Mark Nudelman <markn@HIDDEN>
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64;
 rv:24.0) Gecko/20100101 Thunderbird/24.3.0
MIME-Version: 1.0
References: <53189157.7050505@HIDDEN> <5318ED33.40402@HIDDEN>
In-Reply-To: <5318ED33.40402@HIDDEN>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
Precedence: list
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>

Hi Paul,
Since less-451, if LESSOPEN starts with two pipe chars, less does
examine the exit status of the preprocessor.  Is this what you're
looking for?

--Mark


On 3/6/2014 1:48 PM, Paul Eggert wrote:
> Thanks for the bug report.  This bug occurs because 'less' ignores the
> exit status of gzip.  That is, 'less' uses the LESSOPEN environment
> variable to discover that gzip is the input processor, and uses gzip,
> but when it calls pclose on the resulting stream it discards the exit
> status returned by pclose.  'less' should inspect the exit status and
> report an error in that case.
> 
> I'll CC: this email to bug-less@HIDDEN to give its developer a
> heads-up.  Mark, the original bug report is here:
> 
> http://bugs.gnu.org/16951

Message sent to bug-gzip@HIDDEN:

X-Loop: help-debbugs@HIDDEN
Subject: bug#16951: zless error under ulimit -v
Resent-From: Paul Eggert <eggert@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gzip@HIDDEN
Resent-Date: Fri, 07 Mar 2014 01:41:02 +0000
Resent-Message-ID: <handler.16951.B16951.13941564098193 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 16951
X-GNU-PR-Package: gzip
X-GNU-PR-Keywords: 
To: Mark Nudelman <markn@HIDDEN>,  Jaroslaw Weglinski <jaroslaw.weglinski@HIDDEN>, 16951 <at> debbugs.gnu.org
Received: via spool by 16951-submit <at> debbugs.gnu.org id=B16951.13941564098193
          (code B ref 16951); Fri, 07 Mar 2014 01:41:02 +0000
Received: (at 16951) by debbugs.gnu.org; 7 Mar 2014 01:40:09 +0000
Received: from localhost ([127.0.0.1]:54040 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1WLjlg-000284-44
	for submit <at> debbugs.gnu.org; Thu, 06 Mar 2014 20:40:08 -0500
Received: from smtp.cs.ucla.edu ([131.179.128.62]:58904)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <eggert@HIDDEN>) id 1WLjlZ-00027P-6X
 for 16951 <at> debbugs.gnu.org; Thu, 06 Mar 2014 20:40:02 -0500
Received: from localhost (localhost.localdomain [127.0.0.1])
 by smtp.cs.ucla.edu (Postfix) with ESMTP id 28DDE39E8011;
 Thu,  6 Mar 2014 17:40:00 -0800 (PST)
X-Virus-Scanned: amavisd-new at smtp.cs.ucla.edu
Received: from smtp.cs.ucla.edu ([127.0.0.1])
 by localhost (smtp.cs.ucla.edu [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id OqdAPyw4GXNb; Thu,  6 Mar 2014 17:39:59 -0800 (PST)
Received: from [192.168.1.9] (pool-108-0-233-62.lsanca.fios.verizon.net
 [108.0.233.62])
 by smtp.cs.ucla.edu (Postfix) with ESMTPSA id 2488639E8008;
 Thu,  6 Mar 2014 17:39:59 -0800 (PST)
Message-ID: <5319236B.6020404@HIDDEN>
Date: Thu, 06 Mar 2014 17:39:55 -0800
From: Paul Eggert <eggert@HIDDEN>
Organization: UCLA Computer Science Department
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
 rv:24.0) Gecko/20100101 Thunderbird/24.3.0
MIME-Version: 1.0
References: <53189157.7050505@HIDDEN> <5318ED33.40402@HIDDEN>
 <5318F82B.8020909@HIDDEN>
In-Reply-To: <5318F82B.8020909@HIDDEN>
Content-Type: multipart/mixed; boundary="------------020208080502000104060208"
X-Spam-Score: -2.3 (--)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.3 (--)

This is a multi-part message in MIME format.
--------------020208080502000104060208
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit

Mark Nudelman wrote:
> Since less-451, if LESSOPEN starts with two pipe chars, less does
> examine the exit status of the preprocessor.

Thanks, I didn't know that, and I have installed the attached patch to 
the gzip master on savannah to take advantage of it.  Unfortunately the 
patch doesn't suffice, because 'less' examines the preprocessor's exit 
status only when the preprocessor generates no output.  In the case 
we're talking about, the preprocessor generates some output, but then 
runs out of memory and exits with nonzero status.

You can reproduce the 'less' problem by creating a large text file 't', 
compressing it with 'gzip t', running the following shell command in one 
window:

LESSOPEN='||-gzip -cdfq -- %s' less t.gz

When you see the first screenful, go to another window and kill the gzip 
process that's waiting for 'less' to read more input.  'less' won't 
notice or report the gzip failure.

--------------020208080502000104060208
Content-Type: text/plain; charset=UTF-8;
 name="0001-zless-improve-gzip-failure-checking-and-port-to-new-.patch"
Content-Transfer-Encoding: base64
Content-Disposition: attachment;
 filename*0="0001-zless-improve-gzip-failure-checking-and-port-to-new-.pa";
 filename*1="tch"

RnJvbSBjMGJlZWI1YmMzYzcxMjBmZWE2N2ViOTEyMmY0NjdlNjQ2YWJiNmVkIE1vbiBTZXAg
MTcgMDA6MDA6MDAgMjAwMQpGcm9tOiBQYXVsIEVnZ2VydCA8ZWdnZXJ0QGNzLnVjbGEuZWR1
PgpEYXRlOiBUaHUsIDYgTWFyIDIwMTQgMTc6MzE6MjUgLTA4MDAKU3ViamVjdDogW1BBVENI
XSB6bGVzczogaW1wcm92ZSBnemlwIGZhaWx1cmUgY2hlY2tpbmcsIGFuZCBwb3J0IHRvIG5l
dyAtVgogZm9ybWF0CgpQcm9ibGVtIHJlcG9ydGVkIGJ5IEphcm9zbGF3IFdlZ2xpbnNraSwg
YW5kIExFU1NPUEVOIGNoYW5nZQpzdWdnZXN0ZWQgYnkgTWFyayBOdWRlbG1hbiwgaW46IGh0
dHA6Ly9idWdzLmdudS5vcmcvMTY5NTEKVGhpcyBkb2Vzbid0IGZpeCBidWcgMTY5NTEgZW50
aXJlbHksIGFzICdsZXNzJyBuZWVkcyB0byBiZSBjaGFuZ2VkCnRvbywgYnV0IGl0J3MgYSBz
dGFydC4KKiB6bGVzcy5pbiAoY2hlY2tfZXhpdF9zdGF0dXMpOiBOZXcgdmFyLgooTEVTU09Q
RU4pOiBVc2UgaXQuCih1c2VfaW5wdXRfcGlwZV9vbl9zdGRpbik6IEFkanVzdCB0byBvdXRw
dXQgZm9ybWF0IG9uIEZlZG9yYSAyMCwKd2hlcmUgJ2xlc3MgLVYnIG91dHB1dHMgImxlc3Mg
NDU4IChQT1NJWCByZWd1bGFyIGV4cHJlc3Npb25zKSIKb24gdGhlIGZpcnN0IGxpbmUuCi0t
LQogemxlc3MuaW4gfCAxNiArKysrKysrKysrKysrLS0tCiAxIGZpbGUgY2hhbmdlZCwgMTMg
aW5zZXJ0aW9ucygrKSwgMyBkZWxldGlvbnMoLSkKCmRpZmYgLS1naXQgYS96bGVzcy5pbiBi
L3psZXNzLmluCmluZGV4IDkyMjA5ZjIuLjY3NzYwYjMgMTAwNjQ0Ci0tLSBhL3psZXNzLmlu
CisrKyBiL3psZXNzLmluCkBAIC01NSwxMyArNTUsMjMgQEAgZmkKIAogbGVzc192ZXJzaW9u
PWBsZXNzIC1WYCB8fCBleGl0CiBjYXNlICRsZXNzX3ZlcnNpb24gaW4KLSdsZXNzIDQyOQot
JyogfCAnbGVzcyAnNFszLTldWzAtOV0qIHwgJ2xlc3MgJ1s1LTldWzAtOV1bMC05XSogfCAn
bGVzcyAnWzEtOV1bMC05XVswLTldWzAtOV0qKQorbGVzcycgJzQ1WzEtOV0qIHwgXAorbGVz
cycgJzRbNi05XVswLTldKiB8IFwKK2xlc3MnICdbNS05XVswLTldWzAtOV0qIHwgXAorbGVz
cycgJ1sxLTldWzAtOV1bMC05XVswLTldKikKKyAgIGNoZWNrX2V4aXRfc3RhdHVzPSd8Jzs7
CisqKSBjaGVja19leGl0X3N0YXR1cz0nJzs7Citlc2FjCitjYXNlICRsZXNzX3ZlcnNpb24g
aW4KK2xlc3MnICc0MjkqIHwgXAorbGVzcycgJzRbMy05XVswLTldKiB8IFwKK2xlc3MnICdb
NS05XVswLTldWzAtOV0qIHwgXAorbGVzcycgJ1sxLTldWzAtOV1bMC05XVswLTldKikKICAg
IHVzZV9pbnB1dF9waXBlX29uX3N0ZGluPSctJzs7CiAqKSB1c2VfaW5wdXRfcGlwZV9vbl9z
dGRpbj0nJzs7CiBlc2FjCiAKLUxFU1NPUEVOPSJ8JHt1c2VfaW5wdXRfcGlwZV9vbl9zdGRp
bn1nemlwIC1jZGZxIC0tICVzIgorTEVTU09QRU49InwkY2hlY2tfZXhpdF9zdGF0dXMke3Vz
ZV9pbnB1dF9waXBlX29uX3N0ZGlufWd6aXAgLWNkZnEgLS0gJXMiCiBleHBvcnQgTEVTU09Q
RU4KIAogZXhlYyBsZXNzICIkQCIKLS0gCjEuOC41LjMKCg==
--------------020208080502000104060208--

Message received at control <at> debbugs.gnu.org:

Received: (at control) by debbugs.gnu.org; 8 Sep 2014 21:16:57 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Sep 08 17:16:57 2014
Received: from localhost ([127.0.0.1]:34119 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1XR6Iy-0000Rf-O0
	for submit <at> debbugs.gnu.org; Mon, 08 Sep 2014 17:16:57 -0400
Received: from smtp.cs.ucla.edu ([131.179.128.62]:57415)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <eggert@HIDDEN>) id 1XR6Iv-0000RR-R4
 for control <at> debbugs.gnu.org; Mon, 08 Sep 2014 17:16:54 -0400
Received: from localhost (localhost.localdomain [127.0.0.1])
 by smtp.cs.ucla.edu (Postfix) with ESMTP id 80A1939E8018
 for <control <at> debbugs.gnu.org>; Mon,  8 Sep 2014 14:16:48 -0700 (PDT)
X-Virus-Scanned: amavisd-new at smtp.cs.ucla.edu
Received: from smtp.cs.ucla.edu ([127.0.0.1])
 by localhost (smtp.cs.ucla.edu [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id c0tlBs8faful for <control <at> debbugs.gnu.org>;
 Mon,  8 Sep 2014 14:16:40 -0700 (PDT)
Received: from penguin.cs.ucla.edu (Penguin.CS.UCLA.EDU [131.179.64.200])
 by smtp.cs.ucla.edu (Postfix) with ESMTPSA id D1AAF39E8016
 for <control <at> debbugs.gnu.org>; Mon,  8 Sep 2014 14:16:40 -0700 (PDT)
Message-ID: <540E1CB8.8050006@HIDDEN>
Date: Mon, 08 Sep 2014 14:16:40 -0700
From: Paul Eggert <eggert@HIDDEN>
Organization: UCLA Computer Science Department
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
 rv:24.0) Gecko/20100101 Thunderbird/24.7.0
MIME-Version: 1.0
To: control <at> debbugs.gnu.org
Subject: 18427 is a duplicate of 16951
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Score: -4.8 (----)
X-Debbugs-Envelope-To: control
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -4.8 (----)

merge 16951 18427

Last modified: Mon, 25 Nov 2019 12:00:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.