GNU logs - #25027, boring messages

Message sent to bug-grep@HIDDEN:

Subject: bug#25027: Grep 2.25 misses lines in semi-large file
Resent-From: Mattias Jiderhamn <mattias.jiderhamn@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-grep@HIDDEN
Resent-Date: Fri, 25 Nov 2016 18:01:02 +0000
Resent-Message-ID: <handler.25027.B.14800968532351 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: 25027 <at> debbugs.gnu.org
From: Mattias Jiderhamn <mattias.jiderhamn@HIDDEN>
Message-ID: <d164789d-ee86-5709-1658-d74620711655@HIDDEN>
Date: Fri, 25 Nov 2016 14:25:46 +0100
User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101
 Thunderbird/45.5.0
MIME-Version: 1.0
Content-Type: multipart/alternative;
 boundary="------------3C3EC191B0A72C4B4D3ADA26"
Precedence: list
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>

This is a multi-part message in MIME format.
--------------3C3EC191B0A72C4B4D3ADA26
Content-Type: text/plain; charset=windows-1252; format=flowed
Content-Transfer-Encoding: 7bit

Hi. I'm using grep 2.25 in cygwin on a 17 MB log file. I happened to 
notice that when I did "grep Migrate" on the file some lines were 
missing. If however I did some other filtering first, i.e. "grep foo | 
grep Migrate" (where foo would match those lines), they are included.

I cannot reproduce this issue with grep 2.5.4 on Linux.

I tried minimizing the log file by removing lines that I did not expect 
in the output, but when removing lines before the expected line the 
problem dissappeared, so somewhere in the first 17 MB (of my 50 MB file) 
there is something triggering the bug.

Due to the nature of the logged data, I'm not willing to make the file 
publically available in a bug report, but I'm willing to transfer it to 
one of the maintainers, or by some other means help out in debugging. 
Please suggest how to proceed.
-- 

*Mattias Jiderhamn*
Architect & Development Lead
Invoice Portal & Exder

*M* +46 735 16 34 13
mattias.jiderhamn@HIDDEN

<http://www.lexmark.com>
www.lexmark.com


--------------3C3EC191B0A72C4B4D3ADA26
Content-Type: multipart/related;
 boundary="------------F939139E2CE6979BF1900467"


--------------F939139E2CE6979BF1900467
Content-Type: text/html; charset=windows-1252
Content-Transfer-Encoding: quoted-printable

<html>
  <head>

    <meta http-equiv=3D"content-type" content=3D"text/html; charset=3Dwin=
dows-1252">
  </head>
  <body bgcolor=3D"#FFFFFF" text=3D"#000000">
    Hi. I'm using grep 2.25 in cygwin on a 17 MB log file. I happened to
    notice that when I did "grep Migrate" on the file some lines were
    missing. If however I did some other filtering first, i.e. "grep foo
    | grep Migrate" (where foo would match those lines), they are
    included.<br>
    <br>
    I cannot reproduce this issue with grep 2.5.4 on Linux.<br>
    <br>
    I tried minimizing the log file by removing lines that I did not
    expect in the output, but when removing lines before the expected
    line the problem dissappeared, so somewhere in the first 17 MB (of
    my 50 MB file) there is something triggering the bug.<br>
    <br>
    Due to the nature of the logged data, I'm not willing to make the
    file publically available in a bug report, but I'm willing to
    transfer it to one of the maintainers, or by some other means help
    out in debugging. Please suggest how to proceed.<br>
    <div class=3D"moz-signature">-- <br>
      <p
style=3D"font-size:13px;font-family:arial,helvetica,sans-serif;line-heigh=
t:18px;color:#32323C"><b>Mattias
          Jiderhamn</b><br>
        Architect &amp; Development Lead<br>
        Invoice Portal &amp; Exder<br>
        <br>
        <!-- span style=3D"font-size:10px; color: #1C64B4"><b>O</b></span=
>&nbsp;&nbsp;<span style=3D"font-size:12px">+1 000 000 0000</span><br -->
        <span style=3D"font-size:10px; color: #1C64B4"><b>M</b></span>=A0=
=A0<span
          style=3D"font-size:12px">+46 735 16 34 13</span><br>
        <span style=3D"font-size:12px"><a class=3D"moz-txt-link-abbreviat=
ed" href=3D"mailto:mattias.jiderhamn@HIDDEN">mattias.jiderhamn@lexma=
rk.com</a></span><br>
        <br>
        <a href=3D"http://www.lexmark.com"><img
            src=3D"cid:part1.D3D6A616.4EFB3DA1@HIDDEN" border=3D"0">=
</a><br>
        <span style=3D"font-size:12px"><a class=3D"moz-txt-link-abbreviat=
ed" href=3D"http://www.lexmark.com">www.lexmark.com</a></span><br>
        <br>
      </p>
    </div>
  </body>
</html>

--------------F939139E2CE6979BF1900467
Content-Type: image/png;
 name="lexmark-logo-email-signature.png"
Content-Transfer-Encoding: base64
Content-ID: <part1.D3D6A616.4EFB3DA1@HIDDEN>
Content-Disposition: inline;
 filename="lexmark-logo-email-signature.png"

iVBORw0KGgoAAAANSUhEUgAAAHgAAAAZCAMAAADNEhofAAAAGXRFWHRTb2Z0d2FyZQBBZG9i
ZSBJbWFnZVJlYWR5ccllPAAAAyNpVFh0WE1MOmNvbS5hZG9iZS54bXAAAAAAADw/eHBhY2tl
dCBiZWdpbj0i77u/IiBpZD0iVzVNME1wQ2VoaUh6cmVTek5UY3prYzlkIj8+IDx4OnhtcG1l
dGEgeG1sbnM6eD0iYWRvYmU6bnM6bWV0YS8iIHg6eG1wdGs9IkFkb2JlIFhNUCBDb3JlIDUu
NS1jMDIxIDc5LjE1NDkxMSwgMjAxMy8xMC8yOS0xMTo0NzoxNiAgICAgICAgIj4gPHJkZjpS
REYgeG1sbnM6cmRmPSJodHRwOi8vd3d3LnczLm9yZy8xOTk5LzAyLzIyLXJkZi1zeW50YXgt
bnMjIj4gPHJkZjpEZXNjcmlwdGlvbiByZGY6YWJvdXQ9IiIgeG1sbnM6eG1wPSJodHRwOi8v
bnMuYWRvYmUuY29tL3hhcC8xLjAvIiB4bWxuczp4bXBNTT0iaHR0cDovL25zLmFkb2JlLmNv
bS94YXAvMS4wL21tLyIgeG1sbnM6c3RSZWY9Imh0dHA6Ly9ucy5hZG9iZS5jb20veGFwLzEu
MC9zVHlwZS9SZXNvdXJjZVJlZiMiIHhtcDpDcmVhdG9yVG9vbD0iQWRvYmUgUGhvdG9zaG9w
IENDIChNYWNpbnRvc2gpIiB4bXBNTTpJbnN0YW5jZUlEPSJ4bXAuaWlkOjBBOTc5RjAyQ0Yx
RTExRTQ5NDI4OUY2OEEzQkFDODUyIiB4bXBNTTpEb2N1bWVudElEPSJ4bXAuZGlkOjBBOTc5
RjAzQ0YxRTExRTQ5NDI4OUY2OEEzQkFDODUyIj4gPHhtcE1NOkRlcml2ZWRGcm9tIHN0UmVm
Omluc3RhbmNlSUQ9InhtcC5paWQ6MEE5NzlGMDBDRjFFMTFFNDk0Mjg5RjY4QTNCQUM4NTIi
IHN0UmVmOmRvY3VtZW50SUQ9InhtcC5kaWQ6MEE5NzlGMDFDRjFFMTFFNDk0Mjg5RjY4QTNC
QUM4NTIiLz4gPC9yZGY6RGVzY3JpcHRpb24+IDwvcmRmOlJERj4gPC94OnhtcG1ldGE+IDw/
eHBhY2tldCBlbmQ9InIiPz6G3AfbAAACTFBMVEX///8xMTsAxCQ58TkAY0YAiUQ9PUfy8vOL
i5A1NT8vn2ZkZGuxsbX9/f0zMz1xcXilpalXV1/AwMOenqPl5ebY2NqYmJ1+foTX19n4+Pgv
gGg8PEa1tbn5+fpD31Xq6usxv1f+//44OEL29vff3+E56zw47jnBwcTCwsXz8/Ps7O1ERE3P
z9K6ur0vimRGRk9CQkuqqq76+vrLy84ljmDk5OYFZkohj100kWWamp/19fZzc3r8/PzGxskI
aEyjo6dVVV02omy+vsG7u769vcDw+PShoabDw8b7+/v09PRvb3aXl5zKys0/P0jw9vS+vsL1
+fiDg4mFhYuUlJoyMjycnKAwu1h8fILT09U2hG1paXBISFE5OUNNTVZ6eoBDQ0w0ND6K94o7
O0RAQEllZWxFRU7w8PHS0tS0tLivr7NA21T1+vho3H3R0dOysrZBi3W6ur4okmKurrKgoKVJ
SVJB3VQ+iXOgoKSQkJV34IqHh4yLi5Hi7+o+pnHt7e62trpjY2s6OkNhYWni4uOM94yHh43K
ysytrbGUlJmIiI5eXmaOjpOV+JX5+flEyGXx8fJPT1fn5+irq69WVl709PXU1NbV1dfIyMtr
3YAHZ0t1dXxEn3dZWWGcnKHk5OV4eH+/v8JmZm1dXWWCgohubnVmZm4wi2ORkZZOTlfu7u+B
gYeWlptfX2ePj5SQkJZ3d35Bp3Q3imwwvFjh4eM2NkBbW2NnZ26Skpc3N0B/f4Zf52rW1tjo
6OmVlZrg4OL9//25ubxaWmKdnaKEhIoCkZ74AAADFklEQVR42sTWV0MTQRAA4BlzEM54BwIK
MSJKkS4IIiIiiAhIr9KLVBV777333nvvvffyx5zb3YQLuYAPBuZhbzLZve/K7iYwwjUWeFGM
BA+HG3cY4NdenoS7A2e6gSd6ucAffKz/DfbBUcaw3dXD3mj2ADzB2PU8bJpg6A4BrJOPe/0D
PD/zZ4+iJRGOEmWhsRByIXcPfYj1zwkV9ZCUhPgCgFPbaVRgAYT3pDrgCIId8qbel4PCyUfe
ImJjGaVBAaI2/h7A6F/nE+mLO0qAjKims/rpDqrEHVBUXwA/XFbUhEF2ON6mwaZ1zL0I0Ltt
EFhpwK4teS9UnEswcjlBtRDsnfjwUIaKvvjUx4KYQvUniLsfVCbiQWTwYSy5VSPg6DBksGkJ
uUsnUWXenIHhDfheW4fFcpIVisOY7C+r/gTjzmSALMR9VKrFxwDLsG0l5dYbyGH8Y7W/40Vt
6Mdhkpmrkw1hpbXpEUsqtFver8nkjgcNjqI2FDGWDvnYCZCB3/iLbubwScU+ufxQXgQCNn3+
Ic69ddUAcDAW8iQBN1KbKWMtdwl+o10YtvNu9PDb2TVQ/OZwhX1WV2FYNDhg00J+x6X106e5
h2+i7M1iF34C9pixmrkEB2oH9NbaMQR3Y5wYlM/hIgE3oy0edDCXS+slicuGcBnGWURkCVjM
MBf4BLaKQdEcHivgbJRznWDTXoDy9ZIkZDePulO/G5C7WeayCww2FMs53RkeFYDqYifYdLR8
hcTiUpq7yZWkfufZLIW5U7UmwBC+jM9Yz/DGfjAsVjHPCY58JYmYneZmOa3B7Ovs1m+bIVpz
GZ9lBNdVq6spjylU+8OQ8xGf6+DIKZLUJzvBNj6lWkC5i3JGlc87pGsJYq4mW4xguIZ4prKl
A2tcYEixIRi6JF/RwyLoBLPSS7TsapRuy/RvMIRheRf1XLtDbJl6GIKTwNiVpHF9cIxZRDh7
u+eiMr86/0ikApw1s/3BHMOmgpn/zVDqor5QOYbGhZiPsZLVnCyGCHfyfckt7JkQ7gxpWGBX
d2hgA9fj8F8BBgCQXX3x8MFfGQAAAABJRU5ErkJggg==
--------------F939139E2CE6979BF1900467--

--------------3C3EC191B0A72C4B4D3ADA26--

Message sent:

Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-Mailer: MIME-tools 5.505 (Entity 5.505)
Content-Type: text/plain; charset=utf-8
X-Loop: help-debbugs@HIDDEN
From: help-debbugs@HIDDEN (GNU bug Tracking System)
To: Mattias Jiderhamn <mattias.jiderhamn@HIDDEN>
Subject: bug#25027: Acknowledgement (Grep 2.25 misses lines in semi-large
 file)
Message-ID: <handler.25027.B.14800968532351.ack <at> debbugs.gnu.org>
References: <d164789d-ee86-5709-1658-d74620711655@HIDDEN>
X-Gnu-PR-Message: ack 25027
X-Gnu-PR-Package: grep
Reply-To: 25027 <at> debbugs.gnu.org
Date: Fri, 25 Nov 2016 18:01:02 +0000

Thank you for filing a new bug report with debbugs.gnu.org.

This is an automatically generated reply to let you know your message
has been received.

Your message is being forwarded to the package maintainers and other
interested parties for their attention; they will reply in due course.

Your message has been sent to the package maintainer(s):
 bug-grep@HIDDEN

If you wish to submit further information on this problem, please
send it to 25027 <at> debbugs.gnu.org.

Please do not send mail to help-debbugs@HIDDEN unless you wish
to report a problem with the Bug-tracking system.

--=20
25027: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D25027
GNU Bug Tracking System
Contact help-debbugs@HIDDEN with problems

Message sent to bug-grep@HIDDEN:

Subject: bug#25027: Grep 2.25 misses lines in semi-large file
Resent-From: Jim Meyering <jim@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-grep@HIDDEN
Resent-Date: Fri, 25 Nov 2016 18:14:01 +0000
Resent-Message-ID: <handler.25027.B25027.14800976363590 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: Mattias Jiderhamn <mattias.jiderhamn@HIDDEN>
Cc: 25027 <at> debbugs.gnu.org
MIME-Version: 1.0
In-Reply-To: <d164789d-ee86-5709-1658-d74620711655@HIDDEN>
References: <d164789d-ee86-5709-1658-d74620711655@HIDDEN>
From: Jim Meyering <jim@HIDDEN>
Date: Fri, 25 Nov 2016 10:13:27 -0800
Message-ID: <CA+8g5KE2qToQXoa3bxdEM0fTgGysGjZ375nLtT=HEks1M5NZzw@HIDDEN>
Content-Type: text/plain; charset=UTF-8
Precedence: list
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>

On Fri, Nov 25, 2016 at 5:25 AM, Mattias Jiderhamn
<mattias.jiderhamn@HIDDEN> wrote:
> Hi. I'm using grep 2.25 in cygwin on a 17 MB log file. I happened to notice
> that when I did "grep Migrate" on the file some lines were missing. If
> however I did some other filtering first, i.e. "grep foo | grep Migrate"
> (where foo would match those lines), they are included.
>
> I cannot reproduce this issue with grep 2.5.4 on Linux.
>
> I tried minimizing the log file by removing lines that I did not expect in
> the output, but when removing lines before the expected line the problem
> dissappeared, so somewhere in the first 17 MB (of my 50 MB file) there is
> something triggering the bug.
>
> Due to the nature of the logged data, I'm not willing to make the file
> publically available in a bug report, but I'm willing to transfer it to one
> of the maintainers, or by some other means help out in debugging. Please
> suggest how to proceed.

Thank you for the report.

It may be useful to know what locale you are using in those tests.
I.e., what does "locale" print for you? If you're not already using
the "C" locale, can you reproduce the problem with "LC_ALL=C grep
Migrate" ?

If that doesn't help, I'd be happy to investigate. You are welcome to
send me that log file, preferably well-compressed.

Message sent to bug-grep@HIDDEN:

Subject: bug#25027: Grep 2.25 misses lines in semi-large file
Resent-From: Paul Eggert <eggert@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-grep@HIDDEN
Resent-Date: Fri, 25 Nov 2016 18:18:01 +0000
Resent-Message-ID: <handler.25027.B25027.14800978363948 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: Jim Meyering <jim@HIDDEN>, Mattias Jiderhamn <mattias.jiderhamn@HIDDEN>
Cc: 25027 <at> debbugs.gnu.org
References: <d164789d-ee86-5709-1658-d74620711655@HIDDEN>
 <CA+8g5KE2qToQXoa3bxdEM0fTgGysGjZ375nLtT=HEks1M5NZzw@HIDDEN>
From: Paul Eggert <eggert@HIDDEN>
Organization: UCLA Computer Science Department
Message-ID: <4931e74a-f576-bd68-89b8-21354821d0f4@HIDDEN>
Date: Fri, 25 Nov 2016 10:17:06 -0800
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101
 Thunderbird/45.4.0
MIME-Version: 1.0
In-Reply-To: <CA+8g5KE2qToQXoa3bxdEM0fTgGysGjZ375nLtT=HEks1M5NZzw@HIDDEN>
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit
Precedence: list
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>

Another possibility is to try to sanitize the data. If you're using the C 
locale, for example, replace all  characters in the set A-Za-z0-9_ (other than 
that crucial "Migrate") with 'A', replace all other non-space characters with 
'.', etc. If you're using UTF-8, make sure any replacements do not change the 
number of bytes in the character. If you can reproduce the problem with the 
sanitized data, compress it and email it as an attachment.

Message received at control <at> debbugs.gnu.org:

Received: (at control) by debbugs.gnu.org; 18 Dec 2016 21:39:04 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sun Dec 18 16:39:04 2016
Received: from localhost ([127.0.0.1]:46485 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1cIjAe-0000Yp-JJ
	for submit <at> debbugs.gnu.org; Sun, 18 Dec 2016 16:39:04 -0500
Received: from zimbra.cs.ucla.edu ([131.179.128.68]:48648)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <eggert@HIDDEN>) id 1cIjAd-0000YI-0G
 for control <at> debbugs.gnu.org; Sun, 18 Dec 2016 16:39:03 -0500
Received: from localhost (localhost [127.0.0.1])
 by zimbra.cs.ucla.edu (Postfix) with ESMTP id E4F52160029
 for <control <at> debbugs.gnu.org>; Sun, 18 Dec 2016 13:38:55 -0800 (PST)
Received: from zimbra.cs.ucla.edu ([127.0.0.1])
 by localhost (zimbra.cs.ucla.edu [127.0.0.1]) (amavisd-new, port 10032)
 with ESMTP id EEzmrtF9yxht for <control <at> debbugs.gnu.org>;
 Sun, 18 Dec 2016 13:38:55 -0800 (PST)
Received: from localhost (localhost [127.0.0.1])
 by zimbra.cs.ucla.edu (Postfix) with ESMTP id 4599A16005D
 for <control <at> debbugs.gnu.org>; Sun, 18 Dec 2016 13:38:55 -0800 (PST)
X-Virus-Scanned: amavisd-new at zimbra.cs.ucla.edu
Received: from zimbra.cs.ucla.edu ([127.0.0.1])
 by localhost (zimbra.cs.ucla.edu [127.0.0.1]) (amavisd-new, port 10026)
 with ESMTP id w5F74urUDI75 for <control <at> debbugs.gnu.org>;
 Sun, 18 Dec 2016 13:38:55 -0800 (PST)
Received: from [192.168.1.9] (unknown [47.153.178.162])
 by zimbra.cs.ucla.edu (Postfix) with ESMTPSA id 2C914160029
 for <control <at> debbugs.gnu.org>; Sun, 18 Dec 2016 13:38:55 -0800 (PST)
To: control <at> debbugs.gnu.org
From: Paul Eggert <eggert@HIDDEN>
Subject: grep bug maintenance
Organization: UCLA Computer Science Department
Message-ID: <300b5d24-68ba-b475-6e6e-e1ffc5072c4a@HIDDEN>
Date: Sun, 18 Dec 2016 13:38:55 -0800
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101
 Thunderbird/45.5.1
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Score: -3.1 (---)
X-Debbugs-Envelope-To: control
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.1 (---)

severity 25146 wishlist
severity 25048 wishlist
tag 25027 moreinfo

Last modified: Mon, 25 Nov 2019 12:00:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.