GNU logs - #25048, boring messages

Message sent to bug-grep@HIDDEN:

Subject: bug#25048: --with-included-regex vs. e-acute piped into LC_ALL=fr_FR.iso88591 grep '[d-f]'
Resent-From: Jim Meyering <jim@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-grep@HIDDEN
Resent-Date: Mon, 28 Nov 2016 04:58:01 +0000
Resent-Message-ID: <handler.25048.B.148030907511290 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: 25048 <at> debbugs.gnu.org
MIME-Version: 1.0
From: Jim Meyering <jim@HIDDEN>
Date: Sun, 27 Nov 2016 20:57:23 -0800
Message-ID: <CA+8g5KGz7YYA12Kw0cv2D5JJLWXjYpynurmDmps2CqyXX1i9aQ@HIDDEN>
Content-Type: text/plain; charset=UTF-8
Precedence: list
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>

When grep is configured --with-included-regex, the following command
fails to print the expected match:

   printf '\351\n' |LC_ALL=fr_FR.iso88591 src/grep '[d-f]'

You wouldn't notice on glibc-based systems, since the default there is
to use the glibc-supplied regex code, which does make grep detect the
match.

However, on other systems (I noticed on OS X), configuration machinery
detects that we have to resort to the included regex matcher, and
there, the default build results in a grep binary that fails the new
unibyte-bracket-expr test.

Why? Because the included regcomp.c has two code paths: one for #if
_LIBC (that is collating-sequence aware), and the other that ignores
collation sequences. The former can be used only when building glibc
itself, and is the path we require in order to handle this case.  The
latter code is what we get when compiling any place else.

Since it's always been this way, I don't plan to attempt a work-around
before the next release, and instead will probably arrange for that
test to be skipped when grep is built with the included regex.

Other ideas welcome,

Jim

Message sent:

Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-Mailer: MIME-tools 5.505 (Entity 5.505)
Content-Type: text/plain; charset=utf-8
X-Loop: help-debbugs@HIDDEN
From: help-debbugs@HIDDEN (GNU bug Tracking System)
To: Jim Meyering <jim@HIDDEN>
Subject: bug#25048: Acknowledgement (--with-included-regex vs. e-acute
 piped into LC_ALL=fr_FR.iso88591 grep '[d-f]')
Message-ID: <handler.25048.B.148030907511290.ack <at> debbugs.gnu.org>
References: <CA+8g5KGz7YYA12Kw0cv2D5JJLWXjYpynurmDmps2CqyXX1i9aQ@HIDDEN>
X-Gnu-PR-Message: ack 25048
X-Gnu-PR-Package: grep
Reply-To: 25048 <at> debbugs.gnu.org
Date: Mon, 28 Nov 2016 04:58:02 +0000

Thank you for filing a new bug report with debbugs.gnu.org.

This is an automatically generated reply to let you know your message
has been received.

Your message is being forwarded to the package maintainers and other
interested parties for their attention; they will reply in due course.

Your message has been sent to the package maintainer(s):
 bug-grep@HIDDEN

If you wish to submit further information on this problem, please
send it to 25048 <at> debbugs.gnu.org.

Please do not send mail to help-debbugs@HIDDEN unless you wish
to report a problem with the Bug-tracking system.

--=20
25048: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D25048
GNU Bug Tracking System
Contact help-debbugs@HIDDEN with problems

Message sent to bug-grep@HIDDEN:

Subject: bug#25048: --with-included-regex vs. e-acute piped into LC_ALL=fr_FR.iso88591 grep '[d-f]'
Resent-From: Eric Blake <eblake@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-grep@HIDDEN
Resent-Date: Mon, 28 Nov 2016 16:54:01 +0000
Resent-Message-ID: <handler.25048.B25048.148035199321818 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: Jim Meyering <jim@HIDDEN>, 25048 <at> debbugs.gnu.org
References: <CA+8g5KGz7YYA12Kw0cv2D5JJLWXjYpynurmDmps2CqyXX1i9aQ@HIDDEN>
From: Eric Blake <eblake@HIDDEN>
Openpgp: url=http://people.redhat.com/eblake/eblake.gpg
Organization: Red Hat, Inc.
Message-ID: <77ee4390-f1a4-0d7c-e76d-23d5978d8f4a@HIDDEN>
Date: Mon, 28 Nov 2016 10:53:04 -0600
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101
 Thunderbird/45.4.0
MIME-Version: 1.0
In-Reply-To: <CA+8g5KGz7YYA12Kw0cv2D5JJLWXjYpynurmDmps2CqyXX1i9aQ@HIDDEN>
Content-Type: multipart/signed; micalg=pgp-sha256;
 protocol="application/pgp-signature";
 boundary="J883cdVoLQugHNUAGr6Up0WI1llxQPPMO"
Precedence: list
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>

This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--J883cdVoLQugHNUAGr6Up0WI1llxQPPMO
Content-Type: multipart/mixed; boundary="QKWKI09wppUNLnCsCt7IQclWmrqxAfRpS";
 protected-headers="v1"
From: Eric Blake <eblake@HIDDEN>
To: Jim Meyering <jim@HIDDEN>, 25048 <at> debbugs.gnu.org
Message-ID: <77ee4390-f1a4-0d7c-e76d-23d5978d8f4a@HIDDEN>
Subject: Re: bug#25048: --with-included-regex vs. e-acute piped into
 LC_ALL=fr_FR.iso88591 grep '[d-f]'
References: <CA+8g5KGz7YYA12Kw0cv2D5JJLWXjYpynurmDmps2CqyXX1i9aQ@HIDDEN>
In-Reply-To: <CA+8g5KGz7YYA12Kw0cv2D5JJLWXjYpynurmDmps2CqyXX1i9aQ@HIDDEN>

--QKWKI09wppUNLnCsCt7IQclWmrqxAfRpS
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable

On 11/27/2016 10:57 PM, Jim Meyering wrote:
> When grep is configured --with-included-regex, the following command
> fails to print the expected match:
>=20
>    printf '\351\n' |LC_ALL=3Dfr_FR.iso88591 src/grep '[d-f]'

But the problem is that POSIX does NOT define what the "expected match"
should be. The very fact that you're using a non-C locale but passing a
range means that you have unspecified behavior per POSIX.  Some regex
engines treat 'e' and 'e-acute' as both being part of the range, others
treat only 'e' as being part of the range.  Expecting any particular
behavior is a bug, unless you know for sure that you are using GNU's
"rational range behavior" which explicitly treats ranges in ALL locales
the same as if they were in the C locale (that is, e-acute is never part
of the [d-f] range under rational range behavior).

>=20
> Since it's always been this way, I don't plan to attempt a work-around
> before the next release, and instead will probably arrange for that
> test to be skipped when grep is built with the included regex.
>=20
> Other ideas welcome,

We SHOULD be adjusting more and more GNU tools to honor rational range
behavior, at least as an option, even if that means that e-acute can
never be matched to [d-f].

--=20
Eric Blake   eblake redhat com    +1-919-301-3266
Libvirt virtualization library http://libvirt.org

--QKWKI09wppUNLnCsCt7IQclWmrqxAfRpS--

--J883cdVoLQugHNUAGr6Up0WI1llxQPPMO
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2
Comment: Public key at http://people.redhat.com/eblake/eblake.gpg
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iQEcBAEBCAAGBQJYPGDwAAoJEKeha0olJ0NqLWMH/iY356MQ+zdS6dbxOiOK98hw
PLPwst9XCBklxaMd5On8Li27R3uwUNtxRZbxeFCw3DtA2Nugmsie5e8OEgOGAWbA
QljnZvWCQGk4CcEX+04PfdwAi0tlg5khvF/Ika8ZwH4trBBFMlpiaclY457rq3bq
MeSTCUgBs4b4MYRsCdF+IsrvVOYbbF7bi3kLyvZ6m8657fTiZ+AJzxdMrj48QS8H
W2Yw6D5K9J2h3TcZgRKSsuC7gQAvF/rg37uHjlqyzxHazfBbt6QnRA1B4UIbOtTr
gjbbxk3udL9j/WruEfI6JC+FQVy/4x6pyvxgC+tEsQy913NhaHxmVS/Gm5BG/2s=
=cNUP
-----END PGP SIGNATURE-----

--J883cdVoLQugHNUAGr6Up0WI1llxQPPMO--

Message sent to bug-grep@HIDDEN:

Subject: bug#25048: --with-included-regex vs. e-acute piped into LC_ALL=fr_FR.iso88591 grep '[d-f]'
Resent-From: Paul Eggert <eggert@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-grep@HIDDEN
Resent-Date: Mon, 28 Nov 2016 17:14:01 +0000
Resent-Message-ID: <handler.25048.B25048.148035319123805 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: Eric Blake <eblake@HIDDEN>, Jim Meyering <jim@HIDDEN>, 25048 <at> debbugs.gnu.org
References: <CA+8g5KGz7YYA12Kw0cv2D5JJLWXjYpynurmDmps2CqyXX1i9aQ@HIDDEN>
 <77ee4390-f1a4-0d7c-e76d-23d5978d8f4a@HIDDEN>
From: Paul Eggert <eggert@HIDDEN>
Organization: UCLA Computer Science Department
Message-ID: <f212ab6b-5349-dde8-6d92-bc25efbaf580@HIDDEN>
Date: Mon, 28 Nov 2016 09:13:02 -0800
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101
 Thunderbird/45.4.0
MIME-Version: 1.0
In-Reply-To: <77ee4390-f1a4-0d7c-e76d-23d5978d8f4a@HIDDEN>
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit
Precedence: list
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>

On 11/28/2016 08:53 AM, Eric Blake wrote:
> We SHOULD be adjusting more and more GNU tools to honor rational range
> behavior

Yes, sorry, I forgot about that possibility when writing that test. I 
reverted the change to grep that added the test; this should fix the 
problem.

Message sent to bug-grep@HIDDEN:

X-Loop: help-debbugs@HIDDEN
Subject: bug#25048: --with-included-regex vs. e-acute piped into LC_ALL=fr_FR.iso88591 grep '[d-f]'
Resent-From: arnold@HIDDEN
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-grep@HIDDEN
Resent-Date: Mon, 28 Nov 2016 18:49:02 +0000
Resent-Message-ID: <handler.25048.B25048.1480358907526 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 25048
X-GNU-PR-Package: grep
X-GNU-PR-Keywords: 
To: jim@HIDDEN, eblake@HIDDEN, 25048 <at> debbugs.gnu.org
Received: via spool by 25048-submit <at> debbugs.gnu.org id=B25048.1480358907526
          (code B ref 25048); Mon, 28 Nov 2016 18:49:02 +0000
Received: (at 25048) by debbugs.gnu.org; 28 Nov 2016 18:48:27 +0000
Received: from localhost ([127.0.0.1]:45219 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1cBQyZ-00008Q-IE
	for submit <at> debbugs.gnu.org; Mon, 28 Nov 2016 13:48:27 -0500
Received: from freefriends.org ([96.88.95.60]:52324)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <arnold@HIDDEN>) id 1cBQyY-000089-5l
 for 25048 <at> debbugs.gnu.org; Mon, 28 Nov 2016 13:48:26 -0500
X-Envelope-From: arnold@HIDDEN
Received: from freefriends.org (localhost [127.0.0.1])
 by freefriends.org (8.14.9/8.14.9) with ESMTP id uASImCnD025249;
 Mon, 28 Nov 2016 11:48:12 -0700
Received: (from arnold@localhost)
 by freefriends.org (8.14.9/8.14.9/submit) id uASImBTi025248;
 Mon, 28 Nov 2016 18:48:11 GMT
From: arnold@HIDDEN
Message-Id: <201611281848.uASImBTi025248@HIDDEN>
X-Authentication-Warning: frenzy.freefriends.org: arnold set sender to
 arnold@HIDDEN using -f
Date: Mon, 28 Nov 2016 11:48:11 -0700
References: <CA+8g5KGz7YYA12Kw0cv2D5JJLWXjYpynurmDmps2CqyXX1i9aQ@HIDDEN>
 <77ee4390-f1a4-0d7c-e76d-23d5978d8f4a@HIDDEN>
In-Reply-To: <77ee4390-f1a4-0d7c-e76d-23d5978d8f4a@HIDDEN>
User-Agent: Heirloom mailx 12.4 7/29/08
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
X-Spam-Score: -2.3 (--)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.3 (--)

> We SHOULD be adjusting more and more GNU tools to honor rational range
> behavior,

Hear, hear!  (Or "+1" in 21st Century English.)

The official term, coined by Karl Berry and as documented in the gawk
manual, is "Rational Range Interpretation".  :-) :-)

> at least as an option, even if that means that e-acute can
> never be matched to [d-f].

Now, if we could get GLIBC to move to that, we'd have something.

I've tried to submit patches in the past that weren't accepted,
but maybe it's worth trying again.

At least gawk and gnulib-based programs generally do so.

Arnold

Message received at control <at> debbugs.gnu.org:

Received: (at control) by debbugs.gnu.org; 18 Dec 2016 21:39:04 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sun Dec 18 16:39:04 2016
Received: from localhost ([127.0.0.1]:46485 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1cIjAe-0000Yp-JJ
	for submit <at> debbugs.gnu.org; Sun, 18 Dec 2016 16:39:04 -0500
Received: from zimbra.cs.ucla.edu ([131.179.128.68]:48648)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <eggert@HIDDEN>) id 1cIjAd-0000YI-0G
 for control <at> debbugs.gnu.org; Sun, 18 Dec 2016 16:39:03 -0500
Received: from localhost (localhost [127.0.0.1])
 by zimbra.cs.ucla.edu (Postfix) with ESMTP id E4F52160029
 for <control <at> debbugs.gnu.org>; Sun, 18 Dec 2016 13:38:55 -0800 (PST)
Received: from zimbra.cs.ucla.edu ([127.0.0.1])
 by localhost (zimbra.cs.ucla.edu [127.0.0.1]) (amavisd-new, port 10032)
 with ESMTP id EEzmrtF9yxht for <control <at> debbugs.gnu.org>;
 Sun, 18 Dec 2016 13:38:55 -0800 (PST)
Received: from localhost (localhost [127.0.0.1])
 by zimbra.cs.ucla.edu (Postfix) with ESMTP id 4599A16005D
 for <control <at> debbugs.gnu.org>; Sun, 18 Dec 2016 13:38:55 -0800 (PST)
X-Virus-Scanned: amavisd-new at zimbra.cs.ucla.edu
Received: from zimbra.cs.ucla.edu ([127.0.0.1])
 by localhost (zimbra.cs.ucla.edu [127.0.0.1]) (amavisd-new, port 10026)
 with ESMTP id w5F74urUDI75 for <control <at> debbugs.gnu.org>;
 Sun, 18 Dec 2016 13:38:55 -0800 (PST)
Received: from [192.168.1.9] (unknown [47.153.178.162])
 by zimbra.cs.ucla.edu (Postfix) with ESMTPSA id 2C914160029
 for <control <at> debbugs.gnu.org>; Sun, 18 Dec 2016 13:38:55 -0800 (PST)
To: control <at> debbugs.gnu.org
From: Paul Eggert <eggert@HIDDEN>
Subject: grep bug maintenance
Organization: UCLA Computer Science Department
Message-ID: <300b5d24-68ba-b475-6e6e-e1ffc5072c4a@HIDDEN>
Date: Sun, 18 Dec 2016 13:38:55 -0800
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101
 Thunderbird/45.5.1
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Score: -3.1 (---)
X-Debbugs-Envelope-To: control
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.1 (---)

severity 25146 wishlist
severity 25048 wishlist
tag 25027 moreinfo

Last modified: Mon, 25 Nov 2019 12:00:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.