GNU bug report logs - #55256
27.1; Unicode noncharacters may change writing direction

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: emacs; Reported by: frederik.fouvry@HIDDEN; Keywords: moreinfo; dated Wed, 4 May 2022 07:07:01 UTC; Maintainer for emacs is bug-gnu-emacs@HIDDEN.
Added tag(s) moreinfo. Request was from Lars Ingebrigtsen <larsi@HIDDEN> to control <at> debbugs.gnu.org. Full text available.

Message received at 55256 <at> debbugs.gnu.org:


Received: (at 55256) by debbugs.gnu.org; 4 May 2022 09:03:35 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed May 04 05:03:35 2022
Received: from localhost ([127.0.0.1]:41757 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1nmAv1-0002qc-4p
	for submit <at> debbugs.gnu.org; Wed, 04 May 2022 05:03:35 -0400
Received: from mail-ej1-f48.google.com ([209.85.218.48]:45595)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <frederik.fouvry@HIDDEN>) id 1nmAuz-0002qQ-Az
 for 55256 <at> debbugs.gnu.org; Wed, 04 May 2022 05:03:34 -0400
Received: by mail-ej1-f48.google.com with SMTP id y3so1580285ejo.12
 for <55256 <at> debbugs.gnu.org>; Wed, 04 May 2022 02:03:33 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=acrolinx.com; s=google;
 h=mime-version:references:in-reply-to:from:date:message-id:subject:to;
 bh=t8KvlPt/toVVsca1BYyR9AmkY+llBGNZSy698c7drxw=;
 b=R2tIxJTTZ037dHC8f40VyRCE9WitiAdwAbDVDSNTQwMZWPfpzJa8lz1J5rxJHctkB6
 JOiuqnRR3yM1dEh6cgBkH3Mo2W3wZzHvPIHfOGBilvuiWe95cFki1SSZJFuhRRjhVy8d
 JrHP1KbJ5+pQG9UCV4/HGT+XIRPKuTTHPyNt8C4Jhb/A0jBo0yXMBB3AECoCaurBP3SX
 BL4O4RMSF8HNg3UcxrLg0F6gx6qLX8mRaVOm6QwUgfCR6KvfxBux97D0ZEp9ff9jydW8
 RWLcfag0eWPMUCz8hFMQNGFUXlRzMYy04ThO1X3drbwTCj6giewXcBE1WXtAezDjOn45
 t5Tg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20210112;
 h=x-gm-message-state:mime-version:references:in-reply-to:from:date
 :message-id:subject:to;
 bh=t8KvlPt/toVVsca1BYyR9AmkY+llBGNZSy698c7drxw=;
 b=wCdJedXSeN9NId0OyU1GHwN1Nof46q+xHJunfJXg5XmOWWw3J32CE6DqqZ4p6DXfs9
 e46wsFN3M/Uja887xgKEtNJHaSA9Ad+E1g7vfWbYtXMJqqH0IijsTf1FI6N8/oC4C8qJ
 kSYLNZU00A0YJZaEuO2IhDSIwnQbp3iXe064u40WYzsZhJSvG1swdGeJf8cQY7pYkb+X
 i8qqSSES3lsW3XHr3Vm3QPSeRPHeyIviTxDQDMw0yWtKkhQjc9P7KQXKNlgSz2w7ZDA5
 nIOjviLi3L9ac/X5VVU+PCwZBPrzPwHB+UjheX9dJPwccYSFb9uqcl2PigzB6t/5tKM/
 STbQ==
X-Gm-Message-State: AOAM530cIj7b7AP5zOj5jWSHpqkxyTLUFfPxX0vncORC9nV9a2BytIrQ
 LZjpqRjWpywS1YwzgUhMeTFkoxAvI9kc/QzzPgIJeLDoKbW1Dw==
X-Google-Smtp-Source: ABdhPJyMAX8zPboF+dUOIXVlAHWMh52lVlmMrQFVdpVGfym+K+CxG/2U1/oUy9eXekj5QhPV4zfKGqTej/TJsfmkHeg=
X-Received: by 2002:a17:907:1c20:b0:6f4:639e:9400 with SMTP id
 nc32-20020a1709071c2000b006f4639e9400mr10825156ejc.485.1651655007078; Wed, 04
 May 2022 02:03:27 -0700 (PDT)
MIME-Version: 1.0
References: <875ymlepz6.fsf@HIDDEN> <8735hpepcq.fsf@HIDDEN>
 <834k254sez.fsf@HIDDEN>
In-Reply-To: <834k254sez.fsf@HIDDEN>
From: Frederik Fouvry <frederik.fouvry@HIDDEN>
Date: Wed, 4 May 2022 11:02:50 +0200
Message-ID: <CABANGDe+veoX9kkPjTXrgYDF-yTd-FOLRownna2FsEsoEDpcJQ@HIDDEN>
Subject: Re: bug#55256: Writing direction
To: 55256 <at> debbugs.gnu.org
Content-Type: multipart/alternative; boundary="000000000000fd222405de2be57b"
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: 55256
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

--000000000000fd222405de2be57b
Content-Type: text/plain; charset="UTF-8"

On Wed, 4 May 2022 at 10:23, Eli Zaretskii <eliz@HIDDEN> wrote:

> > Date: Wed, 04 May 2022 09:20:05 +0200
> > From: frederik.fouvry--- via "Bug reports for GNU Emacs,
> >  the Swiss army knife of text editors" <bug-gnu-emacs@HIDDEN>
> >
> >
> > I forgot to add:
> >
> > The Unicode noncharacters should not cause a change in writing
> > direction, since they are not Arabic characters, but a set of characters
> > for internal use only (no exchange between different parties).
>
> That is not entirely true, because Unicode assigns default Bidi Class
> properties to some unassigned codepoints, and Emacs obeys that.  So an
> unassigned codepoint (which is AFAIU what "noncharacter" stands for in
> your terminology) for which Unicode says that its Bidi Class should
> be, for example, AL, _will_ cause change of text directionality.
>
> If you use those unassigned codepoints for private use, you will have
> to override the default properties by manually modifying the relevant
> Emacs char-tables at run time.
>

That sounds fair enough. I admit that my statement was generalising too
much.

The odd name "noncharacter" is Unicode terminology, not mine (see e.g. Spec
v14, Ch. 2, p.30).
<https://www.facebook.com/Acrolinx-127089923970436/>

--000000000000fd222405de2be57b
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><br><div class=3D"gmail_quote"><div dir=3D"ltr" class=3D"g=
mail_attr">On Wed, 4 May 2022 at 10:23, Eli Zaretskii &lt;<a href=3D"mailto=
:eliz@HIDDEN">eliz@HIDDEN</a>&gt; wrote:<br></div><blockquote class=3D"gm=
ail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,=
204,204);padding-left:1ex">&gt; Date: Wed, 04 May 2022 09:20:05 +0200<br>
&gt; From: frederik.fouvry--- via &quot;Bug reports for GNU Emacs,<br>
&gt;=C2=A0 the Swiss army knife of text editors&quot; &lt;<a href=3D"mailto=
:bug-gnu-emacs@HIDDEN" target=3D"_blank">bug-gnu-emacs@HIDDEN</a>&gt;<br>
&gt; <br>
&gt; <br>
&gt; I forgot to add:<br>
&gt; <br>
&gt; The Unicode noncharacters should not cause a change in writing<br>
&gt; direction, since they are not Arabic characters, but a set of characte=
rs<br>
&gt; for internal use only (no exchange between different parties).<br>
<br>
That is not entirely true, because Unicode assigns default Bidi Class<br>
properties to some unassigned codepoints, and Emacs obeys that.=C2=A0 So an=
<br>
unassigned codepoint (which is AFAIU what &quot;noncharacter&quot; stands f=
or in<br>
your terminology) for which Unicode says that its Bidi Class should<br>
be, for example, AL, _will_ cause change of text directionality.<br>
<br>
If you use those unassigned codepoints for private use, you will have<br>
to override the default properties by manually modifying the relevant<br>
Emacs char-tables at run time.<br>
</blockquote></div><div><br></div><div><div style=3D"font-family:verdana,sa=
ns-serif;color:rgb(102,102,102)" class=3D"gmail_default">That sounds fair e=
nough. I admit that my statement was generalising too much.<br></div><div s=
tyle=3D"font-family:verdana,sans-serif;color:rgb(102,102,102)" class=3D"gma=
il_default"><br></div><div style=3D"font-family:verdana,sans-serif;color:rg=
b(102,102,102)" class=3D"gmail_default">The odd name &quot;noncharacter&quo=
t; is Unicode terminology, not mine (see e.g. Spec v14, Ch. 2, p.30).<br></=
div></div><div dir=3D"ltr" class=3D"gmail_signature"><div dir=3D"ltr"><div>=
<div dir=3D"ltr"><div><div dir=3D"ltr"><div><div dir=3D"ltr"><div><div dir=
=3D"ltr"><div><div dir=3D"ltr"><div><div dir=3D"ltr"><div><div dir=3D"ltr">=
<div><div dir=3D"ltr"><div><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"lt=
r"><div dir=3D"ltr"><div><div><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D=
"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><=
div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div><div style=3D"margin=
:0cm 0cm 0.0001pt"><span></span></div><span style=3D"font-size:9pt;font-fam=
ily:Helvetica,sans-serif;color:rgb(158,158,174)"></span><a href=3D"https://=
www.facebook.com/Acrolinx-127089923970436/" target=3D"_blank"><span style=
=3D"font-size:9pt;font-family:Helvetica,sans-serif;color:rgb(158,158,174)">=
</span></a><span style=3D"color:rgb(153,153,153)"><font size=3D"2"><span la=
ng=3D"EN-US"></span></font></span></div></div></div></div></div></div></div=
></div></div></div></div></div></div></div></div></div></div></div></div></=
div></div></div></div></div></div></div></div></div></div></div></div></div=
></div></div></div></div></div>

--000000000000fd222405de2be57b--




Information forwarded to bug-gnu-emacs@HIDDEN:
bug#55256; Package emacs. Full text available.

Message received at 55256 <at> debbugs.gnu.org:


Received: (at 55256) by debbugs.gnu.org; 4 May 2022 08:24:00 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed May 04 04:24:00 2022
Received: from localhost ([127.0.0.1]:41705 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1nmAIh-0001kB-UB
	for submit <at> debbugs.gnu.org; Wed, 04 May 2022 04:24:00 -0400
Received: from eggs.gnu.org ([209.51.188.92]:42908)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <eliz@HIDDEN>) id 1nmAIf-0001jz-50
 for 55256 <at> debbugs.gnu.org; Wed, 04 May 2022 04:23:57 -0400
Received: from fencepost.gnu.org ([2001:470:142:3::e]:49216)
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <eliz@HIDDEN>)
 id 1nmAIZ-00080J-IC; Wed, 04 May 2022 04:23:51 -0400
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org;
 s=fencepost-gnu-org; h=References:Subject:In-Reply-To:To:From:Date:
 mime-version; bh=hxNPjqO6hnEb5DnWUs+FUNk2waAEsgGhbz8HBnqwb6M=; b=mpD5G2Is+qTX
 W3XuShBKb2cdTfz1ngPg+fs+QXzsz3T3cgUEN76zycBHremv/zJBZfcKZ8dY7uMD5y9BJ7F0yOxdZ
 lGUvd0Q2M3bBPcORGqL8TvrNLtDntbJecHhK/t4HXevHzHQVE7+CsVFXJJ17Nb7TW8l3fYu39oHBO
 DVH2BH/NEWaqPZ93bQxDAD0zHam8l94sg0w9p839SpSc/RKQKWnephE6Q2ke3zWI/UjRkFGmIIZPy
 6+zH1UXw5ZcxPuipyfQllRMHiKoRhdqU5a1sS5cWr9kyZSz8++j/NEZvOn8TarIN3/i8dhPNXCkmR
 0Hl3v8bVyrJ54GeubREqUg==;
Received: from [87.69.77.57] (port=3885 helo=home-c4e4a596f7)
 by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <eliz@HIDDEN>)
 id 1nmAIY-0004ei-WF; Wed, 04 May 2022 04:23:51 -0400
Date: Wed, 04 May 2022 11:24:04 +0300
Message-Id: <834k254sez.fsf@HIDDEN>
From: Eli Zaretskii <eliz@HIDDEN>
To: frederik.fouvry@HIDDEN
In-Reply-To: <8735hpepcq.fsf@HIDDEN> (bug-gnu-emacs@HIDDEN)
Subject: Re: bug#55256: Writing direction
References: <875ymlepz6.fsf@HIDDEN> <8735hpepcq.fsf@HIDDEN>
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: 55256
Cc: 55256 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

> Date: Wed, 04 May 2022 09:20:05 +0200
> From: frederik.fouvry--- via "Bug reports for GNU Emacs,
>  the Swiss army knife of text editors" <bug-gnu-emacs@HIDDEN>
> 
> 
> I forgot to add:
> 
> The Unicode noncharacters should not cause a change in writing
> direction, since they are not Arabic characters, but a set of characters
> for internal use only (no exchange between different parties).

That is not entirely true, because Unicode assigns default Bidi Class
properties to some unassigned codepoints, and Emacs obeys that.  So an
unassigned codepoint (which is AFAIU what "noncharacter" stands for in
your terminology) for which Unicode says that its Bidi Class should
be, for example, AL, _will_ cause change of text directionality.

If you use those unassigned codepoints for private use, you will have
to override the default properties by manually modifying the relevant
Emacs char-tables at run time.




Information forwarded to bug-gnu-emacs@HIDDEN:
bug#55256; Package emacs. Full text available.

Message received at 55256 <at> debbugs.gnu.org:


Received: (at 55256) by debbugs.gnu.org; 4 May 2022 08:17:32 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed May 04 04:17:32 2022
Received: from localhost ([127.0.0.1]:41700 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1nmACS-0001ap-6L
	for submit <at> debbugs.gnu.org; Wed, 04 May 2022 04:17:32 -0400
Received: from eggs.gnu.org ([209.51.188.92]:40846)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <eliz@HIDDEN>) id 1nmACQ-0001ad-Q3
 for 55256 <at> debbugs.gnu.org; Wed, 04 May 2022 04:17:31 -0400
Received: from fencepost.gnu.org ([2001:470:142:3::e]:49148)
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <eliz@HIDDEN>)
 id 1nmACL-0006nT-9e; Wed, 04 May 2022 04:17:25 -0400
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org;
 s=fencepost-gnu-org; h=References:Subject:In-Reply-To:To:From:Date:
 mime-version; bh=STpvPLklMlIvpedWieGzSGT0b6com8NWN5ksmiJv6mc=; b=CXAoHIJJJhZQ
 W2GNdbFUERc3Ah5MVhE/i0Gl99jaiC06ZWP2nSYaXifFw2CrmWvkeJCTVQK8VxamySXhVbygls14k
 QNGKouAEL4OGkGfqIMbrOHXqo8gu3Ogm8BBBxEf3ZCzrJZrjWiejeJ3QalihkwpEIn7xolXJmBZhg
 /UVKi1M7KkoBIVCEr2i6yhDvhdKd/tE1goiyaOuiXgBoTvzKeeSkzxCYY9qmg6q9peUFyJ/+V6x+V
 2HQbZMs2izEimDevRP+ZcRaiIiVq8y488C/MqVye4gSs8seQN74U39b2U1VeAJJF1IiV8EKAl6Yn+
 CM+p0SOissn2P9nUtZtddA==;
Received: from [87.69.77.57] (port=3489 helo=home-c4e4a596f7)
 by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <eliz@HIDDEN>)
 id 1nmACK-0003ki-PU; Wed, 04 May 2022 04:17:25 -0400
Date: Wed, 04 May 2022 11:17:38 +0300
Message-Id: <835yml4spp.fsf@HIDDEN>
From: Eli Zaretskii <eliz@HIDDEN>
To: frederik.fouvry@HIDDEN
In-Reply-To: <875ymlepz6.fsf@HIDDEN> (bug-gnu-emacs@HIDDEN)
Subject: Re: bug#55256: 27.1;
 Unicode noncharacters may change writing direction
References: <875ymlepz6.fsf@HIDDEN>
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: 55256
Cc: 55256 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

> Date: Wed, 04 May 2022 09:06:37 +0200
> From: frederik.fouvry--- via "Bug reports for GNU Emacs,
>  the Swiss army knife of text editors" <bug-gnu-emacs@HIDDEN>
> 
> 
> M-x set-input-method RET
> ucs RET
> jufdd0$1 RET
> 
> If you type C-a and then step through the characters with the right
> arrow, the direction is reversed. It seems like the entry of $ followed
> by something else is triggering it, but that may just be an
> impression/side effect.
> 
> I suspect that the reason is that most Unicode noncharacters
> (https://www.unicode.org/faq/private_use.html#nonchar1) are in an Arabic
> block (https://www.unicode.org/faq/private_use.html#nonchar4b) and that
> the cause is an incorrect generalisation of the properties of the
> characters in this block.

Correct.  We failed to be in sync with the Unicode Standard in this
regard.  Should be fixed now on the master branch.

Thanks.




Information forwarded to bug-gnu-emacs@HIDDEN:
bug#55256; Package emacs. Full text available.

Message received at 55256 <at> debbugs.gnu.org:


Received: (at 55256) by debbugs.gnu.org; 4 May 2022 07:20:15 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed May 04 03:20:15 2022
Received: from localhost ([127.0.0.1]:41596 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1nm9J0-00007V-NJ
	for submit <at> debbugs.gnu.org; Wed, 04 May 2022 03:20:14 -0400
Received: from mail-ed1-f43.google.com ([209.85.208.43]:44762)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <frederik.fouvry@HIDDEN>) id 1nm9Iy-00007F-M0
 for 55256 <at> debbugs.gnu.org; Wed, 04 May 2022 03:20:13 -0400
Received: by mail-ed1-f43.google.com with SMTP id t5so681292edw.11
 for <55256 <at> debbugs.gnu.org>; Wed, 04 May 2022 00:20:12 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=acrolinx.com; s=google;
 h=from:to:subject:date:message-id:mime-version;
 bh=g3Wn+R3QdclAdccJRUYVKa3UoV6TpK/LAvZx6luRfTY=;
 b=A6HFcdS5SQjTZw735E2/0Jz2VG3vyg3P1bhufHDeppMI1NgYcRFhZHwiEMAun8WZ2d
 Jy7ibzpuJRlbcUaOVVw2PACRY3tadwSYTPzgpYfF+NC06CgcQ3fosy8/JW5048CYNKT8
 lI67j8Q9y9bv48Jik3YS/MIOiWdN7TvLRZs8a25PJAyZrXz/ko7BlcjCx3KVxVHwNDQf
 BYzl3393C2JA2GhuxkFIhyELbnAl8AlHo58RfiiSQRpQ++l4vTd3IzCk9cw5wE7HFuZy
 9MME1YdmQBo3nSTOBJUQYjwLEV1MIQs94rOGB5+Yg3W/l268cwZVo+68hgSf/YfbU36J
 85XA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20210112;
 h=x-gm-message-state:from:to:subject:date:message-id:mime-version;
 bh=g3Wn+R3QdclAdccJRUYVKa3UoV6TpK/LAvZx6luRfTY=;
 b=3G8GR+NnL8+PDjTPGfTbG815eaUczGkmGNiyQxJcy269ph2CFAh+6tAhZQ+dvXvaOF
 tdpI/c/w5egkpWsnMUGRdumQcM7A8MZxkHckdv/FSw5EUoPACsHizl3EGOx1U7oifSro
 sJourlZSOU/+oV0iw4TtK3zkXRN25Min3OXsNCvrN1xtCVB/zvV74u6GC0lMw1/QX/xq
 ax7mvtMKBxa6iWdjLSihp+URGZM6YRDvZaBetaIqfhLT6HUr+OA0PefN1OyV3w2EHFWD
 ZDPgPhsX2Uo9xkUDXENTv/KudIRJcJJndaDd9tn09uzxc4KyGg2SLIqKeKwk1ye7WUzL
 vOxA==
X-Gm-Message-State: AOAM531ZFs9jUMKstRvYMIbHeHGjFtl4pjMrcwG04K8nMU8UHvp0NhiS
 4u1x82iiqnaFEEu5lhfbEEalEBcCiKzPLX89
X-Google-Smtp-Source: ABdhPJxbKax7T0O+cT77PS4wJ+KwJiYkDYq++GM4SiC+ttt0Zduj8tkqlDkJKBGiSbhq5hqogroabQ==
X-Received: by 2002:a05:6402:3711:b0:425:d3d6:2b65 with SMTP id
 ek17-20020a056402371100b00425d3d62b65mr22251636edb.328.1651648806655; 
 Wed, 04 May 2022 00:20:06 -0700 (PDT)
Received: from choiseul.acrolinx.com (ip5f5a029d.dynamic.kabel-deutschland.de.
 [95.90.2.157]) by smtp.gmail.com with ESMTPSA id
 hy11-20020a1709068a6b00b006f3ef214db0sm5375673ejc.22.2022.05.04.00.20.06
 for <55256 <at> debbugs.gnu.org>
 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
 Wed, 04 May 2022 00:20:06 -0700 (PDT)
Received: by choiseul.acrolinx.com (Postfix, from userid 1000)
 id 5124316A2262; Wed,  4 May 2022 09:20:05 +0200 (CEST)
From: frederik.fouvry@HIDDEN
To: 55256 <at> debbugs.gnu.org
Subject: Writing direction
Date: Wed, 04 May 2022 09:20:05 +0200
Message-ID: <8735hpepcq.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: 55256
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)


I forgot to add:

The Unicode noncharacters should not cause a change in writing
direction, since they are not Arabic characters, but a set of characters
for internal use only (no exchange between different parties).




Information forwarded to bug-gnu-emacs@HIDDEN:
bug#55256; Package emacs. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 4 May 2022 07:07:00 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed May 04 03:07:00 2022
Received: from localhost ([127.0.0.1]:41581 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1nm96B-0008FH-Do
	for submit <at> debbugs.gnu.org; Wed, 04 May 2022 03:06:59 -0400
Received: from lists.gnu.org ([209.51.188.17]:57696)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <frederik.fouvry@HIDDEN>) id 1nm964-0008F4-E3
 for submit <at> debbugs.gnu.org; Wed, 04 May 2022 03:06:58 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10]:46050)
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <frederik.fouvry@HIDDEN>)
 id 1nm961-00026b-Kj
 for bug-gnu-emacs@HIDDEN; Wed, 04 May 2022 03:06:51 -0400
Received: from mail-wr1-x432.google.com ([2a00:1450:4864:20::432]:44552)
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128)
 (Exim 4.90_1) (envelope-from <frederik.fouvry@HIDDEN>)
 id 1nm95u-0004Hm-Ki
 for bug-gnu-emacs@HIDDEN; Wed, 04 May 2022 03:06:44 -0400
Received: by mail-wr1-x432.google.com with SMTP id b19so680366wrh.11
 for <bug-gnu-emacs@HIDDEN>; Wed, 04 May 2022 00:06:40 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=acrolinx.com; s=google;
 h=from:to:subject:date:message-id:mime-version
 :content-transfer-encoding;
 bh=ut29tsgBl91/Yj7Cqf6h0EO9/AQ4HNrN17Ni0mcr+c0=;
 b=Ad0ZUZljSvywMepari40AaV1sIdXaxVDr+wpwjiE8RN4fUScxHa+2bK1N+5JH5RKUH
 LQuO+VTslve7IXxsFaG9+KkNo8C+hBw0x+t8cTX+OvibtBROv7x841r+q6TND8GNmAop
 H6gW4qUtxnLWIb8cC62HI+K/ja6GGb+6hkQpRix0FKDPETZw1MMMo12w7Gtvi4S7hc7F
 JUjdX5gqyiza0HxAfu/KqznU+5CO3trh3/CIgP1i1KqsReTwWFtKiNBHHxP9kk8SK6+J
 LrJ2X+KG1Syt6x9dParZ3fO2EFrI8A2mRGBC5feCY4JF2SBuwkSSI84z4l/bIIY5pb3r
 91zA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20210112;
 h=x-gm-message-state:from:to:subject:date:message-id:mime-version
 :content-transfer-encoding;
 bh=ut29tsgBl91/Yj7Cqf6h0EO9/AQ4HNrN17Ni0mcr+c0=;
 b=nelTjLhGqs73Yn8ZvjqnbUFjt7XeACGSNPaJbloHTBHoyXbayIIfPV1DxUnray6qz3
 +KnmOGS7fVRP7HAmbvyT0oEnCX54lXpxt0EwXc9zJAY1UjNw2ZcjyY9vmpTmo743TNvS
 JaA/xffZBkxWEnTIkQ6/Wf60MF2wSjdMqJyPkYvowbcK45pAt3LbkI442CQKAkNNQepM
 Ogc1d/oyQtigjUxRfHEZa+FawGmFzfZPQX8db3izWRB7CHTNvkj2L5B4oA6RyWuVg4Lm
 3/CooE+hjemH8saaz4D/3wsz87rWUv0QkOVqsdTIlDj5CnY8XLPIw0RefZ962J3ap/dn
 nrtg==
X-Gm-Message-State: AOAM533U7L+juOaHapVzexCzW5SDb9LCQYx/dnKbV1tzLHLAV7jMw/59
 30evylkP4ma5pPF9nDWQJgk4NCt6zc8iChCH
X-Google-Smtp-Source: ABdhPJzJYMnPkGgDqDtxV/if4CLwh/xGs4e9o1AmxyiTkyl7rvcKGf34/dcpjp1XsboQVmD/jP3onA==
X-Received: by 2002:a05:6000:144f:b0:20c:6090:3040 with SMTP id
 v15-20020a056000144f00b0020c60903040mr10195377wrx.479.1651647999235; 
 Wed, 04 May 2022 00:06:39 -0700 (PDT)
Received: from choiseul.acrolinx.com (ip5f5a029d.dynamic.kabel-deutschland.de.
 [95.90.2.157]) by smtp.gmail.com with ESMTPSA id
 q14-20020adfaa4e000000b0020c5253d91fsm11288378wrd.107.2022.05.04.00.06.38
 for <bug-gnu-emacs@HIDDEN>
 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
 Wed, 04 May 2022 00:06:38 -0700 (PDT)
Received: by choiseul.acrolinx.com (Postfix, from userid 1000)
 id 782DF16A2262; Wed,  4 May 2022 09:06:37 +0200 (CEST)
From: frederik.fouvry@HIDDEN
To: bug-gnu-emacs@HIDDEN
Subject: 27.1; Unicode noncharacters may change writing direction
Date: Wed, 04 May 2022 09:06:37 +0200
Message-ID: <875ymlepz6.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Received-SPF: pass client-ip=2a00:1450:4864:20::432;
 envelope-from=frederik.fouvry@HIDDEN; helo=mail-wr1-x432.google.com
X-Spam_score_int: -20
X-Spam_score: -2.1
X-Spam_bar: --
X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
 DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1,
 RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001,
 T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: -1.4 (-)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.4 (--)


M-x set-input-method RET
ucs RET
jufdd0$1 RET

If you type C-a and then step through the characters with the right
arrow, the direction is reversed. It seems like the entry of $ followed
by something else is triggering it, but that may just be an
impression/side effect.

I suspect that the reason is that most Unicode noncharacters
(https://www.unicode.org/faq/private_use.html#nonchar1) are in an Arabic
block (https://www.unicode.org/faq/private_use.html#nonchar4b) and that
the cause is an incorrect generalisation of the properties of the
characters in this block.

In GNU Emacs 27.1 (build 1, x86_64-pc-linux-gnu, GTK+ Version 3.24.20, cair=
o version 1.16.0)
 of 2020-09-19 built on lgw01-amd64-021
Windowing system distributor 'The X.Org Foundation', version 11.0.12013000
System Description: Ubuntu 20.04.4 LTS

Recent messages:
Char: =EF=B7=90=E2=80=8E (64976, #o176720, #xfdd0, file ...) point=3D4361 o=
f 7190 (61%) column=3D23
Mark set [2 times]
Auto-saving...done

Configured using:
 'configure --build=3Dx86_64-linux-gnu --prefix=3D/usr
 '--includedir=3D${prefix}/include' '--mandir=3D${prefix}/share/man'
 '--infodir=3D${prefix}/share/info' --sysconfdir=3D/etc --localstatedir=3D/=
var
 --disable-silent-rules '--libdir=3D${prefix}/lib/x86_64-linux-gnu'
 '--libexecdir=3D${prefix}/lib/x86_64-linux-gnu' --disable-maintainer-mode
 --disable-dependency-tracking --prefix=3D/usr --sharedstatedir=3D/var/lib
 --libexecdir=3D/usr/lib --localstatedir=3D/var/lib
 --infodir=3D/usr/share/info --mandir=3D/usr/share/man
 --enable-locallisppath=3D/etc/emacs:/usr/local/share/emacs/27.1/site-lisp:=
/usr/local/share/emacs/site-lisp:/usr/share/emacs/27.1/site-lisp:/usr/share=
/emacs/site-lisp
 --program-suffix=3D27 --with-modules --with-file-notification=3Dinotify
 --with-mailutils --with-harfbuzz --with-json --with-x=3Dyes
 --with-x-toolkit=3Dgtk3 --with-lcms2 --with-cairo --with-xpm=3Dyes
 --with-gif=3Dyes --with-gnutls=3Dyes --with-jpeg=3Dyes --with-png=3Dyes
 --with-tiff=3Dyes --with-xwidgets 'CFLAGS=3D-g -O2
 -fdebug-prefix-map=3D/build/emacs27-bifpWT/emacs27-27.1~1.git86d8d76aa3=3D=
. -fstack-protector-strong
 -Wformat -Werror=3Dformat-security -no-pie' 'CPPFLAGS=3D-Wdate-time
 -D_FORTIFY_SOURCE=3D2' 'LDFLAGS=3D-Wl,-Bsymbolic-functions -Wl,-z,relro
 -no-pie''

Configured features:
XPM JPEG TIFF GIF PNG RSVG CAIRO SOUND GPM DBUS GSETTINGS GLIB NOTIFY
INOTIFY ACL LIBSELINUX GNUTLS LIBXML2 FREETYPE HARFBUZZ M17N_FLT LIBOTF
ZLIB TOOLKIT_SCROLL_BARS GTK3 X11 XDBE XIM MODULES THREADS XWIDGETS
LIBSYSTEMD JSON PDUMPER LCMS2 GMP

Important settings:
  value of $LC_MONETARY: en_GB.UTF-8
  value of $LC_NUMERIC: en_GB.UTF-8
  value of $LC_TIME: en_GB.UTF-8
  value of $LANG: en_GB.UTF-8
  value of $XMODIFIERS: @im=3Dibus
  locale-coding-system: utf-8-unix

Major mode: Fundamental

Minor modes in effect:
  hexl-follow-ascii: t
  global-git-commit-mode: t
  magit-auto-revert-mode: t
  shell-dirtrack-mode: t
  global-activity-watch-mode: t
  activity-watch-mode: t
  auto-revert-mode: t
  show-paren-mode: t
  desktop-save-mode: t
  display-time-mode: t
  editorconfig-mode: t
  tooltip-mode: t
  global-eldoc-mode: t
  electric-indent-mode: t
  mouse-wheel-mode: t
  menu-bar-mode: t
  file-name-shadow-mode: t
  global-font-lock-mode: t
  font-lock-mode: t
  blink-cursor-mode: t
  auto-composition-mode: t
  auto-encryption-mode: t
  auto-compression-mode: t
  line-number-mode: t
  transient-mark-mode: t

Load-path shadows:

Features:
(shadow sort mail-extr emacsbug ruler-mode hexl uni-input quail misearch
multi-isearch magit-submodule magit-obsolete magit-blame magit-stash
magit-reflog magit-bisect magit-push magit-pull magit-fetch magit-clone
magit-remote magit-commit magit-sequence magit-notes magit-worktree
magit-tag magit-merge magit-branch magit-reset magit-files magit-refs
magit-status magit magit-repos magit-apply magit-wip magit-log
which-func magit-diff smerge-mode diff git-commit magit-core
magit-autorevert magit-margin magit-transient magit-process with-editor
shell magit-mode transient magit-git magit-base magit-section crm dash
compat-27 compat-26 compat flymake-shellcheck flymake-proc flymake
compile sh-script executable css-mode smie imenu rng-xsd xsd-regexp
rng-cmpct rng-nxml rng-valid rng-loc rng-uri rng-parse nxml-parse
rng-match rng-dt rng-util rng-pttrn nxml-ns nxml-mode nxml-outln
nxml-rap sgml-mode nxml-util nxml-enc xmltok ol-eww eww mm-url url-queue
ol-rmail ol-mhe ol-irc ol-info ol-gnus nnir ol-docview ol-bibtex ol-bbdb
ol-w3m ol-doi org-link-doi vc-git diff-mode markdown-mode edit-indirect
color dired-aux server activity-watch-mode request autorevert filenotify
ert pp ewoc debug backtrace paren desktop frameset cus-start cus-load
auto-dictionary flyspell ispell time editorconfig-core
editorconfig-core-handle editorconfig-fnmatch timeclock mu4e mu4e-org
mu4e-main mu4e-view mu4e-view-gnus gnus-art mm-uu mml2015 mm-view
mml-smime smime dig gnus-sum url url-proxy url-privacy url-expand
url-methods url-history gnus-group gnus-undo gnus-start gnus-cloud
nnimap nnmail mail-source utf7 netrc nnoo parse-time iso8601 gnus-spec
gnus-int gnus-range gnus-win gnus nnheader wid-edit mu4e-view-common
thingatpt mu4e-headers mu4e-compose mu4e-context mu4e-draft mu4e-actions
ido rfc2368 smtpmail sendmail mu4e-mark mu4e-proc mu4e-utils doc-view
jka-compr image-mode exif mu4e-lists mu4e-message shr url-cookie
url-domsuf url-util svg xml dom flow-fill mule-util mailcap hl-line
mu4e-vars mu4e-meta dired-x calfw-org org-capture org-element avl-tree
generator org-agenda org-refile calfw holidays hol-loaddefs cl
org-journal edmacro kmacro org-crypt org ob ob-tangle ob-ref ob-lob
ob-table ob-exp org-macro org-footnote org-src ob-comint org-pcomplete
pcomplete comint ansi-color org-list org-faces org-entities noutline
outline org-version ob-emacs-lisp ob-core ob-eval org-table oc-basic
bibtex ol rx org-keys oc org-compat advice org-macs org-loaddefs
find-func cal-iso cal-menu calendar cal-loaddefs vc-svn dsvn log-edit
easy-mmode message rmc puny dired dired-loaddefs format-spec rfc822 mml
mml-sec epa derived epg epg-config gnus-util rmail rmail-loaddefs
warnings text-property-search time-date mm-decode mm-bodies mm-encode
mail-parse rfc2231 rfc2047 rfc2045 mm-util ietf-drums mail-prsvr
mailabbrev mail-utils gmm-utils mailheader ring pcvs-util add-log vc
vc-dispatcher editorconfig cl-extra help-mode use-package-ensure
use-package-core helm-easymenu info package easymenu browse-url
url-handlers url-parse auth-source cl-seq eieio eieio-core cl-macs
eieio-loaddefs password-cache json subr-x map url-vars seq byte-opt gv
bytecomp byte-compile cconv cl-loaddefs cl-lib tooltip eldoc electric
uniquify ediff-hook vc-hooks lisp-float-type mwheel term/x-win x-win
term/common-win x-dnd tool-bar dnd fontset image regexp-opt fringe
tabulated-list replace newcomment text-mode elisp-mode lisp-mode
prog-mode register page tab-bar menu-bar rfn-eshadow isearch timer
select scroll-bar mouse jit-lock font-lock syntax facemenu font-core
term/tty-colors frame minibuffer cl-generic cham georgian utf-8-lang
misc-lang vietnamese tibetan thai tai-viet lao korean japanese eucjp-ms
cp51932 hebrew greek romanian slovak czech european ethiopic indian
cyrillic chinese composite charscript charprop case-table epa-hook
jka-cmpr-hook help simple abbrev obarray cl-preloaded nadvice loaddefs
button faces cus-face macroexp files text-properties overlay sha1 md5
base64 format env code-pages mule custom widget hashtable-print-readable
backquote threads dbusbind inotify lcms2 dynamic-setting
system-font-setting font-render-setting xwidget-internal cairo
move-toolbar gtk x-toolkit x multi-tty make-network-process emacs)

Memory information:
((conses 16 398834 33888)
 (symbols 48 37214 1)
 (strings 32 137584 6008)
 (string-bytes 1 4673915)
 (vectors 16 73119)
 (vector-slots 8 1675119 195896)
 (floats 8 531 329)
 (intervals 56 7085 0)
 (buffers 1000 76))




Acknowledgement sent to frederik.fouvry@HIDDEN:
New bug report received and forwarded. Copy sent to bug-gnu-emacs@HIDDEN. Full text available.
Report forwarded to bug-gnu-emacs@HIDDEN:
bug#55256; Package emacs. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Thu, 5 May 2022 11:30:01 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.