GNU bug report logs - #17412
24.3; Unicode key events broken, not usable in input method

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: emacs; Reported by: Stefan Dorn <mail@HIDDEN>; dated Mon, 5 May 2014 22:51:02 UTC; Maintainer for emacs is bug-gnu-emacs@HIDDEN.

Message received at 17412 <at> debbugs.gnu.org:


Received: (at 17412) by debbugs.gnu.org; 13 May 2014 12:11:58 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue May 13 08:11:58 2014
Received: from localhost ([127.0.0.1]:33407 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1WkBYs-00011W-3V
	for submit <at> debbugs.gnu.org; Tue, 13 May 2014 08:11:58 -0400
Received: from fencepost.gnu.org ([208.118.235.10]:35357 ident=Debian-exim)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <handa@HIDDEN>) id 1WkBYq-00011P-Ba
 for 17412 <at> debbugs.gnu.org; Tue, 13 May 2014 08:11:56 -0400
Received: from fl1-110-233-81-186.iba.mesh.ad.jp ([110.233.81.186]:38675
 helo=wanchai)
 by fencepost.gnu.org with esmtpsa (TLS1.0:DHE_RSA_AES_128_CBC_SHA1:16)
 (Exim 4.71) (envelope-from <handa@HIDDEN>)
 id 1WkBYp-0007SC-CX; Tue, 13 May 2014 08:11:55 -0400
Received: from handa by wanchai with local (Exim 4.80)
 (envelope-from <handa@HIDDEN>)
 id 1WkBYk-0007Wq-0A; Tue, 13 May 2014 21:11:50 +0900
From: handa@HIDDEN (K. Handa)
To: Stefan Monnier <monnier@HIDDEN>
Subject: Re: bug#17412: 24.3;
 Unicode key events broken, not usable in input method
In-Reply-To: <jwvwqdqzdeh.fsf-monnier+emacsbugs@HIDDEN> (message from Stefan
 Monnier on Mon, 12 May 2014 21:17:47 -0400)
Date: Tue, 13 May 2014 21:11:49 +0900
Message-ID: <87a9alanei.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: -5.7 (-----)
X-Debbugs-Envelope-To: 17412
Cc: mail@HIDDEN, 17412 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -5.7 (-----)

In article <jwvwqdqzdeh.fsf-monnier+emacsbugs@HIDDEN>, Stefan Monnier <monnier@HIDDEN> writes:

> > Perhaps we had expected that a user typed C as a character
> > if C >= 256, not as a key to input another character.

> Sounds like it, indeed, but since we have decoded chars by the time we
> get to input-event processing, it doesn't seem very useful to prevent
> users from using non-ASCII keys for input-methods.

> IOW, we should try and lift this restriction,

Yes, I agree.

---
Kenichi Handa
handa@HIDDEN




Information forwarded to bug-gnu-emacs@HIDDEN:
bug#17412; Package emacs. Full text available.

Message received at 17412 <at> debbugs.gnu.org:


Received: (at 17412) by debbugs.gnu.org; 13 May 2014 01:17:56 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon May 12 21:17:56 2014
Received: from localhost ([127.0.0.1]:33073 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1Wk1Lv-0001vp-VZ
	for submit <at> debbugs.gnu.org; Mon, 12 May 2014 21:17:56 -0400
Received: from chene.dit.umontreal.ca ([132.204.246.20]:38191)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <monnier@HIDDEN>) id 1Wk1Lr-0001ve-70
 for 17412 <at> debbugs.gnu.org; Mon, 12 May 2014 21:17:52 -0400
Received: from pastel.home (lechon.iro.umontreal.ca [132.204.27.242])
 by chene.dit.umontreal.ca (8.14.1/8.14.1) with ESMTP id s4D1HmLC031693;
 Mon, 12 May 2014 21:17:48 -0400
Received: by pastel.home (Postfix, from userid 20848)
 id 06C6E601E4; Mon, 12 May 2014 21:17:47 -0400 (EDT)
From: Stefan Monnier <monnier@HIDDEN>
To: handa@HIDDEN (K. Handa)
Subject: Re: bug#17412: 24.3;
 Unicode key events broken, not usable in input method
Message-ID: <jwvwqdqzdeh.fsf-monnier+emacsbugs@HIDDEN>
References: <87d2fia8e1.fsf@HIDDEN>
Date: Mon, 12 May 2014 21:17:47 -0400
In-Reply-To: <87d2fia8e1.fsf@HIDDEN> (K. Handa's message of "Tue, 13 May 2014
 08:23:50 +0900")
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4.50 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain
X-NAI-Spam-Flag: NO
X-NAI-Spam-Threshold: 5
X-NAI-Spam-Score: 0
X-NAI-Spam-Rules: 1 Rules triggered
	RV4940=0
X-NAI-Spam-Version: 2.3.0.9378 : core <4940> : inlines <859> : streams
 <1181043> : uri <1755166>
X-Spam-Score: -2.0 (--)
X-Debbugs-Envelope-To: 17412
Cc: mail@HIDDEN, 17412 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.0 (--)

> Perhaps we had expected that a user typed C as a character
> if C >= 256, not as a key to input another character.

Sounds like it, indeed, but since we have decoded chars by the time we
get to input-event processing, it doesn't seem very useful to prevent
users from using non-ASCII keys for input-methods.

IOW, we should try and lift this restriction,


        Stefan




Information forwarded to bug-gnu-emacs@HIDDEN:
bug#17412; Package emacs. Full text available.

Message received at 17412 <at> debbugs.gnu.org:


Received: (at 17412) by debbugs.gnu.org; 12 May 2014 23:24:00 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon May 12 19:24:00 2014
Received: from localhost ([127.0.0.1]:33013 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1WjzZf-0006kr-PN
	for submit <at> debbugs.gnu.org; Mon, 12 May 2014 19:24:00 -0400
Received: from fencepost.gnu.org ([208.118.235.10]:51181 ident=Debian-exim)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <handa@HIDDEN>) id 1WjzZd-0006kj-QO
 for 17412 <at> debbugs.gnu.org; Mon, 12 May 2014 19:23:58 -0400
Received: from fl1-110-233-81-186.iba.mesh.ad.jp ([110.233.81.186]:60001
 helo=wanchai)
 by fencepost.gnu.org with esmtpsa (TLS1.0:DHE_RSA_AES_128_CBC_SHA1:16)
 (Exim 4.71) (envelope-from <handa@HIDDEN>)
 id 1WjzZc-00045K-DP; Mon, 12 May 2014 19:23:56 -0400
Received: from handa by wanchai with local (Exim 4.80)
 (envelope-from <handa@HIDDEN>)
 id 1WjzZW-00075D-9E; Tue, 13 May 2014 08:23:50 +0900
From: handa@HIDDEN (K. Handa)
To: Stefan Monnier <monnier@HIDDEN>
Subject: Re: bug#17412: 24.3;
 Unicode key events broken, not usable in input method
In-Reply-To: <jwviopiki5k.fsf-monnier+emacsbugs@HIDDEN> (message from Stefan
 Monnier on Tue, 06 May 2014 12:06:47 -0400)
Date: Tue, 13 May 2014 08:23:50 +0900
Message-ID: <87d2fia8e1.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: -5.7 (-----)
X-Debbugs-Envelope-To: 17412
Cc: mail@HIDDEN, 17412 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -5.7 (-----)

In article <jwviopiki5k.fsf-monnier+emacsbugs@HIDDEN>, Stefan Monnier <monnier@HIDDEN> writes:

> > Digging around in keyboard.c, I found that read_char() only passes
> > events with keycode < 256 (line 3050ff) to input-method-function:

> Indeed, this has been in the input-method design from the start.
> I'd be interested to know why.  Handa?

As far as I remember, the relevant code was written by RMS,
and I'm sorry but I don't remember what I discussed with RMS
at that time.

Perhaps we had expected that a user typed C as a character
if C >= 256, not as a key to input another character.

---
Kenichi Handa
handa@HIDDEN




Information forwarded to bug-gnu-emacs@HIDDEN:
bug#17412; Package emacs. Full text available.

Message received at 17412 <at> debbugs.gnu.org:


Received: (at 17412) by debbugs.gnu.org; 7 May 2014 18:13:02 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed May 07 14:13:02 2014
Received: from localhost ([127.0.0.1]:54765 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1Wi6L0-0003bE-4G
	for submit <at> debbugs.gnu.org; Wed, 07 May 2014 14:13:02 -0400
Received: from mtaout20.012.net.il ([80.179.55.166]:35608)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <eliz@HIDDEN>) id 1Wi6Kw-0003aZ-NX
 for 17412 <at> debbugs.gnu.org; Wed, 07 May 2014 14:13:00 -0400
Received: from conversion-daemon.a-mtaout20.012.net.il by
 a-mtaout20.012.net.il (HyperSendmail v2007.08) id
 <0N5700600UHAWV00@HIDDEN> for 17412 <at> debbugs.gnu.org;
 Wed, 07 May 2014 21:12:52 +0300 (IDT)
Received: from HOME-C4E4A596F7 ([87.69.4.28]) by a-mtaout20.012.net.il
 (HyperSendmail v2007.08) with ESMTPA id
 <0N5700656ULFA2A0@HIDDEN>;
 Wed, 07 May 2014 21:12:51 +0300 (IDT)
Date: Wed, 07 May 2014 21:13:01 +0300
From: Eli Zaretskii <eliz@HIDDEN>
Subject: Re: bug#17412: 24.3;
 Unicode key events broken, not usable in input method
In-reply-to: <jwvk39yis5y.fsf-monnier+emacsbugs@HIDDEN>
X-012-Sender: halo1@HIDDEN
To: Stefan Monnier <monnier@HIDDEN>
Message-id: <83iophwj82.fsf@HIDDEN>
References: <CAEOcM3n9pXqFNKuM9hsY=6P=GtO2zyr0tg2AXqksEO0L=wZThQ@HIDDEN>
 <jwviopiki5k.fsf-monnier+emacsbugs@HIDDEN>
 <CAEOcM3m_mPAMGz-MEaLfJ7K4n8FbSkwvnk3GFrquMS9OS-tAzQ@HIDDEN>
 <83a9auybwy.fsf@HIDDEN> <jwvk39yis5y.fsf-monnier+emacsbugs@HIDDEN>
X-Spam-Score: 1.0 (+)
X-Debbugs-Envelope-To: 17412
Cc: mail@HIDDEN, 17412 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
Reply-To: Eli Zaretskii <eliz@HIDDEN>
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: 1.0 (+)

> From: Stefan Monnier <monnier@HIDDEN>
> Cc: Stefan Dorn <mail@HIDDEN>,  17412 <at> debbugs.gnu.org
> Date: Tue, 06 May 2014 16:12:13 -0400
> 
> > That's not how to add normalization support to Emacs search.  It is
> > much better to define a case-table that maps each normalization
> > variant to a single canonical one, and then search functions will (or
> > at least should: I didn't actually try that) automatically do the
> 
> Can case-tables do such normalization?  Last I checked, they work "one
> char at a time" and can't handle multi-char mappings at all (neither as
> input nor as output).

I meant the canonical slot of the case-tables.  Of course, doing what
I suggested will need some changes on the C level, but they are
straightforward, I think.




Information forwarded to bug-gnu-emacs@HIDDEN:
bug#17412; Package emacs. Full text available.

Message received at 17412 <at> debbugs.gnu.org:


Received: (at 17412) by debbugs.gnu.org; 6 May 2014 20:14:23 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue May 06 16:14:23 2014
Received: from localhost ([127.0.0.1]:53151 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1Whlks-00029s-Ta
	for submit <at> debbugs.gnu.org; Tue, 06 May 2014 16:14:23 -0400
Received: from dancol.org ([96.126.100.184]:51823)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <dancol@HIDDEN>) id 1Whlkq-00029k-0N
 for 17412 <at> debbugs.gnu.org; Tue, 06 May 2014 16:14:20 -0400
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=dancol.org;
 s=x; 
 h=Content-Type:In-Reply-To:References:Subject:CC:To:MIME-Version:From:Date:Message-ID;
 bh=+F644UG9gjjX3xQHkvKQNjwOm70vwpA3wWluA38fYH8=; 
 b=RhnvYKz9lNbUhe4UwVKkOBMjBCqggvwGNMdlgai9CmuljXK28arkcUVrwoqYyFsL1cWbxHHMqa0NfCqrVFnNIfKVvl1tsYOGRLXLAPseEfAehnmDX7OKV2Q78g7Ln/qqxsdMfVvYiY9yS6mjWv6ERoBLvY+bp7fHs3AU9rZpfW7idpDKN/WPJVY9y2TXUUNIKSYpP+kytlqTigh0VaVTQMUrckCjwkHNHLpoIUgHCfJ11ZLUwSsPLNVgaL5CqD8sLT7gmjNnl3viHcCpNLVDNrLGo6Se948svibQ3sePHRFjIGb93YPQZgjJ8FpeB52HOuaDtQCHjX3/KlWb53VEUA==;
Received: from [2620:10d:c083:1003:863a:4bff:fec8:e538]
 by dancol.org with esmtpsa (TLS1.0:DHE_RSA_AES_128_CBC_SHA1:128)
 (Exim 4.82) (envelope-from <dancol@HIDDEN>)
 id 1Whlkl-0000AZ-BK; Tue, 06 May 2014 13:14:15 -0700
Message-ID: <53694290.4030303@HIDDEN>
Date: Tue, 06 May 2014 13:14:08 -0700
From: Daniel Colascione <dancol@HIDDEN>
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
 rv:24.0) Gecko/20100101 Thunderbird/24.5.0
MIME-Version: 1.0
To: Stefan Monnier <monnier@HIDDEN>, 
 Eli Zaretskii <eliz@HIDDEN>
Subject: Re: bug#17412: 24.3; Unicode key events broken, not usable in input
 method
References: <CAEOcM3n9pXqFNKuM9hsY=6P=GtO2zyr0tg2AXqksEO0L=wZThQ@HIDDEN>	<jwviopiki5k.fsf-monnier+emacsbugs@HIDDEN>	<CAEOcM3m_mPAMGz-MEaLfJ7K4n8FbSkwvnk3GFrquMS9OS-tAzQ@HIDDEN>	<83a9auybwy.fsf@HIDDEN>
 <jwvk39yis5y.fsf-monnier+emacsbugs@HIDDEN>
In-Reply-To: <jwvk39yis5y.fsf-monnier+emacsbugs@HIDDEN>
X-Enigmail-Version: 1.6
Content-Type: multipart/signed; micalg=pgp-sha1;
 protocol="application/pgp-signature";
 boundary="Xp54tasv1j7g9H4U79Xtu14Qft2PRb7C2"
X-Spam-Score: -0.6 (/)
X-Debbugs-Envelope-To: 17412
Cc: Stefan Dorn <mail@HIDDEN>, 17412 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.6 (/)

This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--Xp54tasv1j7g9H4U79Xtu14Qft2PRb7C2
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

On 05/06/2014 01:12 PM, Stefan Monnier wrote:
>> That's not how to add normalization support to Emacs search.  It is
>> much better to define a case-table that maps each normalization
>> variant to a single canonical one, and then search functions will (or
>> at least should: I didn't actually try that) automatically do the
>=20
> Can case-tables do such normalization?  Last I checked, they work "one
> char at a time" and can't handle multi-char mappings at all (neither as=

> input nor as output).

So why not make them stateful?


--Xp54tasv1j7g9H4U79Xtu14Qft2PRb7C2
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iQIcBAEBAgAGBQJTaUKRAAoJEMAaIROpHW7I3rQP/AlGC55ipCen6R9Y+yBUfJZt
gMJVVtQkd4Pi4savAOmv0//G/8VIjmYjt8ru7LY6VXTS8NDLTr2gvhMHYk6h+GWx
+M5rpaUY1WBTyPD7pd/KQnIP83OjG432zkuUYjT7YKNGP9J0rYikcQZxNEI2nJYn
ICFr1gAK4dG4pz1XwPQyRwAeeGaG4BRDnO1yrk24q5bh4pGbCODqWZbN46qaTJeP
2Iu94fFK31t0ol+r+JB7zVL7FIRgy1nElTb7Z9HefRjhQ0BOWycdeiL8CYDYaKlb
oQR/ln3aCPW7OqZbuUDGhrQV4FSLHZxdU7as9TRpWzKHBGSekLrwq1Kl4jmII8qb
5v9smGdQGj451GS6CXixFEYBcHkG18brk8BMcGCL2yYLh7oBcEZV4DXqVX/PP3c1
yDAYz68qWbO2KiOXTL0WHScfhYzd7WYwOlNrfaEYSzP/37n2Ira3jWH7+B0/jIq+
QGlsJzuG2FC82a9UYU6JHKG/u3MA1de3unhN6O00V4XCYnqg52hpoHI9oYOJs2J0
N/HEE38/jlyViX2d7RsgHsF78Ud8HNZxZiUv5okUScJqNU2JJ7kemAt6tkYYXwfw
1EN4DUwpY/Kf/3PH/pH995Wgyam+/cApW3iu3/AFM+OfcKhlXeAlnbEBZJxioDnQ
bTzVp/sjp4oyqJhR3BZa
=Lknh
-----END PGP SIGNATURE-----

--Xp54tasv1j7g9H4U79Xtu14Qft2PRb7C2--




Information forwarded to bug-gnu-emacs@HIDDEN:
bug#17412; Package emacs. Full text available.

Message received at 17412 <at> debbugs.gnu.org:


Received: (at 17412) by debbugs.gnu.org; 6 May 2014 20:12:32 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue May 06 16:12:32 2014
Received: from localhost ([127.0.0.1]:53145 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1Whliz-00026M-RZ
	for submit <at> debbugs.gnu.org; Tue, 06 May 2014 16:12:31 -0400
Received: from ironport2-out.teksavvy.com ([206.248.154.181]:4815)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <monnier@HIDDEN>) id 1Whliw-000266-Ab
 for 17412 <at> debbugs.gnu.org; Tue, 06 May 2014 16:12:23 -0400
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: ArUGAIDvNVO4rwut/2dsb2JhbABZgwaDSsA9gRcXdIIlAQEBAQIBViMFCws0EhQYDSSIBAjSGReOegeEOASpGYFqg0wh
X-IPAS-Result: ArUGAIDvNVO4rwut/2dsb2JhbABZgwaDSsA9gRcXdIIlAQEBAQIBViMFCws0EhQYDSSIBAjSGReOegeEOASpGYFqg0wh
X-IronPort-AV: E=Sophos;i="4.97,753,1389762000"; d="scan'208";a="61674684"
Received: from 184-175-11-173.dsl.teksavvy.com (HELO pastel.home)
 ([184.175.11.173])
 by ironport2-out.teksavvy.com with ESMTP/TLS/ADH-AES256-SHA;
 06 May 2014 16:12:13 -0400
Received: by pastel.home (Postfix, from userid 20848)
 id CA34760118; Tue,  6 May 2014 16:12:13 -0400 (EDT)
From: Stefan Monnier <monnier@HIDDEN>
To: Eli Zaretskii <eliz@HIDDEN>
Subject: Re: bug#17412: 24.3;
 Unicode key events broken, not usable in input method
Message-ID: <jwvk39yis5y.fsf-monnier+emacsbugs@HIDDEN>
References: <CAEOcM3n9pXqFNKuM9hsY=6P=GtO2zyr0tg2AXqksEO0L=wZThQ@HIDDEN>
 <jwviopiki5k.fsf-monnier+emacsbugs@HIDDEN>
 <CAEOcM3m_mPAMGz-MEaLfJ7K4n8FbSkwvnk3GFrquMS9OS-tAzQ@HIDDEN>
 <83a9auybwy.fsf@HIDDEN>
Date: Tue, 06 May 2014 16:12:13 -0400
In-Reply-To: <83a9auybwy.fsf@HIDDEN> (Eli Zaretskii's message of "Tue, 06 May
 2014 21:55:41 +0300")
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4.50 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: 0.3 (/)
X-Debbugs-Envelope-To: 17412
Cc: Stefan Dorn <mail@HIDDEN>, 17412 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: 0.3 (/)

> That's not how to add normalization support to Emacs search.  It is
> much better to define a case-table that maps each normalization
> variant to a single canonical one, and then search functions will (or
> at least should: I didn't actually try that) automatically do the

Can case-tables do such normalization?  Last I checked, they work "one
char at a time" and can't handle multi-char mappings at all (neither as
input nor as output).


        Stefan




Information forwarded to bug-gnu-emacs@HIDDEN:
bug#17412; Package emacs. Full text available.

Message received at 17412 <at> debbugs.gnu.org:


Received: (at 17412) by debbugs.gnu.org; 6 May 2014 18:55:46 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue May 06 14:55:46 2014
Received: from localhost ([127.0.0.1]:53118 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1WhkWn-0008UN-Rx
	for submit <at> debbugs.gnu.org; Tue, 06 May 2014 14:55:46 -0400
Received: from mtaout22.012.net.il ([80.179.55.172]:51506)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <eliz@HIDDEN>) id 1WhkWk-0008U2-CL
 for 17412 <at> debbugs.gnu.org; Tue, 06 May 2014 14:55:43 -0400
Received: from conversion-daemon.a-mtaout22.012.net.il by
 a-mtaout22.012.net.il (HyperSendmail v2007.08) id
 <0N5600A001J15V00@HIDDEN> for 17412 <at> debbugs.gnu.org;
 Tue, 06 May 2014 21:55:34 +0300 (IDT)
Received: from HOME-C4E4A596F7 ([87.69.4.28]) by a-mtaout22.012.net.il
 (HyperSendmail v2007.08) with ESMTPA id
 <0N56009YU1WMPP70@HIDDEN>;
 Tue, 06 May 2014 21:55:34 +0300 (IDT)
Date: Tue, 06 May 2014 21:55:41 +0300
From: Eli Zaretskii <eliz@HIDDEN>
Subject: Re: bug#17412: 24.3;
 Unicode key events broken, not usable in input method
In-reply-to: <CAEOcM3m_mPAMGz-MEaLfJ7K4n8FbSkwvnk3GFrquMS9OS-tAzQ@HIDDEN>
X-012-Sender: halo1@HIDDEN
To: Stefan Dorn <mail@HIDDEN>
Message-id: <83a9auybwy.fsf@HIDDEN>
MIME-version: 1.0
Content-type: text/plain; charset=utf-8
Content-transfer-encoding: 8BIT
References: <CAEOcM3n9pXqFNKuM9hsY=6P=GtO2zyr0tg2AXqksEO0L=wZThQ@HIDDEN>
 <jwviopiki5k.fsf-monnier+emacsbugs@HIDDEN>
 <CAEOcM3m_mPAMGz-MEaLfJ7K4n8FbSkwvnk3GFrquMS9OS-tAzQ@HIDDEN>
X-Spam-Score: 1.0 (+)
X-Debbugs-Envelope-To: 17412
Cc: monnier@HIDDEN, 17412 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
Reply-To: Eli Zaretskii <eliz@HIDDEN>
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: 1.0 (+)

> From: Stefan Dorn <mail@HIDDEN>
> Date: Tue, 6 May 2014 19:38:24 +0100
> 
> Most search features in Emacs don't do Unicode normalization, so ä (a
> with umlaut) and ä (a with combining diacritic umlaut) don't match. I
> added some normalization hacks to isearch and just force-normalize the
> buffer when I save it, but wanted a more universal and clean solution.
> 
> I thought I could just set up a "letter + combining diacritic" ->
> "normalized character" input method to fix most of this, but again
> arbitrarily can't use any of the diacritics in quail.

That's not how to add normalization support to Emacs search.  It is
much better to define a case-table that maps each normalization
variant to a single canonical one, and then search functions will (or
at least should: I didn't actually try that) automatically do the
mapping for you, both in the search string and in the buffer/string
text you are searching through.




Information forwarded to bug-gnu-emacs@HIDDEN:
bug#17412; Package emacs. Full text available.

Message received at 17412 <at> debbugs.gnu.org:


Received: (at 17412) by debbugs.gnu.org; 6 May 2014 18:38:54 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue May 06 14:38:54 2014
Received: from localhost ([127.0.0.1]:53103 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1WhkGT-00081Z-Lf
	for submit <at> debbugs.gnu.org; Tue, 06 May 2014 14:38:54 -0400
Received: from mail-wi0-f178.google.com ([209.85.212.178]:48168)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <muflax@HIDDEN>) id 1WhkGQ-00081E-3v
 for 17412 <at> debbugs.gnu.org; Tue, 06 May 2014 14:38:50 -0400
Received: by mail-wi0-f178.google.com with SMTP id hm4so53451wib.5
 for <17412 <at> debbugs.gnu.org>; Tue, 06 May 2014 11:38:44 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:sender:in-reply-to:references:from:date:message-id
 :subject:to:content-type:content-transfer-encoding;
 bh=MzsAY44I1mHF6PH1wOi04Ed+b+vdHEhqxq7ETHEi1uU=;
 b=TTuutDfuuJHxkzPchY+ZH9ozeyQdvKt8/eI7QmS4mJM1y/FavsCiGH4iDkyqMYghtr
 0BzNNlH9ujyMyFm2N8tRqQneBnUXIh8TapLPiAqUvs+zMrHjf0dATXz2eypnOI9MJYNt
 12HOceY/l5xaXgummo5mM1FzCMPvfZzHBs//7I1zTJWiuJlFd9OWGtuFZp5zcngUi64I
 8QMC2XSDlFPmE51V1bgzukEQJCQBJMXxAMXRs5mfSyfV3+x3BAbEiM/ijM3Y2At5KNoL
 fv9xIUq94AccC2FxRG4pEEUhScb2x0He6hjgYs67Wpt+SQW9/+H2mS/SW0EGEyVxvl/j
 34Ag==
X-Received: by 10.194.78.77 with SMTP id z13mr3599280wjw.64.1399401524180;
 Tue, 06 May 2014 11:38:44 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.194.80.103 with HTTP; Tue, 6 May 2014 11:38:24 -0700 (PDT)
In-Reply-To: <jwviopiki5k.fsf-monnier+emacsbugs@HIDDEN>
References: <CAEOcM3n9pXqFNKuM9hsY=6P=GtO2zyr0tg2AXqksEO0L=wZThQ@HIDDEN>
 <jwviopiki5k.fsf-monnier+emacsbugs@HIDDEN>
From: Stefan Dorn <mail@HIDDEN>
Date: Tue, 6 May 2014 19:38:24 +0100
X-Google-Sender-Auth: JWGzSIg4geB92bqjS1mdXosizEk
Message-ID: <CAEOcM3m_mPAMGz-MEaLfJ7K4n8FbSkwvnk3GFrquMS9OS-tAzQ@HIDDEN>
Subject: Re: bug#17412: 24.3;
 Unicode key events broken, not usable in input method
To: Stefan Monnier <monnier@HIDDEN>, 17412 <at> debbugs.gnu.org
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: -0.7 (/)
X-Debbugs-Envelope-To: 17412
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.7 (/)

>> Digging around in keyboard.c, I found that read_char() only passes
>> events with keycode < 256 (line 3050ff) to input-method-function:
>
> Indeed, this has been in the input-method design from the start.
> I'd be interested to know why.  Handa?

I write a lot of linguistic analysis, and so added common IPA symbols
to my core keyboard layout, like =C3=9F, =C5=82 or =C3=A6. (I could type th=
em through
an input method, but that would be slower and force me to use a
different typing method inside and outside of Emacs, which would slow
me down a lot.)

I recently set up a Cyrillic input method, but was surprised I
arbitrarily could use =C3=9F in quail but not =C5=82, just because =C3=9F i=
s below
the magic threshold. Unfortunately, merely turning off the conditional
in read_char() is not enough to get it to work.

More importantly, I also have most combining diacritic characters
(U+0301 ff) on keys and use them a lot. Switching them to some
"similar looking punctuation -> diacritic" input method would be
seriously annoying due to lots of conflicts (quoting a letter vs
umlauting it etc).

Most search features in Emacs don't do Unicode normalization, so =C3=A4 (a
with umlaut) and a=CC=88 (a with combining diacritic umlaut) don't match. I
added some normalization hacks to isearch and just force-normalize the
buffer when I save it, but wanted a more universal and clean solution.

I thought I could just set up a "letter + combining diacritic" ->
"normalized character" input method to fix most of this, but again
arbitrarily can't use any of the diacritics in quail.

>> [322] as key event seems strange to me. The XLib keycode for "=C5=82" (a=
s
>> reported by xev) is 0x1000142. Maybe Emacs cuts off the leading bit?
>
> 322 =3D U+0142, so it's really not strange at all: Emacs uses
> Unicode internally.

Ah, cool.




Information forwarded to bug-gnu-emacs@HIDDEN:
bug#17412; Package emacs. Full text available.

Message received at 17412 <at> debbugs.gnu.org:


Received: (at 17412) by debbugs.gnu.org; 6 May 2014 16:06:55 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue May 06 12:06:55 2014
Received: from localhost ([127.0.0.1]:53007 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1WhhtO-0002ai-U5
	for submit <at> debbugs.gnu.org; Tue, 06 May 2014 12:06:55 -0400
Received: from relais.videotron.ca ([24.201.245.36]:18537)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <monnier@HIDDEN>) id 1WhhtL-0002aR-3h
 for 17412 <at> debbugs.gnu.org; Tue, 06 May 2014 12:06:52 -0400
MIME-version: 1.0
Content-type: text/plain; charset=utf-8
Received: from ceviche.home ([24.201.53.56]) by VL-VM-MR002.ip.videotron.ca
 (Oracle Communications Messaging Exchange Server 7u4-22.01 64bit (built Apr 21
 2011)) with ESMTP id <0N5500HISU3CLK90@HIDDEN> for
 17412 <at> debbugs.gnu.org; Tue, 06 May 2014 12:06:50 -0400 (EDT)
Received: by ceviche.home (Postfix, from userid 20848)	id 392AC66094; Tue,
 06 May 2014 12:06:47 -0400 (EDT)
From: Stefan Monnier <monnier@HIDDEN>
To: Stefan Dorn <mail@HIDDEN>
Subject: Re: bug#17412: 24.3; Unicode key events broken,
 not usable in input method
Message-id: <jwviopiki5k.fsf-monnier+emacsbugs@HIDDEN>
References: <CAEOcM3n9pXqFNKuM9hsY=6P=GtO2zyr0tg2AXqksEO0L=wZThQ@HIDDEN>
Date: Tue, 06 May 2014 12:06:47 -0400
In-reply-to: <CAEOcM3n9pXqFNKuM9hsY=6P=GtO2zyr0tg2AXqksEO0L=wZThQ@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4.50 (gnu/linux)
Content-transfer-encoding: quoted-printable
X-Spam-Score: 1.0 (+)
X-Debbugs-Envelope-To: 17412
Cc: 17412 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: 1.0 (+)

> Digging around in keyboard.c, I found that read_char() only passes
> events with keycode < 256 (line 3050ff) to input-method-function:

Indeed, this has been in the input-method design from the start.
I'd be interested to know why.  Handa?

> [322] as key event seems strange to me. The XLib keycode for "=C5=82" (as
> reported by xev) is 0x1000142. Maybe Emacs cuts off the leading bit?

322 =3D U+0142, so it's really not strange at all: Emacs uses
Unicode internally.


        Stefan




Information forwarded to bug-gnu-emacs@HIDDEN:
bug#17412; Package emacs. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 5 May 2014 22:50:10 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon May 05 18:50:09 2014
Received: from localhost ([127.0.0.1]:52038 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1WhRi4-0004sm-TL
	for submit <at> debbugs.gnu.org; Mon, 05 May 2014 18:50:09 -0400
Received: from eggs.gnu.org ([208.118.235.92]:54259)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <muflax@HIDDEN>) id 1WhROx-0004Jr-SF
 for submit <at> debbugs.gnu.org; Mon, 05 May 2014 18:30:25 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <muflax@HIDDEN>) id 1WhROr-0000Iz-FD
 for submit <at> debbugs.gnu.org; Mon, 05 May 2014 18:30:18 -0400
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org
X-Spam-Level: 
X-Spam-Status: No, score=0.8 required=5.0 tests=AC_HTML_NONSENSE_TAGS, BAYES_50,
 FREEMAIL_FROM,T_DKIM_INVALID autolearn=disabled version=3.3.2
Received: from lists.gnu.org ([2001:4830:134:3::11]:41288)
 by eggs.gnu.org with esmtp (Exim 4.71)
 (envelope-from <muflax@HIDDEN>) id 1WhROr-0000Iv-DC
 for submit <at> debbugs.gnu.org; Mon, 05 May 2014 18:30:17 -0400
Received: from eggs.gnu.org ([2001:4830:134:3::10]:55968)
 by lists.gnu.org with esmtp (Exim 4.71)
 (envelope-from <muflax@HIDDEN>) id 1WhROq-00070M-5d
 for bug-gnu-emacs@HIDDEN; Mon, 05 May 2014 18:30:17 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <muflax@HIDDEN>) id 1WhROo-0000HP-PB
 for bug-gnu-emacs@HIDDEN; Mon, 05 May 2014 18:30:16 -0400
Received: from mail-wi0-x236.google.com ([2a00:1450:400c:c05::236]:56829)
 by eggs.gnu.org with esmtp (Exim 4.71)
 (envelope-from <muflax@HIDDEN>) id 1WhROo-0000HC-E0
 for bug-gnu-emacs@HIDDEN; Mon, 05 May 2014 18:30:14 -0400
Received: by mail-wi0-f182.google.com with SMTP id r20so3046918wiv.15
 for <bug-gnu-emacs@HIDDEN>; Mon, 05 May 2014 15:30:12 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:sender:from:date:message-id:subject:to:content-type
 :content-transfer-encoding;
 bh=ngs/gX7S7rhX34pHSMrxEH/65cpl5tNMOMzaGflbk2U=;
 b=0RnJNKV8rm7bw9HmVqJtVgEKXV3TvMgrJO1Z/6K/jkMyv88vHRUPecwe8HklMGxSZ5
 H6Q7SpmMbroVKMK/1ReRctSuDf6R8n3Duvtv/gyuJpVXjLdRSlDpbNo2LrXutMXki3I6
 Pa5+0SjFIiZhdalSpQcnj/RWFpSka39uwSOA+32+fUr5Ecv+l7kvnFO0KX+0pxNVtLB9
 EzaZwF8iZY9B+71UV6D9CGuKRlq3uAlGTciAOWwdbpM3BtcNqd3IO80CwCo71pw6ytZn
 awzrt/CR6wBvS2BNsfa0TrhRcRBqejSh73MjZabe40HgriSAZyHFtmJDnzsteulo6fUE
 Hn8A==
X-Received: by 10.180.90.51 with SMTP id bt19mr324328wib.22.1399329012725;
 Mon, 05 May 2014 15:30:12 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.194.80.103 with HTTP; Mon, 5 May 2014 15:29:52 -0700 (PDT)
From: Stefan Dorn <mail@HIDDEN>
Date: Mon, 5 May 2014 23:29:52 +0100
X-Google-Sender-Auth: kPm9euV-bY7OtJbgSdkane4KX8o
Message-ID: <CAEOcM3n9pXqFNKuM9hsY=6P=GtO2zyr0tg2AXqksEO0L=wZThQ@HIDDEN>
Subject: 24.3; Unicode key events broken, not usable in input method
To: bug-gnu-emacs@HIDDEN
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
X-detected-operating-system: by eggs.gnu.org: Error: Malformed IPv6 address
 (bad octet value).
X-detected-operating-system: by eggs.gnu.org: Error: Malformed IPv6 address
 (bad octet value).
X-Received-From: 2001:4830:134:3::11
X-Spam-Score: -4.0 (----)
X-Debbugs-Envelope-To: submit
X-Mailman-Approved-At: Mon, 05 May 2014 18:50:05 -0400
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -4.0 (----)

My keyboard layout includes Unicode keys like "=C5=82", U+0142 (l with
stroke), and combining diacritics (U+0300 etc). I've been trying to use
them in quail layouts, eg:

  (quail-define-package
  "custom" "custom layout" "^" t
  "Proof-of-concept layout." nil t t nil nil nil nil nil nil nil t)

  (quail-define-rules ("=C5=82" ?l))

The key is never passed into the input-method-function, and so just
inserted literally. (Typing Unicode keys directly works fine.)

Digging around in keyboard.c, I found that read_char() only passes
events with keycode < 256 (line 3050ff) to input-method-function:

  /* Pass this to the input method, if appropriate.  */
  if (INTEGERP (c)
      && ! NILP (Vinput_method_function)
      /* Don't run the input method within a key sequence,
     after the first event of the key sequence.  */
      && NILP (prev_event)
      && ' ' <=3D XINT (c) && XINT (c) < 256 && XINT (c) !=3D 127)

Using read-key-sequence, Emacs seems to parse "=C5=82" as [322] (0x142 in
decimal). Disabling the condition in read_char() (so the key is
actually passed to quail) only seems to cause an infinite loop in quail
that I've not been able diagnose yet.

[322] as key event seems strange to me. The XLib keycode for "=C5=82" (as
reported by xev) is 0x1000142. Maybe Emacs cuts off the leading bit?

Interestingly, quail shows the key in the guidance screen just fine, ie:

  (quail-define-rules ("x=C5=82" ?l))

and typing "x" correctly suggest "x=C5=82" as a pattern; it's just impossib=
le
to pass "=C5=82" to quail and have it be parsed correctly.


In GNU Emacs 24.3.1 (x86_64-pc-linux-gnu, X toolkit)
 of 2014-05-05 on scabeiathrax
Windowing system distributor `The X.Org Foundation', version 11.0.11500000
System Description:    NAME=3DGentoo

Configured using:
 `configure '--prefix=3D/usr' '--build=3Dx86_64-pc-linux-gnu'
 '--host=3Dx86_64-pc-linux-gnu' '--mandir=3D/usr/share/man'
 '--infodir=3D/usr/share/info' '--datadir=3D/usr/share' '--sysconfdir=3D/et=
c'
 '--localstatedir=3D/var/lib' '--libdir=3D/usr/lib64'
 '--disable-silent-rules' '--disable-dependency-tracking'
 '--program-suffix=3D-emacs-24' '--infodir=3D/usr/share/info/emacs-24'
 '--localstatedir=3D/var'
 '--enable-locallisppath=3D/etc/emacs:/usr/share/emacs/site-lisp'
 '--with-crt-dir=3D/usr/lib/gcc/x86_64-pc-linux-gnu/4.8.2/../../../../lib64=
'
 '--with-gameuser=3Dgames' '--without-compress-info' '--without-hesiod'
 '--without-kerberos' '--without-kerberos5' '--with-gpm' '--with-dbus'
 '--without-gnutls' '--without-xml2' '--without-selinux'
 '--without-wide-int' '--with-sound' '--with-x' '--without-ns'
 '--without-gconf' '--without-gsettings' '--without-toolkit-scroll-bars'
 '--with-gif' '--with-jpeg' '--with-png' '--with-rsvg' '--with-tiff'
 '--with-xpm' '--without-imagemagick' '--with-xft' '--with-libotf'
 '--with-m17n-flt' '--with-x-toolkit=3Dlucid' '--with-xaw3d'
 'GENTOO_PACKAGE=3Dapp-editors/emacs-24.3-r4'
 'build_alias=3Dx86_64-pc-linux-gnu' 'host_alias=3Dx86_64-pc-linux-gnu'
 'CFLAGS=3D-O2 -pipe -march=3Dcore2' 'LDFLAGS=3D-Wl,-O1 -Wl,--sort-common
 -Wl,--hash-style=3Dgnu -Wl,--as-needed' 'CPPFLAGS=3D''

Important settings:
  value of $LANG: en_US.UTF-8
  value of $XMODIFIERS: @im=3Dibus
  locale-coding-system: utf-8-unix
  default enable-multibyte-characters: t

Major mode: Lisp Interaction

Minor modes in effect:
  tooltip-mode: t
  mouse-wheel-mode: t
  tool-bar-mode: t
  menu-bar-mode: t
  file-name-shadow-mode: t
  global-font-lock-mode: t
  font-lock-mode: t
  blink-cursor-mode: t
  auto-composition-mode: t
  auto-encryption-mode: t
  auto-compression-mode: t
  line-number-mode: t
  transient-mark-mode: t

Recent input:
( r e d a <backspace> <backspace> a d - k e y - s e
q u e n c e SPC " k e y : SPC " ) <left> <left> C-M-x
=CC=88 C-M-x =C5=82 C-M-x e M-x b u g <tab> <backspace> <backspace>
<backspace> <backspace> <backspace> <backspace> <backspace>
<backspace> <backspace> <backspace> <backspace> <backspace>
<backspace> <backspace> r e p o <tab> r t <tab> <r
eturn>

Recent messages:
For information about GNU Emacs and the GNU system, type C-h C-a.
[776]
[322]
"e"
Making completion list...

Load-path shadows:
None found.

Features:
(shadow sort gnus-util mail-extr emacsbug message format-spec rfc822 mml
mml-sec mm-decode mm-bodies mm-encode mail-parse rfc2231 mailabbrev
gmm-utils mailheader sendmail rfc2047 rfc2045 ietf-drums mm-util
mail-prsvr mail-utils help-mode easymenu time-date tooltip ediff-hook
vc-hooks lisp-float-type mwheel x-win x-dnd tool-bar dnd fontset image
regexp-opt fringe tabulated-list newcomment lisp-mode register page
menu-bar rfn-eshadow timer select scroll-bar mouse jit-lock font-lock
syntax facemenu font-core frame cham georgian utf-8-lang misc-lang
vietnamese tibetan thai tai-viet lao korean japanese hebrew greek
romanian slovak czech european ethiopic indian cyrillic chinese
case-table epa-hook jka-cmpr-hook help simple abbrev minibuffer loaddefs
button faces cus-face macroexp files text-properties overlay sha1 md5
base64 format env code-pages mule custom widget hashtable-print-readable
backquote make-network-process dbusbind dynamic-setting
font-render-setting x-toolkit x multi-tty emacs)




Acknowledgement sent to Stefan Dorn <mail@HIDDEN>:
New bug report received and forwarded. Copy sent to bug-gnu-emacs@HIDDEN. Full text available.
Report forwarded to bug-gnu-emacs@HIDDEN:
bug#17412; Package emacs. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Mon, 25 Nov 2019 12:00:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.