GNU logs - #17412, boring messages


Message sent to bug-gnu-emacs@HIDDEN:


X-Loop: help-debbugs@HIDDEN
Subject: bug#17412: 24.3; Unicode key events broken, not usable in input method
Resent-From: Stefan Dorn <mail@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@HIDDEN
Resent-Date: Mon, 05 May 2014 22:51:02 +0000
Resent-Message-ID: <handler.17412.B.139933021018777 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: report 17412
X-GNU-PR-Package: emacs
X-GNU-PR-Keywords: 
To: 17412 <at> debbugs.gnu.org
X-Debbugs-Original-To: bug-gnu-emacs@HIDDEN
Received: via spool by submit <at> debbugs.gnu.org id=B.139933021018777
          (code B ref -1); Mon, 05 May 2014 22:51:02 +0000
Received: (at submit) by debbugs.gnu.org; 5 May 2014 22:50:10 +0000
Received: from localhost ([127.0.0.1]:52038 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1WhRi4-0004sm-TL
	for submit <at> debbugs.gnu.org; Mon, 05 May 2014 18:50:09 -0400
Received: from eggs.gnu.org ([208.118.235.92]:54259)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <muflax@HIDDEN>) id 1WhROx-0004Jr-SF
 for submit <at> debbugs.gnu.org; Mon, 05 May 2014 18:30:25 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <muflax@HIDDEN>) id 1WhROr-0000Iz-FD
 for submit <at> debbugs.gnu.org; Mon, 05 May 2014 18:30:18 -0400
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org
X-Spam-Level: 
X-Spam-Status: No, score=0.8 required=5.0 tests=AC_HTML_NONSENSE_TAGS, BAYES_50,
 FREEMAIL_FROM,T_DKIM_INVALID autolearn=disabled version=3.3.2
Received: from lists.gnu.org ([2001:4830:134:3::11]:41288)
 by eggs.gnu.org with esmtp (Exim 4.71)
 (envelope-from <muflax@HIDDEN>) id 1WhROr-0000Iv-DC
 for submit <at> debbugs.gnu.org; Mon, 05 May 2014 18:30:17 -0400
Received: from eggs.gnu.org ([2001:4830:134:3::10]:55968)
 by lists.gnu.org with esmtp (Exim 4.71)
 (envelope-from <muflax@HIDDEN>) id 1WhROq-00070M-5d
 for bug-gnu-emacs@HIDDEN; Mon, 05 May 2014 18:30:17 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <muflax@HIDDEN>) id 1WhROo-0000HP-PB
 for bug-gnu-emacs@HIDDEN; Mon, 05 May 2014 18:30:16 -0400
Received: from mail-wi0-x236.google.com ([2a00:1450:400c:c05::236]:56829)
 by eggs.gnu.org with esmtp (Exim 4.71)
 (envelope-from <muflax@HIDDEN>) id 1WhROo-0000HC-E0
 for bug-gnu-emacs@HIDDEN; Mon, 05 May 2014 18:30:14 -0400
Received: by mail-wi0-f182.google.com with SMTP id r20so3046918wiv.15
 for <bug-gnu-emacs@HIDDEN>; Mon, 05 May 2014 15:30:12 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:sender:from:date:message-id:subject:to:content-type
 :content-transfer-encoding;
 bh=ngs/gX7S7rhX34pHSMrxEH/65cpl5tNMOMzaGflbk2U=;
 b=0RnJNKV8rm7bw9HmVqJtVgEKXV3TvMgrJO1Z/6K/jkMyv88vHRUPecwe8HklMGxSZ5
 H6Q7SpmMbroVKMK/1ReRctSuDf6R8n3Duvtv/gyuJpVXjLdRSlDpbNo2LrXutMXki3I6
 Pa5+0SjFIiZhdalSpQcnj/RWFpSka39uwSOA+32+fUr5Ecv+l7kvnFO0KX+0pxNVtLB9
 EzaZwF8iZY9B+71UV6D9CGuKRlq3uAlGTciAOWwdbpM3BtcNqd3IO80CwCo71pw6ytZn
 awzrt/CR6wBvS2BNsfa0TrhRcRBqejSh73MjZabe40HgriSAZyHFtmJDnzsteulo6fUE
 Hn8A==
X-Received: by 10.180.90.51 with SMTP id bt19mr324328wib.22.1399329012725;
 Mon, 05 May 2014 15:30:12 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.194.80.103 with HTTP; Mon, 5 May 2014 15:29:52 -0700 (PDT)
From: Stefan Dorn <mail@HIDDEN>
Date: Mon, 5 May 2014 23:29:52 +0100
X-Google-Sender-Auth: kPm9euV-bY7OtJbgSdkane4KX8o
Message-ID: <CAEOcM3n9pXqFNKuM9hsY=6P=GtO2zyr0tg2AXqksEO0L=wZThQ@HIDDEN>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
X-detected-operating-system: by eggs.gnu.org: Error: Malformed IPv6 address
 (bad octet value).
X-detected-operating-system: by eggs.gnu.org: Error: Malformed IPv6 address
 (bad octet value).
X-Received-From: 2001:4830:134:3::11
X-Spam-Score: -4.0 (----)
X-Mailman-Approved-At: Mon, 05 May 2014 18:50:05 -0400
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -4.0 (----)

My keyboard layout includes Unicode keys like "=C5=82", U+0142 (l with
stroke), and combining diacritics (U+0300 etc). I've been trying to use
them in quail layouts, eg:

  (quail-define-package
  "custom" "custom layout" "^" t
  "Proof-of-concept layout." nil t t nil nil nil nil nil nil nil t)

  (quail-define-rules ("=C5=82" ?l))

The key is never passed into the input-method-function, and so just
inserted literally. (Typing Unicode keys directly works fine.)

Digging around in keyboard.c, I found that read_char() only passes
events with keycode < 256 (line 3050ff) to input-method-function:

  /* Pass this to the input method, if appropriate.  */
  if (INTEGERP (c)
      && ! NILP (Vinput_method_function)
      /* Don't run the input method within a key sequence,
     after the first event of the key sequence.  */
      && NILP (prev_event)
      && ' ' <=3D XINT (c) && XINT (c) < 256 && XINT (c) !=3D 127)

Using read-key-sequence, Emacs seems to parse "=C5=82" as [322] (0x142 in
decimal). Disabling the condition in read_char() (so the key is
actually passed to quail) only seems to cause an infinite loop in quail
that I've not been able diagnose yet.

[322] as key event seems strange to me. The XLib keycode for "=C5=82" (as
reported by xev) is 0x1000142. Maybe Emacs cuts off the leading bit?

Interestingly, quail shows the key in the guidance screen just fine, ie:

  (quail-define-rules ("x=C5=82" ?l))

and typing "x" correctly suggest "x=C5=82" as a pattern; it's just impossib=
le
to pass "=C5=82" to quail and have it be parsed correctly.


In GNU Emacs 24.3.1 (x86_64-pc-linux-gnu, X toolkit)
 of 2014-05-05 on scabeiathrax
Windowing system distributor `The X.Org Foundation', version 11.0.11500000
System Description:    NAME=3DGentoo

Configured using:
 `configure '--prefix=3D/usr' '--build=3Dx86_64-pc-linux-gnu'
 '--host=3Dx86_64-pc-linux-gnu' '--mandir=3D/usr/share/man'
 '--infodir=3D/usr/share/info' '--datadir=3D/usr/share' '--sysconfdir=3D/et=
c'
 '--localstatedir=3D/var/lib' '--libdir=3D/usr/lib64'
 '--disable-silent-rules' '--disable-dependency-tracking'
 '--program-suffix=3D-emacs-24' '--infodir=3D/usr/share/info/emacs-24'
 '--localstatedir=3D/var'
 '--enable-locallisppath=3D/etc/emacs:/usr/share/emacs/site-lisp'
 '--with-crt-dir=3D/usr/lib/gcc/x86_64-pc-linux-gnu/4.8.2/../../../../lib64=
'
 '--with-gameuser=3Dgames' '--without-compress-info' '--without-hesiod'
 '--without-kerberos' '--without-kerberos5' '--with-gpm' '--with-dbus'
 '--without-gnutls' '--without-xml2' '--without-selinux'
 '--without-wide-int' '--with-sound' '--with-x' '--without-ns'
 '--without-gconf' '--without-gsettings' '--without-toolkit-scroll-bars'
 '--with-gif' '--with-jpeg' '--with-png' '--with-rsvg' '--with-tiff'
 '--with-xpm' '--without-imagemagick' '--with-xft' '--with-libotf'
 '--with-m17n-flt' '--with-x-toolkit=3Dlucid' '--with-xaw3d'
 'GENTOO_PACKAGE=3Dapp-editors/emacs-24.3-r4'
 'build_alias=3Dx86_64-pc-linux-gnu' 'host_alias=3Dx86_64-pc-linux-gnu'
 'CFLAGS=3D-O2 -pipe -march=3Dcore2' 'LDFLAGS=3D-Wl,-O1 -Wl,--sort-common
 -Wl,--hash-style=3Dgnu -Wl,--as-needed' 'CPPFLAGS=3D''

Important settings:
  value of $LANG: en_US.UTF-8
  value of $XMODIFIERS: @im=3Dibus
  locale-coding-system: utf-8-unix
  default enable-multibyte-characters: t

Major mode: Lisp Interaction

Minor modes in effect:
  tooltip-mode: t
  mouse-wheel-mode: t
  tool-bar-mode: t
  menu-bar-mode: t
  file-name-shadow-mode: t
  global-font-lock-mode: t
  font-lock-mode: t
  blink-cursor-mode: t
  auto-composition-mode: t
  auto-encryption-mode: t
  auto-compression-mode: t
  line-number-mode: t
  transient-mark-mode: t

Recent input:
( r e d a <backspace> <backspace> a d - k e y - s e
q u e n c e SPC " k e y : SPC " ) <left> <left> C-M-x
=CC=88 C-M-x =C5=82 C-M-x e M-x b u g <tab> <backspace> <backspace>
<backspace> <backspace> <backspace> <backspace> <backspace>
<backspace> <backspace> <backspace> <backspace> <backspace>
<backspace> <backspace> r e p o <tab> r t <tab> <r
eturn>

Recent messages:
For information about GNU Emacs and the GNU system, type C-h C-a.
[776]
[322]
"e"
Making completion list...

Load-path shadows:
None found.

Features:
(shadow sort gnus-util mail-extr emacsbug message format-spec rfc822 mml
mml-sec mm-decode mm-bodies mm-encode mail-parse rfc2231 mailabbrev
gmm-utils mailheader sendmail rfc2047 rfc2045 ietf-drums mm-util
mail-prsvr mail-utils help-mode easymenu time-date tooltip ediff-hook
vc-hooks lisp-float-type mwheel x-win x-dnd tool-bar dnd fontset image
regexp-opt fringe tabulated-list newcomment lisp-mode register page
menu-bar rfn-eshadow timer select scroll-bar mouse jit-lock font-lock
syntax facemenu font-core frame cham georgian utf-8-lang misc-lang
vietnamese tibetan thai tai-viet lao korean japanese hebrew greek
romanian slovak czech european ethiopic indian cyrillic chinese
case-table epa-hook jka-cmpr-hook help simple abbrev minibuffer loaddefs
button faces cus-face macroexp files text-properties overlay sha1 md5
base64 format env code-pages mule custom widget hashtable-print-readable
backquote make-network-process dbusbind dynamic-setting
font-render-setting x-toolkit x multi-tty emacs)




Message sent:


Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-Mailer: MIME-tools 5.503 (Entity 5.503)
Content-Type: text/plain; charset=utf-8
X-Loop: help-debbugs@HIDDEN
From: help-debbugs@HIDDEN (GNU bug Tracking System)
To: Stefan Dorn <mail@HIDDEN>
Subject: bug#17412: Acknowledgement (24.3; Unicode key events broken, not
 usable in input method)
Message-ID: <handler.17412.B.139933021018777.ack <at> debbugs.gnu.org>
References: <CAEOcM3n9pXqFNKuM9hsY=6P=GtO2zyr0tg2AXqksEO0L=wZThQ@HIDDEN>
X-Gnu-PR-Message: ack 17412
X-Gnu-PR-Package: emacs
Reply-To: 17412 <at> debbugs.gnu.org
Date: Mon, 05 May 2014 22:51:02 +0000

Thank you for filing a new bug report with debbugs.gnu.org.

This is an automatically generated reply to let you know your message
has been received.

Your message is being forwarded to the package maintainers and other
interested parties for their attention; they will reply in due course.

Your message has been sent to the package maintainer(s):
 bug-gnu-emacs@HIDDEN

If you wish to submit further information on this problem, please
send it to 17412 <at> debbugs.gnu.org.

Please do not send mail to help-debbugs@HIDDEN unless you wish
to report a problem with the Bug-tracking system.

--=20
17412: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D17412
GNU Bug Tracking System
Contact help-debbugs@HIDDEN with problems


Message sent to bug-gnu-emacs@HIDDEN:


X-Loop: help-debbugs@HIDDEN
Subject: bug#17412: 24.3; Unicode key events broken, not usable in input method
Resent-From: Stefan Monnier <monnier@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@HIDDEN
Resent-Date: Tue, 06 May 2014 16:07:02 +0000
Resent-Message-ID: <handler.17412.B17412.13993924159970 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 17412
X-GNU-PR-Package: emacs
X-GNU-PR-Keywords: 
To: Stefan Dorn <mail@HIDDEN>
Cc: 17412 <at> debbugs.gnu.org
Received: via spool by 17412-submit <at> debbugs.gnu.org id=B17412.13993924159970
          (code B ref 17412); Tue, 06 May 2014 16:07:02 +0000
Received: (at 17412) by debbugs.gnu.org; 6 May 2014 16:06:55 +0000
Received: from localhost ([127.0.0.1]:53007 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1WhhtO-0002ai-U5
	for submit <at> debbugs.gnu.org; Tue, 06 May 2014 12:06:55 -0400
Received: from relais.videotron.ca ([24.201.245.36]:18537)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <monnier@HIDDEN>) id 1WhhtL-0002aR-3h
 for 17412 <at> debbugs.gnu.org; Tue, 06 May 2014 12:06:52 -0400
MIME-version: 1.0
Content-type: text/plain; charset=utf-8
Received: from ceviche.home ([24.201.53.56]) by VL-VM-MR002.ip.videotron.ca
 (Oracle Communications Messaging Exchange Server 7u4-22.01 64bit (built Apr 21
 2011)) with ESMTP id <0N5500HISU3CLK90@HIDDEN> for
 17412 <at> debbugs.gnu.org; Tue, 06 May 2014 12:06:50 -0400 (EDT)
Received: by ceviche.home (Postfix, from userid 20848)	id 392AC66094; Tue,
 06 May 2014 12:06:47 -0400 (EDT)
From: Stefan Monnier <monnier@HIDDEN>
Message-id: <jwviopiki5k.fsf-monnier+emacsbugs@HIDDEN>
References: <CAEOcM3n9pXqFNKuM9hsY=6P=GtO2zyr0tg2AXqksEO0L=wZThQ@HIDDEN>
Date: Tue, 06 May 2014 12:06:47 -0400
In-reply-to: <CAEOcM3n9pXqFNKuM9hsY=6P=GtO2zyr0tg2AXqksEO0L=wZThQ@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4.50 (gnu/linux)
Content-transfer-encoding: quoted-printable
X-Spam-Score: 1.0 (+)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: 1.0 (+)

> Digging around in keyboard.c, I found that read_char() only passes
> events with keycode < 256 (line 3050ff) to input-method-function:

Indeed, this has been in the input-method design from the start.
I'd be interested to know why.  Handa?

> [322] as key event seems strange to me. The XLib keycode for "=C5=82" (as
> reported by xev) is 0x1000142. Maybe Emacs cuts off the leading bit?

322 =3D U+0142, so it's really not strange at all: Emacs uses
Unicode internally.


        Stefan




Message sent to bug-gnu-emacs@HIDDEN:


X-Loop: help-debbugs@HIDDEN
Subject: bug#17412: 24.3; Unicode key events broken, not usable in input method
Resent-From: Stefan Dorn <mail@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@HIDDEN
Resent-Date: Tue, 06 May 2014 18:39:01 +0000
Resent-Message-ID: <handler.17412.B17412.139940153430854 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 17412
X-GNU-PR-Package: emacs
X-GNU-PR-Keywords: 
To: Stefan Monnier <monnier@HIDDEN>, 17412 <at> debbugs.gnu.org
Received: via spool by 17412-submit <at> debbugs.gnu.org id=B17412.139940153430854
          (code B ref 17412); Tue, 06 May 2014 18:39:01 +0000
Received: (at 17412) by debbugs.gnu.org; 6 May 2014 18:38:54 +0000
Received: from localhost ([127.0.0.1]:53103 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1WhkGT-00081Z-Lf
	for submit <at> debbugs.gnu.org; Tue, 06 May 2014 14:38:54 -0400
Received: from mail-wi0-f178.google.com ([209.85.212.178]:48168)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <muflax@HIDDEN>) id 1WhkGQ-00081E-3v
 for 17412 <at> debbugs.gnu.org; Tue, 06 May 2014 14:38:50 -0400
Received: by mail-wi0-f178.google.com with SMTP id hm4so53451wib.5
 for <17412 <at> debbugs.gnu.org>; Tue, 06 May 2014 11:38:44 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:sender:in-reply-to:references:from:date:message-id
 :subject:to:content-type:content-transfer-encoding;
 bh=MzsAY44I1mHF6PH1wOi04Ed+b+vdHEhqxq7ETHEi1uU=;
 b=TTuutDfuuJHxkzPchY+ZH9ozeyQdvKt8/eI7QmS4mJM1y/FavsCiGH4iDkyqMYghtr
 0BzNNlH9ujyMyFm2N8tRqQneBnUXIh8TapLPiAqUvs+zMrHjf0dATXz2eypnOI9MJYNt
 12HOceY/l5xaXgummo5mM1FzCMPvfZzHBs//7I1zTJWiuJlFd9OWGtuFZp5zcngUi64I
 8QMC2XSDlFPmE51V1bgzukEQJCQBJMXxAMXRs5mfSyfV3+x3BAbEiM/ijM3Y2At5KNoL
 fv9xIUq94AccC2FxRG4pEEUhScb2x0He6hjgYs67Wpt+SQW9/+H2mS/SW0EGEyVxvl/j
 34Ag==
X-Received: by 10.194.78.77 with SMTP id z13mr3599280wjw.64.1399401524180;
 Tue, 06 May 2014 11:38:44 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.194.80.103 with HTTP; Tue, 6 May 2014 11:38:24 -0700 (PDT)
In-Reply-To: <jwviopiki5k.fsf-monnier+emacsbugs@HIDDEN>
References: <CAEOcM3n9pXqFNKuM9hsY=6P=GtO2zyr0tg2AXqksEO0L=wZThQ@HIDDEN>
 <jwviopiki5k.fsf-monnier+emacsbugs@HIDDEN>
From: Stefan Dorn <mail@HIDDEN>
Date: Tue, 6 May 2014 19:38:24 +0100
X-Google-Sender-Auth: JWGzSIg4geB92bqjS1mdXosizEk
Message-ID: <CAEOcM3m_mPAMGz-MEaLfJ7K4n8FbSkwvnk3GFrquMS9OS-tAzQ@HIDDEN>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: -0.7 (/)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.7 (/)

>> Digging around in keyboard.c, I found that read_char() only passes
>> events with keycode < 256 (line 3050ff) to input-method-function:
>
> Indeed, this has been in the input-method design from the start.
> I'd be interested to know why.  Handa?

I write a lot of linguistic analysis, and so added common IPA symbols
to my core keyboard layout, like =C3=9F, =C5=82 or =C3=A6. (I could type th=
em through
an input method, but that would be slower and force me to use a
different typing method inside and outside of Emacs, which would slow
me down a lot.)

I recently set up a Cyrillic input method, but was surprised I
arbitrarily could use =C3=9F in quail but not =C5=82, just because =C3=9F i=
s below
the magic threshold. Unfortunately, merely turning off the conditional
in read_char() is not enough to get it to work.

More importantly, I also have most combining diacritic characters
(U+0301 ff) on keys and use them a lot. Switching them to some
"similar looking punctuation -> diacritic" input method would be
seriously annoying due to lots of conflicts (quoting a letter vs
umlauting it etc).

Most search features in Emacs don't do Unicode normalization, so =C3=A4 (a
with umlaut) and a=CC=88 (a with combining diacritic umlaut) don't match. I
added some normalization hacks to isearch and just force-normalize the
buffer when I save it, but wanted a more universal and clean solution.

I thought I could just set up a "letter + combining diacritic" ->
"normalized character" input method to fix most of this, but again
arbitrarily can't use any of the diacritics in quail.

>> [322] as key event seems strange to me. The XLib keycode for "=C5=82" (a=
s
>> reported by xev) is 0x1000142. Maybe Emacs cuts off the leading bit?
>
> 322 =3D U+0142, so it's really not strange at all: Emacs uses
> Unicode internally.

Ah, cool.




Message sent to bug-gnu-emacs@HIDDEN:


X-Loop: help-debbugs@HIDDEN
Subject: bug#17412: 24.3; Unicode key events broken, not usable in input method
Resent-From: Eli Zaretskii <eliz@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@HIDDEN
Resent-Date: Tue, 06 May 2014 18:56:02 +0000
Resent-Message-ID: <handler.17412.B17412.139940254632639 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 17412
X-GNU-PR-Package: emacs
X-GNU-PR-Keywords: 
To: Stefan Dorn <mail@HIDDEN>
Cc: monnier@HIDDEN, 17412 <at> debbugs.gnu.org
Reply-To: Eli Zaretskii <eliz@HIDDEN>
Received: via spool by 17412-submit <at> debbugs.gnu.org id=B17412.139940254632639
          (code B ref 17412); Tue, 06 May 2014 18:56:02 +0000
Received: (at 17412) by debbugs.gnu.org; 6 May 2014 18:55:46 +0000
Received: from localhost ([127.0.0.1]:53118 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1WhkWn-0008UN-Rx
	for submit <at> debbugs.gnu.org; Tue, 06 May 2014 14:55:46 -0400
Received: from mtaout22.012.net.il ([80.179.55.172]:51506)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <eliz@HIDDEN>) id 1WhkWk-0008U2-CL
 for 17412 <at> debbugs.gnu.org; Tue, 06 May 2014 14:55:43 -0400
Received: from conversion-daemon.a-mtaout22.012.net.il by
 a-mtaout22.012.net.il (HyperSendmail v2007.08) id
 <0N5600A001J15V00@HIDDEN> for 17412 <at> debbugs.gnu.org;
 Tue, 06 May 2014 21:55:34 +0300 (IDT)
Received: from HOME-C4E4A596F7 ([87.69.4.28]) by a-mtaout22.012.net.il
 (HyperSendmail v2007.08) with ESMTPA id
 <0N56009YU1WMPP70@HIDDEN>;
 Tue, 06 May 2014 21:55:34 +0300 (IDT)
Date: Tue, 06 May 2014 21:55:41 +0300
From: Eli Zaretskii <eliz@HIDDEN>
In-reply-to: <CAEOcM3m_mPAMGz-MEaLfJ7K4n8FbSkwvnk3GFrquMS9OS-tAzQ@HIDDEN>
X-012-Sender: halo1@HIDDEN
Message-id: <83a9auybwy.fsf@HIDDEN>
MIME-version: 1.0
Content-type: text/plain; charset=utf-8
Content-transfer-encoding: 8BIT
References: <CAEOcM3n9pXqFNKuM9hsY=6P=GtO2zyr0tg2AXqksEO0L=wZThQ@HIDDEN>
 <jwviopiki5k.fsf-monnier+emacsbugs@HIDDEN>
 <CAEOcM3m_mPAMGz-MEaLfJ7K4n8FbSkwvnk3GFrquMS9OS-tAzQ@HIDDEN>
X-Spam-Score: 1.0 (+)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: 1.0 (+)

> From: Stefan Dorn <mail@HIDDEN>
> Date: Tue, 6 May 2014 19:38:24 +0100
> 
> Most search features in Emacs don't do Unicode normalization, so ä (a
> with umlaut) and ä (a with combining diacritic umlaut) don't match. I
> added some normalization hacks to isearch and just force-normalize the
> buffer when I save it, but wanted a more universal and clean solution.
> 
> I thought I could just set up a "letter + combining diacritic" ->
> "normalized character" input method to fix most of this, but again
> arbitrarily can't use any of the diacritics in quail.

That's not how to add normalization support to Emacs search.  It is
much better to define a case-table that maps each normalization
variant to a single canonical one, and then search functions will (or
at least should: I didn't actually try that) automatically do the
mapping for you, both in the search string and in the buffer/string
text you are searching through.




Message sent to bug-gnu-emacs@HIDDEN:


X-Loop: help-debbugs@HIDDEN
Subject: bug#17412: 24.3; Unicode key events broken, not usable in input method
Resent-From: Stefan Monnier <monnier@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@HIDDEN
Resent-Date: Tue, 06 May 2014 20:13:02 +0000
Resent-Message-ID: <handler.17412.B17412.13994071528097 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 17412
X-GNU-PR-Package: emacs
X-GNU-PR-Keywords: 
To: Eli Zaretskii <eliz@HIDDEN>
Cc: Stefan Dorn <mail@HIDDEN>, 17412 <at> debbugs.gnu.org
Received: via spool by 17412-submit <at> debbugs.gnu.org id=B17412.13994071528097
          (code B ref 17412); Tue, 06 May 2014 20:13:02 +0000
Received: (at 17412) by debbugs.gnu.org; 6 May 2014 20:12:32 +0000
Received: from localhost ([127.0.0.1]:53145 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1Whliz-00026M-RZ
	for submit <at> debbugs.gnu.org; Tue, 06 May 2014 16:12:31 -0400
Received: from ironport2-out.teksavvy.com ([206.248.154.181]:4815)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <monnier@HIDDEN>) id 1Whliw-000266-Ab
 for 17412 <at> debbugs.gnu.org; Tue, 06 May 2014 16:12:23 -0400
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: ArUGAIDvNVO4rwut/2dsb2JhbABZgwaDSsA9gRcXdIIlAQEBAQIBViMFCws0EhQYDSSIBAjSGReOegeEOASpGYFqg0wh
X-IPAS-Result: ArUGAIDvNVO4rwut/2dsb2JhbABZgwaDSsA9gRcXdIIlAQEBAQIBViMFCws0EhQYDSSIBAjSGReOegeEOASpGYFqg0wh
X-IronPort-AV: E=Sophos;i="4.97,753,1389762000"; d="scan'208";a="61674684"
Received: from 184-175-11-173.dsl.teksavvy.com (HELO pastel.home)
 ([184.175.11.173])
 by ironport2-out.teksavvy.com with ESMTP/TLS/ADH-AES256-SHA;
 06 May 2014 16:12:13 -0400
Received: by pastel.home (Postfix, from userid 20848)
 id CA34760118; Tue,  6 May 2014 16:12:13 -0400 (EDT)
From: Stefan Monnier <monnier@HIDDEN>
Message-ID: <jwvk39yis5y.fsf-monnier+emacsbugs@HIDDEN>
References: <CAEOcM3n9pXqFNKuM9hsY=6P=GtO2zyr0tg2AXqksEO0L=wZThQ@HIDDEN>
 <jwviopiki5k.fsf-monnier+emacsbugs@HIDDEN>
 <CAEOcM3m_mPAMGz-MEaLfJ7K4n8FbSkwvnk3GFrquMS9OS-tAzQ@HIDDEN>
 <83a9auybwy.fsf@HIDDEN>
Date: Tue, 06 May 2014 16:12:13 -0400
In-Reply-To: <83a9auybwy.fsf@HIDDEN> (Eli Zaretskii's message of "Tue, 06 May
 2014 21:55:41 +0300")
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4.50 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: 0.3 (/)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: 0.3 (/)

> That's not how to add normalization support to Emacs search.  It is
> much better to define a case-table that maps each normalization
> variant to a single canonical one, and then search functions will (or
> at least should: I didn't actually try that) automatically do the

Can case-tables do such normalization?  Last I checked, they work "one
char at a time" and can't handle multi-char mappings at all (neither as
input nor as output).


        Stefan




Message sent to bug-gnu-emacs@HIDDEN:


X-Loop: help-debbugs@HIDDEN
Subject: bug#17412: 24.3; Unicode key events broken, not usable in input method
Resent-From: Daniel Colascione <dancol@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@HIDDEN
Resent-Date: Tue, 06 May 2014 20:15:02 +0000
Resent-Message-ID: <handler.17412.B17412.13994072638304 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 17412
X-GNU-PR-Package: emacs
X-GNU-PR-Keywords: 
To: Stefan Monnier <monnier@HIDDEN>,  Eli Zaretskii <eliz@HIDDEN>
Cc: Stefan Dorn <mail@HIDDEN>, 17412 <at> debbugs.gnu.org
Received: via spool by 17412-submit <at> debbugs.gnu.org id=B17412.13994072638304
          (code B ref 17412); Tue, 06 May 2014 20:15:02 +0000
Received: (at 17412) by debbugs.gnu.org; 6 May 2014 20:14:23 +0000
Received: from localhost ([127.0.0.1]:53151 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1Whlks-00029s-Ta
	for submit <at> debbugs.gnu.org; Tue, 06 May 2014 16:14:23 -0400
Received: from dancol.org ([96.126.100.184]:51823)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <dancol@HIDDEN>) id 1Whlkq-00029k-0N
 for 17412 <at> debbugs.gnu.org; Tue, 06 May 2014 16:14:20 -0400
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=dancol.org;
 s=x; 
 h=Content-Type:In-Reply-To:References:Subject:CC:To:MIME-Version:From:Date:Message-ID;
 bh=+F644UG9gjjX3xQHkvKQNjwOm70vwpA3wWluA38fYH8=; 
 b=RhnvYKz9lNbUhe4UwVKkOBMjBCqggvwGNMdlgai9CmuljXK28arkcUVrwoqYyFsL1cWbxHHMqa0NfCqrVFnNIfKVvl1tsYOGRLXLAPseEfAehnmDX7OKV2Q78g7Ln/qqxsdMfVvYiY9yS6mjWv6ERoBLvY+bp7fHs3AU9rZpfW7idpDKN/WPJVY9y2TXUUNIKSYpP+kytlqTigh0VaVTQMUrckCjwkHNHLpoIUgHCfJ11ZLUwSsPLNVgaL5CqD8sLT7gmjNnl3viHcCpNLVDNrLGo6Se948svibQ3sePHRFjIGb93YPQZgjJ8FpeB52HOuaDtQCHjX3/KlWb53VEUA==;
Received: from [2620:10d:c083:1003:863a:4bff:fec8:e538]
 by dancol.org with esmtpsa (TLS1.0:DHE_RSA_AES_128_CBC_SHA1:128)
 (Exim 4.82) (envelope-from <dancol@HIDDEN>)
 id 1Whlkl-0000AZ-BK; Tue, 06 May 2014 13:14:15 -0700
Message-ID: <53694290.4030303@HIDDEN>
Date: Tue, 06 May 2014 13:14:08 -0700
From: Daniel Colascione <dancol@HIDDEN>
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
 rv:24.0) Gecko/20100101 Thunderbird/24.5.0
MIME-Version: 1.0
References: <CAEOcM3n9pXqFNKuM9hsY=6P=GtO2zyr0tg2AXqksEO0L=wZThQ@HIDDEN>	<jwviopiki5k.fsf-monnier+emacsbugs@HIDDEN>	<CAEOcM3m_mPAMGz-MEaLfJ7K4n8FbSkwvnk3GFrquMS9OS-tAzQ@HIDDEN>	<83a9auybwy.fsf@HIDDEN>
 <jwvk39yis5y.fsf-monnier+emacsbugs@HIDDEN>
In-Reply-To: <jwvk39yis5y.fsf-monnier+emacsbugs@HIDDEN>
X-Enigmail-Version: 1.6
Content-Type: multipart/signed; micalg=pgp-sha1;
 protocol="application/pgp-signature";
 boundary="Xp54tasv1j7g9H4U79Xtu14Qft2PRb7C2"
X-Spam-Score: -0.6 (/)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.6 (/)

This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--Xp54tasv1j7g9H4U79Xtu14Qft2PRb7C2
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

On 05/06/2014 01:12 PM, Stefan Monnier wrote:
>> That's not how to add normalization support to Emacs search.  It is
>> much better to define a case-table that maps each normalization
>> variant to a single canonical one, and then search functions will (or
>> at least should: I didn't actually try that) automatically do the
>=20
> Can case-tables do such normalization?  Last I checked, they work "one
> char at a time" and can't handle multi-char mappings at all (neither as=

> input nor as output).

So why not make them stateful?


--Xp54tasv1j7g9H4U79Xtu14Qft2PRb7C2
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iQIcBAEBAgAGBQJTaUKRAAoJEMAaIROpHW7I3rQP/AlGC55ipCen6R9Y+yBUfJZt
gMJVVtQkd4Pi4savAOmv0//G/8VIjmYjt8ru7LY6VXTS8NDLTr2gvhMHYk6h+GWx
+M5rpaUY1WBTyPD7pd/KQnIP83OjG432zkuUYjT7YKNGP9J0rYikcQZxNEI2nJYn
ICFr1gAK4dG4pz1XwPQyRwAeeGaG4BRDnO1yrk24q5bh4pGbCODqWZbN46qaTJeP
2Iu94fFK31t0ol+r+JB7zVL7FIRgy1nElTb7Z9HefRjhQ0BOWycdeiL8CYDYaKlb
oQR/ln3aCPW7OqZbuUDGhrQV4FSLHZxdU7as9TRpWzKHBGSekLrwq1Kl4jmII8qb
5v9smGdQGj451GS6CXixFEYBcHkG18brk8BMcGCL2yYLh7oBcEZV4DXqVX/PP3c1
yDAYz68qWbO2KiOXTL0WHScfhYzd7WYwOlNrfaEYSzP/37n2Ira3jWH7+B0/jIq+
QGlsJzuG2FC82a9UYU6JHKG/u3MA1de3unhN6O00V4XCYnqg52hpoHI9oYOJs2J0
N/HEE38/jlyViX2d7RsgHsF78Ud8HNZxZiUv5okUScJqNU2JJ7kemAt6tkYYXwfw
1EN4DUwpY/Kf/3PH/pH995Wgyam+/cApW3iu3/AFM+OfcKhlXeAlnbEBZJxioDnQ
bTzVp/sjp4oyqJhR3BZa
=Lknh
-----END PGP SIGNATURE-----

--Xp54tasv1j7g9H4U79Xtu14Qft2PRb7C2--




Message sent to bug-gnu-emacs@HIDDEN:


X-Loop: help-debbugs@HIDDEN
Subject: bug#17412: 24.3; Unicode key events broken, not usable in input method
Resent-From: Eli Zaretskii <eliz@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@HIDDEN
Resent-Date: Wed, 07 May 2014 18:14:01 +0000
Resent-Message-ID: <handler.17412.B17412.139948638213844 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 17412
X-GNU-PR-Package: emacs
X-GNU-PR-Keywords: 
To: Stefan Monnier <monnier@HIDDEN>
Cc: mail@HIDDEN, 17412 <at> debbugs.gnu.org
Reply-To: Eli Zaretskii <eliz@HIDDEN>
Received: via spool by 17412-submit <at> debbugs.gnu.org id=B17412.139948638213844
          (code B ref 17412); Wed, 07 May 2014 18:14:01 +0000
Received: (at 17412) by debbugs.gnu.org; 7 May 2014 18:13:02 +0000
Received: from localhost ([127.0.0.1]:54765 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1Wi6L0-0003bE-4G
	for submit <at> debbugs.gnu.org; Wed, 07 May 2014 14:13:02 -0400
Received: from mtaout20.012.net.il ([80.179.55.166]:35608)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <eliz@HIDDEN>) id 1Wi6Kw-0003aZ-NX
 for 17412 <at> debbugs.gnu.org; Wed, 07 May 2014 14:13:00 -0400
Received: from conversion-daemon.a-mtaout20.012.net.il by
 a-mtaout20.012.net.il (HyperSendmail v2007.08) id
 <0N5700600UHAWV00@HIDDEN> for 17412 <at> debbugs.gnu.org;
 Wed, 07 May 2014 21:12:52 +0300 (IDT)
Received: from HOME-C4E4A596F7 ([87.69.4.28]) by a-mtaout20.012.net.il
 (HyperSendmail v2007.08) with ESMTPA id
 <0N5700656ULFA2A0@HIDDEN>;
 Wed, 07 May 2014 21:12:51 +0300 (IDT)
Date: Wed, 07 May 2014 21:13:01 +0300
From: Eli Zaretskii <eliz@HIDDEN>
In-reply-to: <jwvk39yis5y.fsf-monnier+emacsbugs@HIDDEN>
X-012-Sender: halo1@HIDDEN
Message-id: <83iophwj82.fsf@HIDDEN>
References: <CAEOcM3n9pXqFNKuM9hsY=6P=GtO2zyr0tg2AXqksEO0L=wZThQ@HIDDEN>
 <jwviopiki5k.fsf-monnier+emacsbugs@HIDDEN>
 <CAEOcM3m_mPAMGz-MEaLfJ7K4n8FbSkwvnk3GFrquMS9OS-tAzQ@HIDDEN>
 <83a9auybwy.fsf@HIDDEN> <jwvk39yis5y.fsf-monnier+emacsbugs@HIDDEN>
X-Spam-Score: 1.0 (+)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: 1.0 (+)

> From: Stefan Monnier <monnier@HIDDEN>
> Cc: Stefan Dorn <mail@HIDDEN>,  17412 <at> debbugs.gnu.org
> Date: Tue, 06 May 2014 16:12:13 -0400
> 
> > That's not how to add normalization support to Emacs search.  It is
> > much better to define a case-table that maps each normalization
> > variant to a single canonical one, and then search functions will (or
> > at least should: I didn't actually try that) automatically do the
> 
> Can case-tables do such normalization?  Last I checked, they work "one
> char at a time" and can't handle multi-char mappings at all (neither as
> input nor as output).

I meant the canonical slot of the case-tables.  Of course, doing what
I suggested will need some changes on the C level, but they are
straightforward, I think.




Message sent to bug-gnu-emacs@HIDDEN:


X-Loop: help-debbugs@HIDDEN
Subject: bug#17412: 24.3; Unicode key events broken, not usable in input method
References: <CAEOcM3n9pXqFNKuM9hsY=6P=GtO2zyr0tg2AXqksEO0L=wZThQ@HIDDEN>
Resent-From: handa@HIDDEN (K. Handa)
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@HIDDEN
Resent-Date: Mon, 12 May 2014 23:24:02 +0000
Resent-Message-ID: <handler.17412.B17412.139993704025974 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 17412
X-GNU-PR-Package: emacs
X-GNU-PR-Keywords: 
To: Stefan Monnier <monnier@HIDDEN>
Cc: mail@HIDDEN, 17412 <at> debbugs.gnu.org
Received: via spool by 17412-submit <at> debbugs.gnu.org id=B17412.139993704025974
          (code B ref 17412); Mon, 12 May 2014 23:24:02 +0000
Received: (at 17412) by debbugs.gnu.org; 12 May 2014 23:24:00 +0000
Received: from localhost ([127.0.0.1]:33013 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1WjzZf-0006kr-PN
	for submit <at> debbugs.gnu.org; Mon, 12 May 2014 19:24:00 -0400
Received: from fencepost.gnu.org ([208.118.235.10]:51181 ident=Debian-exim)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <handa@HIDDEN>) id 1WjzZd-0006kj-QO
 for 17412 <at> debbugs.gnu.org; Mon, 12 May 2014 19:23:58 -0400
Received: from fl1-110-233-81-186.iba.mesh.ad.jp ([110.233.81.186]:60001
 helo=wanchai)
 by fencepost.gnu.org with esmtpsa (TLS1.0:DHE_RSA_AES_128_CBC_SHA1:16)
 (Exim 4.71) (envelope-from <handa@HIDDEN>)
 id 1WjzZc-00045K-DP; Mon, 12 May 2014 19:23:56 -0400
Received: from handa by wanchai with local (Exim 4.80)
 (envelope-from <handa@HIDDEN>)
 id 1WjzZW-00075D-9E; Tue, 13 May 2014 08:23:50 +0900
From: handa@HIDDEN (K. Handa)
In-Reply-To: <jwviopiki5k.fsf-monnier+emacsbugs@HIDDEN> (message from Stefan
 Monnier on Tue, 06 May 2014 12:06:47 -0400)
Date: Tue, 13 May 2014 08:23:50 +0900
Message-ID: <87d2fia8e1.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: -5.7 (-----)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -5.7 (-----)

In article <jwviopiki5k.fsf-monnier+emacsbugs@HIDDEN>, Stefan Monnier <monnier@HIDDEN> writes:

> > Digging around in keyboard.c, I found that read_char() only passes
> > events with keycode < 256 (line 3050ff) to input-method-function:

> Indeed, this has been in the input-method design from the start.
> I'd be interested to know why.  Handa?

As far as I remember, the relevant code was written by RMS,
and I'm sorry but I don't remember what I discussed with RMS
at that time.

Perhaps we had expected that a user typed C as a character
if C >= 256, not as a key to input another character.

---
Kenichi Handa
handa@HIDDEN




Message sent to bug-gnu-emacs@HIDDEN:


X-Loop: help-debbugs@HIDDEN
Subject: bug#17412: 24.3; Unicode key events broken, not usable in input method
Resent-From: Stefan Monnier <monnier@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@HIDDEN
Resent-Date: Tue, 13 May 2014 01:18:02 +0000
Resent-Message-ID: <handler.17412.B17412.13999438767434 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 17412
X-GNU-PR-Package: emacs
X-GNU-PR-Keywords: 
To: handa@HIDDEN (K. Handa)
Cc: mail@HIDDEN, 17412 <at> debbugs.gnu.org
Received: via spool by 17412-submit <at> debbugs.gnu.org id=B17412.13999438767434
          (code B ref 17412); Tue, 13 May 2014 01:18:02 +0000
Received: (at 17412) by debbugs.gnu.org; 13 May 2014 01:17:56 +0000
Received: from localhost ([127.0.0.1]:33073 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1Wk1Lv-0001vp-VZ
	for submit <at> debbugs.gnu.org; Mon, 12 May 2014 21:17:56 -0400
Received: from chene.dit.umontreal.ca ([132.204.246.20]:38191)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <monnier@HIDDEN>) id 1Wk1Lr-0001ve-70
 for 17412 <at> debbugs.gnu.org; Mon, 12 May 2014 21:17:52 -0400
Received: from pastel.home (lechon.iro.umontreal.ca [132.204.27.242])
 by chene.dit.umontreal.ca (8.14.1/8.14.1) with ESMTP id s4D1HmLC031693;
 Mon, 12 May 2014 21:17:48 -0400
Received: by pastel.home (Postfix, from userid 20848)
 id 06C6E601E4; Mon, 12 May 2014 21:17:47 -0400 (EDT)
From: Stefan Monnier <monnier@HIDDEN>
Message-ID: <jwvwqdqzdeh.fsf-monnier+emacsbugs@HIDDEN>
References: <87d2fia8e1.fsf@HIDDEN>
Date: Mon, 12 May 2014 21:17:47 -0400
In-Reply-To: <87d2fia8e1.fsf@HIDDEN> (K. Handa's message of "Tue, 13 May 2014
 08:23:50 +0900")
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4.50 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain
X-NAI-Spam-Flag: NO
X-NAI-Spam-Threshold: 5
X-NAI-Spam-Score: 0
X-NAI-Spam-Rules: 1 Rules triggered
	RV4940=0
X-NAI-Spam-Version: 2.3.0.9378 : core <4940> : inlines <859> : streams
 <1181043> : uri <1755166>
X-Spam-Score: -2.0 (--)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.0 (--)

> Perhaps we had expected that a user typed C as a character
> if C >= 256, not as a key to input another character.

Sounds like it, indeed, but since we have decoded chars by the time we
get to input-event processing, it doesn't seem very useful to prevent
users from using non-ASCII keys for input-methods.

IOW, we should try and lift this restriction,


        Stefan




Message sent to bug-gnu-emacs@HIDDEN:


X-Loop: help-debbugs@HIDDEN
Subject: bug#17412: 24.3; Unicode key events broken, not usable in input method
References: <CAEOcM3n9pXqFNKuM9hsY=6P=GtO2zyr0tg2AXqksEO0L=wZThQ@HIDDEN>
Resent-From: handa@HIDDEN (K. Handa)
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@HIDDEN
Resent-Date: Tue, 13 May 2014 12:12:02 +0000
Resent-Message-ID: <handler.17412.B17412.13999831183943 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 17412
X-GNU-PR-Package: emacs
X-GNU-PR-Keywords: 
To: Stefan Monnier <monnier@HIDDEN>
Cc: mail@HIDDEN, 17412 <at> debbugs.gnu.org
Received: via spool by 17412-submit <at> debbugs.gnu.org id=B17412.13999831183943
          (code B ref 17412); Tue, 13 May 2014 12:12:02 +0000
Received: (at 17412) by debbugs.gnu.org; 13 May 2014 12:11:58 +0000
Received: from localhost ([127.0.0.1]:33407 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1WkBYs-00011W-3V
	for submit <at> debbugs.gnu.org; Tue, 13 May 2014 08:11:58 -0400
Received: from fencepost.gnu.org ([208.118.235.10]:35357 ident=Debian-exim)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <handa@HIDDEN>) id 1WkBYq-00011P-Ba
 for 17412 <at> debbugs.gnu.org; Tue, 13 May 2014 08:11:56 -0400
Received: from fl1-110-233-81-186.iba.mesh.ad.jp ([110.233.81.186]:38675
 helo=wanchai)
 by fencepost.gnu.org with esmtpsa (TLS1.0:DHE_RSA_AES_128_CBC_SHA1:16)
 (Exim 4.71) (envelope-from <handa@HIDDEN>)
 id 1WkBYp-0007SC-CX; Tue, 13 May 2014 08:11:55 -0400
Received: from handa by wanchai with local (Exim 4.80)
 (envelope-from <handa@HIDDEN>)
 id 1WkBYk-0007Wq-0A; Tue, 13 May 2014 21:11:50 +0900
From: handa@HIDDEN (K. Handa)
In-Reply-To: <jwvwqdqzdeh.fsf-monnier+emacsbugs@HIDDEN> (message from Stefan
 Monnier on Mon, 12 May 2014 21:17:47 -0400)
Date: Tue, 13 May 2014 21:11:49 +0900
Message-ID: <87a9alanei.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: -5.7 (-----)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -5.7 (-----)

In article <jwvwqdqzdeh.fsf-monnier+emacsbugs@HIDDEN>, Stefan Monnier <monnier@HIDDEN> writes:

> > Perhaps we had expected that a user typed C as a character
> > if C >= 256, not as a key to input another character.

> Sounds like it, indeed, but since we have decoded chars by the time we
> get to input-event processing, it doesn't seem very useful to prevent
> users from using non-ASCII keys for input-methods.

> IOW, we should try and lift this restriction,

Yes, I agree.

---
Kenichi Handa
handa@HIDDEN





Last modified: Mon, 25 Nov 2019 12:00:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.