GNU bug report logs - #15274
24.3; space instead of codepoint 261 on windows console with cp852

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: emacs; Reported by: Jarek Czekalski <jarekczek@HIDDEN>; dated Thu, 5 Sep 2013 15:34:02 UTC; Maintainer for emacs is bug-gnu-emacs@HIDDEN.

Message received at 15274 <at> debbugs.gnu.org:


Received: (at 15274) by debbugs.gnu.org; 6 Sep 2013 14:31:34 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Fri Sep 06 10:31:34 2013
Received: from localhost ([127.0.0.1]:44226 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1VHx4P-0007Ed-Db
	for submit <at> debbugs.gnu.org; Fri, 06 Sep 2013 10:31:33 -0400
Received: from smtpo15.poczta.onet.pl ([213.180.142.146]:49671)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <jarekczek@HIDDEN>) id 1VHx4L-0007EO-Jk
 for 15274 <at> debbugs.gnu.org; Fri, 06 Sep 2013 10:31:31 -0400
Received: from [192.168.17.9] (cj.e-siemianowice.pl [95.215.234.30])
 (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits))
 (No client certificate requested)
 (Authenticated sender: jarekczek@HIDDEN)
 by smtp.poczta.onet.pl (Onet) with ESMTPSA id 3cWh633rTgzZ7WvP
 for <15274 <at> debbugs.gnu.org.>; Fri,  6 Sep 2013 16:31:21 +0200 (CEST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=poczta.onet.pl;
 s=2011; t=1378477883;
 bh=DKw/D657HviU9wYn1CHqAwakc2egpdb3GyjGL1kFPe4=;
 h=Message-ID:Date:From:MIME-Version:To:Subject:Content-Type:
 Content-Transfer-Encoding;
 b=N+JuohVxXWOePOmEfcjsD0arKx0E+/g5a0vbjxhK412NN2JlWFJeJZ0adkn23Y3dp
 TthxiZd4rELSgridGyyql62yDMasxKADqs+M3UC6mvG/pl/yeCjSYn7t8ZGQ2cR4IC
 ly4y0B6GprB6n12JlEWJN30Y7R4cc96pgoc5tvJg=
Message-ID: <5229E73C.4010408@HIDDEN>
Date: Fri, 06 Sep 2013 16:31:24 +0200
From: Jarek Czekalski <jarekczek@HIDDEN>
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64;
 rv:15.0) Gecko/20120824 Thunderbird/15.0
MIME-Version: 1.0
To: 15274 <at> debbugs.gnu.org.
Subject: additional info
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
X-Spam-Score: -2.4 (--)
X-Debbugs-Envelope-To: 15274
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.4 (--)

Eli, thanks for the quick response.

C-x RET c cp852 RET C-x C-f win_cp.txt RET

does not help.

I just compiled the current bzr repository and the problem is still 
reproducable.

chcp in raw cmd.exe, before launching emacs -nw -Q: 852
chcp inside emacs console: 1250

Another way of reproducing

1. enter scratch pad
2. set-terminal-coding-system cp852
2. set-input-method polish-slash
3. type /c/a - the first character displays correctly, the second is a space

I found a similar report that is archived now: 12055
http://debbugs.gnu.org/cgi/bugreport.cgi?bug=12055
24.1.50; Characters "á" and "é" are not correctly displayed on a Windows 
terminal

Jarek





Information forwarded to bug-gnu-emacs@HIDDEN:
bug#15274; Package emacs. Full text available.

Message received at 15274 <at> debbugs.gnu.org:


Received: (at 15274) by debbugs.gnu.org; 5 Sep 2013 16:07:00 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Thu Sep 05 12:07:00 2013
Received: from localhost ([127.0.0.1]:42066 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1VHc5D-00046j-7Q
	for submit <at> debbugs.gnu.org; Thu, 05 Sep 2013 12:06:59 -0400
Received: from mtaout23.012.net.il ([80.179.55.175]:41090)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <eliz@HIDDEN>) id 1VHc59-00046T-Fx
 for 15274 <at> debbugs.gnu.org; Thu, 05 Sep 2013 12:06:56 -0400
Received: from conversion-daemon.a-mtaout23.012.net.il by
 a-mtaout23.012.net.il (HyperSendmail v2007.08) id
 <0MSN00H00TUS3800@HIDDEN> for 15274 <at> debbugs.gnu.org;
 Thu, 05 Sep 2013 19:06:48 +0300 (IDT)
Received: from HOME-C4E4A596F7 ([87.69.4.28]) by a-mtaout23.012.net.il
 (HyperSendmail v2007.08) with ESMTPA id
 <0MSN00HUZU3A0370@HIDDEN>;
 Thu, 05 Sep 2013 19:06:48 +0300 (IDT)
Date: Thu, 05 Sep 2013 19:06:36 +0300
From: Eli Zaretskii <eliz@HIDDEN>
Subject: Re: bug#15274: 24.3;
 space instead of codepoint 261 on windows console with cp852
In-reply-to: <52285A21.5070207@HIDDEN>
X-012-Sender: halo1@HIDDEN
To: Jarek Czekalski <jarekczek@HIDDEN>
Message-id: <834n9zntgz.fsf@HIDDEN>
References: <52285A21.5070207@HIDDEN>
X-Spam-Score: 1.0 (+)
X-Debbugs-Envelope-To: 15274
Cc: 15274 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
Reply-To: Eli Zaretskii <eliz@HIDDEN>
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: 1.0 (+)

> Date: Thu, 05 Sep 2013 12:17:05 +0200
> From: Jarek Czekalski <jarekczek@HIDDEN>
> 
> I start emacs -Q -nw, set terminal encoding to cp852.
> When the file is loaded into console emacs (-nw) and the correct
> file encoding is assured (revert-buffer-with-coding, cp852)
> then some characters are displayed correctly and some not. Those
> displayed incorrectly are replaced with spaces. For example
> the first one in the file ("a" with a tail, U+0105) is displayed
> incorrectly and the second one ("c" with an accent, U+0107)
> is displayed correctly.

Does the file display correctly if you visit it with the following
command, which instructs Emacs to visit the file as cp852 to begin
with:

  C-x RET c cp852 RET C-x C-f win_cp.txt RET

instead of first visiting it with the default encoding, and then
reverting it with the correct encoding?




Information forwarded to bug-gnu-emacs@HIDDEN:
bug#15274; Package emacs. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 5 Sep 2013 15:33:07 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Thu Sep 05 11:33:07 2013
Received: from localhost ([127.0.0.1]:42017 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1VHbYO-00038O-Rb
	for submit <at> debbugs.gnu.org; Thu, 05 Sep 2013 11:33:06 -0400
Received: from eggs.gnu.org ([208.118.235.92]:34285)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <jarekczek@HIDDEN>) id 1VHX7A-0003It-Ob
 for submit <at> debbugs.gnu.org; Thu, 05 Sep 2013 06:48:42 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <jarekczek@HIDDEN>) id 1VHX6z-000336-HP
 for submit <at> debbugs.gnu.org; Thu, 05 Sep 2013 06:48:35 -0400
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org
X-Spam-Level: 
X-Spam-Status: No, score=0.8 required=5.0 tests=BAYES_50,T_DKIM_INVALID
 autolearn=disabled version=3.3.2
Received: from lists.gnu.org ([2001:4830:134:3::11]:35717)
 by eggs.gnu.org with esmtp (Exim 4.71)
 (envelope-from <jarekczek@HIDDEN>) id 1VHX6z-000332-ED
 for submit <at> debbugs.gnu.org; Thu, 05 Sep 2013 06:48:29 -0400
Received: from eggs.gnu.org ([2001:4830:134:3::10]:35974)
 by lists.gnu.org with esmtp (Exim 4.71)
 (envelope-from <jarekczek@HIDDEN>) id 1VHX6t-0001aD-KJ
 for bug-gnu-emacs@HIDDEN; Thu, 05 Sep 2013 06:48:29 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <jarekczek@HIDDEN>) id 1VHX6o-000312-1P
 for bug-gnu-emacs@HIDDEN; Thu, 05 Sep 2013 06:48:23 -0400
Received: from smtpo11.poczta.onet.pl ([213.180.142.142]:50335)
 by eggs.gnu.org with esmtp (Exim 4.71)
 (envelope-from <jarekczek@HIDDEN>) id 1VHX6n-00030w-Jj
 for bug-gnu-emacs@HIDDEN; Thu, 05 Sep 2013 06:48:17 -0400
Received: from [192.168.17.9] (cj.e-siemianowice.pl [95.215.234.30])
 (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits))
 (No client certificate requested)
 (Authenticated sender: jarekczek@HIDDEN)
 by smtp.poczta.onet.pl (Onet) with ESMTPSA id 3cVyW35SHvz9v8rx
 for <bug-gnu-emacs@HIDDEN>; Thu,  5 Sep 2013 12:17:03 +0200 (CEST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=poczta.onet.pl;
 s=2011; t=1378376223;
 bh=ETz3LOoGjDHxH87RkjjTRP+G+fN7hRxhEqM5YpAJHbM=;
 h=Message-ID:Date:From:MIME-Version:To:Subject:Content-Type:
 Content-Transfer-Encoding;
 b=iUZQ+564Ed739z8v2LS9y5bvopkHRjt8OSkKwP/Blbe0T7akYfIXxYgdOCGmbFgBT
 cpEARv8IAcPD0KXbbXxyih+Jx0bdWFa5oubcebSUJR+sZpQb4J+E1fEcPZ/EzmQWrE
 K7ApgS3TJxqeN7Gdq6PD0CO9GMWx+x8h2C9wlcVk=
Message-ID: <52285A21.5070207@HIDDEN>
Date: Thu, 05 Sep 2013 12:17:05 +0200
From: Jarek Czekalski <jarekczek@HIDDEN>
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64;
 rv:15.0) Gecko/20120824 Thunderbird/15.0
MIME-Version: 1.0
To: bug-gnu-emacs@HIDDEN
Subject: 24.3; space instead of codepoint 261 on windows console with cp852
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: quoted-printable
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x
X-detected-operating-system: by eggs.gnu.org: Error: Malformed IPv6 address
 (bad octet value).
X-Received-From: 2001:4830:134:3::11
X-Spam-Score: -2.4 (--)
X-Debbugs-Envelope-To: submit
X-Mailman-Approved-At: Thu, 05 Sep 2013 11:33:02 -0400
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.4 (--)

Hi!

I produced a file (under a different text editor) containing 16
Polish international characters. This file is encoded in ibm852
(cp852) and displays correctly in gui emacs on windows.
It also displays correctly in a console after typing

type win_cp.txt

I start emacs -Q -nw, set terminal encoding to cp852.
When the file is loaded into console emacs (-nw) and the correct
file encoding is assured (revert-buffer-with-coding, cp852)
then some characters are displayed correctly and some not. Those
displayed incorrectly are replaced with spaces. For example
the first one in the file ("a" with a tail, U+0105) is displayed
incorrectly and the second one ("c" with an accent, U+0107)
is displayed correctly.

I employed C-u C-x =3D command to see the details of both characters.
The info seems to be correct including the character codes in the
encoding: A5, 86 - respectively. The same code appears under
"terminal code" entry, what seems to be correct.

I regret there is no thing like "ascii with \U java escapes" encoding.
It would be perfect for sending this file to you.
If you suggest another encoding, I'll provide the file in that
encoding.


If Emacs crashed, and you have the Emacs process in the gdb debugger,
please include the output from the following gdb commands:
     `bt full' and `xbacktrace'.
For information about debugging Emacs, please read the file
d:/Program_Files/emacs/etc/DEBUG.


In GNU Emacs 24.3.1 (i386-mingw-nt6.1.7601)
  of 2013-03-17 on MARVIN
Windowing system distributor `Microsoft Corp.', version 6.1.7601
Configured using:
  `configure --with-gcc (4.7) --cflags
  -ID:/devel/emacs/libs/libXpm-3.5.8/include
  -ID:/devel/emacs/libs/libXpm-3.5.8/src
  -ID:/devel/emacs/libs/libpng-dev_1.4.3-1/include
  -ID:/devel/emacs/libs/zlib-dev_1.2.5-2/include
  -ID:/devel/emacs/libs/giflib-4.1.4-1/include
  -ID:/devel/emacs/libs/jpeg-6b-4/include
  -ID:/devel/emacs/libs/tiff-3.8.2-1/include
  -ID:/devel/emacs/libs/gnutls-3.0.9/include
  -ID:/devel/emacs/libs/libiconv-1.13.1-1-dev/include
  -ID:/devel/emacs/libs/libxml2-2.7.8/include/libxml2'

Important settings:
   value of $LANG: PLK
   locale-coding-system: cp1250
   default enable-multibyte-characters: t

Major mode: Text

Minor modes in effect:
   tooltip-mode: t
   mouse-wheel-mode: t
   tool-bar-mode: t
   menu-bar-mode: t
   file-name-shadow-mode: t
   global-font-lock-mode: t
   font-lock-mode: t
   auto-composition-mode: t
   auto-encryption-mode: t
   auto-compression-mode: t
   line-number-mode: t
   transient-mark-mode: t

Recent input:
C-x C-f w i n _ c p <tab> <return> M-x r e v e <tab>
r t - b u <tab> - <tab> <return> c p 8 5 2 <return>
y e s <return> M-x d e s c r i <tab> c o d <tab> <return>
<return> C-u C-x =3D M-x r e p o <tab> r <tab> <retu
rn>

Recent messages:
("d:\\Program_Files\\emacs\\bin\\emacs.exe")
For information about GNU Emacs and the GNU system, type C-h C-a.
win_cp.txt has auto save data; consider M-x recover-this-file
Making completion list...
You can run the command `revert-buffer-with-coding-system' with C-x RET r
You can run the command `describe-coding-system' with C-h C

Char: =C2=B1 (261, #o405, #x105, file #xA5) point=3D1 of 20 (0%) column=3D=
0
Making completion list...

Load-path shadows:
None found.

Features:
(shadow sort gnus-util mail-extr emacsbug message format-spec rfc822 mml
mml-sec mm-decode mm-bodies mm-encode mail-parse rfc2231 mailabbrev
gmm-utils mailheader sendmail rfc2047 rfc2045 ietf-drums mm-util
mail-prsvr mail-utils pp wid-edit descr-text mule-diag help-mode
easymenu time-date tooltip ediff-hook vc-hooks lisp-float-type mwheel
dos-w32 ls-lisp w32-common-fns disp-table w32-win w32-vars tool-bar dnd
fontset image regexp-opt fringe tabulated-list newcomment lisp-mode
register page menu-bar rfn-eshadow timer select scroll-bar mouse
jit-lock font-lock syntax facemenu font-core frame cham georgian
utf-8-lang misc-lang vietnamese tibetan thai tai-viet lao korean
japanese hebrew greek romanian slovak czech european ethiopic indian
cyrillic chinese case-table epa-hook jka-cmpr-hook help simple abbrev
minibuffer loaddefs button faces cus-face macroexp files text-properties
overlay sha1 md5 base64 format env code-pages mule custom widget
hashtable-print-readable backquote make-network-process w32 multi-tty
emacs)





Acknowledgement sent to Jarek Czekalski <jarekczek@HIDDEN>:
New bug report received and forwarded. Copy sent to bug-gnu-emacs@HIDDEN. Full text available.
Report forwarded to bug-gnu-emacs@HIDDEN:
bug#15274; Package emacs. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Fri, 31 Oct 2014 17:00:04 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.