GNU bug report logs - #32345
12.1.1; wrong preview position for four-byte utf-8 encoded character (xelatex)

Previous Next

Package: auctex;

Reported by: sattler.christian <at> web.de

Date: Thu, 2 Aug 2018 01:08:01 UTC

Severity: normal

Tags: wontfix

Found in version 12.1.1

Done: Arash Esbati <arash <at> gnu.org>

Bug is archived. No further changes may be made.

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 32345 in the body.
You can then email your comments to 32345 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

View this report as an mbox folder, status mbox, maintainer mbox


Report forwarded to bug-auctex <at> gnu.org:
bug#32345; Package auctex. (Thu, 02 Aug 2018 01:08:01 GMT) Full text and rfc822 format available.

Acknowledgement sent to sattler.christian <at> web.de:
New bug report received and forwarded. Copy sent to bug-auctex <at> gnu.org. (Thu, 02 Aug 2018 01:08:01 GMT) Full text and rfc822 format available.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: sattler.christian <at> web.de
To: bug-auctex <at> gnu.org
Subject: 12.1.1; wrong preview position for four-byte utf-8 encoded character
 (xelatex)
Date: Thu, 02 Aug 2018 02:42:08 +0200
The attached log is generated by previewing the following document with xelatex:

\documentclass{article}

\begin{document}

Test: $𝒞$

\end{document}

The unicode character in math mode after "Test: " is U+1D49E.
The preview range for the snippet is completely wrong and includes the
entire line before the snipped. It appears that there are some encoding
problems because the log file refers to a unicode character U+D49E,
which is the lowest 16 bits of the original character's codepoint.

Emacs  : GNU Emacs 26.1 (build 1, x86_64-pc-linux-gnu, GTK+ Version 3.22.30)
 of 2018-07-05
Package: 12.1.1

Run buffer contents:

Running `Preview-LaTeX' on `test' with ``xelatex  --synctex=1 -file-line-error "\nonstopmode\nofiles\PassOptionsToPackage{active,tightpage,auctex}{preview}\AtBeginDocument{\ifx\ifPreview\undefined\RequirePackage[displaymath,floats,graphics,textmath,sections,footnotes]{preview}[2004/11/05]\fi}" "\input" test.tex''
This is XeTeX, Version 3.14159265-2.6-0.99999 (TeX Live 2018/Arch Linux) (preloaded format=xelatex)
 restricted \write18 enabled.
entering extended mode
LaTeX2e <2018-04-01> patch level 2
Babel <3.18> and hyphenation patterns for 84 language(s) loaded.

No auxiliary output files.

(./test.tex (/usr/share/texmf-dist/tex/latex/base/article.cls
Document Class: article 2014/09/29 v1.4h Standard LaTeX document class
(/usr/share/texmf-dist/tex/latex/base/size10.clo)) (./test.aux) (/home/noname/.emacs.d/elpa/auctex-12.1.1/latex/preview.sty (/usr/share/texmf-dist/tex/generic/luatex85/luatex85.sty) (/home/noname/.emacs.d/elpa/auctex-12.1.1/latex/prtightpage.def) (/home/noname/.emacs.d/elpa/auctex-12.1.1/latex/prauctex.def
No auxiliary output files.


(/home/noname/.emacs.d/elpa/auctex-12.1.1/latex/prauctex.cfg)) (/home/noname/.emacs.d/elpa/auctex-12.1.1/latex/prfootnotes.def)
Preview: Fontsize 10pt
Preview: PDFoutput 1
)
./test.tex:5: Preview: Snippet 1 started.
<-><->
      
l.5 Test: $
           풞$
Preview: Tightpage -32891 -32891 32891 32891
./test.tex:5: Preview: Snippet 1 ended.(0+0x0).
<-><->
      
l.5 Test: $풞$
             
[1] )
(see the transcript file for additional information)
Output written on test.pdf (1 page).
SyncTeX written on test.synctex.gz.
Transcript written on test.log.

TeX Output exited as expected with code 1 at Thu Aug  2 01:59:30
Running `Preview-PDF2DSC' with ``pdf2dsc test.pdf test.prv/tmp2pIiJl/preview.dsc''

Preview-PDF2DSC finished at Thu Aug  2 01:59:30
Running `Preview-Ghostscript' with ``/usr/bin/rungs -dOutputFile\=\(test.prv/tmp2pIiJl/pr1-\%d.png\) -q -dDELAYSAFER -dNOPAUSE -DNOPLATFONTS -dPrinted -dTextAlphaBits\=4 -dGraphicsAlphaBits\=4 -sDEVICE\=png16m -r94.08x93.9321''

Preview-Ghostscript finished at Thu Aug  2 01:59:30


current state:
==============
(setq
 AUCTeX-version "12.1.1"
 LaTeX-command-style '(("" "%(PDF)%(latex) %(extraopts) %S%(PDFout) -file-line-error"))
 image-types '(svg imagemagick png gif tiff jpeg xpm xbm pbm postscript)
 preview-image-type 'png
 preview-image-creators '((dvipng (open preview-gs-open preview-dvipng-process-setup) (place preview-gs-place)
                           (close preview-dvipng-close))
                          (png (open preview-gs-open) (place preview-gs-place) (close preview-gs-close))
                          (jpeg (open preview-gs-open) (place preview-gs-place) (close preview-gs-close))
                          (pnm (open preview-gs-open) (place preview-gs-place) (close preview-gs-close))
                          (tiff (open preview-gs-open) (place preview-gs-place) (close preview-gs-close)))
 preview-dvipng-image-type 'png
 preview-dvipng-command "dvipng -picky -noghostscript %d -o \"%m/prev%%03d.png\""
 preview-pdf2dsc-command "pdf2dsc %s.pdf %m/preview.dsc"
 preview-gs-command "/usr/bin/rungs"
 preview-gs-options '("-q" "-dDELAYSAFER" "-dNOPAUSE" "-DNOPLATFONTS" "-dPrinted" "-dTextAlphaBits=4"
                      "-dGraphicsAlphaBits=4")
 preview-gs-image-type-alist '((png png "-sDEVICE=png16m") (dvipng png "-sDEVICE=png16m")
                               (jpeg jpeg "-sDEVICE=jpeg") (pnm pbm "-sDEVICE=pnmraw")
                               (tiff tiff "-sDEVICE=tiff12nc"))
 preview-fast-conversion t
 preview-prefer-TeX-bb nil
 preview-dvips-command "dvips -Pwww -i -E %d -o %m/preview.000"
 preview-fast-dvips-command "dvips -Pwww %d -o %m/preview.ps"
 preview-scale-function 'preview-scale-from-face
 preview-LaTeX-command '("%`%l \"\\nonstopmode\\nofiles\\PassOptionsToPackage{"
                         ("," . preview-required-option-list)
                         "}{preview}\\AtBeginDocument{\\ifx\\ifPreview\\undefined" preview-default-preamble
                         "\\fi}\"%' %t")
 preview-required-option-list '("active" "tightpage" "auctex" (preview-preserve-counters "counters"))
 preview-preserve-counters nil
 preview-default-option-list '("displaymath" "floats" "graphics" "textmath" "sections" "footnotes")
 preview-default-preamble '("\\RequirePackage[" ("," . preview-default-option-list) "]{preview}[2004/11/05]")
 preview-LaTeX-command-replacements nil
 preview-dump-replacements '(preview-LaTeX-command-replacements
                             ("\\`\\([^ ]+\\)\\(\\( +-\\([^ \\\\\"]\\|\\\\\\.\\|\"[^\"]*\"\\)*\\)*\\)\\(.*\\)\\'"
                              "\\1 -ini -interaction=nonstopmode \"&\\1\" " preview-format-name ".ini \\5")
                             )
 preview-undump-replacements '(("\\`\\([^ ]+\\) .*? \"\\\\input\" \\(.*\\)\\'" "\\1 -interaction=nonstopmode \"&"
                                preview-format-name "\" \\2")
                               )
 preview-auto-cache-preamble 'ask
 preview-TeX-style-dir "/home/noname/.emacs.d/elpa/auctex-12.1.1/latex"
 )

Output from running `/usr/bin/rungs -h':
GPL Ghostscript 9.23 (2018-03-21)
Copyright (C) 2018 Artifex Software, Inc.  All rights reserved.
Usage: gs [switches] [file1.ps file2.ps ...]
Most frequently used switches: (you can use # in place of =)
 -dNOPAUSE           no pause after page   | -q       `quiet', fewer messages
 -g<width>x<height>  page size in pixels   | -r<res>  pixels/inch resolution
 -sDEVICE=<devname>  select device         | -dBATCH  exit after last file
 -sOutputFile=<file> select output file: - for stdout, |command for pipe,
                                         embed %d or %ld for page #
Input formats: PostScript PostScriptLevel1 PostScriptLevel2 PostScriptLevel3 PDF
Default output device: x11alpha
Available devices:
   alc1900 alc2000 alc4000 alc4100 alc8500 alc8600 alc9100 ap3250 atx23
   atx24 atx38 bbox bit bitcmyk bitrgb bitrgbtags bj10e bj10v bj10vh bj200
   bjc600 bjc800 bjc880j bjccmyk bjccolor bjcgray bjcmono bmp16 bmp16m
   bmp256 bmp32b bmpgray bmpmono bmpsep1 bmpsep8 ccr cdeskjet cdj1600 cdj500
   cdj550 cdj670 cdj850 cdj880 cdj890 cdj970 cdjcolor cdjmono cdnj500 cfax
   chp2200 cif cljet5 cljet5c cljet5pr coslw2p coslwxl cups declj250 deskjet
   devicen dfaxhigh dfaxlow display dj505j djet500 djet500c dl2100 dnj650c
   epl2050 epl2050p epl2120 epl2500 epl2750 epl5800 epl5900 epl6100 epl6200
   eplcolor eplmono eps2write eps9high eps9mid epson epsonc escp escpage
   faxg3 faxg32d faxg4 fmlbp fmpr fpng fs600 gdi gprf hl1240 hl1250 hl7x0
   hpdj1120c hpdj310 hpdj320 hpdj340 hpdj400 hpdj500 hpdj500c hpdj510
   hpdj520 hpdj540 hpdj550c hpdj560c hpdj600 hpdj660c hpdj670c hpdj680c
   hpdj690c hpdj850c hpdj855c hpdj870c hpdj890c hpdjplus hpdjportable ibmpro
   ijs imagen inferno ink_cov inkcov itk24i itk38 jetp3852 jj100 jpeg
   jpegcmyk jpeggray la50 la70 la75 la75plus laserjet lbp310 lbp320 lbp8
   lex2050 lex3200 lex5700 lex7000 lips2p lips3 lips4 lips4v lj250 lj3100sw
   lj4dith lj4dithp lj5gray lj5mono ljet2p ljet3 ljet3d ljet4 ljet4d
   ljet4pjl ljetplus ln03 lp1800 lp1900 lp2000 lp2200 lp2400 lp2500 lp2563
   lp3000c lp7500 lp7700 lp7900 lp8000 lp8000c lp8100 lp8200c lp8300c
   lp8300f lp8400f lp8500c lp8600 lp8600f lp8700 lp8800c lp8900 lp9000b
   lp9000c lp9100 lp9200b lp9200c lp9300 lp9400 lp9500c lp9600 lp9600s
   lp9800c lps4500 lps6500 lq850 lxm3200 lxm5700m m8510 md1xMono md2k
   md50Eco md50Mono md5k mgr4 mgr8 mgrgray2 mgrgray4 mgrgray8 mgrmono miff24
   mj500c mj6000c mj700v2c mj8000c ml600 necp6 npdl nullpage oce9050 oki182
   oki4w okiibm oprp opvp paintjet pam pamcmyk32 pamcmyk4 pbm pbmraw pcl3
   pclm pcx16 pcx24b pcx256 pcxcmyk pcxgray pcxmono pdfimage24 pdfimage32
   pdfimage8 pdfwrite pdfwrite pdfwrite pgm pgmraw pgnm pgnmraw photoex
   picty180 pj pjetxl pjxl pjxl300 pkm pkmraw pksm pksmraw plan plan9bm
   planc plang plank planm plib plibc plibg plibk plibm png16 png16m png256
   png48 pngalpha pnggray pngmono pngmonod pnm pnmraw ppm ppmraw pr1000
   pr1000_4 pr150 pr201 ps2write psdcmyk psdcmykog psdrgb pwgraster pxlcolor
   pxlmono r4081 rinkj rpdl samsunggdi sj48 spotcmyk st800 stcolor t4693d2
   t4693d4 t4693d8 tek4696 tiff12nc tiff24nc tiff32nc tiff48nc tiff64nc
   tiffcrle tiffg3 tiffg32d tiffg4 tiffgray tifflzw tiffpack tiffscaled
   tiffscaled24 tiffscaled32 tiffscaled4 tiffscaled8 tiffsep tiffsep1
   txtwrite uniprint x11 x11alpha x11cmyk x11cmyk2 x11cmyk4 x11cmyk8
   x11gray2 x11gray4 x11mono xcf xes xpswrite
Search path:
   /usr/share/ghostscript/9.23/Resource/Init :
   /usr/share/ghostscript/9.23/lib :
   /usr/share/ghostscript/9.23/Resource/Font :
   /usr/share/ghostscript/fonts : /usr/share/fonts/gsfonts
Ghostscript is also using fontconfig to search for font files
For more information, see /usr/share/doc/ghostscript/9.23/Use.htm.
Please report bugs to bugs.ghostscript.com.





Information forwarded to bug-auctex <at> gnu.org:
bug#32345; Package auctex. (Thu, 02 Aug 2018 11:15:02 GMT) Full text and rfc822 format available.

Message #8 received at submit <at> debbugs.gnu.org (full text, mbox):

From: jfbu <jfbu <at> free.fr>
To: bug-auctex <at> gnu.org
Subject: Re: bug#32345: 12.1.1; wrong preview position for four-byte utf-8
 encoded character (xelatex)
Date: Thu, 2 Aug 2018 13:13:43 +0200
[Message part 1 (text/plain, inline)]
Le 02/08/2018 à 02:42, sattler.christian <at> web.de a écrit :
> \documentclass{article}
> 
> \begin{document}
> 
> Test: $𝒞$
> 
> \end{document}


This already does not compile correctly with xelatex:

Missing character: There is no 𝒞 in font cmmi10!

I obtain partial success with

\documentclass{article}
\usepackage{unicode-math}
\begin{document}

Test: $𝒞$

\end{document}
% Local variables:
% TeX-engine: xetex
% End:

On generating preview (turning preamble caching off, as xelatex is not compatible with preamble caching and OpenType fonts) I see the attached image.

Further the log contains indication something went wrong indeed

l.5 Test: $
           풞$
Preview: Tightpage -32891 -32891 32891 32891
./testpreview.tex:5: Preview: Snippet 1 ended.(456786+9830x428605).

I am doing this with a 12.1+ incorporating recent fixes related to TeXLive 2018 and accented characters in filenames.

Best,

Jean-François

[Capture d’écran 2018-08-02 à 13.07.42.png (image/png, attachment)]

Information forwarded to bug-auctex <at> gnu.org:
bug#32345; Package auctex. (Thu, 02 Aug 2018 11:36:02 GMT) Full text and rfc822 format available.

Message #11 received at 32345 <at> debbugs.gnu.org (full text, mbox):

From: David Kastrup <dak <at> gnu.org>
To: jfbu <jfbu <at> free.fr>
Cc: 32345 <at> debbugs.gnu.org
Subject: Re: bug#32345: 12.1.1;
 wrong preview position for four-byte utf-8 encoded character (xelatex)
Date: Thu, 02 Aug 2018 13:34:51 +0200
jfbu <jfbu <at> free.fr> writes:

> I obtain partial success with
>
> \documentclass{article}
> \usepackage{unicode-math}
> \begin{document}
>
> Test: $𝒞$
>
> \end{document}

[...]

> Further the log contains indication something went wrong indeed
>
> l.5 Test: $
>            풞$
> Preview: Tightpage -32891 -32891 32891 32891
> ./testpreview.tex:5: Preview: Snippet 1 ended.(456786+9830x428605).

Maybe you should bother to mention what you consider "indication
something went wrong indeed".  preview-latex produces error messages on
purpose.  That's the only way to get to the right column.

The problem here is that the character in the error message appears to
be a different character from what is in the source file, so
preview-latex isn't able to correlate it with the source.

-- 
David Kastrup




Information forwarded to bug-auctex <at> gnu.org:
bug#32345; Package auctex. (Thu, 02 Aug 2018 11:57:02 GMT) Full text and rfc822 format available.

Message #14 received at 32345 <at> debbugs.gnu.org (full text, mbox):

From: jfbu <jfbu <at> free.fr>
To: David Kastrup <dak <at> gnu.org>
Cc: 32345 <at> debbugs.gnu.org
Subject: Re: bug#32345: 12.1.1; wrong preview position for four-byte utf-8
 encoded character (xelatex)
Date: Thu, 2 Aug 2018 13:56:14 +0200
Le 02/08/2018 à 13:34, David Kastrup a écrit :
> jfbu <jfbu <at> free.fr> writes:
> 
>> I obtain partial success with
>>
>> \documentclass{article}
>> \usepackage{unicode-math}
>> \begin{document}
>>
>> Test: $𝒞$
>>
>> \end{document}
> 
> [...]
> 
>> Further the log contains indication something went wrong indeed
>>
>> l.5 Test: $
>>             풞$
>> Preview: Tightpage -32891 -32891 32891 32891
>> ./testpreview.tex:5: Preview: Snippet 1 ended.(456786+9830x428605).
> 
> Maybe you should bother to mention what you consider "indication
> something went wrong indeed".  preview-latex produces error messages on
> purpose.  That's the only way to get to the right column.
> 
> The problem here is that the character in the error message appears to
> be a different character from what is in the source file, so
> preview-latex isn't able to correlate it with the source.
> 

So you do understand what I meant then?

Have a nice summer

Jean-François




Information forwarded to bug-auctex <at> gnu.org:
bug#32345; Package auctex. (Thu, 02 Aug 2018 12:14:01 GMT) Full text and rfc822 format available.

Message #17 received at 32345 <at> debbugs.gnu.org (full text, mbox):

From: David Kastrup <dak <at> gnu.org>
To: jfbu <jfbu <at> free.fr>
Cc: 32345 <at> debbugs.gnu.org
Subject: Re: bug#32345: 12.1.1;
 wrong preview position for four-byte utf-8 encoded character (xelatex)
Date: Thu, 02 Aug 2018 14:13:24 +0200
jfbu <jfbu <at> free.fr> writes:

> Le 02/08/2018 à 13:34, David Kastrup a écrit :
>> jfbu <jfbu <at> free.fr> writes:
>>
>>> I obtain partial success with
>>>
>>> \documentclass{article}
>>> \usepackage{unicode-math}
>>> \begin{document}
>>>
>>> Test: $𝒞$
>>>
>>> \end{document}
>>
>> [...]
>>
>>> Further the log contains indication something went wrong indeed
>>>
>>> l.5 Test: $
>>>             풞$
>>> Preview: Tightpage -32891 -32891 32891 32891
>>> ./testpreview.tex:5: Preview: Snippet 1 ended.(456786+9830x428605).
>>
>> Maybe you should bother to mention what you consider "indication
>> something went wrong indeed".  preview-latex produces error messages on
>> purpose.  That's the only way to get to the right column.
>>
>> The problem here is that the character in the error message appears to
>> be a different character from what is in the source file, so
>> preview-latex isn't able to correlate it with the source.
>>
>
> So you do understand what I meant then?

No.  I am explaining what the log file content means.  There is nothing
in your posting suggesting that this was what you were trying to convey
and I do not consider it likely that a majority of readers of this
report would have been able to properly see the problem.

> Have a nice summer

Does that mean that I should refrain from answers on this list in the
next few months or that you chose to put me into your kill file?  If you
expect others to read between the lines, those would be the two most
obvious interpretations of that line.

Just stating what one wants to say tends to make particularly electronic
communication less troublesome for everybody involved since the usual
cues in face-to-face communication are not available.

All the best,

-- 
David Kastrup




Information forwarded to bug-auctex <at> gnu.org:
bug#32345; Package auctex. (Thu, 02 Aug 2018 12:25:02 GMT) Full text and rfc822 format available.

Message #20 received at 32345 <at> debbugs.gnu.org (full text, mbox):

From: jfbu <jfbu <at> free.fr>
To: David Kastrup <dak <at> gnu.org>
Cc: 32345 <at> debbugs.gnu.org
Subject: Re: bug#32345: 12.1.1; wrong preview position for four-byte utf-8
 encoded character (xelatex)
Date: Thu, 2 Aug 2018 14:24:00 +0200
Le 02/08/2018 à 14:13, David Kastrup a écrit :
> jfbu <jfbu <at> free.fr> writes:
> 
>> Le 02/08/2018 à 13:34, David Kastrup a écrit :
>>> jfbu <jfbu <at> free.fr> writes:
>>>
>>>> I obtain partial success with
>>>>
>>>> \documentclass{article}
>>>> \usepackage{unicode-math}
>>>> \begin{document}
>>>>
>>>> Test: $𝒞$
>>>>
>>>> \end{document}
>>>
>>> [...]
>>>
>>>> Further the log contains indication something went wrong indeed
>>>>
>>>> l.5 Test: $
>>>>              풞$
>>>> Preview: Tightpage -32891 -32891 32891 32891
>>>> ./testpreview.tex:5: Preview: Snippet 1 ended.(456786+9830x428605).
>>>
>>> Maybe you should bother to mention what you consider "indication
>>> something went wrong indeed".  preview-latex produces error messages on
>>> purpose.  That's the only way to get to the right column.
>>>
>>> The problem here is that the character in the error message appears to
>>> be a different character from what is in the source file, so
>>> preview-latex isn't able to correlate it with the source.
>>>
>>
>> So you do understand what I meant then?
> 
> No.  I am explaining what the log file content means.  There is nothing
> in your posting suggesting that this was what you were trying to convey
> and I do not consider it likely that a majority of readers of this
> report would have been able to properly see the problem.

The extract from the log file is as in OP's initial post and
the fact that the displayed character is wrong was already
pointed out there, with even the precision that its codepoint #xd49e
was like original character except for missing 1 most significative byte.

> 
>> Have a nice summer
> 
> Does that mean that I should refrain from answers on this list in the
> next few months or that you chose to put me into your kill file?  If you
> expect others to read between the lines, those would be the two most
> obvious interpretations of that line.

It meant I intended to refrain from participating to this list which
appears somewhat hostile.  But anyway I am off-line from Internet
for most of the summer so this was easily said by me somewhat too
quickly possibly.

> 
> Just stating what one wants to say tends to make particularly electronic
> communication less troublesome for everybody involved since the usual
> cues in face-to-face communication are not available.
> 
> All the best,
> 

The very same document with lualatex in place of xelatex seems
to not experience the same problem, so there might be something
specific to xelatex tokenization of UTF-8 and how it interferes
with the preview-latex hack into $.

I am incompetent for any other remark,

Best,

Jean-François





Information forwarded to bug-auctex <at> gnu.org:
bug#32345; Package auctex. (Thu, 02 Aug 2018 13:07:01 GMT) Full text and rfc822 format available.

Message #23 received at 32345 <at> debbugs.gnu.org (full text, mbox):

From: jfbu <jfbu <at> free.fr>
To: David Kastrup <dak <at> gnu.org>
Cc: 32345 <at> debbugs.gnu.org
Subject: Re: bug#32345: 12.1.1; wrong preview position for four-byte utf-8
 encoded character (xelatex)
Date: Thu, 2 Aug 2018 15:06:26 +0200
Le 02/08/2018 à 14:24, jfbu a écrit :
> Le 02/08/2018 à 14:13, David Kastrup a écrit :
>> jfbu <jfbu <at> free.fr> writes:
>>
>>> Le 02/08/2018 à 13:34, David Kastrup a écrit :
>>>> jfbu <jfbu <at> free.fr> writes:
>>>>
>>>>> I obtain partial success with
>>>>>
>>>>> \documentclass{article}
>>>>> \usepackage{unicode-math}
>>>>> \begin{document}
>>>>>
>>>>> Test: $𝒞$
>>>>>
>>>>> \end{document}
>>>>
>>>> [...]
>>>>
>>>>> Further the log contains indication something went wrong indeed
>>>>>
>>>>> l.5 Test: $
>>>>>              풞$
>>>>> Preview: Tightpage -32891 -32891 32891 32891
>>>>> ./testpreview.tex:5: Preview: Snippet 1 ended.(456786+9830x428605).
>>>>
>>>> Maybe you should bother to mention what you consider "indication
>>>> something went wrong indeed".  preview-latex produces error messages on
>>>> purpose.  That's the only way to get to the right column.
>>>>
>>>> The problem here is that the character in the error message appears to
>>>> be a different character from what is in the source file, so
>>>> preview-latex isn't able to correlate it with the source.
>>>>
>>>
>>> So you do understand what I meant then?
>>
>> No.  I am explaining what the log file content means.  There is nothing
>> in your posting suggesting that this was what you were trying to convey
>> and I do not consider it likely that a majority of readers of this
>> report would have been able to properly see the problem.
> 
> The extract from the log file is as in OP's initial post and
> the fact that the displayed character is wrong was already
> pointed out there, with even the precision that its codepoint #xd49e
> was like original character except for missing 1 most significative byte.
> 
>>
>>> Have a nice summer
>>
>> Does that mean that I should refrain from answers on this list in the
>> next few months or that you chose to put me into your kill file?  If you
>> expect others to read between the lines, those would be the two most
>> obvious interpretations of that line.
> 
> It meant I intended to refrain from participating to this list which
> appears somewhat hostile.  But anyway I am off-line from Internet
> for most of the summer so this was easily said by me somewhat too
> quickly possibly.
> 
>>
>> Just stating what one wants to say tends to make particularly electronic
>> communication less troublesome for everybody involved since the usual
>> cues in face-to-face communication are not available.
>>
>> All the best,
>>
> 
> The very same document with lualatex in place of xelatex seems
> to not experience the same problem, so there might be something
> specific to xelatex tokenization of UTF-8 and how it interferes
> with the preview-latex hack into $.
> 
> I am incompetent for any other remark,

beyond this:

consider (Plain) xetex file testerrorxetex.tex

\font\1="[latinmodern-math.otf]"
\1
\undefined 𝒞
\bye

Run xetex on it from Emacs buffer, the log file is

This is XeTeX, Version 3.14159265-2.6-0.99999 (TeX Live 2018) (preloaded format=xetex 2018.7.31)  2 AUG 2018 15:03
entering extended mode
 restricted \write18 enabled.
 file:line:error style messages enabled.
 %&-line parsing enabled.
**testerrorxetex.tex
(./testerrorxetex.tex
./testerrorxetex.tex:3: Undefined control sequence.
l.3 \undefined
               풞
The control sequence at the end of the top line
of your error message was never \def'ed. If you have
misspelled it (e.g., `\hobx'), type `I' and the correct
spelling (e.g., `I\hbox'). Otherwise just continue,
and I'll forget about whatever was undefined.

[1] )
Output written on testerrorxetex.pdf (1 page).

There is a problem here with xetex error logs.


Best

Jean-François




Information forwarded to bug-auctex <at> gnu.org:
bug#32345; Package auctex. (Thu, 02 Aug 2018 13:08:02 GMT) Full text and rfc822 format available.

Information forwarded to bug-auctex <at> gnu.org:
bug#32345; Package auctex. (Thu, 02 Aug 2018 15:04:02 GMT) Full text and rfc822 format available.

Message #29 received at submit <at> debbugs.gnu.org (full text, mbox):

From: jfbu <jfbu <at> free.fr>
To: bug-auctex <at> gnu.org
Subject: Re: bug#32345: 12.1.1; wrong preview position for four-byte utf-8
 encoded character (xelatex)
Date: Thu, 2 Aug 2018 17:02:54 +0200
Le 02/08/2018 à 15:06, jfbu a écrit :
> There is a problem here with xetex error logs.

I opened an upstream ticket

https://sourceforge.net/p/xetex/bugs/154/

Best,

Jean-François






Information forwarded to bug-auctex <at> gnu.org:
bug#32345; Package auctex. (Thu, 02 Aug 2018 15:54:02 GMT) Full text and rfc822 format available.

Message #32 received at 32345 <at> debbugs.gnu.org (full text, mbox):

From: David Kastrup <dak <at> gnu.org>
To: jfbu <jfbu <at> free.fr>
Cc: 32345 <at> debbugs.gnu.org
Subject: Re: bug#32345: 12.1.1;
 wrong preview position for four-byte utf-8 encoded character (xelatex)
Date: Thu, 02 Aug 2018 17:53:07 +0200
jfbu <jfbu <at> free.fr> writes:

> Le 02/08/2018 à 15:06, jfbu a écrit :
>> There is a problem here with xetex error logs.
>
> I opened an upstream ticket
>
> https://sourceforge.net/p/xetex/bugs/154/

I guess that's the best bet.  preview-latex has special code to deal
with 8-bit engines putting line breaks in the middle of multibyte
characters or ^^-quoting only some of them.

It would likely be possible to teach it to also deal with the
XeTeX-specific current situation, but it would likely end up being a
nightmare to maintain.

-- 
David Kastrup




Information forwarded to bug-auctex <at> gnu.org:
bug#32345; Package auctex. (Tue, 05 Mar 2024 07:58:01 GMT) Full text and rfc822 format available.

Message #35 received at 32345 <at> debbugs.gnu.org (full text, mbox):

From: Arash Esbati <arash <at> gnu.org>
To: David Kastrup <dak <at> gnu.org>
Cc: 32345 <at> debbugs.gnu.org, jfbu <jfbu <at> free.fr>
Subject: Re: bug#32345: 12.1.1; wrong preview position for four-byte utf-8
 encoded character (xelatex)
Date: Tue, 05 Mar 2024 08:56:14 +0100
David Kastrup <dak <at> gnu.org> writes:

> jfbu <jfbu <at> free.fr> writes:
>
>> Le 02/08/2018 à 15:06, jfbu a écrit :
>>> There is a problem here with xetex error logs.
>>
>> I opened an upstream ticket
>>
>> https://sourceforge.net/p/xetex/bugs/154/
>
> I guess that's the best bet.  preview-latex has special code to deal
> with 8-bit engines putting line breaks in the middle of multibyte
> characters or ^^-quoting only some of them.
>
> It would likely be possible to teach it to also deal with the
> XeTeX-specific current situation, but it would likely end up being a
> nightmare to maintain.

(I'm going through old bug reports that unfortunately weren't resolved
at the time.)

That said, it looks like a "wontfix".  Therefore, I'm closing this
report.

Best, Arash




Added tag(s) wontfix. Request was from Arash Esbati <arash <at> gnu.org> to control <at> debbugs.gnu.org. (Tue, 05 Mar 2024 07:58:02 GMT) Full text and rfc822 format available.

bug closed, send any further explanations to 32345 <at> debbugs.gnu.org and sattler.christian <at> web.de Request was from Arash Esbati <arash <at> gnu.org> to control <at> debbugs.gnu.org. (Tue, 05 Mar 2024 07:58:02 GMT) Full text and rfc822 format available.

bug archived. Request was from Debbugs Internal Request <help-debbugs <at> gnu.org> to internal_control <at> debbugs.gnu.org. (Tue, 02 Apr 2024 11:24:18 GMT) Full text and rfc822 format available.

This bug report was last modified 21 days ago.

Previous Next


GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.