GNU logs - #52179, boring messages

Message sent to bug-gnu-emacs@HIDDEN:

Subject: bug#52179: Highlighting a word in `ispell' using `enchant'
Resent-From: Tor Kringeland <tor.a.s.kringeland@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@HIDDEN
Resent-Date: Mon, 29 Nov 2021 14:45:02 +0000
Resent-Message-ID: <handler.52179.B.16381970932078 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: 52179 <at> debbugs.gnu.org
From: Tor Kringeland <tor.a.s.kringeland@HIDDEN>
Date: Mon, 29 Nov 2021 15:44:39 +0100
Message-ID: <m2h7bvxbqg.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Received-SPF: pass client-ip=129.241.56.179;
 envelope-from=tor.a.s.kringeland@HIDDEN; helo=mailgw301.it.ntnu.no
X-Spam_score_int: -20
X-Spam_score: -2.1
X-Spam_bar: --
X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
 DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_HELO_NONE=0.001,
 SPF_PASS=-0.001 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: -1.6 (-)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.6 (--)

Using `ispell' with `enchant' on macOS yields the following problem.  If
a word contains some non-ASCII character, said character will not be
considered part of the word and will split it (like a digit would).  For
example in "na=C3=AFve" both "na" and "ve" are considered two words.  This
does not happen if I use `aspell' instead of `enchant', and if I run

  echo -n "na=C3=AFve" | enchant-2 -a

it registers that this is one word, and that it is valid (using an
English dictionary).

I'm using Enchant version 2.3.1 and an Emacs 29 build from 24 November
on macOS Catalina.

Message sent:

Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-Mailer: MIME-tools 5.505 (Entity 5.505)
Content-Type: text/plain; charset=utf-8
X-Loop: help-debbugs@HIDDEN
From: help-debbugs@HIDDEN (GNU bug Tracking System)
To: Tor Kringeland <tor.a.s.kringeland@HIDDEN>
Subject: bug#52179: Acknowledgement (Highlighting a word in `ispell' using
 `enchant')
Message-ID: <handler.52179.B.16381970932078.ack <at> debbugs.gnu.org>
References: <m2h7bvxbqg.fsf@HIDDEN>
X-Gnu-PR-Message: ack 52179
X-Gnu-PR-Package: emacs
Reply-To: 52179 <at> debbugs.gnu.org
Date: Mon, 29 Nov 2021 14:45:02 +0000

Thank you for filing a new bug report with debbugs.gnu.org.

This is an automatically generated reply to let you know your message
has been received.

Your message is being forwarded to the package maintainers and other
interested parties for their attention; they will reply in due course.

Your message has been sent to the package maintainer(s):
 bug-gnu-emacs@HIDDEN

If you wish to submit further information on this problem, please
send it to 52179 <at> debbugs.gnu.org.

Please do not send mail to help-debbugs@HIDDEN unless you wish
to report a problem with the Bug-tracking system.

--=20
52179: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D52179
GNU Bug Tracking System
Contact help-debbugs@HIDDEN with problems

Message sent to bug-gnu-emacs@HIDDEN:

Subject: bug#52179: Highlighting a word in `ispell' using `enchant'
Resent-From: Eli Zaretskii <eliz@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@HIDDEN
Resent-Date: Mon, 29 Nov 2021 14:52:02 +0000
Resent-Message-ID: <handler.52179.B52179.163819751111490 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: Tor Kringeland <tor.a.s.kringeland@HIDDEN>
Cc: 52179 <at> debbugs.gnu.org
Date: Mon, 29 Nov 2021 16:51:54 +0200
Message-Id: <83k0grui9h.fsf@HIDDEN>
From: Eli Zaretskii <eliz@HIDDEN>
In-Reply-To: <m2h7bvxbqg.fsf@HIDDEN> (message from Tor Kringeland on Mon, 29
 Nov 2021 15:44:39 +0100)
References: <m2h7bvxbqg.fsf@HIDDEN>
MIME-version: 1.0
Content-type: text/plain; charset=utf-8
Content-Transfer-Encoding: 8bit
Precedence: list
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>

> From: Tor Kringeland <tor.a.s.kringeland@HIDDEN>
> Date: Mon, 29 Nov 2021 15:44:39 +0100
> 
> Using `ispell' with `enchant' on macOS yields the following problem.  If
> a word contains some non-ASCII character, said character will not be
> considered part of the word and will split it (like a digit would).  For
> example in "naïve" both "na" and "ve" are considered two words.  This
> does not happen if I use `aspell' instead of `enchant', and if I run
> 
>   echo -n "naïve" | enchant-2 -a
> 
> it registers that this is one word, and that it is valid (using an
> English dictionary).
> 
> I'm using Enchant version 2.3.1 and an Emacs 29 build from 24 November
> on macOS Catalina.

Which dictionary do you use, and what encoding does that dictionary
require?

Message sent to bug-gnu-emacs@HIDDEN:

Subject: bug#52179: Highlighting a word in `ispell' using `enchant'
Resent-From: Tor Kringeland <tor.a.s.kringeland@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@HIDDEN
Resent-Date: Mon, 29 Nov 2021 20:47:01 +0000
Resent-Message-ID: <handler.52179.B52179.16382187804634 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: Eli Zaretskii <eliz@HIDDEN>
Cc: 52179 <at> debbugs.gnu.org
From: Tor Kringeland <tor.a.s.kringeland@HIDDEN>
In-Reply-To: <83k0grui9h.fsf@HIDDEN>
References: <m2h7bvxbqg.fsf@HIDDEN> <83k0grui9h.fsf@HIDDEN>
Date: Mon, 29 Nov 2021 21:46:05 +0100
Message-ID: <m2lf16vgfm.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Precedence: list
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>

Eli Zaretskii <eliz@HIDDEN> writes:

>> From: Tor Kringeland <tor.a.s.kringeland@HIDDEN>
>> Date: Mon, 29 Nov 2021 15:44:39 +0100
>>=20
>> Using `ispell' with `enchant' on macOS yields the following problem.  If
>> a word contains some non-ASCII character, said character will not be
>> considered part of the word and will split it (like a digit would).  For
>> example in "na=C3=AFve" both "na" and "ve" are considered two words.  Th=
is
>> does not happen if I use `aspell' instead of `enchant', and if I run
>>=20
>>   echo -n "na=C3=AFve" | enchant-2 -a
>>=20
>> it registers that this is one word, and that it is valid (using an
>> English dictionary).
>>=20
>> I'm using Enchant version 2.3.1 and an Emacs 29 build from 24 November
>> on macOS Catalina.
>
> Which dictionary do you use, and what encoding does that dictionary
> require?

In Emacs, the relevant entry in `ispell-dictionary-alist' is

  ("en" "[[:alpha:]]" "[^[:alpha:]]" "" t nil nil utf-8)

I installed `aspell' and `enchant' from Homebrew.  The installation of
`aspell' included a bunch of dictionaries downloaded from gnu.org.  In
particular, the "en" dictionary is downloaded from [1].  It is in some
kind of binary format after installation (see [2] for details).

The weird part is that it works fine in a command line, and switching
`ispell-program-name' to use `aspell' fixes the issue, so the problem
seems to be somehow in how Emacs interacts with the `enchant-2' binary.
It's doing the same for non-ASCII characters as one would expect from
numbers: the string "one0two" is valid, as "one" and "two" are treated
as separate words and "0" is ignored.

- [1] https://ftp.gnu.org/gnu/aspell/dict/en/aspell6-en-2018.04.16-0.tar.bz2

- [2] https://github.com/Homebrew/homebrew-core/blob/master/Formula/aspell.=
rb

Message sent to bug-gnu-emacs@HIDDEN:

X-Loop: help-debbugs@HIDDEN
Subject: bug#52179: Highlighting a word in `ispell' using `enchant'
Resent-From: Eli Zaretskii <eliz@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@HIDDEN
Resent-Date: Tue, 30 Nov 2021 03:23:02 +0000
Resent-Message-ID: <handler.52179.B52179.16382425329857 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 52179
X-GNU-PR-Package: emacs
X-GNU-PR-Keywords: 
To: Tor Kringeland <tor.a.s.kringeland@HIDDEN>
Cc: 52179 <at> debbugs.gnu.org
Received: via spool by 52179-submit <at> debbugs.gnu.org id=B52179.16382425329857
          (code B ref 52179); Tue, 30 Nov 2021 03:23:02 +0000
Received: (at 52179) by debbugs.gnu.org; 30 Nov 2021 03:22:12 +0000
Received: from localhost ([127.0.0.1]:39936 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1mrtid-0002Yv-Ld
	for submit <at> debbugs.gnu.org; Mon, 29 Nov 2021 22:22:12 -0500
Received: from eggs.gnu.org ([209.51.188.92]:51544)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <eliz@HIDDEN>) id 1mrtiV-0002YL-K3
 for 52179 <at> debbugs.gnu.org; Mon, 29 Nov 2021 22:22:11 -0500
Received: from [2001:470:142:3::e] (port=46510 helo=fencepost.gnu.org)
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <eliz@HIDDEN>)
 id 1mrtiQ-0007ui-0D; Mon, 29 Nov 2021 22:21:58 -0500
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org;
 s=fencepost-gnu-org; h=References:Subject:In-Reply-To:To:From:Date:
 mime-version; bh=lBivYekusyej/apwxLrTkTwu3tlNXKMZJSQPZdgj00U=; b=os/vmdZJMA5o
 5t7Bp5zv3r68dqZK/qJXIFMx2hUPphtHmzIXYGQ1bS4ifJrVaOXo4O0WdyxWYLKkhM8rD+vUtwW8t
 XDt4qG3ddmciGWLdiWjtEIv1GYxaqjrzh9J2MtKTXQh7Ia6SUEQeuKaMVOd40PJq+E3qpsXP4wL0T
 XxIV1eIdyeKaNh926ytTTCF+lBk88qrr4K8IV2WE5xDUza/tgTT/+CxaSsm9jQ2OsqINuMbd9uxo3
 KDxlkkkxIiogdUNG7FxM8A5nr3ziHjQs/zyLEU9l0MohxSxt2rHqKXSSxA56Oyp+biJo019FDZc0H
 Aqs/8yBJTXx9IkLF2bHaDw==;
Received: from [87.69.77.57] (port=4178 helo=home-c4e4a596f7)
 by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <eliz@HIDDEN>)
 id 1mrtiP-0005Ns-Nn; Mon, 29 Nov 2021 22:21:58 -0500
Date: Tue, 30 Nov 2021 05:22:10 +0200
Message-Id: <835ysauy3h.fsf@HIDDEN>
From: Eli Zaretskii <eliz@HIDDEN>
In-Reply-To: <m2lf16vgfm.fsf@HIDDEN> (message from Tor Kringeland on Mon, 29
 Nov 2021 21:46:05 +0100)
References: <m2h7bvxbqg.fsf@HIDDEN> <83k0grui9h.fsf@HIDDEN>
 <m2lf16vgfm.fsf@HIDDEN>
X-Spam-Score: 0.0 (/)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

> From: Tor Kringeland <tor.a.s.kringeland@HIDDEN>
> Cc: 52179 <at> debbugs.gnu.org
> Date: Mon, 29 Nov 2021 21:46:05 +0100
> 
> >> I'm using Enchant version 2.3.1 and an Emacs 29 build from 24 November
> >> on macOS Catalina.
> >
> > Which dictionary do you use, and what encoding does that dictionary
> > require?
> 
> In Emacs, the relevant entry in `ispell-dictionary-alist' is
> 
>   ("en" "[[:alpha:]]" "[^[:alpha:]]" "" t nil nil utf-8)
> 
> I installed `aspell' and `enchant' from Homebrew.  The installation of
> `aspell' included a bunch of dictionaries downloaded from gnu.org.  In
> particular, the "en" dictionary is downloaded from [1].  It is in some
> kind of binary format after installation (see [2] for details).
> 
> The weird part is that it works fine in a command line, and switching
> `ispell-program-name' to use `aspell' fixes the issue, so the problem
> seems to be somehow in how Emacs interacts with the `enchant-2' binary.
> It's doing the same for non-ASCII characters as one would expect from
> numbers: the string "one0two" is valid, as "one" and "two" are treated
> as separate words and "0" is ignored.

I suspect that the problem is with the LC_* and LANG environment
variables in the problematic case, which confuse the speller with
regards to the language and encoding used.

Last modified: Tue, 30 Nov 2021 03:30:01 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.