GNU bug report logs - #56675
UTF16 encoding adds BOM before every single character

Message received at submit <at> debbugs.gnu.org:

Received: (at submit) by debbugs.gnu.org; 20 Jul 2022 21:40:04 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed Jul 20 17:40:04 2022
Received: from localhost ([127.0.0.1]:36201 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1oEHQJ-0005JM-RL
	for submit <at> debbugs.gnu.org; Wed, 20 Jul 2022 17:40:04 -0400
Received: from lists.gnu.org ([209.51.188.17]:57012)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <jean@HIDDEN>) id 1oEHQI-0005If-0y
 for submit <at> debbugs.gnu.org; Wed, 20 Jul 2022 17:40:03 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10]:34320)
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <jean@HIDDEN>)
 id 1oEHQH-0001PF-Rv
 for bug-guile@HIDDEN; Wed, 20 Jul 2022 17:40:01 -0400
Received: from mout.kundenserver.de ([212.227.17.24]:41121)
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <jean@HIDDEN>)
 id 1oEHQG-0001YD-2B
 for bug-guile@HIDDEN; Wed, 20 Jul 2022 17:40:01 -0400
Received: from [192.168.1.128] ([82.65.251.18]) by mrelayeu.kundenserver.de
 (mreue108 [212.227.15.184]) with ESMTPSA (Nemesis) id
 1N4R0a-1nXxf60VE6-011O7h for <bug-guile@HIDDEN>; Wed, 20 Jul 2022 23:39:58
 +0200
Message-ID: <bac17cbb-53db-c644-e16e-f9f3faa3e10e@HIDDEN>
Date: Wed, 20 Jul 2022 23:39:57 +0200
MIME-Version: 1.0
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101
 Thunderbird/91.11.0
Content-Language: en-US
To: bug-guile@HIDDEN
From: Jean Abou Samra <jean@HIDDEN>
Subject: UTF16 encoding adds BOM before every single character
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
X-Provags-ID: V03:K1:91IhKAEBXJhrl0LYVdm4DJKlsUwIudoBhkC3aAuueNepKFGH32M
 YiiZKIrtfDf2mW1aZzxFFcvcW+NfIOM0qrsdVpwYrkbmnN2MjRCHnh0z7HLK8LcOrKm0cUA
 Hu0QO0zEgxViJUOOZCZw9EuXtDkXHjdKrJiMDGg8yueV8UiMOoctKNsxgommWWGWkMzUrqM
 nPS6SzhM006LOZ4SnvWrA==
X-Spam-Flag: NO
X-UI-Out-Filterresults: notjunk:1;V03:K0:4G4wUioLOZQ=:xBfMOn27KIiUpA1PAE1NUV
 ZTjjSw0AX+/o3lXo9txf1occD8IQ/eTPO61zV8twGUxy77WgEI13A+S5EEOmoAmxyddV36ld3
 Ev2HCglh3tERSB6lliy+dBNXVH/v+ZpvrxgC4+r1rNnq4H8NBuXoX1yQGvgL7PcfobmpHy8S0
 c2cnbsWL44QlSqB2Ckx0zdH/PTMqzYmcS9DMdJIU5Dg9fxECQZVc9i/Ukbfj3exsJkioN6lqh
 LOL9P/ZGNLVIFKciCfHLE52CfjydH4mYoY1wDkFH3qEFxhcaeJrXpDX5gPqTTHsgRtyo4yBdn
 m3HVs0UvvniGUNlFFYzkVQw50g3UipdTRo33X1wvMyl9n7iRbTsvoqoXnnmFCEnlQlv+tEKql
 aWbPjiRFZTD2Te6kHT2v/KvPlaR3BpkVKN7sKyqSG4++WYu9v/hInu0lCOdSZw7wUWgvZjIZw
 EesnwVJTXmWrzcIdBt6/VmFM4USBUgET6iB4ybjk2e+v3EHYX3VfOY2wzlnE+lh1SysQLOfIr
 ILQPolBzUtocti4TeaFEV3YCF/D4NsJ0ii8E84Hxn9uuT69Zc+o6tFV6hs6jmkBXSsa8l1ySy
 Q0W/fL73GaOkbD1RY/gjF3AkO+MCg48vex4xyIiOsuKJD7D1o8ONtc2NAhCXzawcGFLmC3ASQ
 rH1DKFiJcngizgBLoYBJHalryxae7/HZ2RhRQTIK3+u2uUcfvW/o2IzHSGeIqLqGUr1WiALkL
 Zm1113n4Rfs6J5bVbCa13WYq8kLKF2uK3AMz1Q==
Received-SPF: none client-ip=212.227.17.24; envelope-from=jean@HIDDEN;
 helo=mout.kundenserver.de
X-Spam_score_int: -18
X-Spam_score: -1.9
X-Spam_bar: -
X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, SPF_HELO_NONE=0.001,
 SPF_NONE=0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

With this code:

(let ((p (open-output-file "x.txt")))
    (set-port-encoding! p "UTF16")
    (display "ABC" p)
    (close-port p))

the sequence of bytes in the output file x.txt is

['FF', 'FE', '41', '0', 'FF', 'FE', '42', '0', 'FF', 'FE', '43', '0']


As you can see, a BOM is being added before every
single character instead of just at the beginning.

Originally reported at
https://lists.gnu.org/archive/html/guile-user/2022-07/msg00041.html