GNU bug report logs - #48540
Non-recursive Git checkout with submodules breaks SWH download

Message received at submit <at> debbugs.gnu.org:

Received: (at submit) by debbugs.gnu.org; 20 May 2021 15:50:29 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Thu May 20 11:50:29 2021
Received: from localhost ([127.0.0.1]:35036 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1ljkwP-0008AE-6r
	for submit <at> debbugs.gnu.org; Thu, 20 May 2021 11:50:29 -0400
Received: from lists.gnu.org ([209.51.188.17]:56580)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <samplet@HIDDEN>) id 1ljkwN-0008A5-DZ
 for submit <at> debbugs.gnu.org; Thu, 20 May 2021 11:50:28 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10]:54204)
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <samplet@HIDDEN>) id 1ljkwN-0003OX-2f
 for bug-guix@HIDDEN; Thu, 20 May 2021 11:50:27 -0400
Received: from out4-smtp.messagingengine.com ([66.111.4.28]:39053)
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <samplet@HIDDEN>) id 1ljkwK-0001tA-Jt
 for bug-guix@HIDDEN; Thu, 20 May 2021 11:50:26 -0400
Received: from compute5.internal (compute5.nyi.internal [10.202.2.45])
 by mailout.nyi.internal (Postfix) with ESMTP id 6BA075C01A9
 for <bug-guix@HIDDEN>; Thu, 20 May 2021 11:50:20 -0400 (EDT)
Received: from mailfrontend2 ([10.202.2.163])
 by compute5.internal (MEProxy); Thu, 20 May 2021 11:50:20 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=
 messagingengine.com; h=content-transfer-encoding:content-type
 :date:from:message-id:mime-version:subject:to:x-me-proxy
 :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=3kOVXN
 wf6cvHpqfzu09lcSaYyeb21lhNwSjyt4bZC/E=; b=SzTVKaNxL80JwbTM2ahQ+w
 ojgjzbm6YbDIBJksZ9TUmyxoICzTI7Olw9MGh1wZiXJHoJnsRiIY5ibi75g/iMLW
 xk6HPzYnhMvb5gBw6kdKS+KFplcXAzxioDvmVOlLt+QsCe/NxfYyjwfAH5Jg/5yq
 bK80X457ddlV8uzNWYh/Xd+j3BXZt6WbYW2vGydboW1WcEaig6n0LJWywCqLXgE8
 M0SciZ15m6no82/Nh/fk9dNQDRR38n08/+RPKd2bkBTSP1i/J3T0SEadIqymEw0I
 zltAOTE7rky2VpmfMezMqnGltgmdTp/tFmiYOMjqdlKut0s9m1XdVdM9XtI3uUoQ
 ==
X-ME-Sender: <xms:PIWmYJBXXdRB10433LoymAE-A1jVg_ZjhL2dzu6kdgtOJfLd2Yc8Nw>
 <xme:PIWmYHjEHyn1GZrMisbiLw2YXy_6pRl53kJpH3vyAxcWhXolrK5UdnFZViccGFsjG
 _-65i1dHsWOkGb8kw>
X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduledrvdejuddgleegucetufdoteggodetrfdotf
 fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen
 uceurghilhhouhhtmecufedttdenucenucfjughrpefhvffufffkfgggtgfgsehtqhertd
 dtreejnecuhfhrohhmpefvihhmohhthhihucfurghmphhlvgcuoehsrghmphhlvghtsehn
 ghihrhhordgtohhmqeenucggtffrrghtthgvrhhnpeejhefhhffhleegiefhhfduteefie
 ffgeelffdugedtleffgeejtefgkeejveekteenucfkphepjeegrdduudeirddukeeirdeg
 geenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehsrg
 hmphhlvghtsehnghihrhhordgtohhm
X-ME-Proxy: <xmx:PIWmYEnPCjPXGVjVqVTX_haQnisG_nOjf2woQS4mgZIqcEFXy9cZPA>
 <xmx:PIWmYDxEBRyyhJTu3Ykt7F64IQFWfdhB4zG2DFDsgAeb0kJgRQxkrw>
 <xmx:PIWmYOS5H9Vgie0T1S7qCMzIqa7EOffR3DWWQ1WfogS0awTt2lj_lA>
 <xmx:PIWmYFcki_2_Y9xoqgNmfXsyn_ML4FBfz5-tTGogZkFx7cIH2K0qgQ>
Received: from mrblack (74-116-186-44.qc.dsl.ebox.net [74.116.186.44])
 by mail.messagingengine.com (Postfix) with ESMTPA
 for <bug-guix@HIDDEN>; Thu, 20 May 2021 11:50:20 -0400 (EDT)
From: Timothy Sample <samplet@HIDDEN>
To: bug-guix@HIDDEN
Subject: Non-recursive Git checkout with submodules breaks SWH download
Date: Thu, 20 May 2021 11:50:19 -0400
Message-ID: <87a6opl804.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Received-SPF: pass client-ip=66.111.4.28; envelope-from=samplet@HIDDEN;
 helo=out4-smtp.messagingengine.com
X-Spam_score_int: -25
X-Spam_score: -2.6
X-Spam_bar: --
X-Spam_report: (-2.6 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
 DKIM_VALID=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=0.001,
 RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_PASS=-0.001,
 SPF_PASS=-0.001 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: -1.6 (-)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.6 (--)

Hi!

When trying to recover the =E2=80=98non-sequencer=E2=80=99 source from SWH,=
 Guix fails
with a hash mismatch:

    expected hash: 1cljkkyi9dxqpqhx8y6l2ja4zjmlya26m26kqxml8gx08vyvddhx
    actual hash:   1xrrczqx4ll276g449nqiq0ip6lpika9hs4z4xgxaa6ayw60v29f

The reason is that the checkout includes submodules, and the way that
Guix treats submodules differs from the way that SWH treats them.  Note
that this is not a recursive checkout (which is also broken, but more
clearly a =E2=80=9Cknown limitation=E2=80=9D).  In particular, Guix leaves =
the submodule
as an empty directory, while SWH turns it into a symlink pointing to the
submodule=E2=80=99s commit hash:

    $ readlink ./f20fa6babec52bbf703bad6c1c92fa845b781f7e/lib/ntk
    1e3f5106d404562902bed2983403301db24a3f78

This is clearly a rare edge case, but it should be pretty easy to fix.
Perhaps it=E2=80=99s as easy as just opening =E2=80=9C.gitmodules=E2=80=9D =
and replacing the
symlink at each submodule path with an empty directory.


-- Tim