GNU bug report logs - #36711
transformation 'with-source' had no effect on local git checkout directory

Message received at submit <at> debbugs.gnu.org:

Received: (at submit) by debbugs.gnu.org; 17 Jul 2019 23:52:48 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed Jul 17 19:52:48 2019
Received: from localhost ([127.0.0.1]:53179 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1hntj6-0005jN-Bi
	for submit <at> debbugs.gnu.org; Wed, 17 Jul 2019 19:52:48 -0400
Received: from lists.gnu.org ([209.51.188.17]:50705)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <jgibbons2357@HIDDEN>) id 1hntj3-0005jF-Qd
 for submit <at> debbugs.gnu.org; Wed, 17 Jul 2019 19:52:46 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10]:55343)
 by lists.gnu.org with esmtp (Exim 4.86_2)
 (envelope-from <jgibbons2357@HIDDEN>) id 1hntj2-0003vx-Dq
 for bug-guix@HIDDEN; Wed, 17 Jul 2019 19:52:45 -0400
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org
X-Spam-Level: *
X-Spam-Status: No, score=1.1 required=5.0 tests=BAYES_50,
 FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FROM,URIBL_BLOCKED autolearn=disabled
 version=3.3.2
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <jgibbons2357@HIDDEN>) id 1hntj1-0003Bh-24
 for bug-guix@HIDDEN; Wed, 17 Jul 2019 19:52:44 -0400
Received: from mail-pg1-x52f.google.com ([2607:f8b0:4864:20::52f]:41449)
 by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16)
 (Exim 4.71) (envelope-from <jgibbons2357@HIDDEN>)
 id 1hntj0-00039L-RR
 for bug-guix@HIDDEN; Wed, 17 Jul 2019 19:52:43 -0400
Received: by mail-pg1-x52f.google.com with SMTP id x15so1586675pgg.8
 for <bug-guix@HIDDEN>; Wed, 17 Jul 2019 16:52:42 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;
 h=date:from:to:subject:message-id:mime-version
 :content-transfer-encoding;
 bh=t74WCzLjklH4tksEUj/NDPErp8RRCUjEsY76M4VgQKk=;
 b=ODdCdz/ntcrkg3nk1jHazZ8UeoMpenw7zP/VzDKKsvlgc3v2kcC3XqlRL7/RxizLhC
 syJ/xlLZ+VC4jxrlBDCNnfCeT/hq1nHFUuhwbxKBPnJRai6IP9V8kTnKoDCgv+2hsOxs
 A8EizI+DaqZihihsZ7LuiFxwdaWAblmpuBhpUZqvlH+fDfynKvSqu3W+sS8xBFbEGPNy
 2HjWrO+PXuMn2e7of95DJXxmsMIMUzCiYvxALHVRPS9mcpSur2/3O+HRPsPMH8+C0LUp
 Fwj10p8oexsR6OZSZN2Ntm7qDkJk8SGbrjMKqFIn0Ni1soJQR43oJcD0KZidsQVpM+6s
 wVyg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:date:from:to:subject:message-id:mime-version
 :content-transfer-encoding;
 bh=t74WCzLjklH4tksEUj/NDPErp8RRCUjEsY76M4VgQKk=;
 b=B4KGGHkOqy2PE/0jYqmNoutOQs78qZMU1guW3mDNa6TgdHSHh4zcch/2J3p/DzZXpA
 z0ADwRTycARUghsNuVzoVfpujwD8wMt0Z1jTLb2EeXuZeQyzBnoPbGHepGyQepIHlUB0
 kNZenr9cO6ZYZFvkaydPZmg4VEKkRHL5leWjqaa5VhuGXLc3DUTiEwSLgN1xcrSMJTQ1
 tX7kl8kBUvt8Mr1moQV/LQGYB08MnO3elkemtURZOY2bkNPNEAw/XPRMvX/wrvt45Q6Y
 o6MUswKj30StffTFrw6uMzXtFlY5yvMF7wnOk8HEGC3e7utdZb6OowCzZkYlPWakTcfj
 MmgA==
X-Gm-Message-State: APjAAAXXMbXnY6thPsQrUViO8HQK3EmVrYBjaG9NyVWVSnEkM7Ha7o12
 Y1I0GhB4Lo/8CKtirNH4aahYTU5/
X-Google-Smtp-Source: APXvYqxuJwuIc8bNmII0TVuYBl4QNAJOWRAV+s7rGGnwNwV0aCggqpFZ38N313g7awu9/GU5flcRug==
X-Received: by 2002:a17:90a:2488:: with SMTP id
 i8mr46527672pje.123.1563407560627; 
 Wed, 17 Jul 2019 16:52:40 -0700 (PDT)
Received: from localhost ([199.68.53.171])
 by smtp.gmail.com with ESMTPSA id r6sm17666286pgl.74.2019.07.17.16.52.39
 for <bug-guix@HIDDEN>
 (version=TLS1_3 cipher=AEAD-AES256-GCM-SHA384 bits=256/256);
 Wed, 17 Jul 2019 16:52:39 -0700 (PDT)
Date: Wed, 17 Jul 2019 17:52:36 -0600
From: Jesse Gibbons <jgibbons2357@HIDDEN>
To: bug-guix@HIDDEN
Subject: transformation 'with-source' had no effect on local git checkout
 directory
Message-ID: <20190717175236.25164eb9@HIDDEN>
X-Mailer: Claws Mail 3.17.3 (GTK+ 2.24.32; x86_64-unknown-linux-gnu)
MIME-Version: 1.0
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
 recognized.
X-Received-From: 2607:f8b0:4864:20::52f
X-Spam-Score: -1.1 (-)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.1 (--)

I could not find this bug in the archives. This bug seems a
bit inconsistent.

How to reproduce:
Note that I use a variable after I discovered this does not happen with
some packages.

   my_package=guile-git

1. clone any repository referenced by a package:
   git clone https://gitlab.com/guile-git/guile-git.git checkout

2. modify the repository. I use a harmless comment, but I initially
saw this bug when I made a much greater change:
   cd checkout
   echo ";;;hello world" >> git/blob.scm

3. (optional) build the package with no flags:
   guix build $my_package

4. build the package with the flag "--with-source=$PWD":
   guix build --with-source=$PWD $my_package


output result:
guix build: warning: transformation 'with-source' had no effect on
guile-git@HIDDEN /gnu/store/36vgw4w0dh49n5l5vmlnlmiryhay8i52-guile-git-0.2.0


5. check for the edit:
grep ";;hello world" `guix build --with-source=$PWD \
$my_package`/share/guile/site/2.2/git/blob.scm; echo $?

output: guix build: warning: transformation 'with-source' had no effect
on guile-git@HIDDEN 1

If the git repository was used to build anything grep would have found
my comment and returned 0. If the file in question did not exist grep
would have returned 2.

Should I use --with-git-url instead? Probably not. That does not work
either:

guix build --with-git-url=$PWD $my_package

guix build: error: /home/jesse/Documents/tmp/guile-git/checkout:
invalid Git URL replacement specification

Should I commit? Turns out that doesn't help:
git add git/blob.scm
git commit -m"message"
guix build --with-source=$PWD $my_package

guix build: warning: transformation 'with-source' had no effect on
guile-git@HIDDEN /gnu/store/36vgw4w0dh49n5l5vmlnlmiryhay8i52-guile-git-0.2.0

Committing doesn't change the response to --with-git-url=$PWD either,
which is logical given the error message:
guix build --with-git-url=$PWD $my_package

guix build: error: /home/jesse/Documents/tmp/guile-git/checkout:
invalid Git URL replacement specification

Finally I try to build after I delete the .git directory, which makes my
working directory no longer a git checkout directory:
rm -rf .git
guix build --with-source=$PWD guile-gdbm-ffi 

gives me the same result:

guix build: warning: transformation 'with-source' had no effect on
guile-gdbm-ffi@HIDDEN /gnu/store/s5k6sc82ylbgxajdjvk7ns7i17dvx62r-guile-gdbm-ffi-20120209.fa1d5b6


I would expect this to be different, but I guess that's not the case.

However, this does not happen when I use source from guix itself:

cp --dereference --recursive `guix build --source \
$my_package` ./$my_package
cd $my_package
chmod --recursive u+w .
guix build --with-source=$PWD $my_package

...
successfully
built /gnu/store/0vjqhdwv1rsa40naziy9prq8v1jgbyxr-guile-git-0.2.0.drv

But it does not work when I use . instead of $PWD:
guix build --with-source=. $my_package

guix build: warning: transformation 'with-source' had no effect on
guile-git@HIDDEN
/gnu/store/36vgw4w0dh49n5l5vmlnlmiryhay8i52-guile-git-0.2.0

This bug not happen when I try it with the guile-readline package.

Because of this bug, it can be very complicated to develop and install
packages out of a local git clone directory. For example, it becomes
frustrating to check that changes made to the installation process
allow guix to install a package that guix previously couldn't build
before the source is committed and pushed to a remote repository.

I hope this issue has enough information to find a solution.

-Jesse