GNU bug report logs - #61967
guix pack error with python packages

Previous Next

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 61967 in the body.
You can then email your comments to 61967 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Cayetano Santos <cayetano.santos <at> inventati.org>
To: bug-guix <at> gnu.org
Subject: guix pack error with python packages
Date: Sat, 04 Mar 2023 20:35:01 +0100

Hello guix,

  I’m trying to deploy a test set of python packages to a remote server,
  using the following guix pack command (latest guix, as for now)

    guix pack -R --compression=xz --save-provenance \
    -S /.guix-profile/bin=bin -S /.guix-profile/share=share \
    -S /.guix-profile/etc=etc -S /.guix-profile/lib=lib \
    -S /.guix-profile/include=include

  The resulting file.tar.xz is sent to the server with

    scp file.tar.xz server:/dir1/dir2/.

  Then, when I

    ssh server
    cd /dir1/dir2

  I do a

    tar xf file.tar.xz

  At this point, a ’ls /dir1/dir2’ shows, as expected

    .guix-profile
    gnu
    file.tar.xz

  Now, when I just (PYTHONPATH is empty at this point)

    /dir1/dir2/.guix-profile/bin/python3 -c \
    "import sys; print(sys.path)"

  I get

    /dir1/dir2/hj...python...
    /dir1/dir2/hj...numpy...
    /dir1/dir2/hj...matplotlib...

  instead of

    /dir1/dir2/gnu/store/hj...python...
    /dir1/dir2/gnu/store/hj...numpy...
    /dir1/dir2/gnu/store/hj...matplotlib...

  so that when I

    /dir1/dir2/.guix-profile/bin/python3 -c "import numpyt"

  I get an error

    ModuleNotFoundError: No module named 'numpy'

  If, however, I

    export GUIX_PROFILE=/dir1/dir2/.guix-profile
    source $GUIX_PROFILE/etc/profile
    export PYTHONPATH=$GUIX_PYTHONPATH

  and then

    /dir1/dir2/.guix-profile/bin/python3

  I have

    Error processing line 1 of
    /dir1/dir2/.guix-profile/lib/python3.9/site-packages/matplotlib-3.5.2-py3.9-nspkg.pth:

  Trying to ’import numpy’ gives

    Traceback (most recent call last):
      File "<stdin>", line 1, in <module>
      File "/dir1/dir2/.guix-profile/lib/python3.9/site-packages/numpy/__init__.py", line 110, in <module>
    import warnings
      ModuleNotFoundError: No module named 'warnings'

  Am I doing something wrong ? Is this a bug ?

Thanks,

Cayetano Santos

Message #8 received at 61967 <at> debbugs.gnu.org (full text, mbox):

From: Josselin Poiret <dev <at> jpoiret.xyz>
To: cayetano.santos <at> inventati.org, 61967 <at> debbugs.gnu.org
Subject: Re: bug#61967: guix pack error with python packages
Date: Sun, 05 Mar 2023 11:11:19 +0100

[Message part 1 (text/plain, inline)]

Hi Cayetano,

Cayetano Santos via Bug reports for GNU Guix <bug-guix <at> gnu.org> writes:

> Hello guix,
>
>   I’m trying to deploy a test set of python packages to a remote server,
>   using the following guix pack command (latest guix, as for now)
>
>     guix pack -R --compression=xz --save-provenance \
>     -S /.guix-profile/bin=bin -S /.guix-profile/share=share \
>     -S /.guix-profile/etc=etc -S /.guix-profile/lib=lib \
>     -S /.guix-profile/include=include
>
>   The resulting file.tar.xz is sent to the server with
>
>     scp file.tar.xz server:/dir1/dir2/.

This is most likely [1], which hasn't been fixed yet but I have a patch
to that effect.  The problem is that it would cause a lot of rebuilds so
I haven't sent it yet, I'll send it after the core-updates merge.

[1] https://issues.guix.gnu.org/53258
    mid: 67e7d225-f824-b691-7125-6b37abef8bb0 <at> felsoci.sk

Best,
-- 
Josselin Poiret

[signature.asc (application/pgp-signature, inline)]

Message #11 received at 61967 <at> debbugs.gnu.org (full text, mbox):

From: Maxim Cournoyer <maxim.cournoyer <at> gmail.com>
To: Josselin Poiret <dev <at> jpoiret.xyz>
Cc: 61967 <at> debbugs.gnu.org, cayetano.santos <at> inventati.org
Subject: Re: bug#61967: guix pack error with python packages
Date: Tue, 07 Mar 2023 16:08:51 -0500

Hi Josselin,

Josselin Poiret <dev <at> jpoiret.xyz> writes:

> Hi Cayetano,
>
> Cayetano Santos via Bug reports for GNU Guix <bug-guix <at> gnu.org> writes:
>
>> Hello guix,
>>
>>   I’m trying to deploy a test set of python packages to a remote server,
>>   using the following guix pack command (latest guix, as for now)
>>
>>     guix pack -R --compression=xz --save-provenance \
>>     -S /.guix-profile/bin=bin -S /.guix-profile/share=share \
>>     -S /.guix-profile/etc=etc -S /.guix-profile/lib=lib \
>>     -S /.guix-profile/include=include
>>
>>   The resulting file.tar.xz is sent to the server with
>>
>>     scp file.tar.xz server:/dir1/dir2/.
>
> This is most likely [1], which hasn't been fixed yet but I have a patch
> to that effect.  The problem is that it would cause a lot of rebuilds so
> I haven't sent it yet, I'll send it after the core-updates merge.

If you send it *after* the core-updates merge (to core-updates)? It's
going to be quite a while before it lands to master.  Perhaps you could
send it now?  core-updates is the right branch for mass rebuilds.

-- 
Thanks,
Maxim

Message #14 received at 61967 <at> debbugs.gnu.org (full text, mbox):

From: Josselin Poiret <dev <at> jpoiret.xyz>
To: Maxim Cournoyer <maxim.cournoyer <at> gmail.com>
Cc: 61967 <at> debbugs.gnu.org, cayetano.santos <at> inventati.org
Subject: Re: bug#61967: guix pack error with python packages
Date: Thu, 09 Mar 2023 20:57:44 +0100

[Message part 1 (text/plain, inline)]

Hi Maxim,

Maxim Cournoyer <maxim.cournoyer <at> gmail.com> writes:

> If you send it *after* the core-updates merge (to core-updates)? It's
> going to be quite a while before it lands to master.  Perhaps you could
> send it now?  core-updates is the right branch for mass rebuilds.

I think we are trying to move away from the massive core-updates branch
and rather work with feature branches instead, although the pending
core-updates merge is blocking the change for now.  I don't want to add
yet more work for people courageously working on core-updates right now.

Best,
-- 
Josselin Poiret

[signature.asc (application/pgp-signature, inline)]

Message #17 received at 61967 <at> debbugs.gnu.org (full text, mbox):

From: Maxim Cournoyer <maxim.cournoyer <at> gmail.com>
To: Josselin Poiret <dev <at> jpoiret.xyz>
Cc: 61967 <at> debbugs.gnu.org, cayetano.santos <at> inventati.org
Subject: Re: bug#61967: guix pack error with python packages
Date: Thu, 09 Mar 2023 22:43:58 -0500

Hi Josselin,

Josselin Poiret <dev <at> jpoiret.xyz> writes:

> Hi Maxim,
>
> Maxim Cournoyer <maxim.cournoyer <at> gmail.com> writes:
>
>> If you send it *after* the core-updates merge (to core-updates)? It's
>> going to be quite a while before it lands to master.  Perhaps you could
>> send it now?  core-updates is the right branch for mass rebuilds.
>
> I think we are trying to move away from the massive core-updates branch
> and rather work with feature branches instead, although the pending
> core-updates merge is blocking the change for now.  I don't want to add
> yet more work for people courageously working on core-updates right now.

Perhaps I'm out of the loop, but in my book the main branches should
never close.  If there's a need to freeze the state of one the three
main branches new development branches can be created.  This was
discussed in the past.

-- 
Thanks,
Maxim

Message #20 received at 61967 <at> debbugs.gnu.org (full text, mbox):

From: Josselin Poiret <dev <at> jpoiret.xyz>
To: Maxim Cournoyer <maxim.cournoyer <at> gmail.com>
Cc: 61967 <at> debbugs.gnu.org, cayetano.santos <at> inventati.org
Subject: Re: bug#61967: guix pack error with python packages
Date: Fri, 10 Mar 2023 09:10:44 +0100

[Message part 1 (text/plain, inline)]

Hi Maxim, 

Maxim Cournoyer <maxim.cournoyer <at> gmail.com> writes:

> Perhaps I'm out of the loop, but in my book the main branches should
> never close.  If there's a need to freeze the state of one the three
> main branches new development branches can be created.  This was
> discussed in the past.

I don't think there was a freeze for core-updates this time, commits are
still rolling in on the core-updates branch.

Best,
-- 
Josselin Poiret

[signature.asc (application/pgp-signature, inline)]

Message #23 received at 61967 <at> debbugs.gnu.org (full text, mbox):

From: Cayetano Santos <csantosb <at> inventati.org>
To: 61967 <at> debbugs.gnu.org
Date: Mon, 05 Jun 2023 21:53:44 +0200

Hi,

  Just for the record, I fixed the problem with

    export PYTHONPATH=$GUIX_PYTHONPATH:/path-to/.guix-profile/lib/python3.10/:/path-to/.guix-profile/lib/python3.10/site-packages/:/path-to/.guix-profile/lib/python3.10/lib-dynload

  I’m using an up to date guix. Now I can import and use all the python
  libraries with no problem.

Thanks,

Cayetano

Message #28 received at 61967-done <at> debbugs.gnu.org (full text, mbox):

From: Cayetano Santos <csantosb <at> inventati.org>
To: 61967-done <at> debbugs.gnu.org
Subject: Fixed.
Date: Mon, 14 Aug 2023 10:59:23 +0200

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.