GNU bug report logs - #49083
‘guix import pypi’ fails in the absence of “sdist” releases

Previous Next

Package: guix;

Reported by: Ludovic Courtès <ludovic.courtes <at> inria.fr>

Date: Fri, 18 Jun 2021 07:34:01 UTC

Severity: normal

Done: Ludovic Courtès <ludo <at> gnu.org>

Bug is archived. No further changes may be made.

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 49083 in the body.
You can then email your comments to 49083 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

View this report as an mbox folder, status mbox, maintainer mbox


Report forwarded to bug-guix <at> gnu.org:
bug#49083; Package guix. (Fri, 18 Jun 2021 07:34:01 GMT) Full text and rfc822 format available.

Acknowledgement sent to Ludovic Courtès <ludovic.courtes <at> inria.fr>:
New bug report received and forwarded. Copy sent to bug-guix <at> gnu.org. (Fri, 18 Jun 2021 07:34:01 GMT) Full text and rfc822 format available.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Ludovic Courtès <ludovic.courtes <at> inria.fr>
To: <bug-guix <at> gnu.org>
Subject: ‘guix import pypi’ fails in
 the absence of “sdist” releases
Date: Fri, 18 Jun 2021 09:33:13 +0200
Hi,

For some packages we get this:

--8<---------------cut here---------------start------------->8---
$ guix import pypi jaxlib
guix import: error: no source release for pypi package jaxlib 0.1.67
--8<---------------cut here---------------end--------------->8---

and indeed, there’s no “sdist” (source distribution), only
“bdist_wheel” (.whl files).

Nevertheless, should the importer do something smarter here?  The
metadata at <https://pypi.org/pypi/jaxlib/json> doesn’t contain info
about the source repository (though it contains the home page at
github.com).  Would it make sense to build from a .whl file or does this
necessarily include generated code and other byproducts?

Thanks,
Ludo’.




Information forwarded to bug-guix <at> gnu.org:
bug#49083; Package guix. (Fri, 18 Jun 2021 08:57:02 GMT) Full text and rfc822 format available.

Message #8 received at 49083 <at> debbugs.gnu.org (full text, mbox):

From: Leo Prikler <leo.prikler <at> student.tugraz.at>
To: 49083 <at> debbugs.gnu.org
Cc: ludo <at> gnu.org
Subject: ‘guix import pypi’ fails in
 the absence of “sdist” releases
Date: Fri, 18 Jun 2021 10:56:33 +0200
Wheels are (as far as I understand) binary distributions, so they ought
to contain everything, that gets put into site-packages.  I don't think
they make for good source packages.  In particular, the jaxlib wheel
contains a bunch of shared objects and almost none of the source that
one can see on Github.

Instead of erroring out, we could try to check whether the homepage
points to a git forge and try to generate a git-reference from that. 
Failing this, we might want to set source to something, that produces
an error when read or when used as a variable, similar to how unknown
licenses are handled.

Regards,
Leo





Information forwarded to bug-guix <at> gnu.org:
bug#49083; Package guix. (Sun, 20 Jun 2021 21:04:02 GMT) Full text and rfc822 format available.

Message #11 received at 49083 <at> debbugs.gnu.org (full text, mbox):

From: Ludovic Courtès <ludo <at> gnu.org>
To: Leo Prikler <leo.prikler <at> student.tugraz.at>
Cc: 49083 <at> debbugs.gnu.org
Subject: Re: ‘guix import pypi’
 fails in the absence of “sdist” releases
Date: Sun, 20 Jun 2021 23:03:36 +0200
Hi,

Leo Prikler <leo.prikler <at> student.tugraz.at> skribis:

> Wheels are (as far as I understand) binary distributions, so they ought
> to contain everything, that gets put into site-packages.  I don't think
> they make for good source packages.  In particular, the jaxlib wheel
> contains a bunch of shared objects and almost none of the source that
> one can see on Github.

Uh, worse than I thought.

> Instead of erroring out, we could try to check whether the homepage
> points to a git forge and try to generate a git-reference from that. 

Sounds good.  I suspect special-casing github.com would already catch
most cases…  Problem is that we would not know which tag to use, unless
we go to great lengths to guess that.

> Failing this, we might want to set source to something, that produces
> an error when read or when used as a variable, similar to how unknown
> licenses are handled.

Right; not failing seems preferable.

Thanks,
Ludo’.




Information forwarded to bug-guix <at> gnu.org:
bug#49083; Package guix. (Tue, 22 Jun 2021 18:59:02 GMT) Full text and rfc822 format available.

Message #14 received at 49083 <at> debbugs.gnu.org (full text, mbox):

From: Maxim Cournoyer <maxim.cournoyer <at> gmail.com>
To: Ludovic Courtès <ludo <at> gnu.org>
Cc: Leo Prikler <leo.prikler <at> student.tugraz.at>, 49083 <at> debbugs.gnu.org
Subject: Re: bug#49083: ‘guix import pypi’ fails in the absence of “sdist”
 releases
Date: Tue, 22 Jun 2021 14:58:36 -0400
Hi,

Ludovic Courtès <ludo <at> gnu.org> writes:


[...]

>> Failing this, we might want to set source to something, that produces
>> an error when read or when used as a variable, similar to how unknown
>> licenses are handled.
>
> Right; not failing seems preferable.

That seems to be the most actionable thing to do.  It'd help when
importing recursively; the whole collections could still be imported
fully (although requiring manual intervention) instead of erroring-out
half-way.

Maxim




Reply sent to Ludovic Courtès <ludo <at> gnu.org>:
You have taken responsibility. (Wed, 02 Feb 2022 17:48:02 GMT) Full text and rfc822 format available.

Notification sent to Ludovic Courtès <ludovic.courtes <at> inria.fr>:
bug acknowledged by developer. (Wed, 02 Feb 2022 17:48:03 GMT) Full text and rfc822 format available.

Message #19 received at 49083-done <at> debbugs.gnu.org (full text, mbox):

From: Ludovic Courtès <ludo <at> gnu.org>
To: Maxim Cournoyer <maxim.cournoyer <at> gmail.com>
Cc: Leo Prikler <leo.prikler <at> student.tugraz.at>, 49083-done <at> debbugs.gnu.org
Subject: Re: bug#49083: ‘guix import pypi’ fails in the absence of “sdist”
 releases
Date: Wed, 02 Feb 2022 18:46:49 +0100
Hi!

So for now I “fixed” it by displaying a hint in commit
00762a4c4c8ecdd71cccf6afdd87ae68bf9b4964.

--8<---------------cut here---------------start------------->8---
$ ./pre-inst-env guix import pypi jaxlib
guix import: error: no source release for pypi package jaxlib 0.1.76

hint: This indicates that the package is available on PyPI, but only as a "wheel" containing
binaries, not source.  To build it from source, refer to the upstream repository at
`https://github.com/google/jax'.
--8<---------------cut here---------------end--------------->8---

Ludo’.




Information forwarded to bug-guix <at> gnu.org:
bug#49083; Package guix. (Wed, 02 Feb 2022 21:46:02 GMT) Full text and rfc822 format available.

Message #22 received at 49083-done <at> debbugs.gnu.org (full text, mbox):

From: Maxim Cournoyer <maxim.cournoyer <at> gmail.com>
To: Ludovic Courtès <ludo <at> gnu.org>
Cc: Leo Prikler <leo.prikler <at> student.tugraz.at>, 49083-done <at> debbugs.gnu.org
Subject: Re: bug#49083: ‘guix import pypi’ fails in the absence of “sdist”
 releases
Date: Wed, 02 Feb 2022 16:45:26 -0500
Hi,

Ludovic Courtès <ludo <at> gnu.org> writes:

> Hi!
>
> So for now I “fixed” it by displaying a hint in commit
> 00762a4c4c8ecdd71cccf6afdd87ae68bf9b4964.
>
> $ ./pre-inst-env guix import pypi jaxlib
> guix import: error: no source release for pypi package jaxlib 0.1.76
>
> hint: This indicates that the package is available on PyPI, but only as a "wheel" containing
> binaries, not source.  To build it from source, refer to the upstream repository at
> `https://github.com/google/jax'.

That's much clearer, thanks!

Maxim




bug archived. Request was from Debbugs Internal Request <help-debbugs <at> gnu.org> to internal_control <at> debbugs.gnu.org. (Thu, 03 Mar 2022 12:24:15 GMT) Full text and rfc822 format available.

This bug report was last modified 2 years and 26 days ago.

Previous Next


GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.