GNU bug report logs - #52906
python-biopython conflicts with python-numpy

Previous Next

Package: guix;

Reported by: zimoun <zimon.toutoune <at> gmail.com>

Date: Thu, 30 Dec 2021 21:24:02 UTC

Severity: normal

Done: Ricardo Wurmus <rekado <at> elephly.net>

Bug is archived. No further changes may be made.

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 52906 in the body.
You can then email your comments to 52906 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

View this report as an mbox folder, status mbox, maintainer mbox


Report forwarded to rekado <at> elephly.net, bug-guix <at> gnu.org:
bug#52906; Package guix. (Thu, 30 Dec 2021 21:24:02 GMT) Full text and rfc822 format available.

Acknowledgement sent to zimoun <zimon.toutoune <at> gmail.com>:
New bug report received and forwarded. Copy sent to rekado <at> elephly.net, bug-guix <at> gnu.org. (Thu, 30 Dec 2021 21:24:02 GMT) Full text and rfc822 format available.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: zimoun <zimon.toutoune <at> gmail.com>
To: Bug Guix <bug-guix <at> gnu.org>
Subject: python-biopython conflicts with python-numpy
Date: Thu, 30 Dec 2021 22:13:48 +0100
[Message part 1 (text/plain, inline)]
Hi,

Using 7022eb6, the package ’python-biopython’ propagates
’python-numpy’, i.e., python-numpy <at> 1.20.3.

However, because Guix installs by default the last version and:

--8<---------------cut here---------------start------------->8---
$ guix package -A | grep 'python-numpy ' | cut -f1,2
python-numpy        	1.21.3              
python-numpy        	1.20.3              
--8<---------------cut here---------------end--------------->8---

then this manifests.scm leads to an error,

--8<---------------cut here---------------start------------->8---
$ cat /tmp/manifest.scm
(specifications->manifest
 (list "python-numpy"
       "python-biopython"))

$ guix package -m /tmp/manifest.scm -p /tmp/fail
The following packages will be installed:
   python-biopython 1.76
   python-numpy     1.21.3

guix package: error: profile contains conflicting entries for python-numpy
guix package: error:   first entry: python-numpy <at> 1.21.3 /gnu/store/ggrkk9l67fjn1cj7alr8vx40xv08a6h0-python-numpy-1.21.3
guix package: error:   second entry: python-numpy <at> 1.20.3 /gnu/store/wgsmkn68q8h178sqc7ywjcdr330z9rb6-python-numpy-1.20.3
guix package: error:    ... propagated from python-biopython <at> 1.76
hint: Try upgrading both `python-numpy' and `python-biopython', or remove one of
them from the profile.
--8<---------------cut here---------------end--------------->8---

which is annoying.

I propose to refer as name “python-numpy” the symbol python-numpy which
leads to a consistent scientific Python stack.  And to refer as name
“python-numpy-next” the symbol python-numpy-next.

For instance, it is already the case for emacs-next or for the
Bioconductor package r-cistopic.

Doing so, adventurous people can use python-numpy-next (or recompile all
the scientific Python stack using it), or update it directly on master
(for testing say) without going to a core-update cycle.

WDYT?

Attached a proposed patch.

Cheers,
simon

[0001-gnu-Rename-last-python-numpy-as-python-numpy-next.patch (text/x-diff, inline)]
From 962d942ffcba7893ab15c30dc602e51462d9b09a Mon Sep 17 00:00:00 2001
From: zimoun <zimon.toutoune <at> gmail.com>
Date: Thu, 30 Dec 2021 22:04:49 +0100
Subject: [PATCH] gnu: Rename last 'python-numpy' as 'python-numpy-next'.

* gnu/packages/python-xyz.scm (python-numpy-next): Rename.
---
 gnu/packages/python-xyz.scm | 6 +++---
 1 file changed, 3 insertions(+), 3 deletions(-)

diff --git a/gnu/packages/python-xyz.scm b/gnu/packages/python-xyz.scm
index 7ca0b1668d..047bb4cbb8 100644
--- a/gnu/packages/python-xyz.scm
+++ b/gnu/packages/python-xyz.scm
@@ -5366,11 +5366,9 @@ (define-public python2-cython
                     ""))
                  #t)))))))))
 
-;; NOTE: when upgrading numpy please make sure that python-pandas and
-;; python-scipy still build, as these three packages are often used together.
 (define-public python-numpy-next
   (package
-    (name "python-numpy")
+    (name "python-numpy-next")
     (version "1.21.3")
     (source
      (origin
@@ -5481,6 +5479,8 @@ (define-public python-numpy-1.20
      (substitute-keyword-arguments (package-arguments python-numpy-next)
        ((#:tests? _ #t) #f)))))
 
+;; NOTE: when upgrading numpy please make sure that python-pandas and
+;; python-scipy still build, as these three packages are often used together.
 (define-public python-numpy python-numpy-1.20)
 
 ;; NOTE: NumPy 1.8 is packaged only for Python 2 because it is of

base-commit: 002442b2209b0953dd209e6219696a8758ceceb2
-- 
2.34.0


Information forwarded to bug-guix <at> gnu.org:
bug#52906; Package guix. (Thu, 30 Dec 2021 23:56:02 GMT) Full text and rfc822 format available.

Message #8 received at 52906 <at> debbugs.gnu.org (full text, mbox):

From: Leo Famulari <leo <at> famulari.name>
To: zimoun <zimon.toutoune <at> gmail.com>
Cc: Ricardo Wurmus <rekado <at> elephly.net>, 52906 <at> debbugs.gnu.org
Subject: Re: bug#52906: python-biopython conflicts with python-numpy
Date: Thu, 30 Dec 2021 18:55:19 -0500
On Thu, Dec 30, 2021 at 10:13:48PM +0100, zimoun wrote:
> $ guix package -m /tmp/manifest.scm -p /tmp/fail
> The following packages will be installed:
>    python-biopython 1.76
>    python-numpy     1.21.3
> 
> guix package: error: profile contains conflicting entries for python-numpy
> guix package: error:   first entry: python-numpy <at> 1.21.3 /gnu/store/ggrkk9l67fjn1cj7alr8vx40xv08a6h0-python-numpy-1.21.3
> guix package: error:   second entry: python-numpy <at> 1.20.3 /gnu/store/wgsmkn68q8h178sqc7ywjcdr330z9rb6-python-numpy-1.20.3
> guix package: error:    ... propagated from python-biopython <at> 1.76
> hint: Try upgrading both `python-numpy' and `python-biopython', or remove one of
> them from the profile.
> --8<---------------cut here---------------end--------------->8---

See also <https://issues.guix.gnu.org/52859>,
"tests/guix-pack-relocatable fails / numpy propagation collision".

> I propose to refer as name “python-numpy” the symbol python-numpy which
> leads to a consistent scientific Python stack.  And to refer as name
> “python-numpy-next” the symbol python-numpy-next.

Agreed, the stack should be kept consistent.




Information forwarded to bug-guix <at> gnu.org:
bug#52906; Package guix. (Fri, 31 Dec 2021 10:19:02 GMT) Full text and rfc822 format available.

Message #11 received at 52906 <at> debbugs.gnu.org (full text, mbox):

From: Ricardo Wurmus <rekado <at> elephly.net>
To: zimoun <zimon.toutoune <at> gmail.com>
Cc: debbugs-submit <at> debbugs.gnu.org, 52906 <at> debbugs.gnu.org
Subject: Re: bug#52906: python-biopython conflicts with python-numpy
Date: Fri, 31 Dec 2021 11:14:22 +0100
zimoun <zimon.toutoune <at> gmail.com> writes:

> Hi,
>
> Using 7022eb6, the package ’python-biopython’ propagates
> ’python-numpy’, i.e., python-numpy <at> 1.20.

Back then we reverted to numpy 1.20.x as the default because of numba,
which did not work with 1.21.  I’m now upgrading numba (and llvmlite) to
a more recent release candidate, which should bring compatibility with
numpy 1.21.

If that works we’ll make python-numpy-next the new python-numpy.

Your patch is an acceptable workaround.  Arguably this should have been
done when I made numpy 1.20 the default on the core-updates-frozen
branch.  I’ll apply your patch later today unless the switch to numpy
1.21 as the default is successful.

-- 
Ricardo




Information forwarded to bug-guix <at> gnu.org:
bug#52906; Package guix. (Fri, 31 Dec 2021 10:52:01 GMT) Full text and rfc822 format available.

Message #14 received at 52906 <at> debbugs.gnu.org (full text, mbox):

From: zimoun <zimon.toutoune <at> gmail.com>
To: Ricardo Wurmus <rekado <at> elephly.net>
Cc: debbugs-submit <at> debbugs.gnu.org, 52906 <at> debbugs.gnu.org
Subject: Re: bug#52906: python-biopython conflicts with python-numpy
Date: Fri, 31 Dec 2021 11:51:34 +0100
Hi Ricardo,

On Fri, 31 Dec 2021 at 11:18, Ricardo Wurmus <rekado <at> elephly.net> wrote:
> zimoun <zimon.toutoune <at> gmail.com> writes:

> Back then we reverted to numpy 1.20.x as the default because of numba,
> which did not work with 1.21.  I’m now upgrading numba (and llvmlite) to
> a more recent release candidate, which should bring compatibility with
> numpy 1.21.
>
> If that works we’ll make python-numpy-next the new python-numpy.

I think that it could nice to have "python-numpy-next".  Now, because
we are right after a core-updates, the last Numpy version and the one
we use as scientific Python stack are really close.  But it will not
necessary the case between 2 core-updates merges.  Well, my point is
to have the core-updates package python-numpy used by all the
scientific Python stack and the leaf package python-numpy-next where
updates can happen on master, it can be used with transformations
etc., especially by scientific Python developper.


Cheers,
simon




Information forwarded to bug-guix <at> gnu.org:
bug#52906; Package guix. (Fri, 31 Dec 2021 12:45:01 GMT) Full text and rfc822 format available.

Message #17 received at 52906 <at> debbugs.gnu.org (full text, mbox):

From: Ricardo Wurmus <rekado <at> elephly.net>
To: zimoun <zimon.toutoune <at> gmail.com>
Cc: debbugs-submit <at> debbugs.gnu.org, 52906 <at> debbugs.gnu.org
Subject: Re: bug#52906: python-biopython conflicts with python-numpy
Date: Fri, 31 Dec 2021 13:43:13 +0100
zimoun <zimon.toutoune <at> gmail.com> writes:

> Hi Ricardo,
>
> On Fri, 31 Dec 2021 at 11:18, Ricardo Wurmus <rekado <at> elephly.net> wrote:
>> zimoun <zimon.toutoune <at> gmail.com> writes:
>
>> Back then we reverted to numpy 1.20.x as the default because of numba,
>> which did not work with 1.21.  I’m now upgrading numba (and llvmlite) to
>> a more recent release candidate, which should bring compatibility with
>> numpy 1.21.
>>
>> If that works we’ll make python-numpy-next the new python-numpy.
>
> I think that it could nice to have "python-numpy-next".  Now, because
> we are right after a core-updates, the last Numpy version and the one
> we use as scientific Python stack are really close.  But it will not
> necessary the case between 2 core-updates merges.  Well, my point is
> to have the core-updates package python-numpy used by all the
> scientific Python stack and the leaf package python-numpy-next where
> updates can happen on master, it can be used with transformations
> etc., especially by scientific Python developper.

Yes, it’s a good idea to have it anyway.

I just realized that switching over to the new numpy is going to cause
more than a 1000 rebuilds.  So I’ll apply your patch on the master
branch and build out the numpy upgrade on a separate branch.

Thank you!

-- 
Ricardo




Reply sent to Ricardo Wurmus <rekado <at> elephly.net>:
You have taken responsibility. (Fri, 31 Dec 2021 12:52:01 GMT) Full text and rfc822 format available.

Notification sent to zimoun <zimon.toutoune <at> gmail.com>:
bug acknowledged by developer. (Fri, 31 Dec 2021 12:52:01 GMT) Full text and rfc822 format available.

Message #22 received at 52906-done <at> debbugs.gnu.org (full text, mbox):

From: Ricardo Wurmus <rekado <at> elephly.net>
To: zimoun <zimon.toutoune <at> gmail.com>
Cc: 52906-done <at> debbugs.gnu.org
Subject: Re: bug#52906: python-biopython conflicts with python-numpy
Date: Fri, 31 Dec 2021 13:50:21 +0100
zimoun <zimon.toutoune <at> gmail.com> writes:

> Attached a proposed patch.

I applied it with a small change: I also had to override the name as
“python-numpy” in the derived packages.

Thanks!

-- 
Ricardo




Information forwarded to bug-guix <at> gnu.org:
bug#52906; Package guix. (Fri, 31 Dec 2021 13:17:02 GMT) Full text and rfc822 format available.

Message #25 received at 52906 <at> debbugs.gnu.org (full text, mbox):

From: zimoun <zimon.toutoune <at> gmail.com>
To: Ricardo Wurmus <rekado <at> elephly.net>
Cc: debbugs-submit <at> debbugs.gnu.org, 52906 <at> debbugs.gnu.org
Subject: Re: bug#52906: python-biopython conflicts with python-numpy
Date: Fri, 31 Dec 2021 14:16:40 +0100
Hi,

On Fri, 31 Dec 2021 at 13:44, Ricardo Wurmus <rekado <at> elephly.net> wrote:

> I just realized that switching over to the new numpy is going to cause
> more than a 1000 rebuilds.  So I’ll apply your patch on the master
> branch and build out the numpy upgrade on a separate branch.

Thanks!  A separate wip-* branch?


Cheers,
simon




Information forwarded to bug-guix <at> gnu.org:
bug#52906; Package guix. (Fri, 31 Dec 2021 20:20:02 GMT) Full text and rfc822 format available.

Message #28 received at 52906 <at> debbugs.gnu.org (full text, mbox):

From: Ricardo Wurmus <rekado <at> elephly.net>
To: zimoun <zimon.toutoune <at> gmail.com>
Cc: debbugs-submit <at> debbugs.gnu.org, 52906 <at> debbugs.gnu.org
Subject: Re: bug#52906: python-biopython conflicts with python-numpy
Date: Fri, 31 Dec 2021 21:18:43 +0100
zimoun <zimon.toutoune <at> gmail.com> writes:

> Hi,
>
> On Fri, 31 Dec 2021 at 13:44, Ricardo Wurmus <rekado <at> elephly.net> wrote:
>
>> I just realized that switching over to the new numpy is going to cause
>> more than a 1000 rebuilds.  So I’ll apply your patch on the master
>> branch and build out the numpy upgrade on a separate branch.
>
> Thanks!  A separate wip-* branch?

Yes, I wanted to build this out on wip-upgrade-numpy or something
similar.  I’d like to avoid entangling this with other upgrades on a
core-updates or staging branch.

-- 
Ricardo




bug archived. Request was from Debbugs Internal Request <help-debbugs <at> gnu.org> to internal_control <at> debbugs.gnu.org. (Sat, 29 Jan 2022 12:24:04 GMT) Full text and rfc822 format available.

This bug report was last modified 2 years and 59 days ago.

Previous Next


GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.