GNU bug report logs - #22122
{python,python2}-statsmodels on i686: "SVD did not converge"

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: guix; Reported by: Mark H Weaver <mhw@HIDDEN>; dated Thu, 10 Dec 2015 01:02:02 UTC; Maintainer for guix is bug-guix@HIDDEN.

Message received at 22122 <at> debbugs.gnu.org:


Received: (at 22122) by debbugs.gnu.org; 30 Aug 2017 08:55:27 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed Aug 30 04:55:27 2017
Received: from localhost ([127.0.0.1]:33290 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1dmymU-0004lb-Sb
	for submit <at> debbugs.gnu.org; Wed, 30 Aug 2017 04:55:27 -0400
Received: from eggs.gnu.org ([208.118.235.92]:51066)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <ludo@HIDDEN>) id 1dmymT-0004lN-1u
 for 22122 <at> debbugs.gnu.org; Wed, 30 Aug 2017 04:55:25 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <ludo@HIDDEN>) id 1dmymK-0004tg-R5
 for 22122 <at> debbugs.gnu.org; Wed, 30 Aug 2017 04:55:20 -0400
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org
X-Spam-Level: 
X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,RP_MATCHES_RCVD
 autolearn=disabled version=3.3.2
Received: from fencepost.gnu.org ([2001:4830:134:3::e]:33282)
 by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from <ludo@HIDDEN>)
 id 1dmymK-0004tb-Mk; Wed, 30 Aug 2017 04:55:16 -0400
Received: from [193.50.110.251] (port=48194 helo=ribbon)
 by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256)
 (Exim 4.82) (envelope-from <ludo@HIDDEN>)
 id 1dmymJ-0003ET-OY; Wed, 30 Aug 2017 04:55:16 -0400
From: ludo@HIDDEN (Ludovic =?utf-8?Q?Court=C3=A8s?=)
To: Mark H Weaver <mhw@HIDDEN>
Subject: Re: bug#22122: {python,
 python2}-statsmodels on i686: "SVD did not converge"
References: <87h9jreflp.fsf@HIDDEN> <87378chwd3.fsf@HIDDEN>
X-URL: http://www.fdn.fr/~lcourtes/
X-Revolutionary-Date: 13 Fructidor an 225 de la =?utf-8?Q?R=C3=A9volution?=
X-PGP-Key-ID: 0x090B11993D9AEBB5
X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc
X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4  0CFB 090B 1199 3D9A EBB5
X-OS: x86_64-unknown-linux-gnu
Date: Wed, 30 Aug 2017 10:55:14 +0200
In-Reply-To: <87378chwd3.fsf@HIDDEN> (Mark H. Weaver's message of "Mon, 28
 Aug 2017 05:31:20 -0400")
Message-ID: <87efrt77v1.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.2 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic]
X-Received-From: 2001:4830:134:3::e
X-Spam-Score: -5.0 (-----)
X-Debbugs-Envelope-To: 22122
Cc: 22122 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -5.0 (-----)

Mark H Weaver <mhw@HIDDEN> skribis:

> I analyzed Hydra's database, and discovered that these "SVD did not
> converge" test failures on i686 depend only on which machine attempts
> the build, and are otherwise deterministic.
>
> hydra.gnunet.org fails 100% of the time.  It has *never* passed this
> test on i686.  chapters.gnu.org also fails 100% of the time.
>
> guix.sjd.se consistently passes the test, since at least as far back as
> July 2016.

Weird.  Could it be that something in the stack uses ISA extensions?
(What could it be on i686?)

Ludo=E2=80=99.




Information forwarded to bug-guix@HIDDEN:
bug#22122; Package guix. Full text available.

Message received at 22122 <at> debbugs.gnu.org:


Received: (at 22122) by debbugs.gnu.org; 28 Aug 2017 09:31:49 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Aug 28 05:31:49 2017
Received: from localhost ([127.0.0.1]:58648 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1dmGOb-0003hx-6P
	for submit <at> debbugs.gnu.org; Mon, 28 Aug 2017 05:31:49 -0400
Received: from world.peace.net ([50.252.239.5]:42595)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <mhw@HIDDEN>) id 1dmGOY-0003hj-Cl
 for 22122 <at> debbugs.gnu.org; Mon, 28 Aug 2017 05:31:47 -0400
Received: from pool-72-93-33-39.bstnma.east.verizon.net ([72.93.33.39]
 helo=jojen)
 by world.peace.net with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.84_2) (envelope-from <mhw@HIDDEN>)
 id 1dmGOR-0001XR-FL; Mon, 28 Aug 2017 05:31:39 -0400
From: Mark H Weaver <mhw@HIDDEN>
To: 22122 <at> debbugs.gnu.org
Subject: Re: {python,python2}-statsmodels on i686: "SVD did not converge"
Date: Mon, 28 Aug 2017 05:31:20 -0400
Message-ID: <87378chwd3.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 22122
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: 0.0 (/)

I analyzed Hydra's database, and discovered that these "SVD did not
converge" test failures on i686 depend only on which machine attempts
the build, and are otherwise deterministic.

hydra.gnunet.org fails 100% of the time.  It has *never* passed this
test on i686.  chapters.gnu.org also fails 100% of the time.

guix.sjd.se consistently passes the test, since at least as far back as
July 2016.

       Mark




Information forwarded to bug-guix@HIDDEN:
bug#22122; Package guix. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 10 Dec 2015 01:02:00 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed Dec 09 20:02:00 2015
Received: from localhost ([127.0.0.1]:38252 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1a6pcE-0007c0-R2
	for submit <at> debbugs.gnu.org; Wed, 09 Dec 2015 20:02:00 -0500
Received: from eggs.gnu.org ([208.118.235.92]:50505)
 by debbugs.gnu.org with esmtp (Exim 4.84)
 (envelope-from <mhw@HIDDEN>) id 1a6pcA-0007ZB-HT
 for submit <at> debbugs.gnu.org; Wed, 09 Dec 2015 20:01:46 -0500
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <mhw@HIDDEN>) id 1a6hrW-0002m5-8r
 for submit <at> debbugs.gnu.org; Wed, 09 Dec 2015 11:45:07 -0500
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org
X-Spam-Level: 
X-Spam-Status: No, score=0.8 required=5.0 tests=BAYES_50 autolearn=disabled
 version=3.3.2
Received: from lists.gnu.org ([2001:4830:134:3::11]:53054)
 by eggs.gnu.org with esmtp (Exim 4.71)
 (envelope-from <mhw@HIDDEN>) id 1a6hrW-0002lx-6A
 for submit <at> debbugs.gnu.org; Wed, 09 Dec 2015 11:45:06 -0500
Received: from eggs.gnu.org ([2001:4830:134:3::10]:50895)
 by lists.gnu.org with esmtp (Exim 4.71)
 (envelope-from <mhw@HIDDEN>) id 1a6hrU-0004Li-Sc
 for bug-guix@HIDDEN; Wed, 09 Dec 2015 11:45:06 -0500
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <mhw@HIDDEN>) id 1a6hrR-0002iT-HI
 for bug-guix@HIDDEN; Wed, 09 Dec 2015 11:45:04 -0500
Received: from world.peace.net ([50.252.239.5]:57419)
 by eggs.gnu.org with esmtp (Exim 4.71)
 (envelope-from <mhw@HIDDEN>) id 1a6hrR-0002iP-Ea
 for bug-guix@HIDDEN; Wed, 09 Dec 2015 11:45:01 -0500
Received: from [10.1.10.78] (helo=jojen)
 by world.peace.net with esmtpsa (TLS1.0:RSA_AES_128_CBC_SHA1:16)
 (Exim 4.72) (envelope-from <mhw@HIDDEN>)
 id 1a6hrH-0007FB-JW; Wed, 09 Dec 2015 11:44:51 -0500
From: Mark H Weaver <mhw@HIDDEN>
To: bug-guix@HIDDEN
Subject: {python,python2}-statsmodels on i686: "SVD did not converge"
Date: Wed, 09 Dec 2015 11:44:50 -0500
Message-ID: <87h9jreflp.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x
X-Received-From: 2001:4830:134:3::11
X-Spam-Score: -5.0 (-----)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: 0.0 (/)

Both python-statsmodels and python2-statsmodels sometimes fail on i686
during the "statsmodels.tsa.tests.test_arima.test_start_params_bug" test
with the error "LinAlgError: SVD did not converge".  Here's an excerpt
of one such error:

--8<---------------cut here---------------start------------->8---
statsmodels.tsa.tests.test_arima.test_compare_arma ... ok
statsmodels.tsa.tests.test_arima.test_reset_trend ... ok
statsmodels.tsa.tests.test_arima.test_start_params_bug ... ERROR

======================================================================
ERROR: statsmodels.tsa.tests.test_arima.test_start_params_bug
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/gnu/store/vp0l7cx9j7gzrd2kr0iass3nzvlc5yq3-python-nose-1.3.4/lib/python3.4/site-packages/nose-1.3.4-py3.4.egg/nose/case.py", line 198, in runTest
    self.test(*self.arg)
  File "/gnu/store/ny8ihp8q2wkffg978wwrzphxgr3s8xj5-python-statsmodels-0.6.1/lib/python3.4/site-packages/statsmodels-0.6.1-py3.4-linux-i686.egg/statsmodels/tsa/tests/test_arima.py", line 535, in test_start_params_bug
    res = ARMA(data, order=(4,1)).fit(disp=-1)
  File "/gnu/store/ny8ihp8q2wkffg978wwrzphxgr3s8xj5-python-statsmodels-0.6.1/lib/python3.4/site-packages/statsmodels-0.6.1-py3.4-linux-i686.egg/statsmodels/tsa/arima_model.py", line 932, in fit
    callback=callback, **kwargs)
  File "/gnu/store/ny8ihp8q2wkffg978wwrzphxgr3s8xj5-python-statsmodels-0.6.1/lib/python3.4/site-packages/statsmodels-0.6.1-py3.4-linux-i686.egg/statsmodels/base/model.py", line 425, in fit
    full_output=full_output)
  File "/gnu/store/ny8ihp8q2wkffg978wwrzphxgr3s8xj5-python-statsmodels-0.6.1/lib/python3.4/site-packages/statsmodels-0.6.1-py3.4-linux-i686.egg/statsmodels/base/optimizer.py", line 184, in _fit
    hess=hessian)
  File "/gnu/store/ny8ihp8q2wkffg978wwrzphxgr3s8xj5-python-statsmodels-0.6.1/lib/python3.4/site-packages/statsmodels-0.6.1-py3.4-linux-i686.egg/statsmodels/base/optimizer.py", line 382, in _fit_lbfgs
    **extra_kwargs)
  File "/gnu/store/1bx2plf9pmhrfvgb2d36321hr9grh2vg-python-scipy-0.16.0/lib/python3.4/site-packages/scipy/optimize/lbfgsb.py", line 188, in fmin_l_bfgs_b
    **opts)
  File "/gnu/store/1bx2plf9pmhrfvgb2d36321hr9grh2vg-python-scipy-0.16.0/lib/python3.4/site-packages/scipy/optimize/lbfgsb.py", line 320, in _minimize_lbfgsb
    f, g = func_and_grad(x)
  File "/gnu/store/1bx2plf9pmhrfvgb2d36321hr9grh2vg-python-scipy-0.16.0/lib/python3.4/site-packages/scipy/optimize/lbfgsb.py", line 266, in func_and_grad
    f = fun(x, *args)
  File "/gnu/store/1bx2plf9pmhrfvgb2d36321hr9grh2vg-python-scipy-0.16.0/lib/python3.4/site-packages/scipy/optimize/optimize.py", line 285, in function_wrapper
    return function(*(wrapper_args + args))
  File "/gnu/store/ny8ihp8q2wkffg978wwrzphxgr3s8xj5-python-statsmodels-0.6.1/lib/python3.4/site-packages/statsmodels-0.6.1-py3.4-linux-i686.egg/statsmodels/base/model.py", line 403, in <lambda>
    f = lambda params, *args: -self.loglike(params, *args) / nobs
  File "/gnu/store/ny8ihp8q2wkffg978wwrzphxgr3s8xj5-python-statsmodels-0.6.1/lib/python3.4/site-packages/statsmodels-0.6.1-py3.4-linux-i686.egg/statsmodels/tsa/arima_model.py", line 761, in loglike
    return self.loglike_kalman(params, set_sigma2)
  File "/gnu/store/ny8ihp8q2wkffg978wwrzphxgr3s8xj5-python-statsmodels-0.6.1/lib/python3.4/site-packages/statsmodels-0.6.1-py3.4-linux-i686.egg/statsmodels/tsa/arima_model.py", line 771, in loglike_kalman
    return KalmanFilter.loglike(params, self, set_sigma2)
  File "/gnu/store/ny8ihp8q2wkffg978wwrzphxgr3s8xj5-python-statsmodels-0.6.1/lib/python3.4/site-packages/statsmodels-0.6.1-py3.4-linux-i686.egg/statsmodels/tsa/kalmanf/kalmanfilter.py", line 649, in loglike
    R_mat, T_mat)
  File "statsmodels/tsa/kalmanf/kalman_loglike.pyx", line 342, in statsmodels.tsa.kalmanf.kalman_loglike.kalman_loglike_double (statsmodels/tsa/kalmanf/kalman_loglike.c:5245)
  File "statsmodels/tsa/kalmanf/kalman_loglike.pyx", line 74, in statsmodels.tsa.kalmanf.kalman_loglike.kalman_filter_double (statsmodels/tsa/kalmanf/kalman_loglike.c:2572)
  File "/gnu/store/mc60m1v7d0m7qdfsmhwf2k1qadhkdggm-python-numpy-1.9.1/lib/python3.4/site-packages/numpy/linalg/linalg.py", line 1585, in pinv
    u, s, vt = svd(a, 0)
  File "/gnu/store/mc60m1v7d0m7qdfsmhwf2k1qadhkdggm-python-numpy-1.9.1/lib/python3.4/site-packages/numpy/linalg/linalg.py", line 1327, in svd
    u, s, vt = gufunc(a, signature=signature, extobj=extobj)
  File "/gnu/store/mc60m1v7d0m7qdfsmhwf2k1qadhkdggm-python-numpy-1.9.1/lib/python3.4/site-packages/numpy/linalg/linalg.py", line 99, in _raise_linalgerror_svd_nonconvergence
    raise LinAlgError("SVD did not converge")
numpy.linalg.linalg.LinAlgError: SVD did not converge

----------------------------------------------------------------------
Ran 3206 tests in 468.902s

FAILED (SKIP=24, errors=1)
phase `check' failed after 498.0 seconds
--8<---------------cut here---------------end--------------->8---

      Mark




Acknowledgement sent to Mark H Weaver <mhw@HIDDEN>:
New bug report received and forwarded. Copy sent to bug-guix@HIDDEN. Full text available.
Report forwarded to bug-guix@HIDDEN:
bug#22122; Package guix. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Wed, 30 Aug 2017 09:00:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.