Received: (at 63986) by debbugs.gnu.org; 20 Sep 2023 15:58:52 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed Sep 20 11:58:52 2023
Received: from localhost ([127.0.0.1]:60208 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1qizbH-0000VX-Dy
for submit <at> debbugs.gnu.org; Wed, 20 Sep 2023 11:58:51 -0400
Received: from mail-wm1-x32b.google.com ([2a00:1450:4864:20::32b]:41066)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <zimon.toutoune@HIDDEN>) id 1qizb9-0000Ul-Bg
for 63986 <at> debbugs.gnu.org; Wed, 20 Sep 2023 11:58:47 -0400
Received: by mail-wm1-x32b.google.com with SMTP id
5b1f17b1804b1-40506bfca64so12732185e9.0
for <63986 <at> debbugs.gnu.org>; Wed, 20 Sep 2023 08:58:33 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=20230601; t=1695225508; x=1695830308; darn=debbugs.gnu.org;
h=content-transfer-encoding:mime-version:message-id:date:references
:in-reply-to:subject:cc:to:from:from:to:cc:subject:date:message-id
:reply-to; bh=KdKHgw1fuF/Od1Oa00nBEm1STMJGhrvR3RwKbCJ0xwA=;
b=HPtF3v1yaFeIC397Ppo5YN92lr4IQss9koXgEQrum3zrzk/NOAvIiXfwDy49uxt13Y
e1+URTKODgUj9D2hnmMkNznBIRCoew02GLEITgi+OYVn4CQn1WfdUO+OfHImQiJ8XnHd
umj4BayQCwaPntEH4Ocm4B0r5VdAuH6Qut1/aNEJnDJ4ly/ZNQMed7BOq+thzBPyvEDV
XzgyeBfMU8zMun8++6m5dohzChiy+EEAw0ADwyg0HtSpW9G8iJ7XZeH8cr5ST/sksSxo
+KMPrfZFS7/VCFWR9zr7jRhAFsGMj+wNG4WyZQv03XxQOKybAsHqZ1kYIVevQqys5j9O
QROw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20230601; t=1695225508; x=1695830308;
h=content-transfer-encoding:mime-version:message-id:date:references
:in-reply-to:subject:cc:to:from:x-gm-message-state:from:to:cc
:subject:date:message-id:reply-to;
bh=KdKHgw1fuF/Od1Oa00nBEm1STMJGhrvR3RwKbCJ0xwA=;
b=aK4Amj+aR2HqerOEHCwyMlyZ0ohlRoRv1UTtU45BDgb49mDMOT7uWwSTkYmaZnr4VC
mZA/KEskOMDh/DhyDuyBExqu6zgDXuWLbZLr9T59T+v3rDwBD/2XV4Iz1wJSkxPjHsSY
gMSXwgWg90D9lh2EeEQDI4GzSPkAjtv51UpKyIfo1VWHC43K2Glr40+V50YWA0sJfUPS
V1aA6GqQwF7EYEnpfnzJDzKF6BZFGT45jHqcd9J6WhbCnSy6aphpdkRO03+f3cbays+r
7Xqb46qXH23qCysb/MxNTBKzp0q76kOyHr92zwf/zsfHhbWsYCVpc2uq24DzwzaMF37s
WsHg==
X-Gm-Message-State: AOJu0YynceUT6saQm4PIESFiAhL8vOm2+jR6l7051TjX5Hup1FhrnoC6
/nOzdCFo8vnEJL5th7lUl48=
X-Google-Smtp-Source: AGHT+IFqWLROhOo67U+f51S5voULybbyMkPiCN4C5gV7Sopym5IsBwSuV06oiYWor0Lsf7DTq7ZjiQ==
X-Received: by 2002:a05:600c:1d20:b0:403:334:fb0d with SMTP id
l32-20020a05600c1d2000b004030334fb0dmr2819712wms.4.1695225508091;
Wed, 20 Sep 2023 08:58:28 -0700 (PDT)
Received: from pfiuh07 ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id
u12-20020a05600c210c00b00403bbe69629sm2299192wml.31.2023.09.20.08.58.25
(version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
Wed, 20 Sep 2023 08:58:27 -0700 (PDT)
From: Simon Tournier <zimon.toutoune@HIDDEN>
To: Efraim Flashner <efraim@HIDDEN>, Ludovic =?utf-8?Q?Court=C3=A8?=
=?utf-8?Q?s?= <ludo@HIDDEN>
Subject: Re: bug#63986: Julia is very slow
In-Reply-To: <ZQLhcr_Y21H1XiYL@3900XT>
References: <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN>
<ZJR14QoB4SoqhsrP@3900XT> <87cz1n8lq3.fsf@HIDDEN>
<871qi24k9z.fsf@HIDDEN> <ZJVi0Wwg5aRq_XxJ@3900XT>
<87h6qy71oa.fsf@HIDDEN> <ZJWpKhkhHiMMzHST@3900XT>
<87o7kpku0u.fsf@HIDDEN> <87jztpqvtz.fsf@HIDDEN>
<ZQLhcr_Y21H1XiYL@3900XT>
Date: Wed, 20 Sep 2023 17:57:30 +0200
Message-ID: <87y1h096s5.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 63986
Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>,
csantosb@HIDDEN
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)
Hi Efraim,
Applying the patch is done in v3 of #66030.
https://issues.guix.gnu.org/issue/66030
and QA processed all.
https://qa.guix.gnu.org/issue/66030/
It is almost good except one strong annoyance [1]@
--8<---------------cut here---------------start------------->8---
Singular value decomposition | 57 57 5.0s
Hermitian: Error During Test at /gnu/store/zkx6p7kz3m5k5w5iy0l1d09b2n8b0ib3=
-julia-genericlinearalgebra-0.2.5/share/julia/loadpath/GenericLinearAlgebra=
/test/rectfullpacked.jl:12
Got exception outside of a @test
could not load symbol "dsfrk_64_":
/gnu/store/h5mgc7ar7a05f9rwrd1makhzays5wd3s-julia-1.8.3/bin/../lib/julia/=
liblapack.so: undefined symbol: dsfrk_64_
Stacktrace:
[1] sfrk!(transr::Char, uplo::Char, trans::Char, alpha::Float64, A::Mat=
rix{Float64}, beta::Float64, C::Vector{Float64})
@ GenericLinearAlgebra.LAPACK2 /gnu/store/zkx6p7kz3m5k5w5iy0l1d09b2n8=
b0ib3-julia-genericlinearalgebra-0.2.5/share/julia/loadpath/GenericLinearAl=
gebra/src/lapack.jl:523
[2] Ac_mul_A_RFP(A::Matrix{Float64}, uplo::Symbol)
@ GenericLinearAlgebra /gnu/store/zkx6p7kz3m5k5w5iy0l1d09b2n8b0ib3-ju=
lia-genericlinearalgebra-0.2.5/share/julia/loadpath/GenericLinearAlgebra/sr=
c/rectfullpacked.jl:77
[3] macro expansion
@ /gnu/store/zkx6p7kz3m5k5w5iy0l1d09b2n8b0ib3-julia-genericlinearalge=
bra-0.2.5/share/julia/loadpath/GenericLinearAlgebra/test/rectfullpacked.jl:=
13 [inlined]
[4] macro expansion
@ /gnu/store/h5mgc7ar7a05f9rwrd1makhzays5wd3s-julia-1.8.3/share/julia=
/stdlib/v1.8/Test/src/Test.jl:1360 [inlined]
[5] macro expansion
@ /gnu/store/zkx6p7kz3m5k5w5iy0l1d09b2n8b0ib3-julia-genericlinearalge=
bra-0.2.5/share/julia/loadpath/GenericLinearAlgebra/test/rectfullpacked.jl:=
13 [inlined]
[6] macro expansion
@ /gnu/store/h5mgc7ar7a05f9rwrd1makhzays5wd3s-julia-1.8.3/share/julia=
/stdlib/v1.8/Test/src/Test.jl:1436 [inlined]
[7] macro expansion
@ /gnu/store/zkx6p7kz3m5k5w5iy0l1d09b2n8b0ib3-julia-genericlinearalge=
bra-0.2.5/share/julia/loadpath/GenericLinearAlgebra/test/rectfullpacked.jl:=
7 [inlined]
[8] macro expansion
@ /gnu/store/h5mgc7ar7a05f9rwrd1makhzays5wd3s-julia-1.8.3/share/julia=
/stdlib/v1.8/Test/src/Test.jl:1360 [inlined]
[9] top-level scope
@ /gnu/store/zkx6p7kz3m5k5w5iy0l1d09b2n8b0ib3-julia-genericlinearalge=
bra-0.2.5/share/julia/loadpath/GenericLinearAlgebra/test/rectfullpacked.jl:7
[10] include(fname::String)
@ Base.MainInclude ./client.jl:476
[11] top-level scope
@ /gnu/store/zkx6p7kz3m5k5w5iy0l1d09b2n8b0ib3-julia-genericlinearalge=
bra-0.2.5/share/julia/loadpath/GenericLinearAlgebra/test/runtests.jl:10
[12] include(mod::Module, _path::String)
@ Base ./Base.jl:419
[13] exec_options(opts::Base.JLOptions)
@ Base ./client.jl:303
[14] _start()
@ Base ./client.jl:522
--8<---------------cut here---------------end--------------->8---
Any idea? I have no idea and it is blocking the merge because ~20
packages are then broken. Well, if we have no idea, I will push the fix
for =E2=80=9CJulia is slow=E2=80=9D and we will fix later these ~20 failure=
s. WDYT?
Cheers,
simon
1: https://bordeaux.guix.gnu.org/build/30e3aaec-dbde-423b-9554-67a64881e0cf=
/log
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.
Received: (at 63986) by debbugs.gnu.org; 16 Sep 2023 11:19:04 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sat Sep 16 07:19:03 2023
Received: from localhost ([127.0.0.1]:45566 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1qhTKJ-0008HD-MH
for submit <at> debbugs.gnu.org; Sat, 16 Sep 2023 07:19:03 -0400
Received: from mail-wm1-x333.google.com ([2a00:1450:4864:20::333]:37904)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <zimon.toutoune@HIDDEN>) id 1qhTKF-0008Gg-Sx
for 63986 <at> debbugs.gnu.org; Sat, 16 Sep 2023 07:19:02 -0400
Received: by mail-wm1-x333.google.com with SMTP id
5b1f17b1804b1-40472fef044so6179665e9.0
for <63986 <at> debbugs.gnu.org>; Sat, 16 Sep 2023 04:18:52 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=20230601; t=1694863127; x=1695467927; darn=debbugs.gnu.org;
h=mime-version:message-id:date:references:in-reply-to:subject:cc:to
:from:from:to:cc:subject:date:message-id:reply-to;
bh=Zc5M8D8jT4kwluUsuR9os3pOaS1vxSQYOMUTVCLh9Qc=;
b=l68CvQNWWBeAcJP3rx0thoPBJ9hfVQxzYeQ9Wt15NUpsog+17zPspyVhNiVM7MibSz
QfZ4Ql73dahAlJWTloUfMnIlPCsOtAuX3ENqg+7yRbYcdX/wRhJc++xVf2LkTg3OM0Yu
MYKJhjrILaULJw7oz91KpK4GZ7jhrWRjBRh9WNR00bbIoTkNTPKb440jDcCp2FujUYf1
/Q6PrbBKH75RnZ/Sq6TGEIQ6Oq9zdJQ+zafmRhIHvunFEVenWd/HMzZJ4gbPRXykqnKR
daI4LNeR625aJB9MidSfrvUzXTN8RLLEk0bpZ4WdXvLJB8crLu87M5CVSOl1HjtIce//
UXSw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20230601; t=1694863127; x=1695467927;
h=mime-version:message-id:date:references:in-reply-to:subject:cc:to
:from:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to;
bh=Zc5M8D8jT4kwluUsuR9os3pOaS1vxSQYOMUTVCLh9Qc=;
b=HcSbtgcg2amco6R35svyHACpfa3Q2GAfSjDuE9/NVZ1e+Xu8G66R/jRtqtVAeCZzns
xVdMUxjqBgeWM73dyC/29i45AehOv2WqGlxDwmGLfgFMWqyySVjFXsV7RA8rkt6EGzi4
PAdjex1SjcareC/W71VWRx0BUEcTE9kCqFt/c+qc3U+tzWAwVT+Ftg4IT/K+yR9EiIA/
VxbDZFQlX1jP4g4g1NSm6q0cn2tgfS+X4ZwN9XxlcM1ONcWbkVsB51oDaztKALHbGsBJ
Y5QA3ZJN8LIYlPYrxDmbMryoMq8H8OAbM0jejWVp9cSt/UlIqi0S+wFRsOXr4c92Kqry
FxAg==
X-Gm-Message-State: AOJu0Yz+iFjEwUhV+lXzpq2l65UBZG3x3TpvDwAXHP/s8Qmh3L3AmU3G
+s5Wp0IIqVNTAARHSPjPvQzQfn4gvTg=
X-Google-Smtp-Source: AGHT+IHkdYG04csJVra0FLrK0S8s96SENtBk3OCjMCdQ+vjPEGN/3yieUQAI9tiyypCtp+j0sgcErQ==
X-Received: by 2002:a05:600c:1c0e:b0:401:7d3b:cc84 with SMTP id
j14-20020a05600c1c0e00b004017d3bcc84mr3635905wms.0.1694863126598;
Sat, 16 Sep 2023 04:18:46 -0700 (PDT)
Received: from pfiuh07 ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id
t11-20020a1c770b000000b003fc04d13242sm9909281wmi.0.2023.09.16.04.18.46
(version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
Sat, 16 Sep 2023 04:18:46 -0700 (PDT)
From: Simon Tournier <zimon.toutoune@HIDDEN>
To: Efraim Flashner <efraim@HIDDEN>, Ludovic =?utf-8?Q?Court=C3=A8?=
=?utf-8?Q?s?= <ludo@HIDDEN>
Subject: Re: bug#63986: Julia is very slow
In-Reply-To: <87v8ca8ke3.fsf@HIDDEN>
References: <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN>
<ZJR14QoB4SoqhsrP@3900XT> <87cz1n8lq3.fsf@HIDDEN>
<871qi24k9z.fsf@HIDDEN> <ZJVi0Wwg5aRq_XxJ@3900XT>
<87h6qy71oa.fsf@HIDDEN> <ZJWpKhkhHiMMzHST@3900XT>
<87o7kpku0u.fsf@HIDDEN> <87jztpqvtz.fsf@HIDDEN>
<ZQLhcr_Y21H1XiYL@3900XT> <87v8ca8ke3.fsf@HIDDEN>
Date: Sat, 16 Sep 2023 13:18:44 +0200
Message-ID: <87o7i28iy3.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 63986
Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>,
csantosb@HIDDEN
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)
Hi,
On Sat, 16 Sep 2023 at 12:47, Simon Tournier <zimon.toutoune@HIDDEN> wrote:
> I have applied the diff and turned into two patches. Attached below.
> Then, I have sent the cover-letter to guix-patches where you are CC.
> The idea was to trigger the Julia world rebuild. However, I do not get
> back any Debbugs ID for sending the two patches.
Now tacked by #66030. And progress here:
https://qa.guix.gnu.org/issue/66030
Cheers,
simon
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.Received: (at 63986) by debbugs.gnu.org; 16 Sep 2023 11:04:06 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Sat Sep 16 07:04:06 2023 Received: from localhost ([127.0.0.1]:45538 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qhT5q-0005F5-DU for submit <at> debbugs.gnu.org; Sat, 16 Sep 2023 07:04:06 -0400 Received: from mail-wr1-x431.google.com ([2a00:1450:4864:20::431]:37987) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <zimon.toutoune@HIDDEN>) id 1qhT5n-0005EG-KP for 63986 <at> debbugs.gnu.org; Sat, 16 Sep 2023 07:04:04 -0400 Received: by mail-wr1-x431.google.com with SMTP id ffacd0b85a97d-31f7c87353eso513698f8f.0 for <63986 <at> debbugs.gnu.org>; Sat, 16 Sep 2023 04:03:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1694862231; x=1695467031; darn=debbugs.gnu.org; h=mime-version:user-agent:message-id:in-reply-to:date:references :subject:cc:to:from:from:to:cc:subject:date:message-id:reply-to; bh=2aVabeZYfDai8EFOhs+aCQrLglZ4J/Wg/XDrUvzyXG4=; b=BcyQJPj7r2t97ZnA34xBJiJaFuXwIdvxK2bah0jccCJw4GaBL7PjhHpxEQ4yfWvSgF 5vmUhcB7gGREEi+k4g5Y7FKNB/wMyKzSG2M3zEQ3TOpIXihqkDAWMyl2bKMJ95PhfUnX E1Uy2K1/Hlc3l7VqYzbJsfv+orz8hj7epxlB7vBgetxeCAPZFTQPgvVgJniHZrsE41Tz nOhqH7seDySuDxIHmRUPQQwxWGJ5/Wc1AiJcRm70YQbgaR6MjVkiHOIA4RZkz3qD/leb hnrDPundDdnmR3mnkiO3EJWHE+KFuyIiWcimkH7OrCTYHy767A1ZNyF89YWd7AAZ8AcY /WKg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694862231; x=1695467031; h=mime-version:user-agent:message-id:in-reply-to:date:references :subject:cc:to:from:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=2aVabeZYfDai8EFOhs+aCQrLglZ4J/Wg/XDrUvzyXG4=; b=X8eCkyZorYzLhOXVWEy0+FVj1N94DYWdwl7OUA4kkNjpBwKj5JnkgyXF7ATVNT/jxt dfXGf4+2NMngCipQABt2EvI51Zhes/plX7GcmM05gRu8uoeSW4aIzfTJHooKH2a/HXMb GoneAme55rxMRaRMg1caSMTmaABhKQ78LknesMvyIwfYruhnwcYTwf3eeIO6NBJOv97T XQFDDmV+BnAWApaDjEhh74MGTfC3eMuEXigv0T/6QN/VSPholQGRBLnP09RfSgl3wVzu B4BuZvJ2wMV1EQ/xwN9v8nc0lUZH5oE+UUUeEP2+SGgbjbSHPuVtEx4mIs2Rj/i2nT0m pt1g== X-Gm-Message-State: AOJu0YxF8wIrHfGFQVM9p3nB4bJrwNIYjoVu84GupQ8hcyok2Nv1jGVi O0VSqose2K1YmUMuCHpjwu9QSRx5uMk= X-Google-Smtp-Source: AGHT+IFhOxZRaqazT/Nc/BzyvihY/+a3JvLTTAFbnT7+KpPSBVSLOugzw0cCanNsxdgGVu/I1kCnQw== X-Received: by 2002:adf:b64f:0:b0:320:8f0:b93d with SMTP id i15-20020adfb64f000000b0032008f0b93dmr87867wre.3.1694862230422; Sat, 16 Sep 2023 04:03:50 -0700 (PDT) Received: from lili ([2a01:e0a:59b:9120:65d2:2476:f637:db1e]) by smtp.gmail.com with ESMTPSA id a4-20020a5d5704000000b0031fc9402b47sm6907466wrv.4.2023.09.16.04.03.49 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 16 Sep 2023 04:03:50 -0700 (PDT) From: Simon Tournier <zimon.toutoune@HIDDEN> To: help-debbugs@HIDDEN (GNU bug Tracking System) Subject: Re: bug#63986: Julia is very slow References: <87fs3f2p3y.fsf@HIDDEN> <87legsl3cm.fsf@HIDDEN> <handler.63986.D63986.169480740431199.notifdone <at> debbugs.gnu.org> Date: Sat, 16 Sep 2023 13:03:47 +0200 In-Reply-To: <handler.63986.D63986.169480740431199.notifdone <at> debbugs.gnu.org> (GNU bug Tracking System's message of "Fri, 15 Sep 2023 19:51:02 +0000") Message-ID: <86fs3e4bxo.fsf_-_@HIDDEN> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 63986 Cc: 63986 <at> debbugs.gnu.org, csantosb@HIDDEN X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) Hi Cayetano, On Fri, 15 Sep 2023 at 19:51, help-debbugs@HIDDEN (GNU bug Tracking System) wrote: > #63986: Julia is very slow > > which was filed against the guix package, has been closed. > > The explanation is attached below, along with your original report. > If you require more details, please reply to 63986 <at> debbugs.gnu.org. Since nothing had been applied for fixing the bug, could you please keep it open. Let close it once all is fine in master. WDYT? Cheers, simon
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.Tobias Geerinckx-Rice <me@HIDDEN>
to control <at> debbugs.gnu.org.
Full text available.Debbugs Internal Request <help-debbugs@HIDDEN>
to internal_control <at> debbugs.gnu.org.
Full text available.
Received: (at 63986) by debbugs.gnu.org; 16 Sep 2023 10:47:54 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sat Sep 16 06:47:54 2023
Received: from localhost ([127.0.0.1]:45489 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1qhSqA-0004j3-0N
for submit <at> debbugs.gnu.org; Sat, 16 Sep 2023 06:47:54 -0400
Received: from mail-wm1-x32d.google.com ([2a00:1450:4864:20::32d]:41032)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <zimon.toutoune@HIDDEN>) id 1qhSq7-0004iI-P6
for 63986 <at> debbugs.gnu.org; Sat, 16 Sep 2023 06:47:52 -0400
Received: by mail-wm1-x32d.google.com with SMTP id
5b1f17b1804b1-3fe4f3b5f25so9068215e9.0
for <63986 <at> debbugs.gnu.org>; Sat, 16 Sep 2023 03:47:44 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=20230601; t=1694861258; x=1695466058; darn=debbugs.gnu.org;
h=mime-version:message-id:date:references:in-reply-to:subject:cc:to
:from:from:to:cc:subject:date:message-id:reply-to;
bh=9D+emSAYB57FbOmZoQQZt0FGyzA6LA5YfifIFhXBtXw=;
b=RWWH9x+nALmGNhw8aR5oQfyomhtFXi5zgMjWoa44RQm0YOu07JMS1kMK6XCzGkbxW5
mr1RHc9NFAmQ8G2rrF+6XWniddbmPsFfAUZPGE0pBrpJlf49xIeYhiu+0VsapjuApoQn
XEUXu70LFYlff5ii7WuUjDgENOTvczL3Domd+HtYRgdNlUOeNWHvso42mWP1FnjV4BcX
1qRGMlJR0i9A/VVX2K6mWgQFEOK1PXixkBHYkEMfW7gME6cyyP4TvQnJ61/T682op00M
j70ihQT9n9Jy1SwZtHPmgQbGewPZWN6V7LtJrD7evAaljZcUeIz6quWfcvdfb3Do8q54
qc9g==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20230601; t=1694861258; x=1695466058;
h=mime-version:message-id:date:references:in-reply-to:subject:cc:to
:from:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to;
bh=9D+emSAYB57FbOmZoQQZt0FGyzA6LA5YfifIFhXBtXw=;
b=AR9oovMqmctiE2sz7fbAZ0JslasOfzSxISWFX2nUtnszISb4s2yeHLkgONyovj2ntV
f7WhsqZdYZv+BdyO2nfS4hxyX7ciuSQWjPbn9RDJTtZHfAo/SJUq6F/NY5+oDdw1iQU8
fa66kZFNMhlqN/VKIyIqzoV2/MyVQ4ph4QtNn2qCuYKA1O+kNjxBGyu8tO7iVgWIPpZ1
DvIn9AtC5I5oZEiOsMlEOatQ5A8kKuLQSYRMSjFOS0t4TEhZExgpo2WAI6on3QwCYxBf
isZySjvTlMazH4Q+dJLH77/bQQr1/9LWzx0RVKPlLO7prmK7GfBAPRlwlZ+B7HzagL3x
F86w==
X-Gm-Message-State: AOJu0Yzc2lmjoipHDbK9fW152LG4NptvT8u8WVAyM8pK20iHV+7He5j7
33/KHw5YCcCmx2QvFIOCI7A=
X-Google-Smtp-Source: AGHT+IFuH0D1/82zrLnSgpmI5+k/56YnZNB7BMEEyOUSW8zVVb9P0lbONqt3ECDS8IE+KapqIIOcAA==
X-Received: by 2002:a5d:4451:0:b0:317:3a23:4855 with SMTP id
x17-20020a5d4451000000b003173a234855mr3070905wrr.2.1694861258239;
Sat, 16 Sep 2023 03:47:38 -0700 (PDT)
Received: from pfiuh07 ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id
s1-20020a5d4ec1000000b0031fbbe347e1sm6843575wrv.65.2023.09.16.03.47.36
(version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
Sat, 16 Sep 2023 03:47:37 -0700 (PDT)
From: Simon Tournier <zimon.toutoune@HIDDEN>
To: Efraim Flashner <efraim@HIDDEN>, Ludovic =?utf-8?Q?Court=C3=A8?=
=?utf-8?Q?s?= <ludo@HIDDEN>
Subject: Re: bug#63986: Julia is very slow
In-Reply-To: <ZQLhcr_Y21H1XiYL@3900XT>
References: <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN>
<ZJR14QoB4SoqhsrP@3900XT> <87cz1n8lq3.fsf@HIDDEN>
<871qi24k9z.fsf@HIDDEN> <ZJVi0Wwg5aRq_XxJ@3900XT>
<87h6qy71oa.fsf@HIDDEN> <ZJWpKhkhHiMMzHST@3900XT>
<87o7kpku0u.fsf@HIDDEN> <87jztpqvtz.fsf@HIDDEN>
<ZQLhcr_Y21H1XiYL@3900XT>
Date: Sat, 16 Sep 2023 12:47:32 +0200
Message-ID: <87v8ca8ke3.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/mixed; boundary="=-=-="
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 63986
Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>,
csantosb@HIDDEN
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)
--=-=-=
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Hi Efraim,
On Thu, 14 Sep 2023 at 13:33, Efraim Flashner <efraim@HIDDEN> wrote:
> On Sun, Aug 20, 2023 at 10:53:44PM +0200, Ludovic Court=C3=A8s wrote:
> I've attached a diff to adjust openblas64 and to use it for x86_64 in
> julia. I don't know if it's faster than the current openblas.
I have applied the diff and turned into two patches. Attached below.
Then, I have sent the cover-letter to guix-patches where you are CC.
The idea was to trigger the Julia world rebuild. However, I do not get
back any Debbugs ID for sending the two patches.
I think that before pushing the change to master, we should wait that QA
builds some substitutes. It will reduce the annoyance for user since
some Julia paackages are long to build.
I have no time today for waiting after some Debbugs troubles.
Cheers,
simon
--=-=-=
Content-Type: text/x-diff
Content-Disposition: inline; filename=0000-cover-letter.patch
Content-Description: cover-letter
From 7f2347d8e64562e1de563cf1e4cdfd192e81a9df Mon Sep 17 00:00:00 2001
Message-Id: <cover.1694859477.git.zimon.toutoune@HIDDEN>
From: Simon Tournier <zimon.toutoune@HIDDEN>
X-Debbugs-CC: Efraim Flashner <efraim@HIDDEN>, Cayetano Santos <csantosb@HIDDEN>,
Date: Sat, 16 Sep 2023 12:17:57 +0200
Subject: [PATCH 0/2] Fix bug#63986: Julia is very slow
Hi,
This series is for triggering the rebuild of the Julia world. Some Julia
packages are long to build so let minimize the annoyance and make some
substitutes available before pushing to master. :-)
bug#63986: Julia is very slow
Cayetano Santos via Bug reports for GNU Guix <bug-guix@HIDDEN>
Fri, 09 Jun 2023 23:42:00 +0200
id:87legsl3cm.fsf@HIDDEN
https://yhetil.org/guix/87legsl3cm.fsf@HIDDEN
https://issues.guix.gnu.org/msgid/87legsl3cm.fsf@HIDDEN
Cheers,
simon
Efraim Flashner (2):
gnu: openblas-ilp64: Add symbol suffix.
gnu: julia: Conditionally use openblas with ILP64 support.
gnu/packages/julia.scm | 22 ++++++++++++++--------
gnu/packages/maths.scm | 4 +++-
2 files changed, 17 insertions(+), 9 deletions(-)
base-commit: eeec8371890fc95c60112da299dde78b21c948c2
--
2.38.1
--=-=-=
Content-Type: text/x-diff
Content-Disposition: inline;
filename=0001-gnu-openblas-ilp64-Add-symbol-suffix.patch
Content-Description: openblas
From 2f044415efb5dc5703bf2b09439c6f5e2fd1fd72 Mon Sep 17 00:00:00 2001
Message-Id: <2f044415efb5dc5703bf2b09439c6f5e2fd1fd72.1694859477.git.zimon.toutoune@HIDDEN>
In-Reply-To: <cover.1694859477.git.zimon.toutoune@HIDDEN>
References: <cover.1694859477.git.zimon.toutoune@HIDDEN>
From: Efraim Flashner <efraim@HIDDEN>
Date: Sat, 16 Sep 2023 11:59:28 +0200
Subject: [PATCH 1/2] gnu: openblas-ilp64: Add symbol suffix.
* gnu/packages/maths.scm (openblas-ilp64)[arguments]<#:make-flags>: Add the
symbol '64_' as suffix.
---
gnu/packages/maths.scm | 4 +++-
1 file changed, 3 insertions(+), 1 deletion(-)
diff --git a/gnu/packages/maths.scm b/gnu/packages/maths.scm
index 6141c0988612..c051e60d5e40 100644
--- a/gnu/packages/maths.scm
+++ b/gnu/packages/maths.scm
@@ -4638,7 +4638,9 @@ (define-public openblas-ilp64
(arguments
(substitute-keyword-arguments (package-arguments openblas)
((#:make-flags flags #~'())
- #~(append (list "INTERFACE64=1" "LIBNAMESUFFIX=ilp64")
+ #~(append (list "INTERFACE64=1"
+ "SYMBOLSUFFIX=64_"
+ "LIBPREFIX=libopenblas64_")
#$flags))))
(synopsis "Optimized BLAS library based on GotoBLAS (ILP64 version)")
(license license:bsd-3)))
--
2.38.1
--=-=-=
Content-Type: text/x-diff
Content-Disposition: inline;
filename=0002-gnu-julia-Conditionally-use-openblas-with-ILP64-supp.patch
Content-Description: julia
From 7f2347d8e64562e1de563cf1e4cdfd192e81a9df Mon Sep 17 00:00:00 2001
Message-Id: <7f2347d8e64562e1de563cf1e4cdfd192e81a9df.1694859477.git.zimon.toutoune@HIDDEN>
In-Reply-To: <cover.1694859477.git.zimon.toutoune@HIDDEN>
References: <cover.1694859477.git.zimon.toutoune@HIDDEN>
From: Efraim Flashner <efraim@HIDDEN>
Date: Sat, 16 Sep 2023 12:05:41 +0200
Subject: [PATCH 2/2] gnu: julia: Conditionally use openblas with ILP64
support.
Fixes <https://bugs.gnu.org/63986>.
Reported by Cayetano Santos <csantosb@HIDDEN>.
* gnu/packages/julia.scm (julia)[arguments]<#:phases>: Conditionally use
OpenBLAS with ILP64 support for x86-64 target.
<#:make-flags>: Likewise.
[inputs]: Conditionally replace openblas by openblas-ilp64 for x86-64 target.
Co-authored-by: Simon Tournier <zimon.toutoune@HIDDEN>
---
gnu/packages/julia.scm | 22 ++++++++++++++--------
1 file changed, 14 insertions(+), 8 deletions(-)
diff --git a/gnu/packages/julia.scm b/gnu/packages/julia.scm
index ba541758223e..8ba2b480ce55 100644
--- a/gnu/packages/julia.scm
+++ b/gnu/packages/julia.scm
@@ -269,7 +269,10 @@ (define-public julia
(substitute* (jlpath "nghttp2")
(((from "libnghttp2")) (to "libnghttp2" "libnghttp2")))
(substitute* (jlpath "OpenBLAS")
- (((from "libopenblas")) (to "openblas" "libopenblas")))
+ (((from "libopenblas"))
+ ,@(if (target-x86-64?)
+ `((to "openblas" "libopenblas64_" "libopenblas"))
+ `((to "openblas" "libopenblas")))))
(substitute* (jlpath "OpenLibm")
(((from "libopenlibm")) (to "openlibm" "libopenlibm")))
(substitute* (jlpath "PCRE2")
@@ -479,12 +482,13 @@ (define-public julia
"NO_GIT=1" ; build from release tarball.
"USE_GPL_LIBS=1" ; proudly
- ,@(if (target-aarch64?)
- `("USE_BLAS64=0")
- '())
-
- "LIBBLAS=-lopenblas"
- "LIBBLASNAME=libopenblas"
+ ,@(if (target-x86-64?)
+ `("USE_BLAS64=1"
+ "LIBBLAS=-lopenblas64_"
+ "LIBBLASNAME=libopenblas64_")
+ `("USE_BLAS64=0"
+ "LIBBLAS=-lopenblas"
+ "LIBBLASNAME=libopenblas"))
(string-append "UTF8PROC_INC="
(assoc-ref %build-inputs "utf8proc")
@@ -513,7 +517,9 @@ (define-public julia
("llvm" ,llvm-julia)
("mbedtls-apache" ,mbedtls-apache)
("mpfr" ,mpfr)
- ("openblas" ,openblas)
+ ,@(if (target-x86-64?)
+ `(("openblas" ,openblas-ilp64))
+ `(("openblas" ,openblas)))
("openlibm" ,openlibm)
("p7zip" ,p7zip)
("pcre2" ,pcre2)
--
2.38.1
--=-=-=--
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.
Received: (at submit) by debbugs.gnu.org; 16 Sep 2023 10:23:38 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sat Sep 16 06:23:38 2023
Received: from localhost ([127.0.0.1]:45456 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1qhSSf-0003yg-KN
for submit <at> debbugs.gnu.org; Sat, 16 Sep 2023 06:23:37 -0400
Received: from lists.gnu.org ([2001:470:142::17]:43990)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <zimon.toutoune@HIDDEN>) id 1qhSSc-0003yR-A5
for submit <at> debbugs.gnu.org; Sat, 16 Sep 2023 06:23:36 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10])
by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
(Exim 4.90_1) (envelope-from <zimon.toutoune@HIDDEN>)
id 1qhSSP-00089y-OL
for guix-patches@HIDDEN; Sat, 16 Sep 2023 06:23:21 -0400
Received: from mail-wm1-x32a.google.com ([2a00:1450:4864:20::32a])
by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128)
(Exim 4.90_1) (envelope-from <zimon.toutoune@HIDDEN>)
id 1qhSSL-00016x-Id
for guix-patches@HIDDEN; Sat, 16 Sep 2023 06:23:21 -0400
Received: by mail-wm1-x32a.google.com with SMTP id
5b1f17b1804b1-4046f7d49a9so7961065e9.1
for <guix-patches@HIDDEN>; Sat, 16 Sep 2023 03:23:16 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=20230601; t=1694859794; x=1695464594; darn=gnu.org;
h=content-transfer-encoding:mime-version:message-id:date:subject:cc
:to:from:from:to:cc:subject:date:message-id:reply-to;
bh=Ma3NLgOovy+tDH6sTmQgkHRLLYUom9WljS5GhMS3wI8=;
b=K/uqDeUVVUfUxTdnhwBo31ZzbIWgmWL+d9ncS+eKaflhNZrHharyoDMxAEp4vIAzBW
hoGdZl5kkmhaxpwT/fF06pVOvffoUc5ubWNfGnNkfPAjBrU3XKg9Apt2r6PSVqcBnReh
q3KeffYMT/yInQGlieyNijiS3PREiMuamjswmmOcabx/abXZ+HVOGWgxQRnGncEIa5m0
GOx+JjgoFWVGswB/3SySf32BkUbg2K5amruPbqliTYsVT4HXivD7mq+hCzIuS0ZhakCE
CyPg2WvJQZE+7xy8/yjrNSonfDpyj3uXxcWnznWCNc7RWKPUU+Rn8iT6k4pfmt4brVzp
fp+g==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20230601; t=1694859794; x=1695464594;
h=content-transfer-encoding:mime-version:message-id:date:subject:cc
:to:from:x-gm-message-state:from:to:cc:subject:date:message-id
:reply-to;
bh=Ma3NLgOovy+tDH6sTmQgkHRLLYUom9WljS5GhMS3wI8=;
b=AoBLk01scxXBWjyeQygaOkhPIUQdkEQ1hCjoyxZV7yc2JL3qHr90XgV+zRnGeMpamI
YI3pP9rYRq+xJzDqVfxUV/2S8iUZ2MLNLa32tRrYJRzYB83LO4rrpRkUMgzAem5Ql23S
IOJxPBRgt5jwN9YaYYCLe14An0dn+xsd2RGGqAz8iSSrj3g+EH4Er2QkDJpwZpgW0Rcb
deru5cSrXWczXEUBfQo/yMD2hTGpeS1V7r4AcXiLVsoQ1aI417XmISrkPyYyPQhQbFYr
UKQxgI0FQMEpU1fP45WglJ5ycGSdWCUeqYQaEaWm3BkCjmU/uJxrb4Np4ebu/XxcH0wF
OYsg==
X-Gm-Message-State: AOJu0YxC7ssGe1MFmVukhm62cGWKmOx7mh/q602pqPXoq1cfQoXCafM+
IKjmwOWrAppdDbr/ujZsl+kZudLXaE4=
X-Google-Smtp-Source: AGHT+IGf3tbZgMjoTf96msY5ujA6wgwK+9n156bYg9xT4l01Z4NZLnOMNjpbdbV1tMpITYVUssX6eA==
X-Received: by 2002:a05:600c:5103:b0:401:faf5:85c3 with SMTP id
o3-20020a05600c510300b00401faf585c3mr3847350wms.0.1694859793615;
Sat, 16 Sep 2023 03:23:13 -0700 (PDT)
Received: from localhost.localdomain ([193.48.40.241])
by smtp.gmail.com with ESMTPSA id
y6-20020a7bcd86000000b003fee6e170f9sm6931042wmj.45.2023.09.16.03.23.12
(version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
Sat, 16 Sep 2023 03:23:12 -0700 (PDT)
From: Simon Tournier <zimon.toutoune@HIDDEN>
To: guix-patches@HIDDEN
Subject: [PATCH 0/2] Fix bug#63986: Julia is very slow
Date: Sat, 16 Sep 2023 12:23:05 +0200
Message-Id: <cover.1694859477.git.zimon.toutoune@HIDDEN>
X-Mailer: git-send-email 2.39.2
MIME-Version: 1.0
X-Debbugs-CC: Efraim Flashner <efraim@HIDDEN>,
Cayetano Santos <csantosb@HIDDEN>,
Content-Transfer-Encoding: 8bit
Received-SPF: pass client-ip=2a00:1450:4864:20::32a;
envelope-from=zimon.toutoune@HIDDEN; helo=mail-wm1-x32a.google.com
X-Spam_score_int: -20
X-Spam_score: -2.1
X-Spam_bar: --
X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001,
RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001,
SPF_PASS=-0.001 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: 1.0 (+)
X-Debbugs-Envelope-To: submit
Cc: Simon Tournier <zimon.toutoune@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.0 (/)
Hi,
This series is for triggering the rebuild of the Julia world. Some Julia
packages are long to build so let minimize the annoyance and make some
substitutes available before pushing to master. :-)
bug#63986: Julia is very slow
Cayetano Santos via Bug reports for GNU Guix <bug-guix@HIDDEN>
Fri, 09 Jun 2023 23:42:00 +0200
id:87legsl3cm.fsf@HIDDEN
https://yhetil.org/guix/87legsl3cm.fsf@HIDDEN
https://issues.guix.gnu.org/msgid/87legsl3cm.fsf@HIDDEN
Cheers,
simon
Efraim Flashner (2):
gnu: openblas-ilp64: Add symbol suffix.
gnu: julia: Conditionally use openblas with ILP64 support.
gnu/packages/julia.scm | 22 ++++++++++++++--------
gnu/packages/maths.scm | 4 +++-
2 files changed, 17 insertions(+), 9 deletions(-)
base-commit: eeec8371890fc95c60112da299dde78b21c948c2
--
2.38.1
efraim@HIDDEN, csantosb@HIDDEN, bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.Received: (at 63986-done) by debbugs.gnu.org; 15 Sep 2023 19:50:04 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Fri Sep 15 15:50:04 2023 Received: from localhost ([127.0.0.1]:44883 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qhEpI-000879-C5 for submit <at> debbugs.gnu.org; Fri, 15 Sep 2023 15:50:04 -0400 Received: from latitanza.investici.org ([82.94.249.234]:60283) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <csantosb@HIDDEN>) id 1qhEpG-00086n-4J for 63986-done <at> debbugs.gnu.org; Fri, 15 Sep 2023 15:50:02 -0400 Received: from mx3.investici.org (unknown [127.0.0.1]) by latitanza.investici.org (Postfix) with ESMTP id 4RnPst50tJzGnxn for <63986-done <at> debbugs.gnu.org>; Fri, 15 Sep 2023 19:49:54 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inventati.org; s=stigmate; t=1694807394; bh=47DEQpj8HBSa+/TImW+5JCeuQeRkm5NMpJWZG3hSuFU=; h=From:To:Subject:Date:Reply-To:From; b=noADTnW5u9b7i5iS2Oh1MjkSXN/9smxbqyc90GFPojafrswF3YLLT4HMWE7ydlrgw QfRu7NlulQKKCLM+vj7NxVCPqTc4zGRZVnGcWEUkOxC3jnDiW9C97Y1hMhs/xZF9BJ tsC9Lg7234wEtW/+mVgWr8l/w5u9aLKbMrSoZaXI= Received: from [82.94.249.234] (mx3.investici.org [82.94.249.234]) (Authenticated sender: cayetano.santos@HIDDEN) by localhost (Postfix) with ESMTPSA id 4RnPst3DWzzGnxm for <63986-done <at> debbugs.gnu.org>; Fri, 15 Sep 2023 19:49:54 +0000 (UTC) User-agent: mu4e 1.10.5; emacs 29.1 From: Cayetano Santos <csantosb@HIDDEN> To: 63986-done <at> debbugs.gnu.org Subject: Fixed. Date: Fri, 15 Sep 2023 21:49:39 +0200 Message-ID: <87fs3f2p3y.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 63986-done X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Reply-To: csantosb@HIDDEN Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-)
csantosb@HIDDEN:csantosb@HIDDEN:Received: (at 63986) by debbugs.gnu.org; 15 Sep 2023 19:48:45 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Fri Sep 15 15:48:45 2023 Received: from localhost ([127.0.0.1]:44879 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qhEo0-00084M-R2 for submit <at> debbugs.gnu.org; Fri, 15 Sep 2023 15:48:45 -0400 Received: from latitanza.investici.org ([2001:888:2000:56::19]:59655) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <csantosb@HIDDEN>) id 1qhEnx-00083o-Dp for 63986 <at> debbugs.gnu.org; Fri, 15 Sep 2023 15:48:43 -0400 Received: from mx3.investici.org (unknown [127.0.0.1]) by latitanza.investici.org (Postfix) with ESMTP id 4RnPrH6kvyzGnxn; Fri, 15 Sep 2023 19:48:31 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inventati.org; s=stigmate; t=1694807311; bh=2hmwwlxpdyG5hYLpXWuWfs8a7EQjWMb1sQIs3+sAHl0=; h=References:From:To:Cc:Subject:Date:Reply-To:In-reply-to:From; b=WaeRMLCZgW0S3pj4fZ2y8P0cgI/QixWA56nkLj7jljuL6roqoXsY3EQIvEqRrbQYT Shbt+d/jzz7bjLlgEbcsyAqN6CQA6A+cvywEetsF0kBvEnzvdx5kViT18+BXcAPw0f dshgGGhnI7iSxQTMAxBy7Gm69Wi4P3sm+t0XEjDc= Received: from [82.94.249.234] (mx3.investici.org [82.94.249.234]) (Authenticated sender: cayetano.santos@HIDDEN) by localhost (Postfix) with ESMTPSA id 4RnPrH2qdzzGnxm; Fri, 15 Sep 2023 19:48:31 +0000 (UTC) References: <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT> <87cz1n8lq3.fsf@HIDDEN> <871qi24k9z.fsf@HIDDEN> <ZJVi0Wwg5aRq_XxJ@3900XT> <87h6qy71oa.fsf@HIDDEN> <ZJWpKhkhHiMMzHST@3900XT> <87o7kpku0u.fsf@HIDDEN> <87jztpqvtz.fsf@HIDDEN> <ZQLhcr_Y21H1XiYL@3900XT> User-agent: mu4e 1.10.5; emacs 29.1 From: Cayetano Santos <csantosb@HIDDEN> To: Efraim Flashner <efraim@HIDDEN> Subject: Re: bug#63986: Julia is very slow Date: Fri, 15 Sep 2023 21:45:05 +0200 In-reply-to: <ZQLhcr_Y21H1XiYL@3900XT> Message-ID: <87jzsr2p69.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 63986 Cc: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>, 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, Simon Tournier <zimon.toutoune@HIDDEN> X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Reply-To: csantosb@HIDDEN Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) >jeu. 14 sept. 2023 at 13:33, Efraim Flashner <efraim@HIDDEN> wrote: > [[PGP Signed Part:Undecided]] > On Sun, Aug 20, 2023 at 10:53:44PM +0200, Ludovic Court=C3=A8s wrote: >> Hi! >> >> Friendly ping. :-) >> >> https://issues.guix.gnu.org/63986 >> >> Ludo=E2=80=99. >> >> Ludovic Court=C3=A8s <ludo@HIDDEN> skribis: >> >> > Hi there! >> > >> > What=E2=80=99s the status? Sounds like we have a couple of fixes alre= ady. >> > >> > Maybe you can submit one of them to guix-patches@HIDDEN so qa.guix can >> > pick it up. And if one of them is more intrusive (more rebuilds), then >> > submit it separately so it gets merged later? How does that sound? >> > >> > Ludo=E2=80=99. > > I've attached a diff to adjust openblas64 and to use it for x86_64 in > julia. I don't know if it's faster than the current openblas. I have applied the patch in a freshly cloned guix repo, and build julia within a shell as for the instructions under =E2=80=99Contributing=E2=80=99. I get the 13 ms when running the original test, so I guess the issue is solved (other than thinking about the feasibility of performance tests to avoid this kind of situations). Thanks a lot ! C.
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.
Received: (at 63986) by debbugs.gnu.org; 14 Sep 2023 10:33:49 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Thu Sep 14 06:33:49 2023
Received: from localhost ([127.0.0.1]:37744 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1qgjfQ-0004PY-V4
for submit <at> debbugs.gnu.org; Thu, 14 Sep 2023 06:33:49 -0400
Received: from mail-wm1-x32e.google.com ([2a00:1450:4864:20::32e]:59545)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <efraim.flashner@HIDDEN>) id 1qgjfL-0004PH-7i
for 63986 <at> debbugs.gnu.org; Thu, 14 Sep 2023 06:33:47 -0400
Received: by mail-wm1-x32e.google.com with SMTP id
5b1f17b1804b1-40472c3faadso3697195e9.2
for <63986 <at> debbugs.gnu.org>; Thu, 14 Sep 2023 03:33:37 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=20221208; t=1694687611; x=1695292411; darn=debbugs.gnu.org;
h=in-reply-to:content-disposition:mime-version:references
:mail-followup-to:message-id:subject:cc:to:from:date:sender:from:to
:cc:subject:date:message-id:reply-to;
bh=Ie8HTYw17dvtFM9lJ7sKIzpmzt1x5i2Kw75mZtbTBGQ=;
b=d9OzRzSXIzwQB+X/r8S/TPjneqJycmFAFPZmVNmAttnJvgTBg2+/B7u4AJ5QiK9YfX
48pRg8BZtRgMRjQvpJdY+frAVMiTDF7xB2FpmcU5veYvWS5Ubgu2zYpWkqVg3nYChqW5
FZPya76ET1XgSIXyCZzyIQm+7pRwxDmwXxste5G9o2ZbRjN6Gup+dwncLmNsBBOzpwj+
zwjTN7vTGQwsG1mO6mLmhtpcwYr/eWbE9rB1y+idc8wZRgiqNaPjIAzeIcqBqAoosVN8
fuhvkHEemzf02WiiA6U+biAP4ZnV5wmYvSygWWrlPKjiRFFRBP5bKp/Uv4GOUDdU70+l
eqiw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20230601; t=1694687611; x=1695292411;
h=in-reply-to:content-disposition:mime-version:references
:mail-followup-to:message-id:subject:cc:to:from:date:sender
:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to;
bh=Ie8HTYw17dvtFM9lJ7sKIzpmzt1x5i2Kw75mZtbTBGQ=;
b=Kj7a+olxf9JM6JcEgfWERR7Ap0HofEU5AWzTWuYW3l31hrU6tH/F85QQNFBH97OFno
+ASWICyYId696FKTj89QtlCDScUineuWj5QDJtmgPUngZJo+tQ29mmDdBc2N6nEwoMZH
dhCq16rSobfwl15/BTYv0aqdFFcdb/fNNzV21jywGeHLULlsVfWiurFTjMxyw5ZVeIbu
sHu0bhwj1vPIUQHjAB8eevbDU99jOFHiv9TTv153e+DbkFmUBduqb7nZT2jAKwX0amZI
r8p5tkl8ZK7YContArddZ0iloLDBJNy2kFcJv1m7PgOBH+aOQGxbwIhp18HvGh16qoeP
kzFw==
X-Gm-Message-State: AOJu0Yw5wDbi+Qz0rIeZieKM0cERE1PRj/xFIHIFqi19Rey3id7djxMj
AqtDiBRgtIrDsgQBEv3od5U=
X-Google-Smtp-Source: AGHT+IGU5y6lsotpCqgpInWU/xOISGhOmqpVf2VskAo7CCcdZrUnMqk9hsX9nIr5yOA1XK2rUJHpgw==
X-Received: by 2002:a05:600c:290:b0:3fe:2011:a7ce with SMTP id
16-20020a05600c029000b003fe2011a7cemr4505874wmk.6.1694687611126;
Thu, 14 Sep 2023 03:33:31 -0700 (PDT)
Received: from localhost ([2a02:ed3:916:6300:c3db:b80e:a694:a54f])
by smtp.gmail.com with ESMTPSA id
m13-20020a7bca4d000000b003fe4548188bsm4464502wml.48.2023.09.14.03.33.27
(version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
Thu, 14 Sep 2023 03:33:30 -0700 (PDT)
Date: Thu, 14 Sep 2023 13:33:22 +0300
From: Efraim Flashner <efraim@HIDDEN>
To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>
Subject: Re: bug#63986: Julia is very slow
Message-ID: <ZQLhcr_Y21H1XiYL@3900XT>
Mail-Followup-To: Efraim Flashner <efraim@HIDDEN>,
Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>,
Simon Tournier <zimon.toutoune@HIDDEN>, 63986 <at> debbugs.gnu.org,
Nicolas Graves <ngraves@HIDDEN>, csantosb@HIDDEN
References: <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN>
<ZJR14QoB4SoqhsrP@3900XT> <87cz1n8lq3.fsf@HIDDEN>
<871qi24k9z.fsf@HIDDEN> <ZJVi0Wwg5aRq_XxJ@3900XT>
<87h6qy71oa.fsf@HIDDEN> <ZJWpKhkhHiMMzHST@3900XT>
<87o7kpku0u.fsf@HIDDEN> <87jztpqvtz.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha256;
protocol="application/pgp-signature"; boundary="curqSLtO4F5mndYD"
Content-Disposition: inline
In-Reply-To: <87jztpqvtz.fsf@HIDDEN>
X-PGP-Key-ID: 0x41AAE7DCCA3D8351
X-PGP-Key: https://flashner.co.il/~efraim/efraim_flashner.asc
X-PGP-Fingerprint: A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351
X-Spam-Score: 0.5 (/)
X-Debbugs-Envelope-To: 63986
Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>,
csantosb@HIDDEN, Simon Tournier <zimon.toutoune@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.5 (/)
--curqSLtO4F5mndYD
Content-Type: multipart/mixed; boundary="frliOzMGhlesvkSS"
Content-Disposition: inline
--frliOzMGhlesvkSS
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
On Sun, Aug 20, 2023 at 10:53:44PM +0200, Ludovic Court=C3=A8s wrote:
> Hi!
>=20
> Friendly ping. :-)
>=20
> https://issues.guix.gnu.org/63986
>=20
> Ludo=E2=80=99.
>=20
> Ludovic Court=C3=A8s <ludo@HIDDEN> skribis:
>=20
> > Hi there!
> >
> > What=E2=80=99s the status? Sounds like we have a couple of fixes alrea=
dy.
> >
> > Maybe you can submit one of them to guix-patches@HIDDEN so qa.guix can
> > pick it up. And if one of them is more intrusive (more rebuilds), then
> > submit it separately so it gets merged later? How does that sound?
> >
> > Ludo=E2=80=99.
I've attached a diff to adjust openblas64 and to use it for x86_64 in
julia. I don't know if it's faster than the current openblas.
--=20
Efraim Flashner <efraim@HIDDEN> =D7=A8=D7=A0=D7=A9=D7=9C=D7=A4 =
=D7=9D=D7=99=D7=A8=D7=A4=D7=90
GPG key =3D A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted
--frliOzMGhlesvkSS
Content-Type: text/plain; charset=utf-8
Content-Disposition: attachment; filename="julia-openblas-ilp64.patch"
Content-Transfer-Encoding: quoted-printable
diff --git a/gnu/packages/julia.scm b/gnu/packages/julia.scm
index ba54175822..8ba2b480ce 100644
--- a/gnu/packages/julia.scm
+++ b/gnu/packages/julia.scm
@@ -269,7 +269,10 @@ (define-public julia
(substitute* (jlpath "nghttp2")
(((from "libnghttp2")) (to "libnghttp2" "libnghttp2")))
(substitute* (jlpath "OpenBLAS")
- (((from "libopenblas")) (to "openblas" "libopenblas")))
+ (((from "libopenblas"))
+ ,@(if (target-x86-64?)
+ `((to "openblas" "libopenblas64_" "libopenblas"))
+ `((to "openblas" "libopenblas")))))
(substitute* (jlpath "OpenLibm")
(((from "libopenlibm")) (to "openlibm" "libopenlibm")))
(substitute* (jlpath "PCRE2")
@@ -479,12 +482,13 @@ (define-public julia
"NO_GIT=3D1" ; build from release tarball.
"USE_GPL_LIBS=3D1" ; proudly
=20
- ,@(if (target-aarch64?)
- `("USE_BLAS64=3D0")
- '())
-
- "LIBBLAS=3D-lopenblas"
- "LIBBLASNAME=3Dlibopenblas"
+ ,@(if (target-x86-64?)
+ `("USE_BLAS64=3D1"
+ "LIBBLAS=3D-lopenblas64_"
+ "LIBBLASNAME=3Dlibopenblas64_")
+ `("USE_BLAS64=3D0"
+ "LIBBLAS=3D-lopenblas"
+ "LIBBLASNAME=3Dlibopenblas"))
=20
(string-append "UTF8PROC_INC=3D"
(assoc-ref %build-inputs "utf8proc")
@@ -513,7 +517,9 @@ (define-public julia
("llvm" ,llvm-julia)
("mbedtls-apache" ,mbedtls-apache)
("mpfr" ,mpfr)
- ("openblas" ,openblas)
+ ,@(if (target-x86-64?)
+ `(("openblas" ,openblas-ilp64))
+ `(("openblas" ,openblas)))
("openlibm" ,openlibm)
("p7zip" ,p7zip)
("pcre2" ,pcre2)
diff --git a/gnu/packages/maths.scm b/gnu/packages/maths.scm
index f5a2181905..2d3ce41cb7 100644
--- a/gnu/packages/maths.scm
+++ b/gnu/packages/maths.scm
@@ -4645,7 +4645,9 @@ (define-public openblas-ilp64
(arguments
(substitute-keyword-arguments (package-arguments openblas)
((#:make-flags flags #~'())
- #~(append (list "INTERFACE64=3D1" "LIBNAMESUFFIX=3Dilp64")
+ #~(append (list "INTERFACE64=3D1"
+ "SYMBOLSUFFIX=3D64_"
+ "LIBPREFIX=3Dlibopenblas64_")
#$flags))))
(synopsis "Optimized BLAS library based on GotoBLAS (ILP64 version)")
(license license:bsd-3)))
--frliOzMGhlesvkSS--
--curqSLtO4F5mndYD
Content-Type: application/pgp-signature; name="signature.asc"
-----BEGIN PGP SIGNATURE-----
iQIzBAABCAAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAmUC4XEACgkQQarn3Mo9
g1EpERAAu5cuxwDgm/zbny1oH7HA7eqYG3lCvxgNIGCp6voTzhSi9g7gZtJd3IPa
6NdfOcqv4P98n6iSxZN5Y+0Nrx2Cym6ck0KgI5xrGCTbGgy9SGhSdPIm1jRpwFQw
yDFRwb/O4HCpwX7nDaWn1xXGGEgWm2UxRp6z9vG8PPjWS0D6zinST0f0cr9ScHzy
x7jRGfvYu+iHtE5tGMGDMYhg1utaqnkg3M/goU6O0Bfby7a9eMLYn+kXuIdI37e3
vSttwuT0gcHGwrsMFFarBdQ9R/RkjRnZAFdNvWEYopa368LO8bpv/sY1uNeoDNOg
PChiIZF/z97wECb9PKYmXp4sdDpM+c2LqQg+LFHWibqtzAbygK3Jtm9bNsUuOCKP
U0B4bjdUc6crnJ8khQmrRFqLAwKdjcc59kwbFC0gLQHcA+aFxi9refYRyY/Xhxc/
53DgPbPPQjIzMpbe21b+yw7IW/0IE70imTz7q+lBWXqo/gAZPLcJEtN3v3zd5AAd
dfL2gXsFFJRYHuWnCUYn9mX48FnjKjr4ZcKwgfXgAs6EhUWlxsFB5HxA6txGnxXf
8xV6iS/tIw6IwU9tXiWF33QVXOfjVnc05kdvM+btJBwQtKUJIsF5qIgYN7qcS2Aw
RAXNWZi2nESpKcX0nJLwyvPwYoqmI6k79iLMvCFDliDDOTAXN0c=
=/Pj2
-----END PGP SIGNATURE-----
--curqSLtO4F5mndYD--
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.
Received: (at 63986) by debbugs.gnu.org; 20 Aug 2023 20:54:01 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sun Aug 20 16:54:00 2023
Received: from localhost ([127.0.0.1]:54931 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1qXpQu-0006xe-JE
for submit <at> debbugs.gnu.org; Sun, 20 Aug 2023 16:54:00 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10]:38434)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <ludo@HIDDEN>) id 1qXpQs-0006xS-P3
for 63986 <at> debbugs.gnu.org; Sun, 20 Aug 2023 16:53:59 -0400
Received: from fencepost.gnu.org ([2001:470:142:3::e])
by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
(Exim 4.90_1) (envelope-from <ludo@HIDDEN>)
id 1qXpQh-0000xZ-TN; Sun, 20 Aug 2023 16:53:47 -0400
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org;
s=fencepost-gnu-org; h=MIME-Version:In-Reply-To:Date:References:Subject:To:
From; bh=jaOntIMIKkHibGry+VUs9wV4ZMoAPjB+qOxGbTP4SxM=; b=mx41ysZGVa/9MaaNr/+g
1bWZ+EhvE+zJr6U1V/BH4lxduPfcgRJ+6t2d96VzBxKTVLyMTufBEGBI7oQ8VC98iUe4xZqxWWZtu
wxQsYpGQmsB+08a5op8LEnxwmPxjo+PURV3AdmbDwiQzf4NtKRdaS+Mm00OLusVQoDhs0+q6dkDPN
Zenn/1Ui5mD387Glwga3Bn6aHEnTypDgsqtsZkUZKtXGzHg144PHQ1U6MN7bXN1NNoREefSv8gQrd
Z11/fFp/YJie1QyMffu1V7/qPg+VZQIjrePmVwg7U2dWjhxmOA1wAJqyhQDY6fW3XbGSZVQ/M2oil
gn+uwEamZmDStQ==;
From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN>
To: Efraim Flashner <efraim@HIDDEN>
Subject: Re: bug#63986: Julia is very slow
References: <871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN>
<87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN>
<87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT>
<87cz1n8lq3.fsf@HIDDEN> <871qi24k9z.fsf@HIDDEN>
<ZJVi0Wwg5aRq_XxJ@3900XT> <87h6qy71oa.fsf@HIDDEN>
<ZJWpKhkhHiMMzHST@3900XT> <87o7kpku0u.fsf@HIDDEN>
Date: Sun, 20 Aug 2023 22:53:44 +0200
In-Reply-To: <87o7kpku0u.fsf@HIDDEN> ("Ludovic =?utf-8?Q?Court=C3=A8s=22'?=
=?utf-8?Q?s?= message of "Thu, 06 Jul 2023 16:13:21 +0200")
Message-ID: <87jztpqvtz.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: 63986
Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>,
csantosb@HIDDEN, Simon Tournier <zimon.toutoune@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)
Hi!
Friendly ping. :-)
https://issues.guix.gnu.org/63986
Ludo=E2=80=99.
Ludovic Court=C3=A8s <ludo@HIDDEN> skribis:
> Hi there!
>
> What=E2=80=99s the status? Sounds like we have a couple of fixes already.
>
> Maybe you can submit one of them to guix-patches@HIDDEN so qa.guix can
> pick it up. And if one of them is more intrusive (more rebuilds), then
> submit it separately so it gets merged later? How does that sound?
>
> Ludo=E2=80=99.
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.Received: (at 63986) by debbugs.gnu.org; 6 Jul 2023 14:13:51 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Thu Jul 06 10:13:51 2023 Received: from localhost ([127.0.0.1]:41664 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qHPjz-0001S4-5s for submit <at> debbugs.gnu.org; Thu, 06 Jul 2023 10:13:51 -0400 Received: from eggs.gnu.org ([209.51.188.92]:50142) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <ludo@HIDDEN>) id 1qHPjt-0001Ro-Ji for 63986 <at> debbugs.gnu.org; Thu, 06 Jul 2023 10:13:49 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <ludo@HIDDEN>) id 1qHPjl-0006k0-01; Thu, 06 Jul 2023 10:13:38 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:In-Reply-To:Date:References:Subject:To: From; bh=a23HK9URfYfcH1C1LfoX4QDxE+NItT98qHjCUEap+fI=; b=PiZHkX+gfwcp5LujjAJb wnnbWRaukGp3AlC5UYoRPPrWZX1KwK69mIg0ccAD46/dfMjehcGm6ZAw7QDdadR4bT27AyX8b+pIL FSvXI31Z+YDk88F41H6hwlPTM1vWgd0PS84vE4jLtGfLy/WMj32HOQtsHrQxUgah4bkKRPR4tZLNM P9ZkRbOQuY6KGUBchKuECO6i1jvP2LcDzvnQmzUFy+IU+WVgTzoEGka57OX/5cmXjhL8FOroYkmsC XB6nZIGuzoPEOfg2TcFzLZhTa3ffXaqzjqO9ap/E/A5ogKBVP1cHgoR59zDBAjhjFf1GVISHx4rhM YhZs+PRlXOxoAA==; Received: from [2001:660:6102:320:e120:2c8f:8909:cdfe] (helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <ludo@HIDDEN>) id 1qHPjZ-0005g4-GI; Thu, 06 Jul 2023 10:13:34 -0400 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN> To: Efraim Flashner <efraim@HIDDEN>, Simon Tournier <zimon.toutoune@HIDDEN> Subject: Re: bug#63986: Julia is very slow References: <871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN> <87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT> <87cz1n8lq3.fsf@HIDDEN> <871qi24k9z.fsf@HIDDEN> <ZJVi0Wwg5aRq_XxJ@3900XT> <87h6qy71oa.fsf@HIDDEN> <ZJWpKhkhHiMMzHST@3900XT> Date: Thu, 06 Jul 2023 16:13:21 +0200 In-Reply-To: <ZJWpKhkhHiMMzHST@3900XT> (Efraim Flashner's message of "Fri, 23 Jun 2023 17:16:10 +0300") Message-ID: <87o7kpku0u.fsf@HIDDEN> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 63986 Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, csantosb@HIDDEN X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -3.3 (---) Hi there! What=E2=80=99s the status? Sounds like we have a couple of fixes already. Maybe you can submit one of them to guix-patches@HIDDEN so qa.guix can pick it up. And if one of them is more intrusive (more rebuilds), then submit it separately so it gets merged later? How does that sound? Ludo=E2=80=99.
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.
Received: (at 63986) by debbugs.gnu.org; 23 Jun 2023 14:16:22 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Fri Jun 23 10:16:22 2023
Received: from localhost ([127.0.0.1]:39288 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1qChaH-0008H1-RF
for submit <at> debbugs.gnu.org; Fri, 23 Jun 2023 10:16:22 -0400
Received: from mail-wm1-f46.google.com ([209.85.128.46]:50259)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <efraim.flashner@HIDDEN>) id 1qChaE-0008Gn-Gk
for 63986 <at> debbugs.gnu.org; Fri, 23 Jun 2023 10:16:20 -0400
Received: by mail-wm1-f46.google.com with SMTP id
5b1f17b1804b1-3fa798cf201so8742945e9.0
for <63986 <at> debbugs.gnu.org>; Fri, 23 Jun 2023 07:16:18 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=20221208; t=1687529772; x=1690121772;
h=in-reply-to:content-disposition:mime-version:references
:mail-followup-to:message-id:subject:cc:to:from:date:sender:from:to
:cc:subject:date:message-id:reply-to;
bh=Vx3xwOWE0Z/5txufR2s/EzT2VZUyhMtocCYsXjhex5c=;
b=eLwNcviplugoywecPR8GV1f8FcIWl4KdWcLOc2msNy5G8Fyx8K5iuTXr7qyHDlOowo
Mnlm+i3zUOtQ+SHIDqRBeILfSkfA1rcn7O6EJaBVxou2OKqSmuE9ik4ZMk6iGluF/F6t
0fPG8pF3MbeEjwVdgVnR7omRIyD3Hfz64jgOuFm9x7PDGoRBe/m/YMP/TUZXUvTAVysM
WDg1MssCTW8Ta35UJ7J2urTSd4YZ173yJZ2ypnWu0FlFNJs9sp+TNMy1aypLcv5JWc6e
JVwNZ5FfBqT7jvmng80I4V51Ov51XdORLqQrAUPkw8F82lnrF83YwK1YOl4rT6ApQhN/
PlrA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20221208; t=1687529772; x=1690121772;
h=in-reply-to:content-disposition:mime-version:references
:mail-followup-to:message-id:subject:cc:to:from:date:sender
:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to;
bh=Vx3xwOWE0Z/5txufR2s/EzT2VZUyhMtocCYsXjhex5c=;
b=Omrp1+xglybYG1DqTmSpEe5VG/QNLj+Sr2s+QmhrUjuJXzHmkbaDfP/spp2ungVxVB
KbMZw1L8G+c4pZu7mj06Bm92yZc3JESPkspz70eKAWZBs7dp3X7OfWoJaHmZGFWGaScI
nkQigNfUXtanGEcdnet3VU0FMiZwuThpmCCUMWj3d+e/FBy+Og2MfjNOVTHcrb7RoLZd
wZp0nnhYGPYZLfeY4uKBmZERb1d316l+v1LNe1rBK3oPM48y95ckc5ESLmnrlilqPNe7
E4PIR+EEW+7sYcoGQp6iCYnT5WVrnPjkOKBfb5Km/hAGS9j2i9oZBTzhNV6F5g0pVmjk
zOzg==
X-Gm-Message-State: AC+VfDwbqNEula4RkT9yb9sBPrv7da5Tt5aF9jHUw5iV/DRc/pfpJBUL
aBPQO5VdWTV/FhKJlUbKww8=
X-Google-Smtp-Source: ACHHUZ7q5MuGeOrlwV6ONsJFY6cll2GYVxWzAd+kE4XOtHK4WtU94lmBNe3qtoYTh/L9zaeBPFeQLw==
X-Received: by 2002:a1c:4c05:0:b0:3fa:787b:5185 with SMTP id
z5-20020a1c4c05000000b003fa787b5185mr2915767wmf.13.1687529772286;
Fri, 23 Jun 2023 07:16:12 -0700 (PDT)
Received: from localhost ([188.120.129.124]) by smtp.gmail.com with ESMTPSA id
l21-20020a1c7915000000b003f605566610sm2493121wme.13.2023.06.23.07.16.10
(version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
Fri, 23 Jun 2023 07:16:11 -0700 (PDT)
Date: Fri, 23 Jun 2023 17:16:10 +0300
From: Efraim Flashner <efraim@HIDDEN>
To: Simon Tournier <zimon.toutoune@HIDDEN>
Subject: Re: bug#63986: Julia is very slow
Message-ID: <ZJWpKhkhHiMMzHST@3900XT>
Mail-Followup-To: Efraim Flashner <efraim@HIDDEN>,
Simon Tournier <zimon.toutoune@HIDDEN>,
Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>,
63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>,
csantosb@HIDDEN
References: <871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN>
<87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN>
<87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT>
<87cz1n8lq3.fsf@HIDDEN> <871qi24k9z.fsf@HIDDEN>
<ZJVi0Wwg5aRq_XxJ@3900XT> <87h6qy71oa.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha256;
protocol="application/pgp-signature"; boundary="zcDsr1hIZVUVbILN"
Content-Disposition: inline
In-Reply-To: <87h6qy71oa.fsf@HIDDEN>
X-PGP-Key-ID: 0x41AAE7DCCA3D8351
X-PGP-Key: https://flashner.co.il/~efraim/efraim_flashner.asc
X-PGP-Fingerprint: A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351
X-Spam-Score: 0.2 (/)
X-Debbugs-Envelope-To: 63986
Cc: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>,
63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>,
csantosb@HIDDEN
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.8 (/)
--zcDsr1hIZVUVbILN
Content-Type: multipart/mixed; boundary="P1A0iMc2RBMfbKZV"
Content-Disposition: inline
--P1A0iMc2RBMfbKZV
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
On Fri, Jun 23, 2023 at 03:23:17PM +0200, Simon Tournier wrote:
> Hi Efraim,
>=20
> On Fri, 23 Jun 2023 at 12:16, Efraim Flashner <efraim@HIDDEN> wro=
te:
>=20
> > It should be, but julia fails the precompile stage with openblas-ilp64
> >
> > Precompilation complete. Summary:
> > Total =E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80 1=
006.632176 seconds
> > Generation =E2=94=80=E2=94=80 690.274180 seconds 68.5726%
> > Execution =E2=94=80=E2=94=80=E2=94=80 316.357997 seconds 31.4274%
> >
> > signal (15): Terminated
> > in expression starting at none:0
> > unknown function (ip: 0xfffff4d81b24)
> > unknown function (ip: 0xfffff4ed10bb)
> > unknown function (ip: 0xfffff4eda16f)
> > _ZN4llvm19MachineFunctionPass13runOnFunctionERNS_8FunctionE at /gnu/sto=
re/wa28l476c1bfshfiqcqbmk75zr8ml152-llvm-13.0.1/lib/libLLVM-13jl.so (unknow=
n line)
> > _ZN4llvm13FPPassManager13runOnFunctionERNS_8FunctionE at /gnu/store/wa2=
8l476c1bfshfiqcqbmk75zr8ml152-llvm-13.0.1/lib/libLLVM-13jl.so (unknown line)
> > _ZN4llvm13FPPassManager11runOnModuleERNS_6ModuleE at /gnu/store/wa28l47=
6c1bfshfiqcqbmk75zr8ml152-llvm-13.0.1/lib/libLLVM-13jl.so (unknown line)
> > _ZN4llvm6legacy15PassManagerImpl3runERNS_6ModuleE at /gnu/store/wa28l47=
6c1bfshfiqcqbmk75zr8ml152-llvm-13.0.1/lib/libLLVM-13jl.so (unknown line)
> > operator() at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/src/aotcomp=
ile.cpp:580 [inlined]
> > jl_dump_native_impl at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/sr=
c/aotcompile.cpp:592
> > jl_write_compiler_output at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8=
=2E3/src/precompile.c:94
> > ijl_atexit_hook at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/src/in=
it.c:207
> > jl_repl_entrypoint at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/src=
/jlapi.c:720
> > main at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/cli/loader_exe.c:=
59
> > __libc_start_call_main at /gnu/store/a19xbynxc3sg25xpkwmx7g0mdl7g31hx-g=
libc-2.35/lib/libc.so.6 (unknown line)
> > __libc_start_main at /gnu/store/a19xbynxc3sg25xpkwmx7g0mdl7g31hx-glibc-=
2.35/lib/libc.so.6 (unknown line)
> > _start at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/usr/bin/julia (=
unknown line)
> > unknown function (ip: (nil))
> > Allocations: 145655328 (Pool: 145582643; Big: 72685); GC: 120
> > *** This error is usually fixed by running `make clean`. If the error p=
ersists, try `make cleanall`. ***
> > make[1]: *** [sysimage.mk:89: /tmp/guix-build-julia-1.8.3.drv-0/julia-1=
=2E8.3/usr/lib/julia/sys-o.a] Error 1
> > make[1]: Leaving directory '/tmp/guix-build-julia-1.8.3.drv-0/julia-1.8=
=2E3'
> > make: *** [Makefile:88: julia-sysimg-release] Error 2
>=20
> Using my patch, it fails with:
>=20
> --8<---------------cut here---------------start------------->8---
> Error in testset OpenBLAS_jll:
> Test Failed at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/usr/share/ju=
lia/stdlib/v1.8/OpenBLAS_jll/test/runtests.jl:16
> Expression: dlsym(OpenBLAS_jll.libopenblas_handle, #=3D /tmp/guix-build=
-julia-1.8.3.drv-0/julia-1.8.3/usr/share/julia/stdlib/v1.8/OpenBLAS_jll/tes=
t/runtests.jl:16 =3D# @blasfunc(openblas_set_num_threads); throw_error =3D =
false) !=3D nothing
> Evaluated: nothing !=3D nothing
> ERROR: LoadError: Test run finished with errors
> in expression starting at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/t=
est/runtests.jl:93
> --8<---------------cut here---------------end--------------->8---
Mine was on aarch64
> Well, I am still missing why the expression
>=20
> dlsym(OpenBLAS_jll.libopenblas_handle,
> #=3D /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/usr/share/julia/stdl=
ib/v1.8/OpenBLAS_jll/test/runtests.jl:16 =3D#
> @blasfunc(openblas_set_num_threads); throw_error =3D false)
>=20
> is evaluated to nothing. Any idea?
It is something about the wrong internal interface in openblas, I don't
remember exactly what that error came from.
Try with the attached diff.
--=20
Efraim Flashner <efraim@HIDDEN> =D7=A8=D7=A0=D7=A9=D7=9C=D7=A4 =
=D7=9D=D7=99=D7=A8=D7=A4=D7=90
GPG key =3D A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted
--P1A0iMc2RBMfbKZV
Content-Type: text/plain; charset=utf-8
Content-Disposition: attachment; filename="julia-openblas-ilp64.patch"
Content-Transfer-Encoding: quoted-printable
diff --git a/gnu/packages/julia.scm b/gnu/packages/julia.scm
index ba54175822..8ba2b480ce 100644
--- a/gnu/packages/julia.scm
+++ b/gnu/packages/julia.scm
@@ -269,7 +269,10 @@ (define-public julia
(substitute* (jlpath "nghttp2")
(((from "libnghttp2")) (to "libnghttp2" "libnghttp2")))
(substitute* (jlpath "OpenBLAS")
- (((from "libopenblas")) (to "openblas" "libopenblas")))
+ (((from "libopenblas"))
+ ,@(if (target-x86-64?)
+ `((to "openblas" "libopenblas64_" "libopenblas"))
+ `((to "openblas" "libopenblas")))))
(substitute* (jlpath "OpenLibm")
(((from "libopenlibm")) (to "openlibm" "libopenlibm")))
(substitute* (jlpath "PCRE2")
@@ -479,12 +482,13 @@ (define-public julia
"NO_GIT=3D1" ; build from release tarball.
"USE_GPL_LIBS=3D1" ; proudly
=20
- ,@(if (target-aarch64?)
- `("USE_BLAS64=3D0")
- '())
-
- "LIBBLAS=3D-lopenblas"
- "LIBBLASNAME=3Dlibopenblas"
+ ,@(if (target-x86-64?)
+ `("USE_BLAS64=3D1"
+ "LIBBLAS=3D-lopenblas64_"
+ "LIBBLASNAME=3Dlibopenblas64_")
+ `("USE_BLAS64=3D0"
+ "LIBBLAS=3D-lopenblas"
+ "LIBBLASNAME=3Dlibopenblas"))
=20
(string-append "UTF8PROC_INC=3D"
(assoc-ref %build-inputs "utf8proc")
@@ -513,7 +517,9 @@ (define-public julia
("llvm" ,llvm-julia)
("mbedtls-apache" ,mbedtls-apache)
("mpfr" ,mpfr)
- ("openblas" ,openblas)
+ ,@(if (target-x86-64?)
+ `(("openblas" ,openblas-ilp64))
+ `(("openblas" ,openblas)))
("openlibm" ,openlibm)
("p7zip" ,p7zip)
("pcre2" ,pcre2)
diff --git a/gnu/packages/maths.scm b/gnu/packages/maths.scm
index f5a2181905..2d3ce41cb7 100644
--- a/gnu/packages/maths.scm
+++ b/gnu/packages/maths.scm
@@ -4645,7 +4645,9 @@ (define-public openblas-ilp64
(arguments
(substitute-keyword-arguments (package-arguments openblas)
((#:make-flags flags #~'())
- #~(append (list "INTERFACE64=3D1" "LIBNAMESUFFIX=3Dilp64")
+ #~(append (list "INTERFACE64=3D1"
+ "SYMBOLSUFFIX=3D64_"
+ "LIBPREFIX=3Dlibopenblas64_")
#$flags))))
(synopsis "Optimized BLAS library based on GotoBLAS (ILP64 version)")
(license license:bsd-3)))
--P1A0iMc2RBMfbKZV--
--zcDsr1hIZVUVbILN
Content-Type: application/pgp-signature; name="signature.asc"
-----BEGIN PGP SIGNATURE-----
iQIzBAABCAAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAmSVqScACgkQQarn3Mo9
g1Hf5BAAvmP9BmsscY/Dc+6fLF8WhpBwIr7TSh/SKi73ON0gumUJcaISQaEnhQGp
QD11JVj3l0OBsf2OuQYaxfmhUa4WKIEFl5XYDhE8QzX1wetw10Ai7qy8TaqYv0Po
KN1TKdMy0pLj0JLfbRkfkeYYYQSIUILspnwzygxcYUYhgG3tUfKpYAJFlf7BpYDj
NvFoxQfv+Wct2ea87feCANfNc+MbADnKCvmS5KAr2jm0i7INmp/KZs+KosmE77fU
CxHPDnDvh42yhvR5ezDlazXNXjrRVYm3twh3hKPxVEKG/ZpchThd5Zs0o3EFdv6K
0AeXQtNJXUqSfCwxVEA6jFoenHsOkAJJftVs9Ml8N8e768rrpZOSXKkaG8g75cNH
OF5rTWxordYr5DGHg4U5uZuhnKj9C38V37wUebEah/xAsBqF+fm2TdATP147SRdn
HX4ulpnE5YO57ME7ZHAVB9WYO3Ekh7HUbUVHdkHAU6yaIb70ECIkgUItlCj9T6BE
JHcm7A4ZzE/qtFV+9f0K3bo9p4TZ8ekKmqU2HIUtB20VyDmDaLqxSx7R4uvmWBCO
x5HjJRi1bqbJSqm/v8mepfTR1ZtcsNgh43a9XePVdCpcvYKrYSFkA8GZXEEJWTbR
33/41BYgDp+YveqFfzZjjLxKHncVJUYbfh+yVGQz4iRhS1v+8+k=
=VWxD
-----END PGP SIGNATURE-----
--zcDsr1hIZVUVbILN--
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.Received: (at 63986) by debbugs.gnu.org; 23 Jun 2023 14:04:09 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Fri Jun 23 10:04:09 2023 Received: from localhost ([127.0.0.1]:39277 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qChOT-0007ya-0X for submit <at> debbugs.gnu.org; Fri, 23 Jun 2023 10:04:09 -0400 Received: from mail-wr1-f53.google.com ([209.85.221.53]:41080) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <zimon.toutoune@HIDDEN>) id 1qChON-0007y3-S8 for 63986 <at> debbugs.gnu.org; Fri, 23 Jun 2023 10:04:07 -0400 Received: by mail-wr1-f53.google.com with SMTP id ffacd0b85a97d-3110f94915eso179601f8f.0 for <63986 <at> debbugs.gnu.org>; Fri, 23 Jun 2023 07:04:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1687529038; x=1690121038; h=content-transfer-encoding:mime-version:message-id:date:references :in-reply-to:subject:cc:to:from:from:to:cc:subject:date:message-id :reply-to; bh=UJM7eyVMjXmQcVLm17SUJxDMZ0uNZg9JQ3rFJSmA2nY=; b=oNIMBqh+3syHF1vtylU9KKFtL2GkBTyoOU/zZ9R8vgF73gfFv1DhiVMTftAOF3WZr8 A8NsaHhY4pp9dJeWQfetg9w7CjB/FGL/j4DA5H93CMDaiyDMa8dJMl1aEekkIVTQbTkA IdhCl59WmTG3baOxRdf9RFDZu/NPAZuU/U2xKUzlQK+A0F3oz0YZtOYcL7U95711oNFP 2o5QCgxY1VExl7ly87u5NplTkEyg++0VQXUTGP4tFN9yjNxaiwVhBz5TzM0GtO6PE96S tZn2WfSaYe8WfZwgW1yqAJsn70/ECKQjpPwIZXYfzeLPA22OlwYeGf2/h0CNX++FsuLm +YVQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1687529038; x=1690121038; h=content-transfer-encoding:mime-version:message-id:date:references :in-reply-to:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=UJM7eyVMjXmQcVLm17SUJxDMZ0uNZg9JQ3rFJSmA2nY=; b=Y+dsuPcmtybRIHwgKd3nE0QIJ8NPTesCmZn6Sb71yqMv/2g2rqmRcIS9RBH7PwI1TL V7MH+/zGnSmTSOM7uGeuKhpRGinbJw7HoZjlpJ+CQEGxmG3bM83ZMA1K7zog6uDrwEf5 YkPlscNHTBd3lpsWHRSiSk3zz+idGUqlaBRdr+mu3O0mhGspF012VhNAvrQHXXrOK6mJ bOBbLH32QrCCNkWgSBzXE1aUHpSBvAYb/ity9jrjWHufTdo2ZW8yb3oBGCKAEdVwypVR dc3BwdGPXXcvjqtobhtknu1D4ULp0nuypO2DDY35b0hlvLz+Yx4mvO6CmhAy0nRB/Qlk Iq9Q== X-Gm-Message-State: AC+VfDyL7A7Zq0vIrgOqyUF1ITnml1SuNwqphBzwGv0uRQbmVx2rM1qe pHZoT345ywOSBQIPkKIH/Fk= X-Google-Smtp-Source: ACHHUZ7ZWPXzov9RGuBheaxS30cWYc9msQIEjWUnJdK6aN0qVZQA0eoRYz0AJM/uzVa1yX1lpan5Iw== X-Received: by 2002:adf:ec45:0:b0:2c7:1c72:699f with SMTP id w5-20020adfec45000000b002c71c72699fmr18791477wrn.4.1687529037819; Fri, 23 Jun 2023 07:03:57 -0700 (PDT) Received: from pfiuh07 ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id r7-20020adfce87000000b0030af54c5f33sm9638634wrn.113.2023.06.23.07.03.57 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 23 Jun 2023 07:03:57 -0700 (PDT) From: Simon Tournier <zimon.toutoune@HIDDEN> To: Efraim Flashner <efraim@HIDDEN>, Ludovic =?utf-8?Q?Court=C3=A8?= =?utf-8?Q?s?= <ludovic.courtes@HIDDEN> Subject: Re: bug#63986: Julia is very slow In-Reply-To: <ZJVi0Wwg5aRq_XxJ@3900XT> References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN> <871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN> <87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT> <87cz1n8lq3.fsf@HIDDEN> <871qi24k9z.fsf@HIDDEN> <ZJVi0Wwg5aRq_XxJ@3900XT> Date: Fri, 23 Jun 2023 15:23:17 +0200 Message-ID: <87h6qy71oa.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 63986 Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, csantosb@HIDDEN X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) Hi Efraim, On Fri, 23 Jun 2023 at 12:16, Efraim Flashner <efraim@HIDDEN> wrote: > It should be, but julia fails the precompile stage with openblas-ilp64 > > Precompilation complete. Summary: > Total =E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80 100= 6.632176 seconds > Generation =E2=94=80=E2=94=80 690.274180 seconds 68.5726% > Execution =E2=94=80=E2=94=80=E2=94=80 316.357997 seconds 31.4274% > > signal (15): Terminated > in expression starting at none:0 > unknown function (ip: 0xfffff4d81b24) > unknown function (ip: 0xfffff4ed10bb) > unknown function (ip: 0xfffff4eda16f) > _ZN4llvm19MachineFunctionPass13runOnFunctionERNS_8FunctionE at /gnu/store= /wa28l476c1bfshfiqcqbmk75zr8ml152-llvm-13.0.1/lib/libLLVM-13jl.so (unknown = line) > _ZN4llvm13FPPassManager13runOnFunctionERNS_8FunctionE at /gnu/store/wa28l= 476c1bfshfiqcqbmk75zr8ml152-llvm-13.0.1/lib/libLLVM-13jl.so (unknown line) > _ZN4llvm13FPPassManager11runOnModuleERNS_6ModuleE at /gnu/store/wa28l476c= 1bfshfiqcqbmk75zr8ml152-llvm-13.0.1/lib/libLLVM-13jl.so (unknown line) > _ZN4llvm6legacy15PassManagerImpl3runERNS_6ModuleE at /gnu/store/wa28l476c= 1bfshfiqcqbmk75zr8ml152-llvm-13.0.1/lib/libLLVM-13jl.so (unknown line) > operator() at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/src/aotcompil= e.cpp:580 [inlined] > jl_dump_native_impl at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/src/= aotcompile.cpp:592 > jl_write_compiler_output at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3= /src/precompile.c:94 > ijl_atexit_hook at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/src/init= .c:207 > jl_repl_entrypoint at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/src/j= lapi.c:720 > main at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/cli/loader_exe.c:59 > __libc_start_call_main at /gnu/store/a19xbynxc3sg25xpkwmx7g0mdl7g31hx-gli= bc-2.35/lib/libc.so.6 (unknown line) > __libc_start_main at /gnu/store/a19xbynxc3sg25xpkwmx7g0mdl7g31hx-glibc-2.= 35/lib/libc.so.6 (unknown line) > _start at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/usr/bin/julia (un= known line) > unknown function (ip: (nil)) > Allocations: 145655328 (Pool: 145582643; Big: 72685); GC: 120 > *** This error is usually fixed by running `make clean`. If the error per= sists, try `make cleanall`. *** > make[1]: *** [sysimage.mk:89: /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8= .3/usr/lib/julia/sys-o.a] Error 1 > make[1]: Leaving directory '/tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3' > make: *** [Makefile:88: julia-sysimg-release] Error 2 Using my patch, it fails with: --8<---------------cut here---------------start------------->8--- Error in testset OpenBLAS_jll: Test Failed at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/usr/share/juli= a/stdlib/v1.8/OpenBLAS_jll/test/runtests.jl:16 Expression: dlsym(OpenBLAS_jll.libopenblas_handle, #=3D /tmp/guix-build-j= ulia-1.8.3.drv-0/julia-1.8.3/usr/share/julia/stdlib/v1.8/OpenBLAS_jll/test/= runtests.jl:16 =3D# @blasfunc(openblas_set_num_threads); throw_error =3D fa= lse) !=3D nothing Evaluated: nothing !=3D nothing ERROR: LoadError: Test run finished with errors in expression starting at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/tes= t/runtests.jl:93 --8<---------------cut here---------------end--------------->8--- Well, I am still missing why the expression dlsym(OpenBLAS_jll.libopenblas_handle, #=3D /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/usr/share/julia/stdlib= /v1.8/OpenBLAS_jll/test/runtests.jl:16 =3D# @blasfunc(openblas_set_num_threads); throw_error =3D false) is evaluated to nothing. Any idea? Cheers, simon
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.
Received: (at 63986) by debbugs.gnu.org; 23 Jun 2023 13:08:59 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Fri Jun 23 09:08:59 2023
Received: from localhost ([127.0.0.1]:37865 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1qCgX5-00069A-Ce
for submit <at> debbugs.gnu.org; Fri, 23 Jun 2023 09:08:59 -0400
Received: from mail-wr1-f51.google.com ([209.85.221.51]:41101)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <zimon.toutoune@HIDDEN>) id 1qCgX0-00068m-TQ
for 63986 <at> debbugs.gnu.org; Fri, 23 Jun 2023 09:08:57 -0400
Received: by mail-wr1-f51.google.com with SMTP id
ffacd0b85a97d-3110f94915eso165888f8f.0
for <63986 <at> debbugs.gnu.org>; Fri, 23 Jun 2023 06:08:54 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=20221208; t=1687525729; x=1690117729;
h=mime-version:message-id:date:references:in-reply-to:subject:cc:to
:from:from:to:cc:subject:date:message-id:reply-to;
bh=OsBXLFk63JqU/TVN/HEawf+jFy1GWmIZrVof5OXzask=;
b=AJb70rDJj9N1UDRNHgO7BkYlSOrvCjppRQcweEJ117fdgvg7Y32LnjuQePjrVJqC2o
eemPpJ6xuOjScmH4SciWiswSeielumXbvVIIaHBKtHMnt0bIQJmPfwFwKEAh+B0rEIjO
SaUkNBUzy1WHOyrub9udX4l2aWIuutSo/weRKFtblonbQYZImFLyv8Ig6k1vR44+njoy
z6rQBGqN4/jyndeVMC18gbc3nedddPqsd0HA6EpVPHL6J/sa9jwOZdhQmJ6/53zQ5Xi/
7jOVYSndWTLNmjakn5nBUFv3029ABrCkJmes9Y9UA9ydBQJAlGVAEa6tRR25AV2k4eLe
MEWw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20221208; t=1687525729; x=1690117729;
h=mime-version:message-id:date:references:in-reply-to:subject:cc:to
:from:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to;
bh=OsBXLFk63JqU/TVN/HEawf+jFy1GWmIZrVof5OXzask=;
b=dwNJn5dWVbfOISd+4n+qGH7h2K5Sf3uzFn8NYDSU7xehMJAmidhBYDuiRNCvXqNSq8
5mzPGNT2IJMWcnhnZatslHoyLIoaG3LMGTfn1Grb/nXkkxpmBM4s3AN+IOrkwa2/PO6c
5SWBrj4D4hgMYJFBGaFwbQjWUg571AqEAdAndFXFEfJZewpu97YA/5rIMqk8oivDzARU
VM4kWvAryHgxGKjYSeHU+yX3JiyNz+vPETNzX3XKXBibGxZiZRcFeWN+X/P7NgYY4cME
1DBY5nDakwLnQ6Q5C42RXCbygrSSArcFki0squx8QVV8QVFxqW1VFGYsANlx5UR05S7i
0F8g==
X-Gm-Message-State: AC+VfDwe3NMyQy8JuTKIDSQcG2lQoAE/nBSM+BIRAbSBeuuEHQ25VAT5
XzQPVj5kUob+ITlScFDbeic=
X-Google-Smtp-Source: ACHHUZ7xA5TygW62EincumoXZr2UnBm+VnQfn9gn1nUOoUT6bhqVBi/zBU25Rdjm9OoL3b7Ax+vb7Q==
X-Received: by 2002:adf:f290:0:b0:305:f3c1:184e with SMTP id
k16-20020adff290000000b00305f3c1184emr17405478wro.3.1687525728753;
Fri, 23 Jun 2023 06:08:48 -0700 (PDT)
Received: from pfiuh07 ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id
p7-20020a056000018700b003095bd71159sm9575225wrx.7.2023.06.23.06.08.48
(version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
Fri, 23 Jun 2023 06:08:48 -0700 (PDT)
From: Simon Tournier <zimon.toutoune@HIDDEN>
To: Efraim Flashner <efraim@HIDDEN>
Subject: Re: bug#63986: Julia is very slow
In-Reply-To: <ZJSrU5ZqofMV3t4T@3900XT>
References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN>
<871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN>
<87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN>
<87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT>
<875y7f8hbf.fsf@HIDDEN> <ZJSrU5ZqofMV3t4T@3900XT>
Date: Fri, 23 Jun 2023 14:06:12 +0200
Message-ID: <87v8fe758r.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 63986
Cc: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>,
63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>,
csantosb@HIDDEN
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)
Hi Efraim,
On Thu, 22 Jun 2023 at 23:13, Efraim Flashner <efraim@HIDDEN> wrote:
> - ,@(if (target-aarch64?)
> - `("USE_BLAS64=0")
> - '())
[...]
> + ,@(if (target-64bit?)
> + `("USE_BLAS64=1"
Well, I do not know but using this change USE_BLAS64=1 will be applied
to aarch64 when it was specifically not previously. Is it expected?
> diff --git a/gnu/packages/python-xyz.scm b/gnu/packages/python-xyz.scm
> index b650b71f3b..deeffb67ae 100644
> --- a/gnu/packages/python-xyz.scm
> +++ b/gnu/packages/python-xyz.scm
> @@ -6953,19 +6953,36 @@ (define-public python-numpy
This change leads to a large rebuild. Therefore, it should go first to
a dedicated branch, no?
Cheers,
simon
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.
Received: (at 63986) by debbugs.gnu.org; 23 Jun 2023 13:08:59 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Fri Jun 23 09:08:59 2023
Received: from localhost ([127.0.0.1]:37863 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1qCgX5-000698-47
for submit <at> debbugs.gnu.org; Fri, 23 Jun 2023 09:08:59 -0400
Received: from mail-wm1-f50.google.com ([209.85.128.50]:41067)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <zimon.toutoune@HIDDEN>) id 1qCgX1-00068o-Et
for 63986 <at> debbugs.gnu.org; Fri, 23 Jun 2023 09:08:57 -0400
Received: by mail-wm1-f50.google.com with SMTP id
5b1f17b1804b1-3f9b38e4e29so1805935e9.0
for <63986 <at> debbugs.gnu.org>; Fri, 23 Jun 2023 06:08:55 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=20221208; t=1687525729; x=1690117729;
h=content-transfer-encoding:mime-version:message-id:date:references
:in-reply-to:subject:cc:to:from:from:to:cc:subject:date:message-id
:reply-to; bh=rXrt9HE9QUb7XBCUjaGMn/mP2BFughPbBQoKsPvOaY4=;
b=qW11W7nVBcY4Vd3vHDNJ5smCF4r4niZwDG6v78XhJ4ROplhOKpSJ40Sy197fXsuxDL
ZWKCrjODUzlW+xBeVlerAetzTL4J0VtqvJpbt5k8fIr+8litGq1X5TX0bRgZ9gBbWCir
mgFzbu25pQyv3HxrugxroEoRkhNlQqj+SxPx6Vvum9ZjiJnndMA6l8F/LTFoW8UVX+08
AClgu7dzVl++y3UNRgwRtMSaNydeORi4sSPqa1S7bJN55ccNbmSBxsCyXMAfqmoPtoYS
+D+8mHI71pNFh3x9y6USCl8rMhKnccPspze4MYtvByg0j9RqPsf9mbzgvXLdE8pzdR4d
Ifmg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20221208; t=1687525729; x=1690117729;
h=content-transfer-encoding:mime-version:message-id:date:references
:in-reply-to:subject:cc:to:from:x-gm-message-state:from:to:cc
:subject:date:message-id:reply-to;
bh=rXrt9HE9QUb7XBCUjaGMn/mP2BFughPbBQoKsPvOaY4=;
b=TUTAmcs308b72WDFe9IBt2JiDPnBclCR1lGF1X6eETVlUrPjrDrhHMe+Fjo8NX9WER
+K+FrJEYrWIXR1Ka5nNN8TWyfAKNIZescuRnD6LkSzjOsHqI5gnLG/YhbciJKT6PwgjY
+No3saOCW8uyCLuNLMHmJ5UT4IC4onX2oacp+VtmyPb/zP9CRa08WERbQKBWBccNXXk+
16SfrWN5yPWdnYXxc14FMc2KnwK48TT0uv/sAI3sac5jehQsda3pAvYK3oWxwFM/KfO9
Q4BI9mtLvEpXxgF9Hi99dIsjAtLXN7TPX/eyB7ASpKp7mvv6gWR6j6TPCRczl+fwo4hn
QU8g==
X-Gm-Message-State: AC+VfDzTPhpE0uP32/RijvQyYyu2wyXBLi7dMSclu0akuRklEonRF2rk
arijdrz8acBpFnrlUVURZk8=
X-Google-Smtp-Source: ACHHUZ5IoqWLqAjKFg5Z2XkLMCT+PHfYKKa/K/olWzzaqrgXCiuibf/UzOhP3zbkMkiOM0ryQPabaA==
X-Received: by 2002:a1c:ed17:0:b0:3f5:f543:d81f with SMTP id
l23-20020a1ced17000000b003f5f543d81fmr22576316wmh.3.1687525729420;
Fri, 23 Jun 2023 06:08:49 -0700 (PDT)
Received: from pfiuh07 ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id
az27-20020a05600c601b00b003f9bb026e5fsm6442449wmb.0.2023.06.23.06.08.49
(version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
Fri, 23 Jun 2023 06:08:49 -0700 (PDT)
From: Simon Tournier <zimon.toutoune@HIDDEN>
To: Efraim Flashner <efraim@HIDDEN>, Ludovic =?utf-8?Q?Court=C3=A8?=
=?utf-8?Q?s?= <ludovic.courtes@HIDDEN>
Subject: Re: bug#63986: Julia is very slow
In-Reply-To: <ZJVi0Wwg5aRq_XxJ@3900XT>
References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN>
<871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN>
<87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN>
<87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT>
<87cz1n8lq3.fsf@HIDDEN> <871qi24k9z.fsf@HIDDEN>
<ZJVi0Wwg5aRq_XxJ@3900XT>
Date: Fri, 23 Jun 2023 14:11:40 +0200
Message-ID: <87lega74zn.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 63986
Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>,
csantosb@HIDDEN
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)
Hi,
On Fri, 23 Jun 2023 at 12:16, Efraim Flashner <efraim@HIDDEN> wrote:
>> Should it be =E2=80=98target-64bit?=E2=80=99 instead?
>
> It should be, but julia fails the precompile stage with openblas-ilp64
Well, I picked target-x86-64? because the recipe contains,
,@(if (target-aarch64?)
`("USE_BLAS64=3D0")
'())
so using target-64bit? would apply USE_BLAS64=3D1 to aarch64 when it was
not. Well, since I know few about this architecture, I have tried to
keep the way it was. Somehow, I have no opinion about what is best. :-)
Cheers,
simon
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.
Received: (at 63986) by debbugs.gnu.org; 23 Jun 2023 09:16:12 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Fri Jun 23 05:16:12 2023
Received: from localhost ([127.0.0.1]:37686 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1qCctn-0005e9-KO
for submit <at> debbugs.gnu.org; Fri, 23 Jun 2023 05:16:12 -0400
Received: from mail-wr1-f44.google.com ([209.85.221.44]:51218)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <efraim.flashner@HIDDEN>) id 1qCctl-0005dw-95
for 63986 <at> debbugs.gnu.org; Fri, 23 Jun 2023 05:16:10 -0400
Received: by mail-wr1-f44.google.com with SMTP id
ffacd0b85a97d-312863a983fso462390f8f.2
for <63986 <at> debbugs.gnu.org>; Fri, 23 Jun 2023 02:16:09 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=20221208; t=1687511763; x=1690103763;
h=in-reply-to:content-disposition:mime-version:references
:mail-followup-to:message-id:subject:cc:to:from:date:sender:from:to
:cc:subject:date:message-id:reply-to;
bh=zwFGrSq+r3HmHSCUXfCkm01ROQzafXR6dPcULdnQETs=;
b=E5V27uEYF31lO+lG2Hnlwa7qHN6kqWhFJ2bztkxWoU1Acqx9CebHT0jAACnN6KCK1C
+qHhD52QeMjwq3SiDJAKRy0Kf8fwIryKrjMHjr6LKZy2k0U+Z6lOWJln9F3JZpccUlBK
CFMNgAh5iJlKn7IrEqHlWmkZl5foSvFjq2X3pN9yEKShEdWZOy/OFiBPhmk8CekjhrUX
w5AJdeDz1jiU8u19N1wcMAoujpYuw891pcCHRU5hN+a5Yt9RgfoUq7Kv1RDQ9n1CtNKc
MOCu4+u2IqTEBNSEUhNilKWfAjcbVeiyf3jheJ4VOWDlxAjRSSPp9VTjud8Fbup1KDPS
mZ8A==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20221208; t=1687511763; x=1690103763;
h=in-reply-to:content-disposition:mime-version:references
:mail-followup-to:message-id:subject:cc:to:from:date:sender
:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to;
bh=zwFGrSq+r3HmHSCUXfCkm01ROQzafXR6dPcULdnQETs=;
b=BJAhU9ZnTgRWTEPsDErmGJaiGJ0boRzhnWK2hQrInEDY0lFYH1jrKGV2VjUEKhwprj
hUWbAyrwE0+YOcqY4FSCpICTkcsixXcvbLf6JILvPPJt//IWjH6tYbrboJVIuNslH7Ty
DOzH2JL69PLI+92BIo3jPu3/oWTi0QvTovGkyRhjvFNVTe6lxJ9WOtbtZw5y893+fGZY
TI1vutuDEphIas+/qJ7I/67bWRpmC07F1tM8EPOcK0wQUch7+Qy0+ggp69YScDZctoNH
O45txMxCd/UKgyJsRhPzhUKy789EQpQFDGgtysGXsjRzSNQZac0MMY2Hn/IqYQ+S72i8
Wc3A==
X-Gm-Message-State: AC+VfDzRP7lDJtADcZTHEi4Na+lGIXJ7UY4NFm2X4RsaD4AU1f4i37jx
TsMGnJXxLFsjXTvbgxB6f4U=
X-Google-Smtp-Source: ACHHUZ7TSkWHHIR4TOFDpmfEONJBPHRRou90mle+rqAvfkkr2+fgHGfIsbVQVgC3CX+fJgKYjPAT/w==
X-Received: by 2002:a5d:595a:0:b0:30d:d85c:4472 with SMTP id
e26-20020a5d595a000000b0030dd85c4472mr15652657wri.62.1687511763244;
Fri, 23 Jun 2023 02:16:03 -0700 (PDT)
Received: from localhost ([188.120.129.124]) by smtp.gmail.com with ESMTPSA id
x6-20020adff0c6000000b00307972e46fasm8978745wro.107.2023.06.23.02.16.02
(version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
Fri, 23 Jun 2023 02:16:02 -0700 (PDT)
Date: Fri, 23 Jun 2023 12:16:01 +0300
From: Efraim Flashner <efraim@HIDDEN>
To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>
Subject: Re: bug#63986: Julia is very slow
Message-ID: <ZJVi0Wwg5aRq_XxJ@3900XT>
Mail-Followup-To: Efraim Flashner <efraim@HIDDEN>,
Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>,
Simon Tournier <zimon.toutoune@HIDDEN>, 63986 <at> debbugs.gnu.org,
Nicolas Graves <ngraves@HIDDEN>, csantosb@HIDDEN
References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN>
<871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN>
<87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN>
<87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT>
<87cz1n8lq3.fsf@HIDDEN> <871qi24k9z.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha256;
protocol="application/pgp-signature"; boundary="m3keaYW7d3WYN+WZ"
Content-Disposition: inline
In-Reply-To: <871qi24k9z.fsf@HIDDEN>
X-PGP-Key-ID: 0x41AAE7DCCA3D8351
X-PGP-Key: https://flashner.co.il/~efraim/efraim_flashner.asc
X-PGP-Fingerprint: A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351
X-Spam-Score: 0.2 (/)
X-Debbugs-Envelope-To: 63986
Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>,
csantosb@HIDDEN, Simon Tournier <zimon.toutoune@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.8 (/)
--m3keaYW7d3WYN+WZ
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
On Fri, Jun 23, 2023 at 11:09:44AM +0200, Ludovic Court=C3=A8s wrote:
> Hi!
>=20
> Simon Tournier <zimon.toutoune@HIDDEN> skribis:
>=20
> > + ,@(if (target-x86-64?)
> > + `("USE_BLAS64=3D1"
> > + "LIBBLAS=3D-lopenblas_ilp64"
> > + "LIBBLASNAME=3Dlibopenblas_ilp64")
> > + `("LIBBLAS=3D-lopenblas"
> > + "LIBBLASNAME=3Dlibopenblas"))
> > =20
> > (string-append "UTF8PROC_INC=3D"
> > (assoc-ref %build-inputs "utf8proc")
> > @@ -513,7 +517,9 @@ (define-public julia
> > ("llvm" ,llvm-julia)
> > ("mbedtls-apache" ,mbedtls-apache)
> > ("mpfr" ,mpfr)
> > - ("openblas" ,openblas)
> > + ,@(if (target-x86-64?)
> > + `(("openblas" ,openblas-ilp64))
> > + `(("openblas" ,openblas)))
>=20
> Should it be =E2=80=98target-64bit?=E2=80=99 instead?
It should be, but julia fails the precompile stage with openblas-ilp64
Precompilation complete. Summary:
Total =E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80 1006.=
632176 seconds
Generation =E2=94=80=E2=94=80 690.274180 seconds 68.5726%
Execution =E2=94=80=E2=94=80=E2=94=80 316.357997 seconds 31.4274%
signal (15): Terminated
in expression starting at none:0
unknown function (ip: 0xfffff4d81b24)
unknown function (ip: 0xfffff4ed10bb)
unknown function (ip: 0xfffff4eda16f)
_ZN4llvm19MachineFunctionPass13runOnFunctionERNS_8FunctionE at /gnu/store/w=
a28l476c1bfshfiqcqbmk75zr8ml152-llvm-13.0.1/lib/libLLVM-13jl.so (unknown li=
ne)
_ZN4llvm13FPPassManager13runOnFunctionERNS_8FunctionE at /gnu/store/wa28l47=
6c1bfshfiqcqbmk75zr8ml152-llvm-13.0.1/lib/libLLVM-13jl.so (unknown line)
_ZN4llvm13FPPassManager11runOnModuleERNS_6ModuleE at /gnu/store/wa28l476c1b=
fshfiqcqbmk75zr8ml152-llvm-13.0.1/lib/libLLVM-13jl.so (unknown line)
_ZN4llvm6legacy15PassManagerImpl3runERNS_6ModuleE at /gnu/store/wa28l476c1b=
fshfiqcqbmk75zr8ml152-llvm-13.0.1/lib/libLLVM-13jl.so (unknown line)
operator() at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/src/aotcompile.=
cpp:580 [inlined]
jl_dump_native_impl at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/src/ao=
tcompile.cpp:592
jl_write_compiler_output at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/s=
rc/precompile.c:94
ijl_atexit_hook at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/src/init.c=
:207
jl_repl_entrypoint at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/src/jla=
pi.c:720
main at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/cli/loader_exe.c:59
__libc_start_call_main at /gnu/store/a19xbynxc3sg25xpkwmx7g0mdl7g31hx-glibc=
-2.35/lib/libc.so.6 (unknown line)
__libc_start_main at /gnu/store/a19xbynxc3sg25xpkwmx7g0mdl7g31hx-glibc-2.35=
/lib/libc.so.6 (unknown line)
_start at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/usr/bin/julia (unkn=
own line)
unknown function (ip: (nil))
Allocations: 145655328 (Pool: 145582643; Big: 72685); GC: 120
*** This error is usually fixed by running `make clean`. If the error persi=
sts, try `make cleanall`. ***
make[1]: *** [sysimage.mk:89: /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3=
/usr/lib/julia/sys-o.a] Error 1
make[1]: Leaving directory '/tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3'
make: *** [Makefile:88: julia-sysimg-release] Error 2
> Thumbs up for finding the solution!
>=20
> Ludo=E2=80=99.
--=20
Efraim Flashner <efraim@HIDDEN> =D7=A8=D7=A0=D7=A9=D7=9C=D7=A4 =
=D7=9D=D7=99=D7=A8=D7=A4=D7=90
GPG key =3D A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted
--m3keaYW7d3WYN+WZ
Content-Type: application/pgp-signature; name="signature.asc"
-----BEGIN PGP SIGNATURE-----
iQIzBAABCAAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAmSVYs4ACgkQQarn3Mo9
g1FeKQ/8CmpsiVH5Re1hDe3VzRI6l2dPfIO+WB2e5YlCmCjgJH3OHIeIyuI84PQX
8wvxfbbngNp2qQ4/JUUuijI28VeSl+9voBTQxmB3eWOt4Bdrd0O7XX5q+7CmTRWg
Gdci6jvdugbwbjW4P5gGt0aYBxC3OazQ9b6449dvsodyIEiYrRVMOLQvSQ/zzvfe
LqlZQPbB4RYsJ1RnFvPTlxAwt4LLVGzzxpjkgaOxUk/JwMqfTpzS2jynRhdx3JID
HbbxPf0XgyzIV5EKXYB29T0IdUD3PNlmxU2Xn9iN8A27uDPRB5wkNLRh2KHF1Ipw
X3JA+NE8kDXz7oWMBVbkezhOXwNaHC3/zpxBOXrvvaehrFDZe3ypBeAFcLmdI/XM
5wDZ8lU0gtbqz2+gEyOkbr4xQhEZz7lthAN2m65rFZBA9k/NIFdof2I7N0GU2pvo
q9bfVdgoIy42Cmi2bnLRC8qc9xIdhAs1ZjH9JMX1yBnhQeK+AgFwEgOZkW2O8FjR
Wqr9PsGsowGShr7h644Ty9P9ZwfJGf7FAqxOz6WbkmXFBg3XZRzW72HSpD/5nsso
C/Rkmsa6qh4C6js8qBpgmM8BQ+46VwgBXmcHXaONIUPKB0v2jjPUoUrYCcZwRBXl
VMleI99dlcVNRg6MH/P4Ryz4ShWtFnDWa2thTR3PzfCro0+6/vI=
=uPlc
-----END PGP SIGNATURE-----
--m3keaYW7d3WYN+WZ--
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.
Received: (at 63986) by debbugs.gnu.org; 23 Jun 2023 09:09:56 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Fri Jun 23 05:09:56 2023
Received: from localhost ([127.0.0.1]:37682 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1qCcnj-0005U3-Rk
for submit <at> debbugs.gnu.org; Fri, 23 Jun 2023 05:09:56 -0400
Received: from mail3-relais-sop.national.inria.fr ([192.134.164.104]:61702)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <ludovic.courtes@HIDDEN>) id 1qCcnh-0005Tl-NR
for 63986 <at> debbugs.gnu.org; Fri, 23 Jun 2023 05:09:54 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc;
h=from:to:cc:subject:references:date:in-reply-to:
message-id:mime-version:content-transfer-encoding;
bh=unP7cNdMiPCmCtBA3dFR62BGPTtjizcR96dTsFScw24=;
b=ECWvRPj7L7HePeQ8aZKIfn+OC6k1CRmKV909WIOHx0sox6q7DcHfb57g
IdundLrNh4fhebIxm7oFxMh5oIgZpPZCgk1SLQIAtiLPTW7M2T2gD531N
9J/0txF9BGlUPT9nNIuIr7EX2dsdfr5OtMlYCtcaatU9VoMYoZA0jXZRT s=;
Authentication-Results: mail3-relais-sop.national.inria.fr;
dkim=none (message not signed) header.i=none;
spf=SoftFail smtp.mailfrom=ludovic.courtes@HIDDEN;
dmarc=fail (p=none dis=none) d=inria.fr
X-IronPort-AV: E=Sophos;i="6.01,151,1684792800"; d="scan'208";a="59626948"
Received: from lsm-cpl.in2p3.fr (HELO ribbon) ([134.158.178.2])
by mail3-relais-sop.national.inria.fr with
ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 23 Jun 2023 11:09:48 +0200
From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludovic.courtes@HIDDEN>
To: Simon Tournier <zimon.toutoune@HIDDEN>
Subject: Re: bug#63986: Julia is very slow
References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN>
<871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN>
<87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN>
<87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT>
<87cz1n8lq3.fsf@HIDDEN>
X-URL: http://www.fdn.fr/~lcourtes/
X-Revolutionary-Date: Quintidi 5 Messidor an 231 de la =?utf-8?Q?R=C3=A9vo?=
=?utf-8?Q?lution=2C?= jour du Mulet
X-PGP-Key-ID: 0x090B11993D9AEBB5
X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc
X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5
X-OS: x86_64-pc-linux-gnu
Date: Fri, 23 Jun 2023 11:09:44 +0200
In-Reply-To: <87cz1n8lq3.fsf@HIDDEN> (Simon Tournier's message of "Thu, 22
Jun 2023 19:12:36 +0200")
Message-ID: <871qi24k9z.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 63986
Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>,
Efraim Flashner <efraim@HIDDEN>, csantosb@HIDDEN
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)
Hi!
Simon Tournier <zimon.toutoune@HIDDEN> skribis:
> + ,@(if (target-x86-64?)
> + `("USE_BLAS64=3D1"
> + "LIBBLAS=3D-lopenblas_ilp64"
> + "LIBBLASNAME=3Dlibopenblas_ilp64")
> + `("LIBBLAS=3D-lopenblas"
> + "LIBBLASNAME=3Dlibopenblas"))
>=20=20
> (string-append "UTF8PROC_INC=3D"
> (assoc-ref %build-inputs "utf8proc")
> @@ -513,7 +517,9 @@ (define-public julia
> ("llvm" ,llvm-julia)
> ("mbedtls-apache" ,mbedtls-apache)
> ("mpfr" ,mpfr)
> - ("openblas" ,openblas)
> + ,@(if (target-x86-64?)
> + `(("openblas" ,openblas-ilp64))
> + `(("openblas" ,openblas)))
Should it be =E2=80=98target-64bit?=E2=80=99 instead?
Thumbs up for finding the solution!
Ludo=E2=80=99.
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.
Received: (at 63986) by debbugs.gnu.org; 22 Jun 2023 20:13:20 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Thu Jun 22 16:13:20 2023
Received: from localhost ([127.0.0.1]:36858 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1qCQgB-0007Bm-TL
for submit <at> debbugs.gnu.org; Thu, 22 Jun 2023 16:13:20 -0400
Received: from mail-wm1-f44.google.com ([209.85.128.44]:51400)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <efraim.flashner@HIDDEN>) id 1qCQg8-0007BU-Nh
for 63986 <at> debbugs.gnu.org; Thu, 22 Jun 2023 16:13:18 -0400
Received: by mail-wm1-f44.google.com with SMTP id
5b1f17b1804b1-3f900cd3f96so66563295e9.2
for <63986 <at> debbugs.gnu.org>; Thu, 22 Jun 2023 13:13:16 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=20221208; t=1687464790; x=1690056790;
h=in-reply-to:content-disposition:mime-version:references
:mail-followup-to:message-id:subject:cc:to:from:date:sender:from:to
:cc:subject:date:message-id:reply-to;
bh=Ky8Xs7f6tCQ0/1DiEKVSUMPCsNJgIfwZsJoAStEQ9zY=;
b=UFASvvkEbF+0bklbcOwKUqVd98Zd6DV95YcFBvZUj6LfSoCdXrcu2ZA9tIMzxhQCZZ
9+uNZWCwW9s2q0sSw+dOL6JeTcjt7UUbSJK8c6+MdwZZ16ZqPJ2i5iNeAZ6KmDToYaDn
28gGCE79h6kf2HsdA0hbUJs9MneCMP+rk+MPXD1kR+N4HoGnM5t37a6lKkF1y0msBzr5
6xLZ5laY9RV2E0OHx4rzsr4eXvs+9VoQ7UaoZmH12ivqGhqhw5AD4fPJezwjAFXN/oCC
g2kYgt1goR8YOailxbIpy/GurBalgca1TUOwjEQ0aEUZFxksKnuP0/BNmyoF5sBtgO9p
eK/Q==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20221208; t=1687464790; x=1690056790;
h=in-reply-to:content-disposition:mime-version:references
:mail-followup-to:message-id:subject:cc:to:from:date:sender
:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to;
bh=Ky8Xs7f6tCQ0/1DiEKVSUMPCsNJgIfwZsJoAStEQ9zY=;
b=Ny1LLnvS8E4IdMkqssdX2vq5s3Gj8nYQbq3oBzTHXP5nNnyHpfYzq3olb1jxWimWFH
/71SwSUYbs7eSE40y+o3qAUMdNRIoIWL4HZXEW372MX7isGocIS+4pO2Ulzrph8NpQdR
Q1RcTyNAuI6o/hk0aKryeKTYLZ8gAjg4cyyQtn2Ko26oIS1XM8fVF/jnKIXpH4r41917
+aEoAawyLxkdkr/xZGHBws/YvGnUGl9oDFSdPU7t0BYHa4vNv59uodZrOxyGGc2SjVA0
QdvX5+B2t2koLzlMe/BbGrqspFHlM/9XmqBlP13QStPDfdW4/lWfKr8SWaUdTAcL9yYB
7FzQ==
X-Gm-Message-State: AC+VfDwqRUTqVxkRI3KCxMTruUpNgG5Zi8Yo4tXNgQqtuj15FrBAVwBc
B6D6EX+zQXzubk7O2AUZasI=
X-Google-Smtp-Source: ACHHUZ5ocX4oVNLHhXzvPZLSWWXwMRNrsl5ykIIZ4lSRx3CqPAalMcquNulOQuwK6lZ9IiK7K/5e6g==
X-Received: by 2002:adf:f3d0:0:b0:30d:7c09:b677 with SMTP id
g16-20020adff3d0000000b0030d7c09b677mr16203892wrp.39.1687464789644;
Thu, 22 Jun 2023 13:13:09 -0700 (PDT)
Received: from localhost ([188.120.129.124]) by smtp.gmail.com with ESMTPSA id
p1-20020adfcc81000000b0030ada01ca78sm7791448wrj.10.2023.06.22.13.13.08
(version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
Thu, 22 Jun 2023 13:13:08 -0700 (PDT)
Date: Thu, 22 Jun 2023 23:13:07 +0300
From: Efraim Flashner <efraim@HIDDEN>
To: Simon Tournier <zimon.toutoune@HIDDEN>
Subject: Re: bug#63986: Julia is very slow
Message-ID: <ZJSrU5ZqofMV3t4T@3900XT>
Mail-Followup-To: Efraim Flashner <efraim@HIDDEN>,
Simon Tournier <zimon.toutoune@HIDDEN>,
Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>,
63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>,
csantosb@HIDDEN
References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN>
<871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN>
<87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN>
<87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT>
<875y7f8hbf.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha256;
protocol="application/pgp-signature"; boundary="gdMZlgtagU6t38UE"
Content-Disposition: inline
In-Reply-To: <875y7f8hbf.fsf@HIDDEN>
X-PGP-Key-ID: 0x41AAE7DCCA3D8351
X-PGP-Key: https://flashner.co.il/~efraim/efraim_flashner.asc
X-PGP-Fingerprint: A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351
X-Spam-Score: 0.2 (/)
X-Debbugs-Envelope-To: 63986
Cc: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>,
63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>,
csantosb@HIDDEN
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.8 (/)
--gdMZlgtagU6t38UE
Content-Type: multipart/mixed; boundary="VONVFpOeYgn05Vzw"
Content-Disposition: inline
--VONVFpOeYgn05Vzw
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
On Thu, Jun 22, 2023 at 08:47:48PM +0200, Simon Tournier wrote:
> Hi,
>=20
> On Thu, 22 Jun 2023 at 19:25, Efraim Flashner <efraim@HIDDEN> wro=
te:
>=20
> > (ins)efraim@3900XT ~/workspace/guix$ cat /gnu/store/v6z5ykkjfzbc72x1x90=
0xflspqc5wd5r-openblas-ilp64-0.3.20/lib/pkgconfig/openblas.pc
> > libdir=3D/gnu/store/v6z5ykkjfzbc72x1x900xflspqc5wd5r-openblas-ilp64-0.3=
=2E20/lib
> > includedir=3D/gnu/store/v6z5ykkjfzbc72x1x900xflspqc5wd5r-openblas-ilp64=
-0.3.20/include
> > openblas_config=3D USE_64BITINT=3D DYNAMIC_ARCH=3D1 DYNAMIC_OLDER=3D1 N=
O_CBLAS=3D NO_LAPACK=3D NO_LAPACKE=3D NO_AFFINITY=3D1 USE_OPENMP=3D generic=
MAX_THREADS=3D128
> > version=3D0.3.20
> > extralib=3D-lm -lpthread -lgfortran -lm -lpthread -lgfortran
> > Name: openblas
> > Description: OpenBLAS is an optimized BLAS library based on GotoBLAS2 1=
=2E13 BSD version
> > Version: ${version}
> > URL: https://github.com/xianyi/OpenBLAS
> > Libs: -L${libdir} -lopenblas
> > Libs.private: ${extralib}
> > Cflags: -I${includedir}
> >
> > Looks like it should be "LIBBLAS=3D-lopenblas"
>=20
> I propose to tweak openblas-ilp64. Currently it looks like:
>=20
> --8<---------------cut here---------------start------------->8---
> $ tree $(guix build openblas-ilp64)/lib
> /gnu/store/v6z5ykkjfzbc72x1x900xflspqc5wd5r-openblas-ilp64-0.3.20/lib
> =E2=94=9C=E2=94=80=E2=94=80 cmake
> =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 openblas
> =E2=94=82=C2=A0=C2=A0 =E2=94=9C=E2=94=80=E2=94=80 OpenBLASConfig.cmake
> =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 OpenBLASConfigVersi=
on.cmake
> =E2=94=9C=E2=94=80=E2=94=80 libopenblas_ilp64p-r0.3.20.so
> =E2=94=9C=E2=94=80=E2=94=80 libopenblas_ilp64.so -> libopenblas_ilp64p-r0=
=2E3.20.so
> =E2=94=9C=E2=94=80=E2=94=80 libopenblas_ilp64.so.0 -> libopenblas_ilp64p-=
r0.3.20.so
> =E2=94=94=E2=94=80=E2=94=80 pkgconfig
> =E2=94=94=E2=94=80=E2=94=80 openblas.pc
> --8<---------------cut here---------------end--------------->8---
>=20
> which is inconsistent with pkgconfig as you noticed above. Therefore, I
> am proposing the addition of a symlink of libopenblas_ilp64p.so to
> libopenblas.so. For instance this attached patch.
I've attached the patch that I've made it to. julia is built with
openblas-ilp64 on 64-bit architectures, openblas-ilp64 has its
configure-flags adjusted to match what other programs are expecting, and
I've also patched python-numpy to use openblas-ilp64 as another test
target.
--=20
Efraim Flashner <efraim@HIDDEN> =D7=A8=D7=A0=D7=A9=D7=9C=D7=A4 =
=D7=9D=D7=99=D7=A8=D7=A4=D7=90
GPG key =3D A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted
--VONVFpOeYgn05Vzw
Content-Type: text/plain; charset=utf-8
Content-Disposition: attachment; filename="julia-openblas-ilp64.patch"
Content-Transfer-Encoding: quoted-printable
diff --git a/gnu/packages/julia.scm b/gnu/packages/julia.scm
index ba54175822..e96131dfc0 100644
--- a/gnu/packages/julia.scm
+++ b/gnu/packages/julia.scm
@@ -269,7 +269,10 @@ (define-public julia
(substitute* (jlpath "nghttp2")
(((from "libnghttp2")) (to "libnghttp2" "libnghttp2")))
(substitute* (jlpath "OpenBLAS")
- (((from "libopenblas")) (to "openblas" "libopenblas")))
+ (((from "libopenblas"))
+ ,@(if (target-64bit?)
+ `((to "openblas" "libopenblas64_" "libopenblas"))
+ `((to "openblas" "libopenblas")))))
(substitute* (jlpath "OpenLibm")
(((from "libopenlibm")) (to "openlibm" "libopenlibm")))
(substitute* (jlpath "PCRE2")
@@ -479,12 +482,12 @@ (define-public julia
"NO_GIT=3D1" ; build from release tarball.
"USE_GPL_LIBS=3D1" ; proudly
=20
- ,@(if (target-aarch64?)
- `("USE_BLAS64=3D0")
- '())
-
- "LIBBLAS=3D-lopenblas"
- "LIBBLASNAME=3Dlibopenblas"
+ ,@(if (target-64bit?)
+ `("USE_BLAS64=3D1"
+ "LIBBLAS=3D-lopenblas64_"
+ "LIBBLASNAME=3Dlibopenblas64_")
+ `("LIBBLAS=3D-lopenblas"
+ "LIBBLASNAME=3Dlibopenblas"))
=20
(string-append "UTF8PROC_INC=3D"
(assoc-ref %build-inputs "utf8proc")
@@ -513,7 +516,9 @@ (define-public julia
("llvm" ,llvm-julia)
("mbedtls-apache" ,mbedtls-apache)
("mpfr" ,mpfr)
- ("openblas" ,openblas)
+ ,@(if (target-64bit?)
+ `(("openblas" ,openblas-ilp64))
+ `(("openblas" ,openblas)))
("openlibm" ,openlibm)
("p7zip" ,p7zip)
("pcre2" ,pcre2)
diff --git a/gnu/packages/maths.scm b/gnu/packages/maths.scm
index f5a2181905..2d3ce41cb7 100644
--- a/gnu/packages/maths.scm
+++ b/gnu/packages/maths.scm
@@ -4645,7 +4645,9 @@ (define-public openblas-ilp64
(arguments
(substitute-keyword-arguments (package-arguments openblas)
((#:make-flags flags #~'())
- #~(append (list "INTERFACE64=3D1" "LIBNAMESUFFIX=3Dilp64")
+ #~(append (list "INTERFACE64=3D1"
+ "SYMBOLSUFFIX=3D64_"
+ "LIBPREFIX=3Dlibopenblas64_")
#$flags))))
(synopsis "Optimized BLAS library based on GotoBLAS (ILP64 version)")
(license license:bsd-3)))
diff --git a/gnu/packages/python-xyz.scm b/gnu/packages/python-xyz.scm
index b650b71f3b..deeffb67ae 100644
--- a/gnu/packages/python-xyz.scm
+++ b/gnu/packages/python-xyz.scm
@@ -6953,19 +6953,36 @@ (define-public python-numpy
(lambda _
(setenv "NPY_NUM_BUILD_JOBS"
(number->string (parallel-job-count)))))
- (add-before 'build 'configure-blas
- (lambda* (#:key inputs #:allow-other-keys)
- (call-with-output-file "site.cfg"
- (lambda (port)
- (format port
- "\
+ #$@(if (target-64bit?)
+ #~((add-before 'build 'configure-blas
+ (lambda* (#:key inputs #:allow-other-keys)
+ (setenv "NPY_USE_BLAS_ILP64" "1")
+ (setenv "NPY_BLAS_ILP64_ORDER" "openblas64_")
+ (setenv "NPY_LAPACK_ILP64_ORDER" "openblas64_")
+ (call-with-output-file "site.cfg"
+ (lambda (port)
+ (format port
+ "\
+[openblas64_]
+libraries =3D openblas64_
+library_dirs =3D ~a/lib
+include_dirs =3D ~:*~a/include~%"
+ (dirname (dirname
+ (search-input-file
+ inputs "include/openblas_config.h")))=
))))))
+ #~((add-before 'build 'configure-blas
+ (lambda* (#:key inputs #:allow-other-keys)
+ (call-with-output-file "site.cfg"
+ (lambda (port)
+ (format port
+ "\
[openblas]
libraries =3D openblas
library_dirs =3D ~a/lib
include_dirs =3D ~:*~a/include~%"
(dirname (dirname
(search-input-file
- inputs "include/openblas_config.h")))=
)))))
+ inputs "include/openblas_config.h")))=
)))))))
(add-before 'build 'fix-executable-paths
(lambda* (#:key inputs #:allow-other-keys)
;; Make /gnu/store/...-bash-.../bin/sh the default shell,
@@ -7021,7 +7038,11 @@ (define-public python-numpy
python-pytest-xdist
python-typing-extensions
gfortran))
- (inputs (list bash openblas))
+ (inputs
+ (list bash
+ (if (target-64bit?)
+ openblas-ilp64
+ openblas)))
(home-page "https://numpy.org")
(synopsis "Fundamental package for scientific computing with Python")
(description "NumPy is the fundamental package for scientific computing
--VONVFpOeYgn05Vzw--
--gdMZlgtagU6t38UE
Content-Type: application/pgp-signature; name="signature.asc"
-----BEGIN PGP SIGNATURE-----
iQIzBAABCAAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAmSUq1AACgkQQarn3Mo9
g1EKKA/+MMJCz0bec5w1dDBBZFaPNvmamno2xZD+sjeZCIWwruLAjnShYynJ8+qz
I9GoOQc7Yzgd52VKd6DekCFXPTlviKRTzpR1wdNmWPgVTz8VKm0kEpjZdGzcz9aq
aCoTnZrQs15aEY0B5yDXyXwtWjx4D8FbZLRs/QlBk0a0WRGHm9gxfCRzMOJJS3Iw
hFPWftIET4YVtF5W2W/cZqVHJO1OrgFPdfKPglYJGQl2U4WVxpMWOe5xjyjlM27c
/uV5l4BzAOhIUDFweIHmNthfG8X+Bn7T2XqKbmWLolOB+rT1ScETWMxiHs/uH6V2
kWaU9v6BhVOVYshqGvxdDzSyqF3YtXiEt1DG9ZwSvWnb3OtzRwzEMSJV4OrVeJzQ
82u822DLRw0IYylFOmhr39Qx4ZV85ekmlPkyz4BI6Hzw38xsorjN18CrnJxYmKDy
FVeVRXoQHW6IZJPIYv9XW8LziGeRych2vJWMaU9DkJUbpWFLO2xDA7FZr7Ra5tag
JCqoETfRDovpiUeJ89oa3fwR5OseriXJcLYBn8NYET9xsgNtUnQI+7lQfiExNzBN
X6iwRqNJ3JqB0pn1iNyms4uX+RlCEokBYS2xZFzTYKI2C/eVme0eEhtWHod6UrEs
kFhIfqMGUhO94rwQCoUvheL1YruAuok0br6/4daiZe2gg6E1RYQ=
=wake
-----END PGP SIGNATURE-----
--gdMZlgtagU6t38UE--
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.
Received: (at 63986) by debbugs.gnu.org; 22 Jun 2023 18:55:27 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Thu Jun 22 14:55:27 2023
Received: from localhost ([127.0.0.1]:36742 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1qCPSp-0008UJ-8N
for submit <at> debbugs.gnu.org; Thu, 22 Jun 2023 14:55:27 -0400
Received: from mail-wm1-f46.google.com ([209.85.128.46]:58811)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <efraim.flashner@HIDDEN>) id 1qCPSl-0008U2-OQ
for 63986 <at> debbugs.gnu.org; Thu, 22 Jun 2023 14:55:25 -0400
Received: by mail-wm1-f46.google.com with SMTP id
5b1f17b1804b1-3f9b4a71623so42172655e9.1
for <63986 <at> debbugs.gnu.org>; Thu, 22 Jun 2023 11:55:23 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=20221208; t=1687460118; x=1690052118;
h=in-reply-to:content-disposition:mime-version:references
:mail-followup-to:message-id:subject:cc:to:from:date:sender:from:to
:cc:subject:date:message-id:reply-to;
bh=ANqVlzFUPFGBCFGLmuLmlp52BrGF8o/ek7tSUgBWEO8=;
b=o0iO8M6Ow0mtyGUhOqmu0MosKKQh3uWAj5KOiCqVjQIgSVlbSQTHVp5xgdBg3/z0Ec
1hTJPsZCgm1vIz9ZblE5pq/pW4TWTSqIVcfvPSLhBZl3JE67/jvCa6d0STpRvY5qcGN0
PArrRrpZP0gmd9VLCCv1ut6bVBHlCdq+hRdRxOskKWMR4puw9Lk7k2M1tDdyaCLtxRzQ
9kucEYcNygZxGeJqk5UQ9Uzrd5YtM5LTEmcs1VOKAo4NC10h1UinTjqdcroSo0OMMzwM
YACwzYPT8YNG/T7tQL/MAZ4A7/90+0cZZs3qkz0pKXpvN1yZHAszs/kIya6776tmBt63
hLlQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20221208; t=1687460118; x=1690052118;
h=in-reply-to:content-disposition:mime-version:references
:mail-followup-to:message-id:subject:cc:to:from:date:sender
:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to;
bh=ANqVlzFUPFGBCFGLmuLmlp52BrGF8o/ek7tSUgBWEO8=;
b=TI6XhdwhK12cwIFh2STo0GHMQJFNrmF3SAjr0qDEmxESbdMs6ESg2bq1jF4SmQq5Fj
Bv7eha5jFQR6CYoe+Ow7p9UFNLKwQ0qg1pcRpMEQ4G/sL9pmpypbJA0wrIzejcLPb2zV
3wCwuGZS88QHS4CkUBEmXIGAJZb8W44Vw2pXjgert52RndIx0lxqmJ+9p6ANhYBqP9Uw
TxlwQqD8Sywq6wDPRzArvdUncyyUqWmP58AC1yML3kyYzfnoiGyZP1VZQoraag7tdFFu
7Le5z+P3SZ9y+e5fUkLQ78G0p6lMjKxvSOpR5JKCMUzTjV+4uZsQHthOtRIJ4oJoua5x
mjew==
X-Gm-Message-State: AC+VfDwd2WSR5wmqoVHsDS9QMFICb6WU2JIENvA8cuQzBkBOtd4JmVHJ
JBhwYl2FMNkRIq1NX5t295I=
X-Google-Smtp-Source: ACHHUZ6xAPBXU38/tJ7QgzTMP/v7AfycxSzkd550t6XcfGgipyHBaZPa4J9aZI8d3FBKDS6tDL81bw==
X-Received: by 2002:a1c:4b08:0:b0:3f7:b1dd:954b with SMTP id
y8-20020a1c4b08000000b003f7b1dd954bmr2203107wma.31.1687460117612;
Thu, 22 Jun 2023 11:55:17 -0700 (PDT)
Received: from localhost ([188.120.129.124]) by smtp.gmail.com with ESMTPSA id
n10-20020a7bc5ca000000b003f42314832fsm244466wmk.18.2023.06.22.11.55.16
(version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
Thu, 22 Jun 2023 11:55:17 -0700 (PDT)
Date: Thu, 22 Jun 2023 21:55:15 +0300
From: Efraim Flashner <efraim@HIDDEN>
To: Simon Tournier <zimon.toutoune@HIDDEN>
Subject: Re: bug#63986: Julia is very slow
Message-ID: <ZJSZExs94_1yjjZh@3900XT>
Mail-Followup-To: Efraim Flashner <efraim@HIDDEN>,
Simon Tournier <zimon.toutoune@HIDDEN>,
Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>,
63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>,
csantosb@HIDDEN
References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN>
<871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN>
<87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN>
<87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT>
<875y7f8hbf.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha256;
protocol="application/pgp-signature"; boundary="gEMngYjU58n67i/L"
Content-Disposition: inline
In-Reply-To: <875y7f8hbf.fsf@HIDDEN>
X-PGP-Key-ID: 0x41AAE7DCCA3D8351
X-PGP-Key: https://flashner.co.il/~efraim/efraim_flashner.asc
X-PGP-Fingerprint: A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351
X-Spam-Score: 0.2 (/)
X-Debbugs-Envelope-To: 63986
Cc: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>,
63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>,
csantosb@HIDDEN
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.8 (/)
--gEMngYjU58n67i/L
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
On Thu, Jun 22, 2023 at 08:47:48PM +0200, Simon Tournier wrote:
> Hi,
>=20
> On Thu, 22 Jun 2023 at 19:25, Efraim Flashner <efraim@HIDDEN> wro=
te:
>=20
> > (ins)efraim@3900XT ~/workspace/guix$ cat /gnu/store/v6z5ykkjfzbc72x1x90=
0xflspqc5wd5r-openblas-ilp64-0.3.20/lib/pkgconfig/openblas.pc
> > libdir=3D/gnu/store/v6z5ykkjfzbc72x1x900xflspqc5wd5r-openblas-ilp64-0.3=
=2E20/lib
> > includedir=3D/gnu/store/v6z5ykkjfzbc72x1x900xflspqc5wd5r-openblas-ilp64=
-0.3.20/include
> > openblas_config=3D USE_64BITINT=3D DYNAMIC_ARCH=3D1 DYNAMIC_OLDER=3D1 N=
O_CBLAS=3D NO_LAPACK=3D NO_LAPACKE=3D NO_AFFINITY=3D1 USE_OPENMP=3D generic=
MAX_THREADS=3D128
> > version=3D0.3.20
> > extralib=3D-lm -lpthread -lgfortran -lm -lpthread -lgfortran
> > Name: openblas
> > Description: OpenBLAS is an optimized BLAS library based on GotoBLAS2 1=
=2E13 BSD version
> > Version: ${version}
> > URL: https://github.com/xianyi/OpenBLAS
> > Libs: -L${libdir} -lopenblas
> > Libs.private: ${extralib}
> > Cflags: -I${includedir}
> >
> > Looks like it should be "LIBBLAS=3D-lopenblas"
>=20
> I propose to tweak openblas-ilp64. Currently it looks like:
>=20
> --8<---------------cut here---------------start------------->8---
> $ tree $(guix build openblas-ilp64)/lib
> /gnu/store/v6z5ykkjfzbc72x1x900xflspqc5wd5r-openblas-ilp64-0.3.20/lib
> =E2=94=9C=E2=94=80=E2=94=80 cmake
> =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 openblas
> =E2=94=82=C2=A0=C2=A0 =E2=94=9C=E2=94=80=E2=94=80 OpenBLASConfig.cmake
> =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 OpenBLASConfigVersi=
on.cmake
> =E2=94=9C=E2=94=80=E2=94=80 libopenblas_ilp64p-r0.3.20.so
> =E2=94=9C=E2=94=80=E2=94=80 libopenblas_ilp64.so -> libopenblas_ilp64p-r0=
=2E3.20.so
> =E2=94=9C=E2=94=80=E2=94=80 libopenblas_ilp64.so.0 -> libopenblas_ilp64p-=
r0.3.20.so
> =E2=94=94=E2=94=80=E2=94=80 pkgconfig
> =E2=94=94=E2=94=80=E2=94=80 openblas.pc
> --8<---------------cut here---------------end--------------->8---
>=20
> which is inconsistent with pkgconfig as you noticed above. Therefore, I
> am proposing the addition of a symlink of libopenblas_ilp64p.so to
> libopenblas.so. For instance this attached patch.
If we drop the "LIBNAMESUFFIX=3Dilp64" from openblas-ilp64 then we get
libopenblas.so by default without needing to also symlink it into place.
One benefit of this is we'd be able to easily do some package
transformations between openblas and openblas-ilp64.
Currently I'm looking around online to see what the consensus seems to
be with naming openblas-ilp64, and there seems to be a lot of options.
> From 0c8c7e9371d11972f4a6012ef503ef3057c91364 Mon Sep 17 00:00:00 2001
> Message-Id: <0c8c7e9371d11972f4a6012ef503ef3057c91364.1687459454.git.zimo=
n.toutoune@HIDDEN>
> From: Simon Tournier <zimon.toutoune@HIDDEN>
> Date: Thu, 22 Jun 2023 20:31:26 +0200
> Subject: [PATCH v3 1/2] gnu: openblas-ilp64: Install symlink to libopenbl=
as.
>=20
> * gnu/packages/maths.scm (openblas-ilp64)[arguments]: Add phases for
> installing symlink to libopenblas.
> ---
> gnu/packages/maths.scm | 8 +++++++-
> 1 file changed, 7 insertions(+), 1 deletion(-)
>=20
> diff --git a/gnu/packages/maths.scm b/gnu/packages/maths.scm
> index f5a2181905..5c39ab8b94 100644
> --- a/gnu/packages/maths.scm
> +++ b/gnu/packages/maths.scm
> @@ -4646,7 +4646,13 @@ (define-public openblas-ilp64
> (substitute-keyword-arguments (package-arguments openblas)
> ((#:make-flags flags #~'())
> #~(append (list "INTERFACE64=3D1" "LIBNAMESUFFIX=3Dilp64")
> - #$flags))))
> + #$flags))
> + ((#:phases phases)
> + #~(modify-phases #$phases
> + (add-after 'install 'install-symlink
> + (lambda _
> + (symlink "libopenblas_ilp64.so"
> + (string-append #$output "/lib/libopenblas.so"))=
))))))
> (synopsis "Optimized BLAS library based on GotoBLAS (ILP64 version)")
> (license license:bsd-3)))
> =20
>=20
> base-commit: 37c2e94cec6cb8b5e0e93e7b6c712c3b187ca5db
> --=20
> 2.38.1
>=20
>=20
> Then, the patch for Julia looks like the other attached patch.
>=20
> From 8563a738703d133b44ae05b91b7448ca56d280b5 Mon Sep 17 00:00:00 2001
> Message-Id: <8563a738703d133b44ae05b91b7448ca56d280b5.1687459454.git.zimo=
n.toutoune@HIDDEN>
> In-Reply-To: <0c8c7e9371d11972f4a6012ef503ef3057c91364.1687459454.git.zim=
on.toutoune@HIDDEN>
> References: <0c8c7e9371d11972f4a6012ef503ef3057c91364.1687459454.git.zimo=
n.toutoune@HIDDEN>
> From: Simon Tournier <zimon.toutoune@HIDDEN>
> Date: Thu, 22 Jun 2023 17:45:50 +0200
> Subject: [PATCH v3 2/2] gnu: julia: Conditionally use openblas with ILP64
> support.
>=20
> Fixes <https://bugs.gnu.org/63986>.
> Reported by Cayetano Santos <csantosb@HIDDEN>.
>=20
> * gnu/packages/julia.scm (julia)[arguments]<#:make-flags>: Conditionally =
use
> 64-bit BLAS for x86-64 target.
> [inputs]: Conditionally replace openblas by openblas-ilp64 for x86-64 tar=
get.
> ---
> gnu/packages/julia.scm | 10 ++++++----
> 1 file changed, 6 insertions(+), 4 deletions(-)
>=20
> diff --git a/gnu/packages/julia.scm b/gnu/packages/julia.scm
> index ba54175822..17a27f4928 100644
> --- a/gnu/packages/julia.scm
> +++ b/gnu/packages/julia.scm
> @@ -479,9 +479,9 @@ (define-public julia
> "NO_GIT=3D1" ; build from release tarball.
> "USE_GPL_LIBS=3D1" ; proudly
> =20
> - ,@(if (target-aarch64?)
> - `("USE_BLAS64=3D0")
> - '())
> + ,@(if (target-x86-64?)
> + `("USE_BLAS64=3D1")
> + '())
> =20
> "LIBBLAS=3D-lopenblas"
> "LIBBLASNAME=3Dlibopenblas"
> @@ -513,7 +513,9 @@ (define-public julia
> ("llvm" ,llvm-julia)
> ("mbedtls-apache" ,mbedtls-apache)
> ("mpfr" ,mpfr)
> - ("openblas" ,openblas)
> + ,@(if (target-x86-64?)
> + `(("openblas" ,openblas-ilp64))
> + `(("openblas" ,openblas)))
> ("openlibm" ,openlibm)
> ("p7zip" ,p7zip)
> ("pcre2" ,pcre2)
> --=20
> 2.38.1
>=20
>=20
> WDYT?
>=20
> Well, I am running all the testsuite for checking if all is correct.
> Somehow, I think this is direction. Otherwise, what would you suggest?
>=20
> Cheers,
> simon
>=20
>=20
>=20
--=20
Efraim Flashner <efraim@HIDDEN> =D7=A8=D7=A0=D7=A9=D7=9C=D7=A4 =
=D7=9D=D7=99=D7=A8=D7=A4=D7=90
GPG key =3D A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted
--gEMngYjU58n67i/L
Content-Type: application/pgp-signature; name="signature.asc"
-----BEGIN PGP SIGNATURE-----
iQIzBAABCAAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAmSUmQ8ACgkQQarn3Mo9
g1HAzBAApzwRY8knjwQjcNMckKOnvm3ijPtcg/obG60V/rc8Lt0FSoR6vQItN1Yx
/lyf+WMkSntOt3BbCUa47GI+BzHBgoUvlhh9oxUyIiNDYKceVdTCXk8EqxT8woLb
Tx6jYWJyqun/v/ToyOr0m+MHyljoER93/TlRt2zWHwRvC+d6OdDos1GvRM4/dtEp
nlsI5R7pcjLsCb97+wLc9nfzxOLHvVykDNMqWHVFCdRdNPO9PxJoN9TFtL/h0Btp
7RHgVBBl16ljHi82qvVJp2vrMEObTkaL4UIe0fbYmZfylJIiKWfFL+JSdM5sX8oi
6+7uNev3x7lzn+bxWj3pi/ZR9m5l3lXPa1+HKUbAtz2SR1zTJFqQgtuT/E50jFzd
wgcL64tXaIo7FkRYvXexsSJVkFIxs/ZTCOV7R65m4haXVsF37B9pylrCrYDmvt9J
26IoWZazmex1G2WjUQ8rrn9EKiLkzLURwSqwtABRZ+6CMYNd5eEQZ5/oQ+WYJMKY
rgqeuLe44Uz4ozysP7BNbcsuF/C6z8oFg8Nd7xAhiW+y9l5Ux6uKrOKFtuqjcJMT
5nyAN8CuX7zbr1MKe7K154T0QyerIkW2lWCrcPfLa7gMEcalzmk/bUQON03kUHhP
pcI5orfVRWH5a27E/mZ6ee36w31gfKOfe1z3Eb03gg8OyeTqhZI=
=jfnB
-----END PGP SIGNATURE-----
--gEMngYjU58n67i/L--
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.
Received: (at 63986) by debbugs.gnu.org; 22 Jun 2023 18:48:00 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Thu Jun 22 14:48:00 2023
Received: from localhost ([127.0.0.1]:36734 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1qCPLb-0008H2-Ly
for submit <at> debbugs.gnu.org; Thu, 22 Jun 2023 14:48:00 -0400
Received: from mail-wr1-f42.google.com ([209.85.221.42]:39937)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <zimon.toutoune@HIDDEN>) id 1qCPLZ-0008GD-Q3
for 63986 <at> debbugs.gnu.org; Thu, 22 Jun 2023 14:47:58 -0400
Received: by mail-wr1-f42.google.com with SMTP id
ffacd0b85a97d-3112599fd5cso1864140f8f.0
for <63986 <at> debbugs.gnu.org>; Thu, 22 Jun 2023 11:47:57 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=20221208; t=1687459672; x=1690051672;
h=mime-version:message-id:date:references:in-reply-to:subject:cc:to
:from:from:to:cc:subject:date:message-id:reply-to;
bh=0y2jwc9zoMvk3rZO1kB3N5leeibatl97Uk95S7oUrDA=;
b=avU+VIOFvj7NVUfU4m0X7CQgP0X3L3dabmyhzX65/Vbe4oMSkAIX2+XmdSs9/P4RCJ
BQX4cTElggqRj1FH2Rxk++TB/Ez83FravC8q2B8sKowlPBbpTGMW1CeYr9X08+Ae0iuG
Ab847BctucGTPjI5uxnoMBLTuxcnsF2goCt407kKqxH5q1P51rxqDse5m9R1l4811RNJ
Jf0eDqkNn+QGBrgTp8OyGGlt7uG43d5wEfVMKmG1HJD9YqIMfzRHzXHeHXdk/aCPVuk6
PtHmGDQ+42JkrlRc1aCa+p3ded0Ibk9bN5LDHFlAFNksEYNIhbChz7Zt3jwdNVzpeDj6
E/tg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20221208; t=1687459672; x=1690051672;
h=mime-version:message-id:date:references:in-reply-to:subject:cc:to
:from:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to;
bh=0y2jwc9zoMvk3rZO1kB3N5leeibatl97Uk95S7oUrDA=;
b=Z1ozi0FKePObB35PmwrdzI2PWoJgDKqpxw+a7tCGy8qlyDCKb3i740IQEzJFP4fZIk
c2tC3oYmjW+uuvSzXrKAQhenJP89iE4J0TjBjnDkATCnsVB7qtf9hbk37sKCG8kjWYwW
Qa4vDQZghUWOSm0h/xbLNfQieTBy716tncUAKtyjKLqIHiOQFEXqkSBPoHiQ8YxFRN10
1CTBpRLGt9Fi/6C35TkcYvnoxvAUSQ03NyjGOY0ItzaBd3pgJk9Hs1Pi4NNMXltlNhaq
jORwF/jTRmU6NGdSuT01WD6SZcqlC61lNth7WRPBwcjzQ7PShyMPNdUxFTVyS6zQIGFj
MuIA==
X-Gm-Message-State: AC+VfDzcroTiGlVQEfHxaFJxZyCPx/7Rxzvl16c6L3zrS5Ok2VceFO/5
zgjcp091kj8xnqRQVVO7+dU=
X-Google-Smtp-Source: ACHHUZ4pStzuxaCGMmJm6RluYCnmi8a/0FXSIabaZLhS0t7Ugn+9nMSZePlrHbVFphmfhFde/rsL4w==
X-Received: by 2002:adf:ef8d:0:b0:30f:ca51:629e with SMTP id
d13-20020adfef8d000000b0030fca51629emr15377397wro.5.1687459671648;
Thu, 22 Jun 2023 11:47:51 -0700 (PDT)
Received: from pfiuh07 ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id
c9-20020a056000104900b0030631a599a0sm7528073wrx.24.2023.06.22.11.47.50
(version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
Thu, 22 Jun 2023 11:47:51 -0700 (PDT)
From: Simon Tournier <zimon.toutoune@HIDDEN>
To: Efraim Flashner <efraim@HIDDEN>
Subject: Re: bug#63986: Julia is very slow
In-Reply-To: <ZJR14QoB4SoqhsrP@3900XT>
References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN>
<871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN>
<87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN>
<87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT>
Date: Thu, 22 Jun 2023 20:47:48 +0200
Message-ID: <875y7f8hbf.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/mixed; boundary="=-=-="
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 63986
Cc: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>,
63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>,
csantosb@HIDDEN
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)
--=-=-=
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Hi,
On Thu, 22 Jun 2023 at 19:25, Efraim Flashner <efraim@HIDDEN> wrote:
> (ins)efraim@3900XT ~/workspace/guix$ cat /gnu/store/v6z5ykkjfzbc72x1x900x=
flspqc5wd5r-openblas-ilp64-0.3.20/lib/pkgconfig/openblas.pc
> libdir=3D/gnu/store/v6z5ykkjfzbc72x1x900xflspqc5wd5r-openblas-ilp64-0.3.2=
0/lib
> includedir=3D/gnu/store/v6z5ykkjfzbc72x1x900xflspqc5wd5r-openblas-ilp64-0=
.3.20/include
> openblas_config=3D USE_64BITINT=3D DYNAMIC_ARCH=3D1 DYNAMIC_OLDER=3D1 NO_=
CBLAS=3D NO_LAPACK=3D NO_LAPACKE=3D NO_AFFINITY=3D1 USE_OPENMP=3D generic M=
AX_THREADS=3D128
> version=3D0.3.20
> extralib=3D-lm -lpthread -lgfortran -lm -lpthread -lgfortran
> Name: openblas
> Description: OpenBLAS is an optimized BLAS library based on GotoBLAS2 1.1=
3 BSD version
> Version: ${version}
> URL: https://github.com/xianyi/OpenBLAS
> Libs: -L${libdir} -lopenblas
> Libs.private: ${extralib}
> Cflags: -I${includedir}
>
> Looks like it should be "LIBBLAS=3D-lopenblas"
I propose to tweak openblas-ilp64. Currently it looks like:
--8<---------------cut here---------------start------------->8---
$ tree $(guix build openblas-ilp64)/lib
/gnu/store/v6z5ykkjfzbc72x1x900xflspqc5wd5r-openblas-ilp64-0.3.20/lib
=E2=94=9C=E2=94=80=E2=94=80 cmake
=E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 openblas
=E2=94=82=C2=A0=C2=A0 =E2=94=9C=E2=94=80=E2=94=80 OpenBLASConfig.cmake
=E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 OpenBLASConfigVersion=
.cmake
=E2=94=9C=E2=94=80=E2=94=80 libopenblas_ilp64p-r0.3.20.so
=E2=94=9C=E2=94=80=E2=94=80 libopenblas_ilp64.so -> libopenblas_ilp64p-r0.3=
.20.so
=E2=94=9C=E2=94=80=E2=94=80 libopenblas_ilp64.so.0 -> libopenblas_ilp64p-r0=
.3.20.so
=E2=94=94=E2=94=80=E2=94=80 pkgconfig
=E2=94=94=E2=94=80=E2=94=80 openblas.pc
--8<---------------cut here---------------end--------------->8---
which is inconsistent with pkgconfig as you noticed above. Therefore, I
am proposing the addition of a symlink of libopenblas_ilp64p.so to
libopenblas.so. For instance this attached patch.
--=-=-=
Content-Type: text/x-diff
Content-Disposition: inline;
filename=v3-0001-gnu-openblas-ilp64-Install-symlink-to-libopenblas.patch
Content-Description: p3-openblas-ilp64.patch
From 0c8c7e9371d11972f4a6012ef503ef3057c91364 Mon Sep 17 00:00:00 2001
Message-Id: <0c8c7e9371d11972f4a6012ef503ef3057c91364.1687459454.git.zimon.toutoune@HIDDEN>
From: Simon Tournier <zimon.toutoune@HIDDEN>
Date: Thu, 22 Jun 2023 20:31:26 +0200
Subject: [PATCH v3 1/2] gnu: openblas-ilp64: Install symlink to libopenblas.
* gnu/packages/maths.scm (openblas-ilp64)[arguments]: Add phases for
installing symlink to libopenblas.
---
gnu/packages/maths.scm | 8 +++++++-
1 file changed, 7 insertions(+), 1 deletion(-)
diff --git a/gnu/packages/maths.scm b/gnu/packages/maths.scm
index f5a2181905..5c39ab8b94 100644
--- a/gnu/packages/maths.scm
+++ b/gnu/packages/maths.scm
@@ -4646,7 +4646,13 @@ (define-public openblas-ilp64
(substitute-keyword-arguments (package-arguments openblas)
((#:make-flags flags #~'())
#~(append (list "INTERFACE64=1" "LIBNAMESUFFIX=ilp64")
- #$flags))))
+ #$flags))
+ ((#:phases phases)
+ #~(modify-phases #$phases
+ (add-after 'install 'install-symlink
+ (lambda _
+ (symlink "libopenblas_ilp64.so"
+ (string-append #$output "/lib/libopenblas.so"))))))))
(synopsis "Optimized BLAS library based on GotoBLAS (ILP64 version)")
(license license:bsd-3)))
base-commit: 37c2e94cec6cb8b5e0e93e7b6c712c3b187ca5db
--
2.38.1
--=-=-=
Content-Type: text/plain
Then, the patch for Julia looks like the other attached patch.
--=-=-=
Content-Type: text/x-diff
Content-Disposition: inline;
filename=v3-0002-gnu-julia-Conditionally-use-openblas-with-ILP64-s.patch
Content-Description: p3.patch
From 8563a738703d133b44ae05b91b7448ca56d280b5 Mon Sep 17 00:00:00 2001
Message-Id: <8563a738703d133b44ae05b91b7448ca56d280b5.1687459454.git.zimon.toutoune@HIDDEN>
In-Reply-To: <0c8c7e9371d11972f4a6012ef503ef3057c91364.1687459454.git.zimon.toutoune@HIDDEN>
References: <0c8c7e9371d11972f4a6012ef503ef3057c91364.1687459454.git.zimon.toutoune@HIDDEN>
From: Simon Tournier <zimon.toutoune@HIDDEN>
Date: Thu, 22 Jun 2023 17:45:50 +0200
Subject: [PATCH v3 2/2] gnu: julia: Conditionally use openblas with ILP64
support.
Fixes <https://bugs.gnu.org/63986>.
Reported by Cayetano Santos <csantosb@HIDDEN>.
* gnu/packages/julia.scm (julia)[arguments]<#:make-flags>: Conditionally use
64-bit BLAS for x86-64 target.
[inputs]: Conditionally replace openblas by openblas-ilp64 for x86-64 target.
---
gnu/packages/julia.scm | 10 ++++++----
1 file changed, 6 insertions(+), 4 deletions(-)
diff --git a/gnu/packages/julia.scm b/gnu/packages/julia.scm
index ba54175822..17a27f4928 100644
--- a/gnu/packages/julia.scm
+++ b/gnu/packages/julia.scm
@@ -479,9 +479,9 @@ (define-public julia
"NO_GIT=1" ; build from release tarball.
"USE_GPL_LIBS=1" ; proudly
- ,@(if (target-aarch64?)
- `("USE_BLAS64=0")
- '())
+ ,@(if (target-x86-64?)
+ `("USE_BLAS64=1")
+ '())
"LIBBLAS=-lopenblas"
"LIBBLASNAME=libopenblas"
@@ -513,7 +513,9 @@ (define-public julia
("llvm" ,llvm-julia)
("mbedtls-apache" ,mbedtls-apache)
("mpfr" ,mpfr)
- ("openblas" ,openblas)
+ ,@(if (target-x86-64?)
+ `(("openblas" ,openblas-ilp64))
+ `(("openblas" ,openblas)))
("openlibm" ,openlibm)
("p7zip" ,p7zip)
("pcre2" ,pcre2)
--
2.38.1
--=-=-=
Content-Type: text/plain
WDYT?
Well, I am running all the testsuite for checking if all is correct.
Somehow, I think this is direction. Otherwise, what would you suggest?
Cheers,
simon
--=-=-=--
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.
Received: (at 63986) by debbugs.gnu.org; 22 Jun 2023 17:13:09 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Thu Jun 22 13:13:09 2023
Received: from localhost ([127.0.0.1]:36635 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1qCNrp-0005nK-3J
for submit <at> debbugs.gnu.org; Thu, 22 Jun 2023 13:13:09 -0400
Received: from mail-wr1-f49.google.com ([209.85.221.49]:39266)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <zimon.toutoune@HIDDEN>) id 1qCNrn-0005mi-1d
for 63986 <at> debbugs.gnu.org; Thu, 22 Jun 2023 13:13:07 -0400
Received: by mail-wr1-f49.google.com with SMTP id
ffacd0b85a97d-3110e74bf3cso1700787f8f.1
for <63986 <at> debbugs.gnu.org>; Thu, 22 Jun 2023 10:13:07 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=20221208; t=1687453981; x=1690045981;
h=mime-version:message-id:date:references:in-reply-to:subject:cc:to
:from:from:to:cc:subject:date:message-id:reply-to;
bh=CCIvvJGyvYD1aXPcYmmZShvGhfoviO6cdJxb4jDJoOU=;
b=e/Fq714yk9fF283IBlkGzrtK4CY8I1JxlhL40NVL+Nt1JD/Ntxxib+FWcv4CVCpxEC
2LEBMoRBmBxZQaVe2MZdqbeeVksEhlXQ8xs8gpYtTtOsoglXlK/Ch92+4lOwblBiOH3C
41i9liyeQv8rG4GlIa0wNozO4T1Zt9UF02ROJWPU0C+XSEmPdYS1fW7krcSR8KIRLiRi
HnZjVpFRLWNDcV0486aVV6FgUMT70S1onyMKhfRe9abctSjOLz5udTL5qzLSw6XYlio1
GDlHG8SPsf5vaqpwM2Vkxwhw+7VYE89aDBrJ5hNqqHb6yoVvk7MJboUmeqXWAqtzDkZ7
Im3A==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20221208; t=1687453981; x=1690045981;
h=mime-version:message-id:date:references:in-reply-to:subject:cc:to
:from:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to;
bh=CCIvvJGyvYD1aXPcYmmZShvGhfoviO6cdJxb4jDJoOU=;
b=GOBfYt2YYjokPq1tliybihABQIPOOwlN+Akcq55BHJ14OxivfoTOFD67l9bScVs+Kv
/AEAcusHWcx1d2CoN0FMsNPUql1vbGv9FFTYS48DhoT+MgkgV8YO4OUfMJMsvXUI+bCB
nCz8692HY5GeVSDVYT+FahHqxCWDV1FhcOF+5vhfGOcswvXMHWVqP9/WRCrTTR7mJ7w6
Ep8rtMNPe/oXjyEWT6SMSMPC+wVjr3zcErJJBTlTGMqYErh/Ld78XxlzZhKzJNS1ruKB
H7zQ+OJ3i2YnOEdp8AISgyz9BYTcCEmf+MTY2sU+IQYYQzNI64A8nih+0SixwrNmSuj4
BPqg==
X-Gm-Message-State: AC+VfDwy7ypiz/BMd7ObbYY8vD60lveuowBv29HViXqOQwqAN46BVBzC
Y5xlFEshwUB3lFOrJv3Mp74=
X-Google-Smtp-Source: ACHHUZ65BF1smcs3xSnRLW+wBcCjoBo1SKBU2dUflls1HV+n1IGlGmOcFZbq+UGft4CfpfCZxRIW6g==
X-Received: by 2002:adf:f682:0:b0:2e4:c9ac:c491 with SMTP id
v2-20020adff682000000b002e4c9acc491mr14634305wrp.1.1687453981050;
Thu, 22 Jun 2023 10:13:01 -0700 (PDT)
Received: from pfiuh07 ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id
c11-20020a056000104b00b003063a92bbf5sm7568938wrx.70.2023.06.22.10.13.00
(version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
Thu, 22 Jun 2023 10:13:00 -0700 (PDT)
From: Simon Tournier <zimon.toutoune@HIDDEN>
To: Efraim Flashner <efraim@HIDDEN>
Subject: Re: bug#63986: Julia is very slow
In-Reply-To: <ZJR14QoB4SoqhsrP@3900XT>
References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN>
<871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN>
<87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN>
<87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT>
Date: Thu, 22 Jun 2023 19:12:36 +0200
Message-ID: <87cz1n8lq3.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/mixed; boundary="=-=-="
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 63986
Cc: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>,
63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>,
csantosb@HIDDEN
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)
--=-=-=
Content-Type: text/plain
Hi,
On Thu, 22 Jun 2023 at 19:25, Efraim Flashner <efraim@HIDDEN> wrote:
> It might need some tuning anyway, currently we have julia for i686 and
> switching to solely openblas-ilp64 we'd lose 32-bit support.
Yes, indeed. This attached patch conditionally switches.
--=-=-=
Content-Type: text/x-diff
Content-Disposition: inline;
filename=v2-0001-gnu-julia-Conditionally-use-openblas-with-ILP64-s.patch
Content-Description: p2.patch
From 9e1912148d4a691a5484fc7f87597b579ba61785 Mon Sep 17 00:00:00 2001
Message-Id: <9e1912148d4a691a5484fc7f87597b579ba61785.1687453627.git.zimon.toutoune@HIDDEN>
From: Simon Tournier <zimon.toutoune@HIDDEN>
Date: Thu, 22 Jun 2023 17:45:50 +0200
Subject: [PATCH v2] gnu: julia: Conditionally use openblas with ILP64 support.
Fixes <https://bugs.gnu.org/63986>.
Reported by Cayetano Santos <csantosb@HIDDEN>.
* gnu/packages/julia.scm (julia)[arguments]<#:make-flags>: Conditionally use
OpenBLAS with ILP64 support for x86-64 target.
[inputs]: Conditionally replace openblas by openblas-ilp64 for x86-64 target.
---
gnu/packages/julia.scm | 12 +++++++++---
1 file changed, 9 insertions(+), 3 deletions(-)
diff --git a/gnu/packages/julia.scm b/gnu/packages/julia.scm
index ba54175822..3ffd1fa4cb 100644
--- a/gnu/packages/julia.scm
+++ b/gnu/packages/julia.scm
@@ -483,8 +483,12 @@ (define-public julia
`("USE_BLAS64=0")
'())
- "LIBBLAS=-lopenblas"
- "LIBBLASNAME=libopenblas"
+ ,@(if (target-x86-64?)
+ `("USE_BLAS64=1"
+ "LIBBLAS=-lopenblas_ilp64"
+ "LIBBLASNAME=libopenblas_ilp64")
+ `("LIBBLAS=-lopenblas"
+ "LIBBLASNAME=libopenblas"))
(string-append "UTF8PROC_INC="
(assoc-ref %build-inputs "utf8proc")
@@ -513,7 +517,9 @@ (define-public julia
("llvm" ,llvm-julia)
("mbedtls-apache" ,mbedtls-apache)
("mpfr" ,mpfr)
- ("openblas" ,openblas)
+ ,@(if (target-x86-64?)
+ `(("openblas" ,openblas-ilp64))
+ `(("openblas" ,openblas)))
("openlibm" ,openlibm)
("p7zip" ,p7zip)
("pcre2" ,pcre2)
base-commit: 37c2e94cec6cb8b5e0e93e7b6c712c3b187ca5db
--
2.38.1
--=-=-=
Content-Type: text/plain
Well, the current recipe could be improved but let focus on the current
bug report. And I guess the slowness come from an incorrect use of BLAS
for x86-64. That seems fixed by the patch, no?
Cheers,
simon
--=-=-=--
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.Received: (at 63986) by debbugs.gnu.org; 22 Jun 2023 16:59:33 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Thu Jun 22 12:59:33 2023 Received: from localhost ([127.0.0.1]:36601 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qCNef-0005Le-E2 for submit <at> debbugs.gnu.org; Thu, 22 Jun 2023 12:59:33 -0400 Received: from latitanza.investici.org ([82.94.249.234]:55285) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <csantosb@HIDDEN>) id 1qCNed-0005LT-8c for 63986 <at> debbugs.gnu.org; Thu, 22 Jun 2023 12:59:32 -0400 Received: from mx3.investici.org (unknown [127.0.0.1]) by latitanza.investici.org (Postfix) with ESMTP id 4Qn66T5X7RzGp0l; Thu, 22 Jun 2023 16:59:29 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inventati.org; s=stigmate; t=1687453169; bh=szCTjG06zkw2H62SY9FRAnsUJjXqn6+6u/+/oLHGF6Y=; h=References:From:To:Cc:Subject:Date:Reply-To:In-reply-to:From; b=Qi8CyzZSuTy1xb+VdezNVvBYBjvNpN8CDpdMwyz4pok74E9Q+AF4iw/TF5jkGCF5B Cpod4jLQ4quqtLBd5BDedmqI7vtY0IBsZhQiX9YTji4hdT/URQizYrc/KEcnFOnERn vxMQHDd7Py/A8x8T0kcaLbdNvVmI/Yz89BNLqXX4= Received: from [82.94.249.234] (mx3.investici.org [82.94.249.234]) (Authenticated sender: cayetano.santos@HIDDEN) by localhost (Postfix) with ESMTPSA id 4Qn66T2P3zzGp0W; Thu, 22 Jun 2023 16:59:29 +0000 (UTC) References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN> <871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN> <87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT> User-agent: mu4e 1.10.3; emacs 29.0.91 From: Cayetano Santos <csantosb@HIDDEN> To: Efraim Flashner <efraim@HIDDEN> Subject: Re: bug#63986: Julia is very slow Date: Thu, 22 Jun 2023 18:56:30 +0200 In-reply-to: <ZJR14QoB4SoqhsrP@3900XT> Message-ID: <874jmz8mc0.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 63986 Cc: Ludovic =?utf-8?Q?Court?= =?utf-8?Q?=C3=A8s?= <ludovic.courtes@HIDDEN>, 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, Simon Tournier <zimon.toutoune@HIDDEN> X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Reply-To: csantosb@HIDDEN Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) > Looks like it should be "LIBBLAS=3D-lopenblas" > > It might need some tuning anyway, currently we have julia for i686 and > switching to solely openblas-ilp64 we'd lose 32-bit support. > > I also noticed the julia expects the 64-bit openblas to be libopenblas64 > (which happens to be what Debian=C2=B9 has). Would we need to adapt anyth= ing > in stdlib/OpenBLAS_jll/src/OpenBLAS_jll.jl? > > Also, are we supposed to build lapack with our openblas as an input? Being used to Arch, it seems to me the way they do things is the way to go, or at least, a good reference (other than the support for 32-bit) https://archlinux.org/packages/?sort=3D&q=3Dblas&maintainer=3D&flagged=3D https://gitlab.archlinux.org/archlinux/packaging/packages/julia/-/blob/main= /PKGBUILD C.
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.
Received: (at 63986) by debbugs.gnu.org; 22 Jun 2023 16:25:16 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Thu Jun 22 12:25:16 2023
Received: from localhost ([127.0.0.1]:36567 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1qCN7T-0004G0-U5
for submit <at> debbugs.gnu.org; Thu, 22 Jun 2023 12:25:16 -0400
Received: from mail-wr1-f50.google.com ([209.85.221.50]:56653)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <efraim.flashner@HIDDEN>) id 1qCN7R-0004Fl-Qi
for 63986 <at> debbugs.gnu.org; Thu, 22 Jun 2023 12:25:15 -0400
Received: by mail-wr1-f50.google.com with SMTP id
ffacd0b85a97d-3111547c8f9so8510750f8f.1
for <63986 <at> debbugs.gnu.org>; Thu, 22 Jun 2023 09:25:13 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=20221208; t=1687451108; x=1690043108;
h=in-reply-to:content-disposition:mime-version:references
:mail-followup-to:message-id:subject:cc:to:from:date:sender:from:to
:cc:subject:date:message-id:reply-to;
bh=vvhWHnCHM+ij5aVKhS0iJmCdHC/FRM5UQ9cey6hHr8c=;
b=CBEyCOiJGUqP3TqETuTYsOwy5I3seQKO5kPF3KbE2QfH9uaJprwokpSjfExp9lpq4L
BFLIjYIJdLKpdwB8FtYGBm+dDiMru+B3aYgzQjN8HvQ3hiupzx039wFGAGJi35HIIt1P
7Czpmy+Zy+ey9BLbd4nqUBtOcnynKoQYPdDaoabF1nVHzFGQ+sglgNLaOhi5ZUIT/T68
uXs30yWa9s8gevkhvfacap61T7lNV+V7Ny+3ehBDG6KJ/tM+phG+vdmMCAntqWfLi4B1
L9Q++1qb/v4olc9hHPzhX5iP1ZNHNo0c7EoLjwpeq9sNKJ/XzjN9nryg78HK9YKgKVl3
lsdg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20221208; t=1687451108; x=1690043108;
h=in-reply-to:content-disposition:mime-version:references
:mail-followup-to:message-id:subject:cc:to:from:date:sender
:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to;
bh=vvhWHnCHM+ij5aVKhS0iJmCdHC/FRM5UQ9cey6hHr8c=;
b=JxJ8csYmPGjka525b4CrImab8qe97r+Y+2PTl6WXc1wI5u6xXUnwW+0gR6JBEf7Bn6
qbHWgHyRoHJCQK9hMsfv+xUJSuLVuHpbi8K/+L/tkJdaXzCV2SrdSwAvcAFlussI7EBc
T6S1s4OyUS8qlqw2APB1yJjMVK5ftU431Cy4B6vXoGqM3roxfbW3Lhpx8PECCAVT9J7j
a9kf2mSN2BAFuMdKL6DBKCmw27BKi1CbcqNl7ONyO/FPqmkrnQ0ykPrwSnXcnGGot2g5
7Nd7uxHVJll7jHL09BgeGaxl+1C4ujYC1MP0fWgvzUKrXS0npdDn8SN090VKCfP8OETj
35QQ==
X-Gm-Message-State: AC+VfDwcDcxGal20TdfbNbHsR3UUJ87W08y124zEk4FGqAnqPP0s+QqE
k+nQo6+B9Acklz7Tqhvc3oo=
X-Google-Smtp-Source: ACHHUZ6hn0nziJbQiLpQ0uiOP6JVy3qZSenhvZF9FdQjbJTq3+M/ZXm5mgo59aM8DK8GO4hjGQ/Djg==
X-Received: by 2002:a5d:4711:0:b0:311:19df:dad2 with SMTP id
y17-20020a5d4711000000b0031119dfdad2mr16569276wrq.47.1687451107638;
Thu, 22 Jun 2023 09:25:07 -0700 (PDT)
Received: from localhost ([188.120.129.124]) by smtp.gmail.com with ESMTPSA id
m7-20020a7bca47000000b003f90b9b2c31sm13233255wml.28.2023.06.22.09.25.06
(version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
Thu, 22 Jun 2023 09:25:06 -0700 (PDT)
Date: Thu, 22 Jun 2023 19:25:05 +0300
From: Efraim Flashner <efraim@HIDDEN>
To: Simon Tournier <zimon.toutoune@HIDDEN>
Subject: Re: bug#63986: Julia is very slow
Message-ID: <ZJR14QoB4SoqhsrP@3900XT>
Mail-Followup-To: Efraim Flashner <efraim@HIDDEN>,
Simon Tournier <zimon.toutoune@HIDDEN>, csantosb@HIDDEN,
Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>,
63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>
References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN>
<871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN>
<87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN>
<87h6qz8pg0.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha256;
protocol="application/pgp-signature"; boundary="ddGpKuQheAwz6IMG"
Content-Disposition: inline
In-Reply-To: <87h6qz8pg0.fsf@HIDDEN>
X-PGP-Key-ID: 0x41AAE7DCCA3D8351
X-PGP-Key: https://flashner.co.il/~efraim/efraim_flashner.asc
X-PGP-Fingerprint: A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351
X-Spam-Score: 0.2 (/)
X-Debbugs-Envelope-To: 63986
Cc: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>,
63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>,
csantosb@HIDDEN
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.8 (/)
--ddGpKuQheAwz6IMG
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
On Thu, Jun 22, 2023 at 05:52:15PM +0200, Simon Tournier wrote:
> Hi,
>=20
> On Thu, 22 Jun 2023 at 15:26, Cayetano Santos via Bug reports for GNU Gui=
x <bug-guix@HIDDEN> wrote:
> >> Are we following all instructions here ?
> >>
> >> https://docs.julialang.org/en/v1.8/devdocs/build/distributing/#Notes=
-on-BLAS-and-LAPACK
>=20
> [...]
>=20
> > Base.USE_BLAS64
> >
> > gives "true" when running fast. Guix julia gives "false".
>=20
> When I try USE_BLAS64=3D1, then I get:
>=20
> --8<---------------cut here---------------start------------->8---
> =E2=94=8C Error: No loaded BLAS libraries were built with ILP64 support
> =E2=94=94 @ LinearAlgebra.BLAS /tmp/guix-build-julia-1.8.3.drv-0/julia-1.=
8.3/usr/share/julia/stdlib/v1.8/LinearAlgebra/src/blas.jl:155
> Quitting.
> --8<---------------cut here---------------end--------------->8---
>=20
> And from the documentation above, it reads:
>=20
> [...] while on 64-bit architectures, Julia builds OpenBLAS to
> use 64-bit integers (ILP64). It is essential that all Julia
> functions that call BLAS and LAPACK API routines use integers of
> the correct width.
>=20
> Well using the patch attached, I get:
>=20
> 6.884 ms (2 allocations: 7.63 MiB)
>=20
> compared to the previous
>=20
> 494.345 ms (2 allocations: 7.63 MiB)
>=20
> WDYT about this patch?
(ins)efraim@3900XT ~/workspace/guix$ cat /gnu/store/v6z5ykkjfzbc72x1x900xfl=
spqc5wd5r-openblas-ilp64-0.3.20/lib/pkgconfig/openblas.pc
libdir=3D/gnu/store/v6z5ykkjfzbc72x1x900xflspqc5wd5r-openblas-ilp64-0.3.20/=
lib
includedir=3D/gnu/store/v6z5ykkjfzbc72x1x900xflspqc5wd5r-openblas-ilp64-0.3=
=2E20/include
openblas_config=3D USE_64BITINT=3D DYNAMIC_ARCH=3D1 DYNAMIC_OLDER=3D1 NO_CB=
LAS=3D NO_LAPACK=3D NO_LAPACKE=3D NO_AFFINITY=3D1 USE_OPENMP=3D generic MAX=
_THREADS=3D128
version=3D0.3.20
extralib=3D-lm -lpthread -lgfortran -lm -lpthread -lgfortran
Name: openblas
Description: OpenBLAS is an optimized BLAS library based on GotoBLAS2 1.13 =
BSD version
Version: ${version}
URL: https://github.com/xianyi/OpenBLAS
Libs: -L${libdir} -lopenblas
Libs.private: ${extralib}
Cflags: -I${includedir}
Looks like it should be "LIBBLAS=3D-lopenblas"
It might need some tuning anyway, currently we have julia for i686 and
switching to solely openblas-ilp64 we'd lose 32-bit support.
I also noticed the julia expects the 64-bit openblas to be libopenblas64
(which happens to be what Debian=C2=B9 has). Would we need to adapt anything
in stdlib/OpenBLAS_jll/src/OpenBLAS_jll.jl?
Also, are we supposed to build lapack with our openblas as an input?
=C2=B9 https://sources.debian.org/src/openblas/0.3.21%2Bds-4/debian/rules/#=
L71
> From 024c92fac091f59dcdbd3a78eb6ea77bb15b2170 Mon Sep 17 00:00:00 2001
> Message-Id: <024c92fac091f59dcdbd3a78eb6ea77bb15b2170.1687449033.git.zimo=
n.toutoune@HIDDEN>
> From: Simon Tournier <zimon.toutoune@HIDDEN>
> Date: Thu, 22 Jun 2023 17:45:50 +0200
> Subject: [PATCH] gnu: julia: Use openblas with ILP64 support.
>=20
> Fixes <https://bugs.gnu.org/63986>.
> Reported by Cayetano Santos <csantosb@HIDDEN>.
>=20
> * gnu/packages/julia.scm (julia)[arguments]<#:make-flags>: Use OpenBLAS w=
ith
> ILP64 support.
> [inputs]: Replace openblas by openblas-ilp64.
> ---
> gnu/packages/julia.scm | 8 ++++----
> 1 file changed, 4 insertions(+), 4 deletions(-)
>=20
> diff --git a/gnu/packages/julia.scm b/gnu/packages/julia.scm
> index ba54175822..a034cbf543 100644
> --- a/gnu/packages/julia.scm
> +++ b/gnu/packages/julia.scm
> @@ -481,10 +481,10 @@ (define-public julia
> =20
> ,@(if (target-aarch64?)
> `("USE_BLAS64=3D0")
> - '())
> + `("USE_BLAS64=3D1"))
> =20
> - "LIBBLAS=3D-lopenblas"
> - "LIBBLASNAME=3Dlibopenblas"
> + "LIBBLAS=3D-lopenblas_ilp64"
> + "LIBBLASNAME=3Dlibopenblas_ilp64"
> =20
> (string-append "UTF8PROC_INC=3D"
> (assoc-ref %build-inputs "utf8proc")
> @@ -513,7 +513,7 @@ (define-public julia
> ("llvm" ,llvm-julia)
> ("mbedtls-apache" ,mbedtls-apache)
> ("mpfr" ,mpfr)
> - ("openblas" ,openblas)
> + ("openblas" ,openblas-ilp64)
> ("openlibm" ,openlibm)
> ("p7zip" ,p7zip)
> ("pcre2" ,pcre2)
>=20
> base-commit: 37c2e94cec6cb8b5e0e93e7b6c712c3b187ca5db
> --=20
> 2.38.1
>=20
>=20
> Well, I need to do more tests but I guess that=E2=80=99s the good directi=
on. :-)
>=20
> Cheers,
> simon
--=20
Efraim Flashner <efraim@HIDDEN> =D7=A8=D7=A0=D7=A9=D7=9C=D7=A4 =
=D7=9D=D7=99=D7=A8=D7=A4=D7=90
GPG key =3D A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted
--ddGpKuQheAwz6IMG
Content-Type: application/pgp-signature; name="signature.asc"
-----BEGIN PGP SIGNATURE-----
iQIzBAABCAAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAmSUdd4ACgkQQarn3Mo9
g1ESrRAAgXQ6J4sf6gpxitgDtYAgogbuyH71S/VJyIDyPDZK0LCrEFvRwPThlD39
W/2ZPjjvtriPtUChiRvNPrykVNugzMJ7uUAOwUflKIFq+b30B/2uZt2P8EgAUkuE
FEbgpWOoT2CvmN80LHMl5vlOEsd4wd1W8ZexIspZeOIF11CjmxDbSXrftir0gLTs
koSplycsYnfpp6WJAlk4ATYkkTy6QO24ZRLz5WpXYD4DNQNLRbMa3bkVrxZmScGE
ZQ8gawgKojceyyhOYu39cXk36EiSLxH1ok0jKm1n5nHVWeSDm3Xi8rlMhE9e/Lkm
6DZUAylZ2sRu+qqCYyjIw9pEptv98crDoh+1tmWo44S3Vx6ezNgb/ltyTf2gGa1z
eh0UxunoLRGun03On5r4QDKSFsSpkLo6WzHV/mNxIlP5Ew/P7dasbT1+lR4T5x4Y
KvERCHsgKggn2U3bUvxvH5pzaOva4WtpwF6I7xStdQ2VX3HQu9VVFfL97YurC+lr
SDjwrHri3MqGY7CqEetlizNEyK0nUQdrAt9D9QfjWCf6GpgE/xfPGVNcy5oqoLAb
lM0O/RI1f6d11xn5aELyJBZ5tIHrTpM+8ZIINHGEfslk+kBel85MYT0VtLMtiGtx
8woKv9uBaKjJOmyLwy8rnbN8UmlCOok2NGFgEaijVWQ5QiPA2gM=
=/GU9
-----END PGP SIGNATURE-----
--ddGpKuQheAwz6IMG--
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.
Received: (at 63986) by debbugs.gnu.org; 22 Jun 2023 15:52:27 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Thu Jun 22 11:52:27 2023
Received: from localhost ([127.0.0.1]:36539 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1qCMbj-0000ni-75
for submit <at> debbugs.gnu.org; Thu, 22 Jun 2023 11:52:27 -0400
Received: from mail-wr1-f49.google.com ([209.85.221.49]:39372)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <zimon.toutoune@HIDDEN>) id 1qCMbg-0000nO-PA
for 63986 <at> debbugs.gnu.org; Thu, 22 Jun 2023 11:52:25 -0400
Received: by mail-wr1-f49.google.com with SMTP id
ffacd0b85a97d-3110e74bf3cso1678063f8f.1
for <63986 <at> debbugs.gnu.org>; Thu, 22 Jun 2023 08:52:24 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=20221208; t=1687449139; x=1690041139;
h=mime-version:message-id:date:references:in-reply-to:subject:to:from
:from:to:cc:subject:date:message-id:reply-to;
bh=BKLSOe03WjqB9Tg1GzTxn2Grh/M1D9CqDAFoSGTgjaE=;
b=KPlE7ZuLhzjp57HkSVd+E8aZnMnzf5ml6YhCJ/I1h/hzD7CYes5YW/05w8yRT+gdFd
2iKNMEyIheq14rTghrbyUpvmr0+Pt8eL1tj5s19juq+RS6EzmwNVooHr/ONKvUbGfeKf
+6nGvhmWbBAN3ABk2ZwSUbaMvF++xmYI+bXw0rl9V2D15lHlP4YlTxEerrPhjsbVV6+N
QviQz6kN7bWwmat5WXTdVfUTerEWTiJfSRS1L1zrANAQeXoLFyGFAdZNZoDRX9nFzp7R
sCF97L4zeX738yXaAbBE01RrQ3VhAkOzflvuc4ESYVda0/Nnn1W/UvA3nd4HXgNATon+
I5Mw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20221208; t=1687449139; x=1690041139;
h=mime-version:message-id:date:references:in-reply-to:subject:to:from
:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to;
bh=BKLSOe03WjqB9Tg1GzTxn2Grh/M1D9CqDAFoSGTgjaE=;
b=KYp/nm9Rsa8NE+cqb5ymovVcP3s/MQcihogrHq3Qc1IS88rQPxDhwhmSaV+ldbe8cB
Utk6fnugySVMhYwwLKU1HSE+y26cXAPTvrPWBZPRLRLwBuU0sB8Fs8Kjxs7J9trHjb+A
RWs7ocdDwZSBSlFLRxNgR/eRe/xkzufXjRxZ79BCbTCacXbqgrh+9tZBYLzqcGMVQtvq
e4jtIdwhPjtdp00xwoAZSJXnGDvPX8NIHSgfzDrSQGmbgVjdnB2jabEYGCeAwf9LxSnZ
iNev/aYGWsZyyQmxuIlwXedhJ+loSWuK9ASeL9e+xiNRaal0IUWL1k178kYQfq8pTj3n
cpWQ==
X-Gm-Message-State: AC+VfDzWrVrLiHDqVhiX2Xuc7BM+7Zox1bx7S0xzQJ59x6HU8axeEIhA
Ytas82v4gOOs2jb9zlmvCt4=
X-Google-Smtp-Source: ACHHUZ6hjmeEwzHMGeWnBCWR9OAyOUb2lCBUWhsbDwphFg2TzcsXx1pL5H+DrOqeXXP+Ign1nKRONQ==
X-Received: by 2002:a5d:66d0:0:b0:311:166b:b3b0 with SMTP id
k16-20020a5d66d0000000b00311166bb3b0mr13746627wrw.7.1687449138772;
Thu, 22 Jun 2023 08:52:18 -0700 (PDT)
Received: from pfiuh07 ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id
w7-20020a5d6807000000b003127741d7desm7342098wru.58.2023.06.22.08.52.17
(version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
Thu, 22 Jun 2023 08:52:18 -0700 (PDT)
From: Simon Tournier <zimon.toutoune@HIDDEN>
To: csantosb@HIDDEN, Ludovic =?utf-8?Q?Court=C3=A8s?=
<ludovic.courtes@HIDDEN>,
63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, Efraim
Flashner <efraim@HIDDEN>
Subject: Re: bug#63986: Julia is very slow
In-Reply-To: <87wmzvmxt8.fsf@HIDDEN>
References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN>
<871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN>
<87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN>
Date: Thu, 22 Jun 2023 17:52:15 +0200
Message-ID: <87h6qz8pg0.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/mixed; boundary="=-=-="
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 63986
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)
--=-=-=
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Hi,
On Thu, 22 Jun 2023 at 15:26, Cayetano Santos via Bug reports for GNU Guix =
<bug-guix@HIDDEN> wrote:
>> Are we following all instructions here ?
>>
>> https://docs.julialang.org/en/v1.8/devdocs/build/distributing/#Notes-o=
n-BLAS-and-LAPACK
[...]
> Base.USE_BLAS64
>
> gives "true" when running fast. Guix julia gives "false".
When I try USE_BLAS64=3D1, then I get:
--8<---------------cut here---------------start------------->8---
=E2=94=8C Error: No loaded BLAS libraries were built with ILP64 support
=E2=94=94 @ LinearAlgebra.BLAS /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.=
3/usr/share/julia/stdlib/v1.8/LinearAlgebra/src/blas.jl:155
Quitting.
--8<---------------cut here---------------end--------------->8---
And from the documentation above, it reads:
[...] while on 64-bit architectures, Julia builds OpenBLAS to
use 64-bit integers (ILP64). It is essential that all Julia
functions that call BLAS and LAPACK API routines use integers of
the correct width.
Well using the patch attached, I get:
6.884 ms (2 allocations: 7.63 MiB)
compared to the previous
494.345 ms (2 allocations: 7.63 MiB)
WDYT about this patch?
--=-=-=
Content-Type: text/x-diff
Content-Disposition: inline;
filename=0001-gnu-julia-Use-openblas-with-ILP64-support.patch
Content-Description: p.patch
From 024c92fac091f59dcdbd3a78eb6ea77bb15b2170 Mon Sep 17 00:00:00 2001
Message-Id: <024c92fac091f59dcdbd3a78eb6ea77bb15b2170.1687449033.git.zimon.toutoune@HIDDEN>
From: Simon Tournier <zimon.toutoune@HIDDEN>
Date: Thu, 22 Jun 2023 17:45:50 +0200
Subject: [PATCH] gnu: julia: Use openblas with ILP64 support.
Fixes <https://bugs.gnu.org/63986>.
Reported by Cayetano Santos <csantosb@HIDDEN>.
* gnu/packages/julia.scm (julia)[arguments]<#:make-flags>: Use OpenBLAS with
ILP64 support.
[inputs]: Replace openblas by openblas-ilp64.
---
gnu/packages/julia.scm | 8 ++++----
1 file changed, 4 insertions(+), 4 deletions(-)
diff --git a/gnu/packages/julia.scm b/gnu/packages/julia.scm
index ba54175822..a034cbf543 100644
--- a/gnu/packages/julia.scm
+++ b/gnu/packages/julia.scm
@@ -481,10 +481,10 @@ (define-public julia
,@(if (target-aarch64?)
`("USE_BLAS64=0")
- '())
+ `("USE_BLAS64=1"))
- "LIBBLAS=-lopenblas"
- "LIBBLASNAME=libopenblas"
+ "LIBBLAS=-lopenblas_ilp64"
+ "LIBBLASNAME=libopenblas_ilp64"
(string-append "UTF8PROC_INC="
(assoc-ref %build-inputs "utf8proc")
@@ -513,7 +513,7 @@ (define-public julia
("llvm" ,llvm-julia)
("mbedtls-apache" ,mbedtls-apache)
("mpfr" ,mpfr)
- ("openblas" ,openblas)
+ ("openblas" ,openblas-ilp64)
("openlibm" ,openlibm)
("p7zip" ,p7zip)
("pcre2" ,pcre2)
base-commit: 37c2e94cec6cb8b5e0e93e7b6c712c3b187ca5db
--
2.38.1
--=-=-=
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Well, I need to do more tests but I guess that=E2=80=99s the good direction=
. :-)
Cheers,
simon
--=-=-=--
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.
Received: (at 63986) by debbugs.gnu.org; 22 Jun 2023 14:37:41 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Thu Jun 22 10:37:41 2023
Received: from localhost ([127.0.0.1]:36468 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1qCLRN-00075k-5k
for submit <at> debbugs.gnu.org; Thu, 22 Jun 2023 10:37:41 -0400
Received: from mail-wr1-f44.google.com ([209.85.221.44]:49520)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <efraim.flashner@HIDDEN>) id 1qCLRL-00075W-E5
for 63986 <at> debbugs.gnu.org; Thu, 22 Jun 2023 10:37:40 -0400
Received: by mail-wr1-f44.google.com with SMTP id
ffacd0b85a97d-311275efaf8so5713395f8f.3
for <63986 <at> debbugs.gnu.org>; Thu, 22 Jun 2023 07:37:39 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=20221208; t=1687444653; x=1690036653;
h=in-reply-to:content-disposition:mime-version:references
:mail-followup-to:message-id:subject:cc:to:from:date:sender:from:to
:cc:subject:date:message-id:reply-to;
bh=ZofPEYQrpib6IX5MT5nBg3oBYR51rESp/kRgJshA8YY=;
b=LQzOiwYu22REw3utKiyQO7Zsy4NdpaCKqbdEWvhRy8SPZ9nnPARBDtcK3fUcQJLyBJ
Xizjp3hDiayfWsaXHscE7kIXzpSTx4aJOkTatisyyvy6K6c9rXog25PgGCyDZwBtZo7z
Qc/wENJ52v7mqsYrNbanqEiz/ZVEoxX2f+MHqp2jhZQg9HCjPDbQ1IM+wL6Yvp0DWe7/
2XxZalD0H9epJk779r4YRhthZIOFiyPWAs5rABFy6NeXTwNEXR0FQBWl3Lb+Mh2z9P+I
rqhlI93waCtu+mintpxh2NnAYe9DWKMTPloTeisP18oxMtwdx6kIBybCr1KLYszkDz+r
qE8g==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20221208; t=1687444653; x=1690036653;
h=in-reply-to:content-disposition:mime-version:references
:mail-followup-to:message-id:subject:cc:to:from:date:sender
:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to;
bh=ZofPEYQrpib6IX5MT5nBg3oBYR51rESp/kRgJshA8YY=;
b=glVUTT+vkA/4JavC6O8jgUYgbEWUscHpEygRyQdYjCPE3ic42SGzJnhV4ELsTcQeLG
XJcr9VAk1wmIcSUETm0vD4i+xc05NL0IvSqZLPQx170nDZpnERyHnqqrMyVL6unz1SJQ
nreMoBOTQLiPq4ABQ8v/FhFu3IqGTirz60pcssFoCgZFXCPlhPqRRfvSm1gOkdnp/OAz
e7azdPG1kDY2aJuY56Kr1vXAB01wkns7vwn27QHvtxPHTzwghqETdC743Qa/FxsWO/7K
R6bGcViZiHYHiyOoNIuqQu8dS7gmpfqw21ldfNyEba1RoFsh6XZhdWXBHbhMNSqAOhjE
OPaQ==
X-Gm-Message-State: AC+VfDyUVmM+D7aASBs/3TC/qFcV3wXdwxmdkkGBtPSqxYViqmwYVbH1
SH+2TP3XAX1s0pxo2RJfqIA=
X-Google-Smtp-Source: ACHHUZ7PJzE0teRZgJV2fR6xtHiznaoukKpI/DwpJ+JL4OjDKYteTw96EqK0zgFc19KfOxB8oqj7uQ==
X-Received: by 2002:a5d:50d2:0:b0:311:f8a:1ca4 with SMTP id
f18-20020a5d50d2000000b003110f8a1ca4mr13739663wrt.31.1687444653402;
Thu, 22 Jun 2023 07:37:33 -0700 (PDT)
Received: from localhost ([188.120.129.124]) by smtp.gmail.com with ESMTPSA id
t13-20020a1c770d000000b003f91e32b1ebsm12465017wmi.17.2023.06.22.07.37.32
(version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
Thu, 22 Jun 2023 07:37:32 -0700 (PDT)
Date: Thu, 22 Jun 2023 17:37:31 +0300
From: Efraim Flashner <efraim@HIDDEN>
To: Cayetano Santos <csantosb@HIDDEN>
Subject: Re: bug#63986: Julia is very slow
Message-ID: <ZJRcq8BieSPFPIEk@3900XT>
Mail-Followup-To: Efraim Flashner <efraim@HIDDEN>,
Cayetano Santos <csantosb@HIDDEN>,
Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>,
Simon Tournier <zimon.toutoune@HIDDEN>, 63986 <at> debbugs.gnu.org,
Nicolas Graves <ngraves@HIDDEN>
References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN>
<871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN>
<87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha256;
protocol="application/pgp-signature"; boundary="SRceopnWyrJRrsaM"
Content-Disposition: inline
In-Reply-To: <87wmzvmxt8.fsf@HIDDEN>
X-PGP-Key-ID: 0x41AAE7DCCA3D8351
X-PGP-Key: https://flashner.co.il/~efraim/efraim_flashner.asc
X-PGP-Fingerprint: A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351
X-Spam-Score: 0.2 (/)
X-Debbugs-Envelope-To: 63986
Cc: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>,
63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>,
Simon Tournier <zimon.toutoune@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.8 (/)
--SRceopnWyrJRrsaM
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
On Thu, Jun 22, 2023 at 03:26:30PM +0200, Cayetano Santos wrote:
>=20
>=20
> >mer. 21 juin 2023 at 22:39, Cayetano Santos <csantosb@HIDDEN> wro=
te:
>=20
> >>mer. 21 juin 2023 at 16:36, Ludovic Court=C3=A8s <ludovic.courtes@inria=
=2Efr> wrote:
> >
> >> Hey!
> >>
> >> The benchmark you posted, Cayetano, is:
> >>
> >> julia -e 'using Pkg; Pkg.add("BenchmarkTools"); using BenchmarkTools=
; N =3D 1000; A =3D rand(N, N); B =3D rand(N, N); @btime $A*$B'
I've been having a hard time with that command, so I've been running
julia -e 'using Pkg; Pkg.add("BenchmarkTools"); using BenchmarkTools; N =3D=
1000; A =3D rand(N, N); B =3D rand(N, N); @time A*B'
I'm not sure if that's useful or not but I didn't see a different with
LIBBLAS* set.
> >>
> >> This is a matrix multiplication that gets delegated to the underlying
> >> BLAS right. Running it under =E2=80=98perf record=E2=80=99 confirms i=
t:
> >>
> >> Samples: 139K of event 'cycles:u', Event count (approx.): 99624880590
> >> Overhead Command Shared Object Symbol
> >> 35.27% .julia-real libblas.so.3.9.0 [.] dgemm_
> >> 3.99% .julia-real libjulia-internal.so.1.8 [.] gc_mark_loop
> >> 2.60% .julia-real libjulia-internal.so.1.8 [.] apply_cl
> >> 1.06% .julia-real libjulia-internal.so.1.8 [.] jl_get_binding_
> >>
> >> We=E2=80=99re using libblas.so (presumably from the =E2=80=98lapack=E2=
=80=99 package) and not
> >> OpenBLAS, so no wonder it=E2=80=99s slow.
> >>
> >> Could it be that:
> >>
> >> "LIBBLAS=3D-lopenblas"
> >> "LIBBLASNAME=3Dlibopenblas"
> >>
> >> is ineffective? I think we have a lead!
> >
> > Are we following all instructions here ?
> >
> > https://docs.julialang.org/en/v1.8/devdocs/build/distributing/#Notes-=
on-BLAS-and-LAPACK
> >
> > I=E2=80=99m thinking about the variables LIBLAPACK and LIBLAPACKNAME.
>=20
> To complete my previous comment, I just realised that
>=20
> Base.USE_BLAS64
>=20
> gives "true" when running fast. Guix julia gives "false".
>=20
> C.
I'll see what comes with switching it to blas64
--=20
Efraim Flashner <efraim@HIDDEN> =D7=A8=D7=A0=D7=A9=D7=9C=D7=A4 =
=D7=9D=D7=99=D7=A8=D7=A4=D7=90
GPG key =3D A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted
--SRceopnWyrJRrsaM
Content-Type: application/pgp-signature; name="signature.asc"
-----BEGIN PGP SIGNATURE-----
iQIzBAABCAAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAmSUXKgACgkQQarn3Mo9
g1EjSg//dfiNlu7SXBgZ1yh1v+3mrJDopwHX8Hi+GQzslVxXrGAdkhvETGyor2YI
4hUQhWlKI5bqoPknACVnWcvD0ZhAepViv1a/lWzOFhKkyWJzB3zs0XjYLWON3/Nl
Hixv6Hsl6+s9LajaBO1dcG2dQul5qNDUpYg/jyW0V+gAkeAjvMjv2IAbOnfzyGlf
TaejEpiXzcWLT/V8uwXtNBkCD0i2ICbi63+2amxEPzjqatZ0KH2pV9imRx1SmVtU
lbicU21UOqnJWgSA6MlAfUCW1RkkJp/A8vqayCA5cZG+bBtTqBIPoJvwAUXlXgEI
TZFcyb/QUe2FWCy6FZWh58VDSDdwIHIyUJ1N8XpfdCHzY6CkaV57yqWqcjr8UVUl
YK1XClHJ2Ml7/dHg/nyXgvXg7cpjNOGo8/kugYWoi5QQK4ON9AFhrK4eVBEV1Cse
8PMqzMMvjwglhhwD72sTA8Y42J1DtNeNSippibTL8UmgdasQI0/JvfF7QlMpq7oS
5CxUAItMHqwjHq7ALD291AhDsrcyr8Gyo3x3CnfVscr+ndvdSi4AQtYEJTGseEhh
73pXoo37yROstuTByUUyOc1CnvyGTUxG8vxPfkXjIMVQwjxKxQdCDBJCytYOl5ga
JaMps//U03ygl6Ei12TNLNqYx6YvaQl3lIVINvEWAUq/yq1dCqI=
=0OVi
-----END PGP SIGNATURE-----
--SRceopnWyrJRrsaM--
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.
Received: (at 63986) by debbugs.gnu.org; 22 Jun 2023 13:27:53 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Thu Jun 22 09:27:53 2023
Received: from localhost ([127.0.0.1]:35149 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1qCKLp-0002TJ-1S
for submit <at> debbugs.gnu.org; Thu, 22 Jun 2023 09:27:53 -0400
Received: from devianza.investici.org ([198.167.222.108]:61991)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <csantosb@HIDDEN>) id 1qCKLm-0002T9-C1
for 63986 <at> debbugs.gnu.org; Thu, 22 Jun 2023 09:27:51 -0400
Received: from mx2.investici.org (unknown [127.0.0.1])
by devianza.investici.org (Postfix) with ESMTP id 4Qn1QF0Fx8z6v6B;
Thu, 22 Jun 2023 13:27:49 +0000 (UTC)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inventati.org;
s=stigmate; t=1687440469;
bh=iKePJyzGkJIlg8E9ZsUsZ5xduzWU761lT8epjbLu3kc=;
h=References:From:To:Subject:Date:Reply-To:In-reply-to:From;
b=EWAa2j2lY1+LEB4MACQ3KLYE6VluIkJm6m3EmbhzBobouvRyKaGNtap9QI/bkuXQR
1P2AsrRN28wz0QLvbtXISxBB0jQjHUDD+AyKIcd8WY10xbUYwwBPlt1fM+IjXWPpXR
TYIx0jhd5SQ9ZztJHGwPwDriKH2QZl9bnc6P9H9Q=
Received: from [198.167.222.108] (mx2.investici.org [198.167.222.108])
(Authenticated sender: cayetano.santos@HIDDEN) by localhost (Postfix)
with ESMTPSA id 4Qn1QD4ZR6z6v2n;
Thu, 22 Jun 2023 13:27:48 +0000 (UTC)
References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN>
<871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN>
<87ttv0mth3.fsf@HIDDEN>
User-agent: mu4e 1.10.3; emacs 29.0.91
From: Cayetano Santos <csantosb@HIDDEN>
To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>, Simon Tournier
<zimon.toutoune@HIDDEN>, 63986 <at> debbugs.gnu.org, Nicolas Graves
<ngraves@HIDDEN>, Efraim Flashner <efraim@HIDDEN>
Subject: Re: bug#63986: Julia is very slow
Date: Thu, 22 Jun 2023 15:26:30 +0200
In-reply-to: <87ttv0mth3.fsf@HIDDEN>
Message-ID: <87wmzvmxt8.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: 63986
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Reply-To: csantosb@HIDDEN
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)
>mer. 21 juin 2023 at 22:39, Cayetano Santos <csantosb@HIDDEN> wrote:
>>mer. 21 juin 2023 at 16:36, Ludovic Court=C3=A8s <ludovic.courtes@HIDDEN=
r> wrote:
>
>> Hey!
>>
>> The benchmark you posted, Cayetano, is:
>>
>> julia -e 'using Pkg; Pkg.add("BenchmarkTools"); using BenchmarkTools; =
N =3D 1000; A =3D rand(N, N); B =3D rand(N, N); @btime $A*$B'
>>
>> This is a matrix multiplication that gets delegated to the underlying
>> BLAS right. Running it under =E2=80=98perf record=E2=80=99 confirms it:
>>
>> Samples: 139K of event 'cycles:u', Event count (approx.): 99624880590
>> Overhead Command Shared Object Symbol
>> 35.27% .julia-real libblas.so.3.9.0 [.] dgemm_
>> 3.99% .julia-real libjulia-internal.so.1.8 [.] gc_mark_loop
>> 2.60% .julia-real libjulia-internal.so.1.8 [.] apply_cl
>> 1.06% .julia-real libjulia-internal.so.1.8 [.] jl_get_binding_
>>
>> We=E2=80=99re using libblas.so (presumably from the =E2=80=98lapack=E2=
=80=99 package) and not
>> OpenBLAS, so no wonder it=E2=80=99s slow.
>>
>> Could it be that:
>>
>> "LIBBLAS=3D-lopenblas"
>> "LIBBLASNAME=3Dlibopenblas"
>>
>> is ineffective? I think we have a lead!
>
> Are we following all instructions here ?
>
> https://docs.julialang.org/en/v1.8/devdocs/build/distributing/#Notes-on=
-BLAS-and-LAPACK
>
> I=E2=80=99m thinking about the variables LIBLAPACK and LIBLAPACKNAME.
To complete my previous comment, I just realised that
Base.USE_BLAS64
gives "true" when running fast. Guix julia gives "false".
C.
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.
Received: (at 63986) by debbugs.gnu.org; 21 Jun 2023 20:49:20 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed Jun 21 16:49:19 2023
Received: from localhost ([127.0.0.1]:34299 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1qC4lT-00032m-Hx
for submit <at> debbugs.gnu.org; Wed, 21 Jun 2023 16:49:19 -0400
Received: from confino.investici.org ([93.190.126.19]:33597)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <csantosb@HIDDEN>) id 1qC4lQ-00032b-IO
for 63986 <at> debbugs.gnu.org; Wed, 21 Jun 2023 16:49:17 -0400
Received: from mx1.investici.org (unknown [127.0.0.1])
by confino.investici.org (Postfix) with ESMTP id 4QmbG314yKz11GK;
Wed, 21 Jun 2023 20:49:15 +0000 (UTC)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inventati.org;
s=stigmate; t=1687380555;
bh=rjbRY0Bg8vpTMQrQYEJiwdtdOzn1pNMIlSPuNZgMpQY=;
h=References:From:To:Cc:Subject:Date:Reply-To:In-reply-to:From;
b=PYOb1CNc+Hcz55fgh9+K95+wJi6tEVTgRdVf38lEs06M214aWVl/284by0M9ccjoo
EL4G7+2+CPr6r+CGMEOcdRcZSoEveNz9hkyRbSBmIVoJghMiUb5UpEq05cQ6ME/jlA
ST5Xhgy3BMTxBj8uNKAg7lU3Ig3V6IoWortFHp1E=
Received: from [93.190.126.19] (mx1.investici.org [93.190.126.19])
(Authenticated sender: cayetano.santos@HIDDEN) by localhost (Postfix)
with ESMTPSA id 4QmbG22zXwz11H0;
Wed, 21 Jun 2023 20:49:14 +0000 (UTC)
References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN>
<871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN>
User-agent: mu4e 1.10.3; emacs 29.0.91
From: Cayetano Santos <csantosb@HIDDEN>
To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>
Subject: Re: bug#63986: Julia is very slow
Date: Wed, 21 Jun 2023 22:39:52 +0200
In-reply-to: <87pm5o7uh9.fsf@HIDDEN>
Message-ID: <87ttv0mth3.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: 63986
Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>,
Efraim Flashner <efraim@HIDDEN>,
Simon Tournier <zimon.toutoune@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Reply-To: csantosb@HIDDEN
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)
>mer. 21 juin 2023 at 16:36, Ludovic Court=C3=A8s <ludovic.courtes@HIDDEN=
> wrote:
> Hey!
>
> The benchmark you posted, Cayetano, is:
>
> julia -e 'using Pkg; Pkg.add("BenchmarkTools"); using BenchmarkTools; N=
=3D 1000; A =3D rand(N, N); B =3D rand(N, N); @btime $A*$B'
>
> This is a matrix multiplication that gets delegated to the underlying
> BLAS right. Running it under =E2=80=98perf record=E2=80=99 confirms it:
>
> Samples: 139K of event 'cycles:u', Event count (approx.): 99624880590
> Overhead Command Shared Object Symbol
> 35.27% .julia-real libblas.so.3.9.0 [.] dgemm_
> 3.99% .julia-real libjulia-internal.so.1.8 [.] gc_mark_loop
> 2.60% .julia-real libjulia-internal.so.1.8 [.] apply_cl
> 1.06% .julia-real libjulia-internal.so.1.8 [.] jl_get_binding_
>
> We=E2=80=99re using libblas.so (presumably from the =E2=80=98lapack=E2=80=
=99 package) and not
> OpenBLAS, so no wonder it=E2=80=99s slow.
>
> Could it be that:
>
> "LIBBLAS=3D-lopenblas"
> "LIBBLASNAME=3Dlibopenblas"
>
> is ineffective? I think we have a lead!
Are we following all instructions here ?
https://docs.julialang.org/en/v1.8/devdocs/build/distributing/#Notes-on=
-BLAS-and-LAPACK
I=E2=80=99m thinking about the variables LIBLAPACK and LIBLAPACKNAME.
C.
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.
Received: (at 63986) by debbugs.gnu.org; 21 Jun 2023 14:36:48 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed Jun 21 10:36:48 2023
Received: from localhost ([127.0.0.1]:33909 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1qBywx-0005yP-Ml
for submit <at> debbugs.gnu.org; Wed, 21 Jun 2023 10:36:47 -0400
Received: from mail2-relais-roc.national.inria.fr ([192.134.164.83]:51523)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <ludovic.courtes@HIDDEN>) id 1qBywu-0005y5-PR
for 63986 <at> debbugs.gnu.org; Wed, 21 Jun 2023 10:36:46 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc;
h=from:to:cc:subject:references:date:in-reply-to:
message-id:mime-version:content-transfer-encoding;
bh=6oJnykTpXbWJVw5JZB94cKt571bgz6zmrYXXEBZLtN0=;
b=XcRB/JFxkcyYTOZtgq/m8VvAwnU/QFg9OlQt4pCjeqQuOC0R6x66/SLj
5Rw+4uhwqS4Fyz+ANES+2aVOpHqcLA+UHEpuLECEKEMUU6WVVmHp+V+Ue
Ej47lsyDOGIK/iAv63FZ6V6JHuvJxr88XcvxPlALNbL1MpmEBf09jFzmR Q=;
Authentication-Results: mail2-relais-roc.national.inria.fr;
dkim=none (message not signed) header.i=none;
spf=SoftFail smtp.mailfrom=ludovic.courtes@HIDDEN;
dmarc=fail (p=none dis=none) d=inria.fr
X-IronPort-AV: E=Sophos;i="6.00,260,1681164000"; d="scan'208";a="114039724"
Received: from unknown (HELO ribbon) ([109.190.253.15])
by mail2-relais-roc.national.inria.fr with
ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 21 Jun 2023 16:36:37 +0200
From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludovic.courtes@HIDDEN>
To: Simon Tournier <zimon.toutoune@HIDDEN>
Subject: Re: bug#63986: Julia is very slow
References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN>
<871qi7a0qr.fsf@HIDDEN>
Date: Wed, 21 Jun 2023 16:36:34 +0200
In-Reply-To: <871qi7a0qr.fsf@HIDDEN> (Simon Tournier's message of "Mon, 19
Jun 2023 18:13:48 +0200")
Message-ID: <87pm5o7uh9.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: 63986
Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>,
Cayetano Santos <csantosb@HIDDEN>,
Efraim Flashner <efraim@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)
Hey!
The benchmark you posted, Cayetano, is:
julia -e 'using Pkg; Pkg.add("BenchmarkTools"); using BenchmarkTools; N =
=3D 1000; A =3D rand(N, N); B =3D rand(N, N); @btime $A*$B'
This is a matrix multiplication that gets delegated to the underlying
BLAS right. Running it under =E2=80=98perf record=E2=80=99 confirms it:
--8<---------------cut here---------------start------------->8---
Samples: 139K of event 'cycles:u', Event count (approx.): 99624880590=20=20=
=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=
=20=20
Overhead Command Shared Object Symbol=20=20=20=20=20=20=
=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=
=20=20=20=20=20=20=20=20=20=20
35.27% .julia-real libblas.so.3.9.0 [.] dgemm_
3.99% .julia-real libjulia-internal.so.1.8 [.] gc_mark_loop
2.60% .julia-real libjulia-internal.so.1.8 [.] apply_cl
1.06% .julia-real libjulia-internal.so.1.8 [.] jl_get_binding_
--8<---------------cut here---------------end--------------->8---
We=E2=80=99re using libblas.so (presumably from the =E2=80=98lapack=E2=80=
=99 package) and not
OpenBLAS, so no wonder it=E2=80=99s slow.
Could it be that:
"LIBBLAS=3D-lopenblas"
"LIBBLASNAME=3Dlibopenblas"
is ineffective? I think we have a lead!
Ludo=E2=80=99.
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.
Received: (at 63986) by debbugs.gnu.org; 19 Jun 2023 16:36:27 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Jun 19 12:36:27 2023
Received: from localhost ([127.0.0.1]:57145 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1qBHre-0004q2-IT
for submit <at> debbugs.gnu.org; Mon, 19 Jun 2023 12:36:27 -0400
Received: from mail-wm1-f49.google.com ([209.85.128.49]:41367)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <zimon.toutoune@HIDDEN>) id 1qBHrd-0004pb-0q
for 63986 <at> debbugs.gnu.org; Mon, 19 Jun 2023 12:36:25 -0400
Received: by mail-wm1-f49.google.com with SMTP id
5b1f17b1804b1-3f99aa36d18so3589905e9.1
for <63986 <at> debbugs.gnu.org>; Mon, 19 Jun 2023 09:36:24 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=20221208; t=1687192579; x=1689784579;
h=content-transfer-encoding:mime-version:message-id:date:references
:in-reply-to:subject:cc:to:from:from:to:cc:subject:date:message-id
:reply-to; bh=ZcUH8qQXjO1AO6zqsBgLlZlizTYB9gGb6Q13jkadH1Y=;
b=auB/dNZRAzyahfDZHsnpI8rxRCtDvT4Mwi5eYVDzVITa3OzBcMLuap7LoZV+ytMavr
h6G5PhH3voj2PCRQ8tQ9UEdfJwYBSWI6NiFe96cwL39lj8kbiU+988Akq+yPXKw8tq0C
Av4MHegCowNyBl/7PH3LQ/1CS0Wyrw6sSpDPQ79FRiVwu2evPNQo+UTYZpOBuI/agTa6
znEQ7E8rqBIV8mOijccCHYjry7hWPyjsvQWpttZBqUi+iV59BSCB62meReEbvlj24Lxm
u0DcYyZiPGK/VQqoQlfDsoLpTpmoSF2+WG45qkecuaoUZz4TpfHJjtQm4loYwQVNL5/U
tw5w==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20221208; t=1687192579; x=1689784579;
h=content-transfer-encoding:mime-version:message-id:date:references
:in-reply-to:subject:cc:to:from:x-gm-message-state:from:to:cc
:subject:date:message-id:reply-to;
bh=ZcUH8qQXjO1AO6zqsBgLlZlizTYB9gGb6Q13jkadH1Y=;
b=iLEiH78ICK9Y2BzG27W+1PqrsALL0G2T5a0j3Nmhs0vbzR/puVG2ciHCpOR8sS5PAG
YkUduH1OS5kaand8gQzFcy0d7TNTIp9mTFFyKT5O8lnmNxIgsP/IQCzhpgt35z8/kHWR
X6SCwor2mqt9+xXX7jte0YoKLvGmEua6GtXYdMLQgLTIgy/yESk9eAH1ppnZZIwtTkal
rskd+7daofFGejDcMf8EL/vivgR8VrbslTyuRy97Yw6uckE89R1mfWx9gVkGqfwBnN59
5lTiE8j+SBYhEDmHQhhxXh4GhcpveBhIFrIQb8S1doDeUWuGFKPHlT3Wk2OnvIFQk4ky
qEEg==
X-Gm-Message-State: AC+VfDz2+BjjX6q2GKc2SH+LQSHg4rMVZz23TwJqyHaGqfsFEuphnYzQ
dqQSLZwu5mivADzQSZ9NWhs=
X-Google-Smtp-Source: ACHHUZ5CuFQyiWvDxlNgMQuajmqdoE5Pp1wyarVC6Gh5BrreiCFWnyy+9ow2FJ2QMj6jW9kQimsZuQ==
X-Received: by 2002:a1c:ed17:0:b0:3f5:f543:d81f with SMTP id
l23-20020a1ced17000000b003f5f543d81fmr11017421wmh.3.1687192579107;
Mon, 19 Jun 2023 09:36:19 -0700 (PDT)
Received: from pfiuh07 ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id
v8-20020a05600c214800b003f42314832fsm173372wml.18.2023.06.19.09.36.18
(version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
Mon, 19 Jun 2023 09:36:18 -0700 (PDT)
From: Simon Tournier <zimon.toutoune@HIDDEN>
To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>, Cayetano Santos
<csantosb@HIDDEN>
Subject: Re: bug#63986: Julia is very slow
In-Reply-To: <87jzw6rq48.fsf@HIDDEN>
References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN>
Date: Mon, 19 Jun 2023 18:13:48 +0200
Message-ID: <871qi7a0qr.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: 1.7 (+)
X-Spam-Report: Spam detection software, running on the system "debbugs.gnu.org",
has NOT identified this incoming email as spam. The original
message has been attached to this so you can view it or label
similar future email. If you have any questions, see
the administrator of that system for details.
Content preview: Hi, On Wed, 14 Jun 2023 at 18:00, Ludovic Courtès wrote:
> Cc’in Efraim, Simon, and Nicolas who’ve looked into Julia packaging
in > the past. Hopefully we can get inspiration from Arch’s build recipe!
Content analysis details: (1.7 points, 10.0 required)
pts rule name description
---- ---------------------- --------------------------------------------------
0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail
provider (zimon.toutoune[at]gmail.com)
0.0 SPF_HELO_NONE SPF: HELO does not publish an SPF Record
-0.0 RCVD_IN_MSPIKE_H2 RBL: Average reputation (+2)
[209.85.128.49 listed in wl.mailspike.net]
-0.0 SPF_PASS SPF: sender matches SPF record
1.7 URIBL_BLACK Contains an URL listed in the URIBL blacklist
[URIs: libz.so]
-0.0 RCVD_IN_DNSWL_NONE RBL: Sender listed at https://www.dnswl.org/,
no trust
[209.85.128.49 listed in list.dnswl.org]
X-Debbugs-Envelope-To: 63986
Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>,
Efraim Flashner <efraim@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: 0.7 (/)
Hi,
On Wed, 14 Jun 2023 at 18:00, Ludovic Court=C3=A8s <ludo@HIDDEN> wrote:
> Cc=E2=80=99in Efraim, Simon, and Nicolas who=E2=80=99ve looked into Julia=
packaging in
> the past. Hopefully we can get inspiration from Arch=E2=80=99s build rec=
ipe!
Hum, the difference seems:
USE_SYSTEM_DSFMT=3D0
USE_SYSTEM_LIBUV=3D0
which are set to 1 in our Guix recipe; I guess it does not come from
that. And we link against OpenBLAS and they link against some NETLIB; I
guess it does not come from that. Well, the other difference could be
=E2=80=9Cmake release=E2=80=9D that we do not run. Maybe?
Somehow, it seems from the ability to exploit the multicore, IIUC.
Using the binary generated by upstream:
--8<---------------cut here---------------start------------->8---
$ ldd julia-1.9.1/bin/julia=20
linux-vdso.so.1 (0x00007fffd83f1000)
libdl.so.2 =3D> /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f08fb274000)
libpthread.so.0 =3D> /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f08fb25=
1000)
libc.so.6 =3D> /lib/x86_64-linux-gnu/libc.so.6 (0x00007f08fb05f000)
libjulia.so.1 =3D> /tmp/julia-1.9.1/bin/../lib/libjulia.so.1 (0x00007f08fb=
03c000)
/lib64/ld-linux-x86-64.so.2 (0x00007f08fb28e000)
$ ldd julia-1.6.7/bin/julia=20
linux-vdso.so.1 (0x00007fffcdbd7000)
libdl.so.2 =3D> /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f822423f000)
libpthread.so.0 =3D> /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f822421=
c000)
libc.so.6 =3D> /lib/x86_64-linux-gnu/libc.so.6 (0x00007f822402a000)
libjulia.so.1 =3D> /tmp/julia-1.6.7/bin/../lib/libjulia.so.1 (0x00007f8223=
e04000)
/lib64/ld-linux-x86-64.so.2 (0x00007f8224259000)
--8<---------------cut here---------------end--------------->8---
And please note it also contain all these binaries:
--8<---------------cut here---------------start------------->8---
libamd.so -> libamd.so.2.4.6
libamd.so.2 -> libamd.so.2.4.6
libamd.so.2.4.6
libatomic.so -> libatomic.so.1.2.0
libatomic.so.1 -> libatomic.so.1.2.0
libatomic.so.1.2.0
libblastrampoline.so -> libblastrampoline.so.5
libblastrampoline.so.5
libblastrampoline.so.5.4.0 -> libblastrampoline.so.5
[...]
libsuitesparseconfig.so -> libsuitesparseconfig.so.5.10.1
libsuitesparseconfig.so.5 -> libsuitesparseconfig.so.5.10.1
libsuitesparseconfig.so.5.10.1
libumfpack.so -> libumfpack.so.5.7.9
libumfpack.so.5 -> libumfpack.so.5.7.9
libumfpack.so.5.7.9
libunwind.so -> libunwind.so.8.0.1
libunwind.so.8 -> libunwind.so.8.0.1
libunwind.so.8.0.1
libuv.so -> libuv.so.2.0.0
libuv.so.2 -> libuv.so.2.0.0
libuv.so.2.0.0
libz.so -> libz.so.1
libz.so.1 -> libz.so.1.2.13
libz.so.1.2.13
sys.so
--8<---------------cut here---------------end--------------->8---
I get these time:
+ ~7ms v1.9.1
+ ~18ms v1.6.7
compared to ~500ms of v1.8.3 provided by Guix.
I guess the issue is about =E2=80=9Cthreading=E2=80=9D. Most of the time i=
s about
=E2=80=99futex=E2=80=99 in the Guix version.
--8<---------------cut here---------------start------------->8---
$ head v1.9.1.txt=20
% time seconds usecs/call calls errors syscall
------ ----------- ----------- --------- --------- ----------------
83.48 5.682198 6 926675 sched_yield
14.87 1.011882 987 1025 futex
0.42 0.028269 2 12308 rt_sigprocmask
0.35 0.023628 9 2592 madvise
0.18 0.012532 6266 2 wait4
0.18 0.012353 10 1227 epoll_wait
0.17 0.011707 2 5015 13 read
0.09 0.006235 13 448 brk
$ head v1.6.7.txt
245193 ????( <detached ...>
% time seconds usecs/call calls errors syscall
------ ----------- ----------- --------- --------- ----------------
86.41 5.870043 5 1008236 sched_yield
12.85 0.872865 467 1869 futex
0.26 0.017538 3 5165 madvise
0.09 0.006171 2 2173 12 read
0.07 0.004486 13 321 brk
0.06 0.004242 2 1772 rt_sigprocmask
0.05 0.003197 2 1554 456 statx
$ head vguix.txt
% time seconds usecs/call calls errors syscall
------ ----------- ----------- --------- --------- ----------------
88.96 7.843293 4621 1697 2 futex
6.88 0.606245 31 19080 sched_yield
1.74 0.153092 153092 1 1 rt_sigtimedwait
0.48 0.041975 1 26317 1 read
0.36 0.032148 1 27602 rt_sigprocmask
0.34 0.030236 10078 3 1 wait4
0.33 0.028833 1 20780 mincore
0.33 0.028801 1 22424 write
--8<---------------cut here---------------end--------------->8---
Hum, I do not know=E2=80=A6 It needs some investigations.
Thanks for the report.
Cheers,
simon
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.
Received: (at 63986) by debbugs.gnu.org; 14 Jun 2023 16:00:25 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed Jun 14 12:00:25 2023
Received: from localhost ([127.0.0.1]:45212 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1q9Sv3-0001Fz-38
for submit <at> debbugs.gnu.org; Wed, 14 Jun 2023 12:00:25 -0400
Received: from eggs.gnu.org ([209.51.188.92]:34616)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <ludo@HIDDEN>) id 1q9Sv1-0000v5-0J
for 63986 <at> debbugs.gnu.org; Wed, 14 Jun 2023 12:00:23 -0400
Received: from fencepost.gnu.org ([2001:470:142:3::e])
by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
(Exim 4.90_1) (envelope-from <ludo@HIDDEN>)
id 1q9Sut-0004c8-EG; Wed, 14 Jun 2023 12:00:15 -0400
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org;
s=fencepost-gnu-org; h=MIME-Version:In-Reply-To:Date:References:Subject:To:
From; bh=w4scQW22TYPgAXDlnfE5s4yeo5djIfRebO1KcToSuMk=; b=Heab+TdQHx6L3yCvuVFl
Sy3t9wZ/366YOBf2rYywIoDaGwdJEsxXLhBITa5t3DfPXsRlqmmMfNmoCytJVTY5EKQwUKpq/NwvO
aBDw5c806pdrAxN94oQLiSiiWCEQRKNvCa/cBUhvBuXU8UnXoRHhk41hjeKgQf7Dov9CfFiLfDY6J
HTJAUjAtNwBlO4Yn5RgR/dKGFnvbpv+7shijbQYMN8xX+iZ1TLS7GXKc2BmW48ThxFuYfGKSgR+Vt
v/vQHbhYijnDjE6P2sm1+kdaLOy/nPNd2gUf3A/hy67n3LDcKNpwltfRKWJpsREf9Iyor74+BkmKa
fiEF2sM7Fww5WA==;
Received: from 91-160-117-201.subs.proxad.net ([91.160.117.201] helo=ribbon)
by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
(Exim 4.90_1) (envelope-from <ludo@HIDDEN>)
id 1q9Sun-0003fY-OU; Wed, 14 Jun 2023 12:00:14 -0400
From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN>
To: Cayetano Santos <csantosb@HIDDEN>
Subject: Re: bug#63986: Julia is very slow
References: <87legsl3cm.fsf@HIDDEN>
Date: Wed, 14 Jun 2023 18:00:07 +0200
In-Reply-To: <87legsl3cm.fsf@HIDDEN> (Cayetano Santos's message of
"Fri, 09 Jun 2023 23:42:00 +0200")
Message-ID: <87jzw6rq48.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: 63986
Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>,
Efraim Flashner <efraim@HIDDEN>,
Simon Tournier <zimon.toutoune@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)
Hi Cayetano,
Cc=E2=80=99in Efraim, Simon, and Nicolas who=E2=80=99ve looked into Julia p=
ackaging in
the past. Hopefully we can get inspiration from Arch=E2=80=99s build recip=
e!
Thanks,
Ludo=E2=80=99.
Cayetano Santos <csantosb@HIDDEN> skribis:
> Hi guix,
>
> I just noticed that the following line
>
> julia -e 'using Pkg; Pkg.add("BenchmarkTools"); using BenchmarkTools;=
N =3D 1000; A =3D rand(N, N); B =3D rand(N, N); @btime $A*$B'
>
> gives around 530 ms in my laptop when using guix provided julia. Same
> behavior when running within a guix container.
>
> This very same code, using the binary one may download from the julia
> site gives 15 ms.
>
> I=E2=80=99m using here an up to date guix. As a reference, julia binary
> provided by archlinux takes also 15 ms.
>
> Thanks,
>
> Cayetano Santos
bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.
Received: (at submit) by debbugs.gnu.org; 9 Jun 2023 21:42:50 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Fri Jun 09 17:42:49 2023
Received: from localhost ([127.0.0.1]:32900 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1q7jsf-00010X-MZ
for submit <at> debbugs.gnu.org; Fri, 09 Jun 2023 17:42:49 -0400
Received: from lists.gnu.org ([209.51.188.17]:60990)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <csantosb@HIDDEN>) id 1q7jsd-00010O-Ce
for submit <at> debbugs.gnu.org; Fri, 09 Jun 2023 17:42:47 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10])
by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
(Exim 4.90_1) (envelope-from <csantosb@HIDDEN>)
id 1q7jsY-00013j-Mp
for bug-guix@HIDDEN; Fri, 09 Jun 2023 17:42:44 -0400
Received: from confino.investici.org ([2a11:7980:1::2:0])
by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
(Exim 4.90_1) (envelope-from <csantosb@HIDDEN>)
id 1q7jsU-0003GK-8J
for bug-guix@HIDDEN; Fri, 09 Jun 2023 17:42:41 -0400
Received: from mx1.investici.org (unknown [127.0.0.1])
by confino.investici.org (Postfix) with ESMTP id 4QdF143rdFz115P
for <bug-guix@HIDDEN>; Fri, 9 Jun 2023 21:42:32 +0000 (UTC)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inventati.org;
s=stigmate; t=1686346952;
bh=vC3FXmPwx3wC63Ohwn4y/S1cP+5KIGvho4cVu3oyxy0=;
h=From:To:Subject:Date:Reply-To:From;
b=JndiZhbKswi2JKH7gx9goCKD9dycA2v6qR792wC3+a7P74M4hEm3T7YtHyS7eLgAm
aJ8vDbCxK4+JhX6EfvB2DleI/t2Bwy6oqe0CzI9wJEzZ/hSI6k4LrVfRqBttr7eg1f
fszsOt7XL9w0fDHKALYC+cfE69UBenAWG0NgraNU=
Received: from [93.190.126.19] (mx1.investici.org [93.190.126.19])
(Authenticated sender: cayetano.santos@HIDDEN) by localhost (Postfix)
with ESMTPSA id 4QdF142496z115M
for <bug-guix@HIDDEN>; Fri, 9 Jun 2023 21:42:32 +0000 (UTC)
User-agent: mu4e 1.10.2; emacs 29.0.91
From: Cayetano Santos <csantosb@HIDDEN>
To: bug-guix@HIDDEN
Subject: Julia is very slow
Date: Fri, 09 Jun 2023 23:42:00 +0200
Message-ID: <87legsl3cm.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Received-SPF: pass client-ip=2a11:7980:1::2:0;
envelope-from=csantosb@HIDDEN; helo=confino.investici.org
X-Spam_score_int: -20
X-Spam_score: -2.1
X-Spam_bar: --
X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_HELO_PASS=-0.001,
SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: -1.4 (-)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Reply-To: csantosb@HIDDEN
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.4 (--)
Hi guix,
I just noticed that the following line
julia -e 'using Pkg; Pkg.add("BenchmarkTools"); using BenchmarkTools; N=
=3D 1000; A =3D rand(N, N); B =3D rand(N, N); @btime $A*$B'
gives around 530 ms in my laptop when using guix provided julia. Same
behavior when running within a guix container.
This very same code, using the binary one may download from the julia
site gives 15 ms.
I=E2=80=99m using here an up to date guix. As a reference, julia binary
provided by archlinux takes also 15 ms.
Thanks,
Cayetano Santos
csantosb@HIDDEN:bug-guix@HIDDEN.
Full text available.bug-guix@HIDDEN:bug#63986; Package guix.
Full text available.
GNU bug tracking system
Copyright (C) 1999 Darren O. Benham,
1997 nCipher Corporation Ltd,
1994-97 Ian Jackson.