Received: (at 63986) by debbugs.gnu.org; 20 Sep 2023 15:58:52 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Wed Sep 20 11:58:52 2023 Received: from localhost ([127.0.0.1]:60208 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qizbH-0000VX-Dy for submit <at> debbugs.gnu.org; Wed, 20 Sep 2023 11:58:51 -0400 Received: from mail-wm1-x32b.google.com ([2a00:1450:4864:20::32b]:41066) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <zimon.toutoune@HIDDEN>) id 1qizb9-0000Ul-Bg for 63986 <at> debbugs.gnu.org; Wed, 20 Sep 2023 11:58:47 -0400 Received: by mail-wm1-x32b.google.com with SMTP id 5b1f17b1804b1-40506bfca64so12732185e9.0 for <63986 <at> debbugs.gnu.org>; Wed, 20 Sep 2023 08:58:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1695225508; x=1695830308; darn=debbugs.gnu.org; h=content-transfer-encoding:mime-version:message-id:date:references :in-reply-to:subject:cc:to:from:from:to:cc:subject:date:message-id :reply-to; bh=KdKHgw1fuF/Od1Oa00nBEm1STMJGhrvR3RwKbCJ0xwA=; b=HPtF3v1yaFeIC397Ppo5YN92lr4IQss9koXgEQrum3zrzk/NOAvIiXfwDy49uxt13Y e1+URTKODgUj9D2hnmMkNznBIRCoew02GLEITgi+OYVn4CQn1WfdUO+OfHImQiJ8XnHd umj4BayQCwaPntEH4Ocm4B0r5VdAuH6Qut1/aNEJnDJ4ly/ZNQMed7BOq+thzBPyvEDV XzgyeBfMU8zMun8++6m5dohzChiy+EEAw0ADwyg0HtSpW9G8iJ7XZeH8cr5ST/sksSxo +KMPrfZFS7/VCFWR9zr7jRhAFsGMj+wNG4WyZQv03XxQOKybAsHqZ1kYIVevQqys5j9O QROw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1695225508; x=1695830308; h=content-transfer-encoding:mime-version:message-id:date:references :in-reply-to:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=KdKHgw1fuF/Od1Oa00nBEm1STMJGhrvR3RwKbCJ0xwA=; b=aK4Amj+aR2HqerOEHCwyMlyZ0ohlRoRv1UTtU45BDgb49mDMOT7uWwSTkYmaZnr4VC mZA/KEskOMDh/DhyDuyBExqu6zgDXuWLbZLr9T59T+v3rDwBD/2XV4Iz1wJSkxPjHsSY gMSXwgWg90D9lh2EeEQDI4GzSPkAjtv51UpKyIfo1VWHC43K2Glr40+V50YWA0sJfUPS V1aA6GqQwF7EYEnpfnzJDzKF6BZFGT45jHqcd9J6WhbCnSy6aphpdkRO03+f3cbays+r 7Xqb46qXH23qCysb/MxNTBKzp0q76kOyHr92zwf/zsfHhbWsYCVpc2uq24DzwzaMF37s WsHg== X-Gm-Message-State: AOJu0YynceUT6saQm4PIESFiAhL8vOm2+jR6l7051TjX5Hup1FhrnoC6 /nOzdCFo8vnEJL5th7lUl48= X-Google-Smtp-Source: AGHT+IFqWLROhOo67U+f51S5voULybbyMkPiCN4C5gV7Sopym5IsBwSuV06oiYWor0Lsf7DTq7ZjiQ== X-Received: by 2002:a05:600c:1d20:b0:403:334:fb0d with SMTP id l32-20020a05600c1d2000b004030334fb0dmr2819712wms.4.1695225508091; Wed, 20 Sep 2023 08:58:28 -0700 (PDT) Received: from pfiuh07 ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id u12-20020a05600c210c00b00403bbe69629sm2299192wml.31.2023.09.20.08.58.25 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 20 Sep 2023 08:58:27 -0700 (PDT) From: Simon Tournier <zimon.toutoune@HIDDEN> To: Efraim Flashner <efraim@HIDDEN>, Ludovic =?utf-8?Q?Court=C3=A8?= =?utf-8?Q?s?= <ludo@HIDDEN> Subject: Re: bug#63986: Julia is very slow In-Reply-To: <ZQLhcr_Y21H1XiYL@3900XT> References: <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT> <87cz1n8lq3.fsf@HIDDEN> <871qi24k9z.fsf@HIDDEN> <ZJVi0Wwg5aRq_XxJ@3900XT> <87h6qy71oa.fsf@HIDDEN> <ZJWpKhkhHiMMzHST@3900XT> <87o7kpku0u.fsf@HIDDEN> <87jztpqvtz.fsf@HIDDEN> <ZQLhcr_Y21H1XiYL@3900XT> Date: Wed, 20 Sep 2023 17:57:30 +0200 Message-ID: <87y1h096s5.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 63986 Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, csantosb@HIDDEN X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) Hi Efraim, Applying the patch is done in v3 of #66030. https://issues.guix.gnu.org/issue/66030 and QA processed all. https://qa.guix.gnu.org/issue/66030/ It is almost good except one strong annoyance [1]@ --8<---------------cut here---------------start------------->8--- Singular value decomposition | 57 57 5.0s Hermitian: Error During Test at /gnu/store/zkx6p7kz3m5k5w5iy0l1d09b2n8b0ib3= -julia-genericlinearalgebra-0.2.5/share/julia/loadpath/GenericLinearAlgebra= /test/rectfullpacked.jl:12 Got exception outside of a @test could not load symbol "dsfrk_64_": /gnu/store/h5mgc7ar7a05f9rwrd1makhzays5wd3s-julia-1.8.3/bin/../lib/julia/= liblapack.so: undefined symbol: dsfrk_64_ Stacktrace: [1] sfrk!(transr::Char, uplo::Char, trans::Char, alpha::Float64, A::Mat= rix{Float64}, beta::Float64, C::Vector{Float64}) @ GenericLinearAlgebra.LAPACK2 /gnu/store/zkx6p7kz3m5k5w5iy0l1d09b2n8= b0ib3-julia-genericlinearalgebra-0.2.5/share/julia/loadpath/GenericLinearAl= gebra/src/lapack.jl:523 [2] Ac_mul_A_RFP(A::Matrix{Float64}, uplo::Symbol) @ GenericLinearAlgebra /gnu/store/zkx6p7kz3m5k5w5iy0l1d09b2n8b0ib3-ju= lia-genericlinearalgebra-0.2.5/share/julia/loadpath/GenericLinearAlgebra/sr= c/rectfullpacked.jl:77 [3] macro expansion @ /gnu/store/zkx6p7kz3m5k5w5iy0l1d09b2n8b0ib3-julia-genericlinearalge= bra-0.2.5/share/julia/loadpath/GenericLinearAlgebra/test/rectfullpacked.jl:= 13 [inlined] [4] macro expansion @ /gnu/store/h5mgc7ar7a05f9rwrd1makhzays5wd3s-julia-1.8.3/share/julia= /stdlib/v1.8/Test/src/Test.jl:1360 [inlined] [5] macro expansion @ /gnu/store/zkx6p7kz3m5k5w5iy0l1d09b2n8b0ib3-julia-genericlinearalge= bra-0.2.5/share/julia/loadpath/GenericLinearAlgebra/test/rectfullpacked.jl:= 13 [inlined] [6] macro expansion @ /gnu/store/h5mgc7ar7a05f9rwrd1makhzays5wd3s-julia-1.8.3/share/julia= /stdlib/v1.8/Test/src/Test.jl:1436 [inlined] [7] macro expansion @ /gnu/store/zkx6p7kz3m5k5w5iy0l1d09b2n8b0ib3-julia-genericlinearalge= bra-0.2.5/share/julia/loadpath/GenericLinearAlgebra/test/rectfullpacked.jl:= 7 [inlined] [8] macro expansion @ /gnu/store/h5mgc7ar7a05f9rwrd1makhzays5wd3s-julia-1.8.3/share/julia= /stdlib/v1.8/Test/src/Test.jl:1360 [inlined] [9] top-level scope @ /gnu/store/zkx6p7kz3m5k5w5iy0l1d09b2n8b0ib3-julia-genericlinearalge= bra-0.2.5/share/julia/loadpath/GenericLinearAlgebra/test/rectfullpacked.jl:7 [10] include(fname::String) @ Base.MainInclude ./client.jl:476 [11] top-level scope @ /gnu/store/zkx6p7kz3m5k5w5iy0l1d09b2n8b0ib3-julia-genericlinearalge= bra-0.2.5/share/julia/loadpath/GenericLinearAlgebra/test/runtests.jl:10 [12] include(mod::Module, _path::String) @ Base ./Base.jl:419 [13] exec_options(opts::Base.JLOptions) @ Base ./client.jl:303 [14] _start() @ Base ./client.jl:522 --8<---------------cut here---------------end--------------->8--- Any idea? I have no idea and it is blocking the merge because ~20 packages are then broken. Well, if we have no idea, I will push the fix for =E2=80=9CJulia is slow=E2=80=9D and we will fix later these ~20 failure= s. WDYT? Cheers, simon 1: https://bordeaux.guix.gnu.org/build/30e3aaec-dbde-423b-9554-67a64881e0cf= /log
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at 63986) by debbugs.gnu.org; 16 Sep 2023 11:19:04 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Sat Sep 16 07:19:03 2023 Received: from localhost ([127.0.0.1]:45566 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qhTKJ-0008HD-MH for submit <at> debbugs.gnu.org; Sat, 16 Sep 2023 07:19:03 -0400 Received: from mail-wm1-x333.google.com ([2a00:1450:4864:20::333]:37904) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <zimon.toutoune@HIDDEN>) id 1qhTKF-0008Gg-Sx for 63986 <at> debbugs.gnu.org; Sat, 16 Sep 2023 07:19:02 -0400 Received: by mail-wm1-x333.google.com with SMTP id 5b1f17b1804b1-40472fef044so6179665e9.0 for <63986 <at> debbugs.gnu.org>; Sat, 16 Sep 2023 04:18:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1694863127; x=1695467927; darn=debbugs.gnu.org; h=mime-version:message-id:date:references:in-reply-to:subject:cc:to :from:from:to:cc:subject:date:message-id:reply-to; bh=Zc5M8D8jT4kwluUsuR9os3pOaS1vxSQYOMUTVCLh9Qc=; b=l68CvQNWWBeAcJP3rx0thoPBJ9hfVQxzYeQ9Wt15NUpsog+17zPspyVhNiVM7MibSz QfZ4Ql73dahAlJWTloUfMnIlPCsOtAuX3ENqg+7yRbYcdX/wRhJc++xVf2LkTg3OM0Yu MYKJhjrILaULJw7oz91KpK4GZ7jhrWRjBRh9WNR00bbIoTkNTPKb440jDcCp2FujUYf1 /Q6PrbBKH75RnZ/Sq6TGEIQ6Oq9zdJQ+zafmRhIHvunFEVenWd/HMzZJ4gbPRXykqnKR daI4LNeR625aJB9MidSfrvUzXTN8RLLEk0bpZ4WdXvLJB8crLu87M5CVSOl1HjtIce// UXSw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694863127; x=1695467927; h=mime-version:message-id:date:references:in-reply-to:subject:cc:to :from:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=Zc5M8D8jT4kwluUsuR9os3pOaS1vxSQYOMUTVCLh9Qc=; b=HcSbtgcg2amco6R35svyHACpfa3Q2GAfSjDuE9/NVZ1e+Xu8G66R/jRtqtVAeCZzns xVdMUxjqBgeWM73dyC/29i45AehOv2WqGlxDwmGLfgFMWqyySVjFXsV7RA8rkt6EGzi4 PAdjex1SjcareC/W71VWRx0BUEcTE9kCqFt/c+qc3U+tzWAwVT+Ftg4IT/K+yR9EiIA/ VxbDZFQlX1jP4g4g1NSm6q0cn2tgfS+X4ZwN9XxlcM1ONcWbkVsB51oDaztKALHbGsBJ Y5QA3ZJN8LIYlPYrxDmbMryoMq8H8OAbM0jejWVp9cSt/UlIqi0S+wFRsOXr4c92Kqry FxAg== X-Gm-Message-State: AOJu0Yz+iFjEwUhV+lXzpq2l65UBZG3x3TpvDwAXHP/s8Qmh3L3AmU3G +s5Wp0IIqVNTAARHSPjPvQzQfn4gvTg= X-Google-Smtp-Source: AGHT+IHkdYG04csJVra0FLrK0S8s96SENtBk3OCjMCdQ+vjPEGN/3yieUQAI9tiyypCtp+j0sgcErQ== X-Received: by 2002:a05:600c:1c0e:b0:401:7d3b:cc84 with SMTP id j14-20020a05600c1c0e00b004017d3bcc84mr3635905wms.0.1694863126598; Sat, 16 Sep 2023 04:18:46 -0700 (PDT) Received: from pfiuh07 ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id t11-20020a1c770b000000b003fc04d13242sm9909281wmi.0.2023.09.16.04.18.46 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 16 Sep 2023 04:18:46 -0700 (PDT) From: Simon Tournier <zimon.toutoune@HIDDEN> To: Efraim Flashner <efraim@HIDDEN>, Ludovic =?utf-8?Q?Court=C3=A8?= =?utf-8?Q?s?= <ludo@HIDDEN> Subject: Re: bug#63986: Julia is very slow In-Reply-To: <87v8ca8ke3.fsf@HIDDEN> References: <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT> <87cz1n8lq3.fsf@HIDDEN> <871qi24k9z.fsf@HIDDEN> <ZJVi0Wwg5aRq_XxJ@3900XT> <87h6qy71oa.fsf@HIDDEN> <ZJWpKhkhHiMMzHST@3900XT> <87o7kpku0u.fsf@HIDDEN> <87jztpqvtz.fsf@HIDDEN> <ZQLhcr_Y21H1XiYL@3900XT> <87v8ca8ke3.fsf@HIDDEN> Date: Sat, 16 Sep 2023 13:18:44 +0200 Message-ID: <87o7i28iy3.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 63986 Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, csantosb@HIDDEN X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) Hi, On Sat, 16 Sep 2023 at 12:47, Simon Tournier <zimon.toutoune@HIDDEN> wrote: > I have applied the diff and turned into two patches. Attached below. > Then, I have sent the cover-letter to guix-patches where you are CC. > The idea was to trigger the Julia world rebuild. However, I do not get > back any Debbugs ID for sending the two patches. Now tacked by #66030. And progress here: https://qa.guix.gnu.org/issue/66030 Cheers, simon
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at 63986) by debbugs.gnu.org; 16 Sep 2023 11:04:06 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Sat Sep 16 07:04:06 2023 Received: from localhost ([127.0.0.1]:45538 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qhT5q-0005F5-DU for submit <at> debbugs.gnu.org; Sat, 16 Sep 2023 07:04:06 -0400 Received: from mail-wr1-x431.google.com ([2a00:1450:4864:20::431]:37987) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <zimon.toutoune@HIDDEN>) id 1qhT5n-0005EG-KP for 63986 <at> debbugs.gnu.org; Sat, 16 Sep 2023 07:04:04 -0400 Received: by mail-wr1-x431.google.com with SMTP id ffacd0b85a97d-31f7c87353eso513698f8f.0 for <63986 <at> debbugs.gnu.org>; Sat, 16 Sep 2023 04:03:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1694862231; x=1695467031; darn=debbugs.gnu.org; h=mime-version:user-agent:message-id:in-reply-to:date:references :subject:cc:to:from:from:to:cc:subject:date:message-id:reply-to; bh=2aVabeZYfDai8EFOhs+aCQrLglZ4J/Wg/XDrUvzyXG4=; b=BcyQJPj7r2t97ZnA34xBJiJaFuXwIdvxK2bah0jccCJw4GaBL7PjhHpxEQ4yfWvSgF 5vmUhcB7gGREEi+k4g5Y7FKNB/wMyKzSG2M3zEQ3TOpIXihqkDAWMyl2bKMJ95PhfUnX E1Uy2K1/Hlc3l7VqYzbJsfv+orz8hj7epxlB7vBgetxeCAPZFTQPgvVgJniHZrsE41Tz nOhqH7seDySuDxIHmRUPQQwxWGJ5/Wc1AiJcRm70YQbgaR6MjVkiHOIA4RZkz3qD/leb hnrDPundDdnmR3mnkiO3EJWHE+KFuyIiWcimkH7OrCTYHy767A1ZNyF89YWd7AAZ8AcY /WKg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694862231; x=1695467031; h=mime-version:user-agent:message-id:in-reply-to:date:references :subject:cc:to:from:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=2aVabeZYfDai8EFOhs+aCQrLglZ4J/Wg/XDrUvzyXG4=; b=X8eCkyZorYzLhOXVWEy0+FVj1N94DYWdwl7OUA4kkNjpBwKj5JnkgyXF7ATVNT/jxt dfXGf4+2NMngCipQABt2EvI51Zhes/plX7GcmM05gRu8uoeSW4aIzfTJHooKH2a/HXMb GoneAme55rxMRaRMg1caSMTmaABhKQ78LknesMvyIwfYruhnwcYTwf3eeIO6NBJOv97T XQFDDmV+BnAWApaDjEhh74MGTfC3eMuEXigv0T/6QN/VSPholQGRBLnP09RfSgl3wVzu B4BuZvJ2wMV1EQ/xwN9v8nc0lUZH5oE+UUUeEP2+SGgbjbSHPuVtEx4mIs2Rj/i2nT0m pt1g== X-Gm-Message-State: AOJu0YxF8wIrHfGFQVM9p3nB4bJrwNIYjoVu84GupQ8hcyok2Nv1jGVi O0VSqose2K1YmUMuCHpjwu9QSRx5uMk= X-Google-Smtp-Source: AGHT+IFhOxZRaqazT/Nc/BzyvihY/+a3JvLTTAFbnT7+KpPSBVSLOugzw0cCanNsxdgGVu/I1kCnQw== X-Received: by 2002:adf:b64f:0:b0:320:8f0:b93d with SMTP id i15-20020adfb64f000000b0032008f0b93dmr87867wre.3.1694862230422; Sat, 16 Sep 2023 04:03:50 -0700 (PDT) Received: from lili ([2a01:e0a:59b:9120:65d2:2476:f637:db1e]) by smtp.gmail.com with ESMTPSA id a4-20020a5d5704000000b0031fc9402b47sm6907466wrv.4.2023.09.16.04.03.49 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 16 Sep 2023 04:03:50 -0700 (PDT) From: Simon Tournier <zimon.toutoune@HIDDEN> To: help-debbugs@HIDDEN (GNU bug Tracking System) Subject: Re: bug#63986: Julia is very slow References: <87fs3f2p3y.fsf@HIDDEN> <87legsl3cm.fsf@HIDDEN> <handler.63986.D63986.169480740431199.notifdone <at> debbugs.gnu.org> Date: Sat, 16 Sep 2023 13:03:47 +0200 In-Reply-To: <handler.63986.D63986.169480740431199.notifdone <at> debbugs.gnu.org> (GNU bug Tracking System's message of "Fri, 15 Sep 2023 19:51:02 +0000") Message-ID: <86fs3e4bxo.fsf_-_@HIDDEN> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 63986 Cc: 63986 <at> debbugs.gnu.org, csantosb@HIDDEN X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) Hi Cayetano, On Fri, 15 Sep 2023 at 19:51, help-debbugs@HIDDEN (GNU bug Tracking System) wrote: > #63986: Julia is very slow > > which was filed against the guix package, has been closed. > > The explanation is attached below, along with your original report. > If you require more details, please reply to 63986 <at> debbugs.gnu.org. Since nothing had been applied for fixing the bug, could you please keep it open. Let close it once all is fine in master. WDYT? Cheers, simon
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Tobias Geerinckx-Rice <me@HIDDEN>
to control <at> debbugs.gnu.org
.
Full text available.Debbugs Internal Request <help-debbugs@HIDDEN>
to internal_control <at> debbugs.gnu.org
.
Full text available.Received: (at 63986) by debbugs.gnu.org; 16 Sep 2023 10:47:54 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Sat Sep 16 06:47:54 2023 Received: from localhost ([127.0.0.1]:45489 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qhSqA-0004j3-0N for submit <at> debbugs.gnu.org; Sat, 16 Sep 2023 06:47:54 -0400 Received: from mail-wm1-x32d.google.com ([2a00:1450:4864:20::32d]:41032) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <zimon.toutoune@HIDDEN>) id 1qhSq7-0004iI-P6 for 63986 <at> debbugs.gnu.org; Sat, 16 Sep 2023 06:47:52 -0400 Received: by mail-wm1-x32d.google.com with SMTP id 5b1f17b1804b1-3fe4f3b5f25so9068215e9.0 for <63986 <at> debbugs.gnu.org>; Sat, 16 Sep 2023 03:47:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1694861258; x=1695466058; darn=debbugs.gnu.org; h=mime-version:message-id:date:references:in-reply-to:subject:cc:to :from:from:to:cc:subject:date:message-id:reply-to; bh=9D+emSAYB57FbOmZoQQZt0FGyzA6LA5YfifIFhXBtXw=; b=RWWH9x+nALmGNhw8aR5oQfyomhtFXi5zgMjWoa44RQm0YOu07JMS1kMK6XCzGkbxW5 mr1RHc9NFAmQ8G2rrF+6XWniddbmPsFfAUZPGE0pBrpJlf49xIeYhiu+0VsapjuApoQn XEUXu70LFYlff5ii7WuUjDgENOTvczL3Domd+HtYRgdNlUOeNWHvso42mWP1FnjV4BcX 1qRGMlJR0i9A/VVX2K6mWgQFEOK1PXixkBHYkEMfW7gME6cyyP4TvQnJ61/T682op00M j70ihQT9n9Jy1SwZtHPmgQbGewPZWN6V7LtJrD7evAaljZcUeIz6quWfcvdfb3Do8q54 qc9g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694861258; x=1695466058; h=mime-version:message-id:date:references:in-reply-to:subject:cc:to :from:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=9D+emSAYB57FbOmZoQQZt0FGyzA6LA5YfifIFhXBtXw=; b=AR9oovMqmctiE2sz7fbAZ0JslasOfzSxISWFX2nUtnszISb4s2yeHLkgONyovj2ntV f7WhsqZdYZv+BdyO2nfS4hxyX7ciuSQWjPbn9RDJTtZHfAo/SJUq6F/NY5+oDdw1iQU8 fa66kZFNMhlqN/VKIyIqzoV2/MyVQ4ph4QtNn2qCuYKA1O+kNjxBGyu8tO7iVgWIPpZ1 DvIn9AtC5I5oZEiOsMlEOatQ5A8kKuLQSYRMSjFOS0t4TEhZExgpo2WAI6on3QwCYxBf isZySjvTlMazH4Q+dJLH77/bQQr1/9LWzx0RVKPlLO7prmK7GfBAPRlwlZ+B7HzagL3x F86w== X-Gm-Message-State: AOJu0Yzc2lmjoipHDbK9fW152LG4NptvT8u8WVAyM8pK20iHV+7He5j7 33/KHw5YCcCmx2QvFIOCI7A= X-Google-Smtp-Source: AGHT+IFuH0D1/82zrLnSgpmI5+k/56YnZNB7BMEEyOUSW8zVVb9P0lbONqt3ECDS8IE+KapqIIOcAA== X-Received: by 2002:a5d:4451:0:b0:317:3a23:4855 with SMTP id x17-20020a5d4451000000b003173a234855mr3070905wrr.2.1694861258239; Sat, 16 Sep 2023 03:47:38 -0700 (PDT) Received: from pfiuh07 ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id s1-20020a5d4ec1000000b0031fbbe347e1sm6843575wrv.65.2023.09.16.03.47.36 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 16 Sep 2023 03:47:37 -0700 (PDT) From: Simon Tournier <zimon.toutoune@HIDDEN> To: Efraim Flashner <efraim@HIDDEN>, Ludovic =?utf-8?Q?Court=C3=A8?= =?utf-8?Q?s?= <ludo@HIDDEN> Subject: Re: bug#63986: Julia is very slow In-Reply-To: <ZQLhcr_Y21H1XiYL@3900XT> References: <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT> <87cz1n8lq3.fsf@HIDDEN> <871qi24k9z.fsf@HIDDEN> <ZJVi0Wwg5aRq_XxJ@3900XT> <87h6qy71oa.fsf@HIDDEN> <ZJWpKhkhHiMMzHST@3900XT> <87o7kpku0u.fsf@HIDDEN> <87jztpqvtz.fsf@HIDDEN> <ZQLhcr_Y21H1XiYL@3900XT> Date: Sat, 16 Sep 2023 12:47:32 +0200 Message-ID: <87v8ca8ke3.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="=-=-=" X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 63986 Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, csantosb@HIDDEN X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hi Efraim, On Thu, 14 Sep 2023 at 13:33, Efraim Flashner <efraim@HIDDEN> wrote: > On Sun, Aug 20, 2023 at 10:53:44PM +0200, Ludovic Court=C3=A8s wrote: > I've attached a diff to adjust openblas64 and to use it for x86_64 in > julia. I don't know if it's faster than the current openblas. I have applied the diff and turned into two patches. Attached below. Then, I have sent the cover-letter to guix-patches where you are CC. The idea was to trigger the Julia world rebuild. However, I do not get back any Debbugs ID for sending the two patches. I think that before pushing the change to master, we should wait that QA builds some substitutes. It will reduce the annoyance for user since some Julia paackages are long to build. I have no time today for waiting after some Debbugs troubles. Cheers, simon --=-=-= Content-Type: text/x-diff Content-Disposition: inline; filename=0000-cover-letter.patch Content-Description: cover-letter From 7f2347d8e64562e1de563cf1e4cdfd192e81a9df Mon Sep 17 00:00:00 2001 Message-Id: <cover.1694859477.git.zimon.toutoune@HIDDEN> From: Simon Tournier <zimon.toutoune@HIDDEN> X-Debbugs-CC: Efraim Flashner <efraim@HIDDEN>, Cayetano Santos <csantosb@HIDDEN>, Date: Sat, 16 Sep 2023 12:17:57 +0200 Subject: [PATCH 0/2] Fix bug#63986: Julia is very slow Hi, This series is for triggering the rebuild of the Julia world. Some Julia packages are long to build so let minimize the annoyance and make some substitutes available before pushing to master. :-) bug#63986: Julia is very slow Cayetano Santos via Bug reports for GNU Guix <bug-guix@HIDDEN> Fri, 09 Jun 2023 23:42:00 +0200 id:87legsl3cm.fsf@HIDDEN https://yhetil.org/guix/87legsl3cm.fsf@HIDDEN https://issues.guix.gnu.org/msgid/87legsl3cm.fsf@HIDDEN Cheers, simon Efraim Flashner (2): gnu: openblas-ilp64: Add symbol suffix. gnu: julia: Conditionally use openblas with ILP64 support. gnu/packages/julia.scm | 22 ++++++++++++++-------- gnu/packages/maths.scm | 4 +++- 2 files changed, 17 insertions(+), 9 deletions(-) base-commit: eeec8371890fc95c60112da299dde78b21c948c2 -- 2.38.1 --=-=-= Content-Type: text/x-diff Content-Disposition: inline; filename=0001-gnu-openblas-ilp64-Add-symbol-suffix.patch Content-Description: openblas From 2f044415efb5dc5703bf2b09439c6f5e2fd1fd72 Mon Sep 17 00:00:00 2001 Message-Id: <2f044415efb5dc5703bf2b09439c6f5e2fd1fd72.1694859477.git.zimon.toutoune@HIDDEN> In-Reply-To: <cover.1694859477.git.zimon.toutoune@HIDDEN> References: <cover.1694859477.git.zimon.toutoune@HIDDEN> From: Efraim Flashner <efraim@HIDDEN> Date: Sat, 16 Sep 2023 11:59:28 +0200 Subject: [PATCH 1/2] gnu: openblas-ilp64: Add symbol suffix. * gnu/packages/maths.scm (openblas-ilp64)[arguments]<#:make-flags>: Add the symbol '64_' as suffix. --- gnu/packages/maths.scm | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/gnu/packages/maths.scm b/gnu/packages/maths.scm index 6141c0988612..c051e60d5e40 100644 --- a/gnu/packages/maths.scm +++ b/gnu/packages/maths.scm @@ -4638,7 +4638,9 @@ (define-public openblas-ilp64 (arguments (substitute-keyword-arguments (package-arguments openblas) ((#:make-flags flags #~'()) - #~(append (list "INTERFACE64=1" "LIBNAMESUFFIX=ilp64") + #~(append (list "INTERFACE64=1" + "SYMBOLSUFFIX=64_" + "LIBPREFIX=libopenblas64_") #$flags)))) (synopsis "Optimized BLAS library based on GotoBLAS (ILP64 version)") (license license:bsd-3))) -- 2.38.1 --=-=-= Content-Type: text/x-diff Content-Disposition: inline; filename=0002-gnu-julia-Conditionally-use-openblas-with-ILP64-supp.patch Content-Description: julia From 7f2347d8e64562e1de563cf1e4cdfd192e81a9df Mon Sep 17 00:00:00 2001 Message-Id: <7f2347d8e64562e1de563cf1e4cdfd192e81a9df.1694859477.git.zimon.toutoune@HIDDEN> In-Reply-To: <cover.1694859477.git.zimon.toutoune@HIDDEN> References: <cover.1694859477.git.zimon.toutoune@HIDDEN> From: Efraim Flashner <efraim@HIDDEN> Date: Sat, 16 Sep 2023 12:05:41 +0200 Subject: [PATCH 2/2] gnu: julia: Conditionally use openblas with ILP64 support. Fixes <https://bugs.gnu.org/63986>. Reported by Cayetano Santos <csantosb@HIDDEN>. * gnu/packages/julia.scm (julia)[arguments]<#:phases>: Conditionally use OpenBLAS with ILP64 support for x86-64 target. <#:make-flags>: Likewise. [inputs]: Conditionally replace openblas by openblas-ilp64 for x86-64 target. Co-authored-by: Simon Tournier <zimon.toutoune@HIDDEN> --- gnu/packages/julia.scm | 22 ++++++++++++++-------- 1 file changed, 14 insertions(+), 8 deletions(-) diff --git a/gnu/packages/julia.scm b/gnu/packages/julia.scm index ba541758223e..8ba2b480ce55 100644 --- a/gnu/packages/julia.scm +++ b/gnu/packages/julia.scm @@ -269,7 +269,10 @@ (define-public julia (substitute* (jlpath "nghttp2") (((from "libnghttp2")) (to "libnghttp2" "libnghttp2"))) (substitute* (jlpath "OpenBLAS") - (((from "libopenblas")) (to "openblas" "libopenblas"))) + (((from "libopenblas")) + ,@(if (target-x86-64?) + `((to "openblas" "libopenblas64_" "libopenblas")) + `((to "openblas" "libopenblas"))))) (substitute* (jlpath "OpenLibm") (((from "libopenlibm")) (to "openlibm" "libopenlibm"))) (substitute* (jlpath "PCRE2") @@ -479,12 +482,13 @@ (define-public julia "NO_GIT=1" ; build from release tarball. "USE_GPL_LIBS=1" ; proudly - ,@(if (target-aarch64?) - `("USE_BLAS64=0") - '()) - - "LIBBLAS=-lopenblas" - "LIBBLASNAME=libopenblas" + ,@(if (target-x86-64?) + `("USE_BLAS64=1" + "LIBBLAS=-lopenblas64_" + "LIBBLASNAME=libopenblas64_") + `("USE_BLAS64=0" + "LIBBLAS=-lopenblas" + "LIBBLASNAME=libopenblas")) (string-append "UTF8PROC_INC=" (assoc-ref %build-inputs "utf8proc") @@ -513,7 +517,9 @@ (define-public julia ("llvm" ,llvm-julia) ("mbedtls-apache" ,mbedtls-apache) ("mpfr" ,mpfr) - ("openblas" ,openblas) + ,@(if (target-x86-64?) + `(("openblas" ,openblas-ilp64)) + `(("openblas" ,openblas))) ("openlibm" ,openlibm) ("p7zip" ,p7zip) ("pcre2" ,pcre2) -- 2.38.1 --=-=-=--
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at submit) by debbugs.gnu.org; 16 Sep 2023 10:23:38 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Sat Sep 16 06:23:38 2023 Received: from localhost ([127.0.0.1]:45456 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qhSSf-0003yg-KN for submit <at> debbugs.gnu.org; Sat, 16 Sep 2023 06:23:37 -0400 Received: from lists.gnu.org ([2001:470:142::17]:43990) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <zimon.toutoune@HIDDEN>) id 1qhSSc-0003yR-A5 for submit <at> debbugs.gnu.org; Sat, 16 Sep 2023 06:23:36 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <zimon.toutoune@HIDDEN>) id 1qhSSP-00089y-OL for guix-patches@HIDDEN; Sat, 16 Sep 2023 06:23:21 -0400 Received: from mail-wm1-x32a.google.com ([2a00:1450:4864:20::32a]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from <zimon.toutoune@HIDDEN>) id 1qhSSL-00016x-Id for guix-patches@HIDDEN; Sat, 16 Sep 2023 06:23:21 -0400 Received: by mail-wm1-x32a.google.com with SMTP id 5b1f17b1804b1-4046f7d49a9so7961065e9.1 for <guix-patches@HIDDEN>; Sat, 16 Sep 2023 03:23:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1694859794; x=1695464594; darn=gnu.org; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to; bh=Ma3NLgOovy+tDH6sTmQgkHRLLYUom9WljS5GhMS3wI8=; b=K/uqDeUVVUfUxTdnhwBo31ZzbIWgmWL+d9ncS+eKaflhNZrHharyoDMxAEp4vIAzBW hoGdZl5kkmhaxpwT/fF06pVOvffoUc5ubWNfGnNkfPAjBrU3XKg9Apt2r6PSVqcBnReh q3KeffYMT/yInQGlieyNijiS3PREiMuamjswmmOcabx/abXZ+HVOGWgxQRnGncEIa5m0 GOx+JjgoFWVGswB/3SySf32BkUbg2K5amruPbqliTYsVT4HXivD7mq+hCzIuS0ZhakCE CyPg2WvJQZE+7xy8/yjrNSonfDpyj3uXxcWnznWCNc7RWKPUU+Rn8iT6k4pfmt4brVzp fp+g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694859794; x=1695464594; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=Ma3NLgOovy+tDH6sTmQgkHRLLYUom9WljS5GhMS3wI8=; b=AoBLk01scxXBWjyeQygaOkhPIUQdkEQ1hCjoyxZV7yc2JL3qHr90XgV+zRnGeMpamI YI3pP9rYRq+xJzDqVfxUV/2S8iUZ2MLNLa32tRrYJRzYB83LO4rrpRkUMgzAem5Ql23S IOJxPBRgt5jwN9YaYYCLe14An0dn+xsd2RGGqAz8iSSrj3g+EH4Er2QkDJpwZpgW0Rcb deru5cSrXWczXEUBfQo/yMD2hTGpeS1V7r4AcXiLVsoQ1aI417XmISrkPyYyPQhQbFYr UKQxgI0FQMEpU1fP45WglJ5ycGSdWCUeqYQaEaWm3BkCjmU/uJxrb4Np4ebu/XxcH0wF OYsg== X-Gm-Message-State: AOJu0YxC7ssGe1MFmVukhm62cGWKmOx7mh/q602pqPXoq1cfQoXCafM+ IKjmwOWrAppdDbr/ujZsl+kZudLXaE4= X-Google-Smtp-Source: AGHT+IGf3tbZgMjoTf96msY5ujA6wgwK+9n156bYg9xT4l01Z4NZLnOMNjpbdbV1tMpITYVUssX6eA== X-Received: by 2002:a05:600c:5103:b0:401:faf5:85c3 with SMTP id o3-20020a05600c510300b00401faf585c3mr3847350wms.0.1694859793615; Sat, 16 Sep 2023 03:23:13 -0700 (PDT) Received: from localhost.localdomain ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id y6-20020a7bcd86000000b003fee6e170f9sm6931042wmj.45.2023.09.16.03.23.12 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 16 Sep 2023 03:23:12 -0700 (PDT) From: Simon Tournier <zimon.toutoune@HIDDEN> To: guix-patches@HIDDEN Subject: [PATCH 0/2] Fix bug#63986: Julia is very slow Date: Sat, 16 Sep 2023 12:23:05 +0200 Message-Id: <cover.1694859477.git.zimon.toutoune@HIDDEN> X-Mailer: git-send-email 2.39.2 MIME-Version: 1.0 X-Debbugs-CC: Efraim Flashner <efraim@HIDDEN>, Cayetano Santos <csantosb@HIDDEN>, Content-Transfer-Encoding: 8bit Received-SPF: pass client-ip=2a00:1450:4864:20::32a; envelope-from=zimon.toutoune@HIDDEN; helo=mail-wm1-x32a.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: 1.0 (+) X-Debbugs-Envelope-To: submit Cc: Simon Tournier <zimon.toutoune@HIDDEN> X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -0.0 (/) Hi, This series is for triggering the rebuild of the Julia world. Some Julia packages are long to build so let minimize the annoyance and make some substitutes available before pushing to master. :-) bug#63986: Julia is very slow Cayetano Santos via Bug reports for GNU Guix <bug-guix@HIDDEN> Fri, 09 Jun 2023 23:42:00 +0200 id:87legsl3cm.fsf@HIDDEN https://yhetil.org/guix/87legsl3cm.fsf@HIDDEN https://issues.guix.gnu.org/msgid/87legsl3cm.fsf@HIDDEN Cheers, simon Efraim Flashner (2): gnu: openblas-ilp64: Add symbol suffix. gnu: julia: Conditionally use openblas with ILP64 support. gnu/packages/julia.scm | 22 ++++++++++++++-------- gnu/packages/maths.scm | 4 +++- 2 files changed, 17 insertions(+), 9 deletions(-) base-commit: eeec8371890fc95c60112da299dde78b21c948c2 -- 2.38.1
efraim@HIDDEN, csantosb@HIDDEN, bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at 63986-done) by debbugs.gnu.org; 15 Sep 2023 19:50:04 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Fri Sep 15 15:50:04 2023 Received: from localhost ([127.0.0.1]:44883 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qhEpI-000879-C5 for submit <at> debbugs.gnu.org; Fri, 15 Sep 2023 15:50:04 -0400 Received: from latitanza.investici.org ([82.94.249.234]:60283) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <csantosb@HIDDEN>) id 1qhEpG-00086n-4J for 63986-done <at> debbugs.gnu.org; Fri, 15 Sep 2023 15:50:02 -0400 Received: from mx3.investici.org (unknown [127.0.0.1]) by latitanza.investici.org (Postfix) with ESMTP id 4RnPst50tJzGnxn for <63986-done <at> debbugs.gnu.org>; Fri, 15 Sep 2023 19:49:54 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inventati.org; s=stigmate; t=1694807394; bh=47DEQpj8HBSa+/TImW+5JCeuQeRkm5NMpJWZG3hSuFU=; h=From:To:Subject:Date:Reply-To:From; b=noADTnW5u9b7i5iS2Oh1MjkSXN/9smxbqyc90GFPojafrswF3YLLT4HMWE7ydlrgw QfRu7NlulQKKCLM+vj7NxVCPqTc4zGRZVnGcWEUkOxC3jnDiW9C97Y1hMhs/xZF9BJ tsC9Lg7234wEtW/+mVgWr8l/w5u9aLKbMrSoZaXI= Received: from [82.94.249.234] (mx3.investici.org [82.94.249.234]) (Authenticated sender: cayetano.santos@HIDDEN) by localhost (Postfix) with ESMTPSA id 4RnPst3DWzzGnxm for <63986-done <at> debbugs.gnu.org>; Fri, 15 Sep 2023 19:49:54 +0000 (UTC) User-agent: mu4e 1.10.5; emacs 29.1 From: Cayetano Santos <csantosb@HIDDEN> To: 63986-done <at> debbugs.gnu.org Subject: Fixed. Date: Fri, 15 Sep 2023 21:49:39 +0200 Message-ID: <87fs3f2p3y.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 63986-done X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Reply-To: csantosb@HIDDEN Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-)
csantosb@HIDDEN
:csantosb@HIDDEN
:Received: (at 63986) by debbugs.gnu.org; 15 Sep 2023 19:48:45 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Fri Sep 15 15:48:45 2023 Received: from localhost ([127.0.0.1]:44879 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qhEo0-00084M-R2 for submit <at> debbugs.gnu.org; Fri, 15 Sep 2023 15:48:45 -0400 Received: from latitanza.investici.org ([2001:888:2000:56::19]:59655) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <csantosb@HIDDEN>) id 1qhEnx-00083o-Dp for 63986 <at> debbugs.gnu.org; Fri, 15 Sep 2023 15:48:43 -0400 Received: from mx3.investici.org (unknown [127.0.0.1]) by latitanza.investici.org (Postfix) with ESMTP id 4RnPrH6kvyzGnxn; Fri, 15 Sep 2023 19:48:31 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inventati.org; s=stigmate; t=1694807311; bh=2hmwwlxpdyG5hYLpXWuWfs8a7EQjWMb1sQIs3+sAHl0=; h=References:From:To:Cc:Subject:Date:Reply-To:In-reply-to:From; b=WaeRMLCZgW0S3pj4fZ2y8P0cgI/QixWA56nkLj7jljuL6roqoXsY3EQIvEqRrbQYT Shbt+d/jzz7bjLlgEbcsyAqN6CQA6A+cvywEetsF0kBvEnzvdx5kViT18+BXcAPw0f dshgGGhnI7iSxQTMAxBy7Gm69Wi4P3sm+t0XEjDc= Received: from [82.94.249.234] (mx3.investici.org [82.94.249.234]) (Authenticated sender: cayetano.santos@HIDDEN) by localhost (Postfix) with ESMTPSA id 4RnPrH2qdzzGnxm; Fri, 15 Sep 2023 19:48:31 +0000 (UTC) References: <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT> <87cz1n8lq3.fsf@HIDDEN> <871qi24k9z.fsf@HIDDEN> <ZJVi0Wwg5aRq_XxJ@3900XT> <87h6qy71oa.fsf@HIDDEN> <ZJWpKhkhHiMMzHST@3900XT> <87o7kpku0u.fsf@HIDDEN> <87jztpqvtz.fsf@HIDDEN> <ZQLhcr_Y21H1XiYL@3900XT> User-agent: mu4e 1.10.5; emacs 29.1 From: Cayetano Santos <csantosb@HIDDEN> To: Efraim Flashner <efraim@HIDDEN> Subject: Re: bug#63986: Julia is very slow Date: Fri, 15 Sep 2023 21:45:05 +0200 In-reply-to: <ZQLhcr_Y21H1XiYL@3900XT> Message-ID: <87jzsr2p69.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 63986 Cc: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>, 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, Simon Tournier <zimon.toutoune@HIDDEN> X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Reply-To: csantosb@HIDDEN Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) >jeu. 14 sept. 2023 at 13:33, Efraim Flashner <efraim@HIDDEN> wrote: > [[PGP Signed Part:Undecided]] > On Sun, Aug 20, 2023 at 10:53:44PM +0200, Ludovic Court=C3=A8s wrote: >> Hi! >> >> Friendly ping. :-) >> >> https://issues.guix.gnu.org/63986 >> >> Ludo=E2=80=99. >> >> Ludovic Court=C3=A8s <ludo@HIDDEN> skribis: >> >> > Hi there! >> > >> > What=E2=80=99s the status? Sounds like we have a couple of fixes alre= ady. >> > >> > Maybe you can submit one of them to guix-patches@HIDDEN so qa.guix can >> > pick it up. And if one of them is more intrusive (more rebuilds), then >> > submit it separately so it gets merged later? How does that sound? >> > >> > Ludo=E2=80=99. > > I've attached a diff to adjust openblas64 and to use it for x86_64 in > julia. I don't know if it's faster than the current openblas. I have applied the patch in a freshly cloned guix repo, and build julia within a shell as for the instructions under =E2=80=99Contributing=E2=80=99. I get the 13 ms when running the original test, so I guess the issue is solved (other than thinking about the feasibility of performance tests to avoid this kind of situations). Thanks a lot ! C.
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at 63986) by debbugs.gnu.org; 14 Sep 2023 10:33:49 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Thu Sep 14 06:33:49 2023 Received: from localhost ([127.0.0.1]:37744 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qgjfQ-0004PY-V4 for submit <at> debbugs.gnu.org; Thu, 14 Sep 2023 06:33:49 -0400 Received: from mail-wm1-x32e.google.com ([2a00:1450:4864:20::32e]:59545) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <efraim.flashner@HIDDEN>) id 1qgjfL-0004PH-7i for 63986 <at> debbugs.gnu.org; Thu, 14 Sep 2023 06:33:47 -0400 Received: by mail-wm1-x32e.google.com with SMTP id 5b1f17b1804b1-40472c3faadso3697195e9.2 for <63986 <at> debbugs.gnu.org>; Thu, 14 Sep 2023 03:33:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1694687611; x=1695292411; darn=debbugs.gnu.org; h=in-reply-to:content-disposition:mime-version:references :mail-followup-to:message-id:subject:cc:to:from:date:sender:from:to :cc:subject:date:message-id:reply-to; bh=Ie8HTYw17dvtFM9lJ7sKIzpmzt1x5i2Kw75mZtbTBGQ=; b=d9OzRzSXIzwQB+X/r8S/TPjneqJycmFAFPZmVNmAttnJvgTBg2+/B7u4AJ5QiK9YfX 48pRg8BZtRgMRjQvpJdY+frAVMiTDF7xB2FpmcU5veYvWS5Ubgu2zYpWkqVg3nYChqW5 FZPya76ET1XgSIXyCZzyIQm+7pRwxDmwXxste5G9o2ZbRjN6Gup+dwncLmNsBBOzpwj+ zwjTN7vTGQwsG1mO6mLmhtpcwYr/eWbE9rB1y+idc8wZRgiqNaPjIAzeIcqBqAoosVN8 fuhvkHEemzf02WiiA6U+biAP4ZnV5wmYvSygWWrlPKjiRFFRBP5bKp/Uv4GOUDdU70+l eqiw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694687611; x=1695292411; h=in-reply-to:content-disposition:mime-version:references :mail-followup-to:message-id:subject:cc:to:from:date:sender :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=Ie8HTYw17dvtFM9lJ7sKIzpmzt1x5i2Kw75mZtbTBGQ=; b=Kj7a+olxf9JM6JcEgfWERR7Ap0HofEU5AWzTWuYW3l31hrU6tH/F85QQNFBH97OFno +ASWICyYId696FKTj89QtlCDScUineuWj5QDJtmgPUngZJo+tQ29mmDdBc2N6nEwoMZH dhCq16rSobfwl15/BTYv0aqdFFcdb/fNNzV21jywGeHLULlsVfWiurFTjMxyw5ZVeIbu sHu0bhwj1vPIUQHjAB8eevbDU99jOFHiv9TTv153e+DbkFmUBduqb7nZT2jAKwX0amZI r8p5tkl8ZK7YContArddZ0iloLDBJNy2kFcJv1m7PgOBH+aOQGxbwIhp18HvGh16qoeP kzFw== X-Gm-Message-State: AOJu0Yw5wDbi+Qz0rIeZieKM0cERE1PRj/xFIHIFqi19Rey3id7djxMj AqtDiBRgtIrDsgQBEv3od5U= X-Google-Smtp-Source: AGHT+IGU5y6lsotpCqgpInWU/xOISGhOmqpVf2VskAo7CCcdZrUnMqk9hsX9nIr5yOA1XK2rUJHpgw== X-Received: by 2002:a05:600c:290:b0:3fe:2011:a7ce with SMTP id 16-20020a05600c029000b003fe2011a7cemr4505874wmk.6.1694687611126; Thu, 14 Sep 2023 03:33:31 -0700 (PDT) Received: from localhost ([2a02:ed3:916:6300:c3db:b80e:a694:a54f]) by smtp.gmail.com with ESMTPSA id m13-20020a7bca4d000000b003fe4548188bsm4464502wml.48.2023.09.14.03.33.27 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 14 Sep 2023 03:33:30 -0700 (PDT) Date: Thu, 14 Sep 2023 13:33:22 +0300 From: Efraim Flashner <efraim@HIDDEN> To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN> Subject: Re: bug#63986: Julia is very slow Message-ID: <ZQLhcr_Y21H1XiYL@3900XT> Mail-Followup-To: Efraim Flashner <efraim@HIDDEN>, Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>, Simon Tournier <zimon.toutoune@HIDDEN>, 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, csantosb@HIDDEN References: <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT> <87cz1n8lq3.fsf@HIDDEN> <871qi24k9z.fsf@HIDDEN> <ZJVi0Wwg5aRq_XxJ@3900XT> <87h6qy71oa.fsf@HIDDEN> <ZJWpKhkhHiMMzHST@3900XT> <87o7kpku0u.fsf@HIDDEN> <87jztpqvtz.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="curqSLtO4F5mndYD" Content-Disposition: inline In-Reply-To: <87jztpqvtz.fsf@HIDDEN> X-PGP-Key-ID: 0x41AAE7DCCA3D8351 X-PGP-Key: https://flashner.co.il/~efraim/efraim_flashner.asc X-PGP-Fingerprint: A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351 X-Spam-Score: 0.5 (/) X-Debbugs-Envelope-To: 63986 Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, csantosb@HIDDEN, Simon Tournier <zimon.toutoune@HIDDEN> X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -0.5 (/) --curqSLtO4F5mndYD Content-Type: multipart/mixed; boundary="frliOzMGhlesvkSS" Content-Disposition: inline --frliOzMGhlesvkSS Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, Aug 20, 2023 at 10:53:44PM +0200, Ludovic Court=C3=A8s wrote: > Hi! >=20 > Friendly ping. :-) >=20 > https://issues.guix.gnu.org/63986 >=20 > Ludo=E2=80=99. >=20 > Ludovic Court=C3=A8s <ludo@HIDDEN> skribis: >=20 > > Hi there! > > > > What=E2=80=99s the status? Sounds like we have a couple of fixes alrea= dy. > > > > Maybe you can submit one of them to guix-patches@HIDDEN so qa.guix can > > pick it up. And if one of them is more intrusive (more rebuilds), then > > submit it separately so it gets merged later? How does that sound? > > > > Ludo=E2=80=99. I've attached a diff to adjust openblas64 and to use it for x86_64 in julia. I don't know if it's faster than the current openblas. --=20 Efraim Flashner <efraim@HIDDEN> =D7=A8=D7=A0=D7=A9=D7=9C=D7=A4 = =D7=9D=D7=99=D7=A8=D7=A4=D7=90 GPG key =3D A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351 Confidentiality cannot be guaranteed on emails sent or received unencrypted --frliOzMGhlesvkSS Content-Type: text/plain; charset=utf-8 Content-Disposition: attachment; filename="julia-openblas-ilp64.patch" Content-Transfer-Encoding: quoted-printable diff --git a/gnu/packages/julia.scm b/gnu/packages/julia.scm index ba54175822..8ba2b480ce 100644 --- a/gnu/packages/julia.scm +++ b/gnu/packages/julia.scm @@ -269,7 +269,10 @@ (define-public julia (substitute* (jlpath "nghttp2") (((from "libnghttp2")) (to "libnghttp2" "libnghttp2"))) (substitute* (jlpath "OpenBLAS") - (((from "libopenblas")) (to "openblas" "libopenblas"))) + (((from "libopenblas")) + ,@(if (target-x86-64?) + `((to "openblas" "libopenblas64_" "libopenblas")) + `((to "openblas" "libopenblas"))))) (substitute* (jlpath "OpenLibm") (((from "libopenlibm")) (to "openlibm" "libopenlibm"))) (substitute* (jlpath "PCRE2") @@ -479,12 +482,13 @@ (define-public julia "NO_GIT=3D1" ; build from release tarball. "USE_GPL_LIBS=3D1" ; proudly =20 - ,@(if (target-aarch64?) - `("USE_BLAS64=3D0") - '()) - - "LIBBLAS=3D-lopenblas" - "LIBBLASNAME=3Dlibopenblas" + ,@(if (target-x86-64?) + `("USE_BLAS64=3D1" + "LIBBLAS=3D-lopenblas64_" + "LIBBLASNAME=3Dlibopenblas64_") + `("USE_BLAS64=3D0" + "LIBBLAS=3D-lopenblas" + "LIBBLASNAME=3Dlibopenblas")) =20 (string-append "UTF8PROC_INC=3D" (assoc-ref %build-inputs "utf8proc") @@ -513,7 +517,9 @@ (define-public julia ("llvm" ,llvm-julia) ("mbedtls-apache" ,mbedtls-apache) ("mpfr" ,mpfr) - ("openblas" ,openblas) + ,@(if (target-x86-64?) + `(("openblas" ,openblas-ilp64)) + `(("openblas" ,openblas))) ("openlibm" ,openlibm) ("p7zip" ,p7zip) ("pcre2" ,pcre2) diff --git a/gnu/packages/maths.scm b/gnu/packages/maths.scm index f5a2181905..2d3ce41cb7 100644 --- a/gnu/packages/maths.scm +++ b/gnu/packages/maths.scm @@ -4645,7 +4645,9 @@ (define-public openblas-ilp64 (arguments (substitute-keyword-arguments (package-arguments openblas) ((#:make-flags flags #~'()) - #~(append (list "INTERFACE64=3D1" "LIBNAMESUFFIX=3Dilp64") + #~(append (list "INTERFACE64=3D1" + "SYMBOLSUFFIX=3D64_" + "LIBPREFIX=3Dlibopenblas64_") #$flags)))) (synopsis "Optimized BLAS library based on GotoBLAS (ILP64 version)") (license license:bsd-3))) --frliOzMGhlesvkSS-- --curqSLtO4F5mndYD Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAmUC4XEACgkQQarn3Mo9 g1EpERAAu5cuxwDgm/zbny1oH7HA7eqYG3lCvxgNIGCp6voTzhSi9g7gZtJd3IPa 6NdfOcqv4P98n6iSxZN5Y+0Nrx2Cym6ck0KgI5xrGCTbGgy9SGhSdPIm1jRpwFQw yDFRwb/O4HCpwX7nDaWn1xXGGEgWm2UxRp6z9vG8PPjWS0D6zinST0f0cr9ScHzy x7jRGfvYu+iHtE5tGMGDMYhg1utaqnkg3M/goU6O0Bfby7a9eMLYn+kXuIdI37e3 vSttwuT0gcHGwrsMFFarBdQ9R/RkjRnZAFdNvWEYopa368LO8bpv/sY1uNeoDNOg PChiIZF/z97wECb9PKYmXp4sdDpM+c2LqQg+LFHWibqtzAbygK3Jtm9bNsUuOCKP U0B4bjdUc6crnJ8khQmrRFqLAwKdjcc59kwbFC0gLQHcA+aFxi9refYRyY/Xhxc/ 53DgPbPPQjIzMpbe21b+yw7IW/0IE70imTz7q+lBWXqo/gAZPLcJEtN3v3zd5AAd dfL2gXsFFJRYHuWnCUYn9mX48FnjKjr4ZcKwgfXgAs6EhUWlxsFB5HxA6txGnxXf 8xV6iS/tIw6IwU9tXiWF33QVXOfjVnc05kdvM+btJBwQtKUJIsF5qIgYN7qcS2Aw RAXNWZi2nESpKcX0nJLwyvPwYoqmI6k79iLMvCFDliDDOTAXN0c= =/Pj2 -----END PGP SIGNATURE----- --curqSLtO4F5mndYD--
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at 63986) by debbugs.gnu.org; 20 Aug 2023 20:54:01 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Sun Aug 20 16:54:00 2023 Received: from localhost ([127.0.0.1]:54931 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qXpQu-0006xe-JE for submit <at> debbugs.gnu.org; Sun, 20 Aug 2023 16:54:00 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:38434) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <ludo@HIDDEN>) id 1qXpQs-0006xS-P3 for 63986 <at> debbugs.gnu.org; Sun, 20 Aug 2023 16:53:59 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <ludo@HIDDEN>) id 1qXpQh-0000xZ-TN; Sun, 20 Aug 2023 16:53:47 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:In-Reply-To:Date:References:Subject:To: From; bh=jaOntIMIKkHibGry+VUs9wV4ZMoAPjB+qOxGbTP4SxM=; b=mx41ysZGVa/9MaaNr/+g 1bWZ+EhvE+zJr6U1V/BH4lxduPfcgRJ+6t2d96VzBxKTVLyMTufBEGBI7oQ8VC98iUe4xZqxWWZtu wxQsYpGQmsB+08a5op8LEnxwmPxjo+PURV3AdmbDwiQzf4NtKRdaS+Mm00OLusVQoDhs0+q6dkDPN Zenn/1Ui5mD387Glwga3Bn6aHEnTypDgsqtsZkUZKtXGzHg144PHQ1U6MN7bXN1NNoREefSv8gQrd Z11/fFp/YJie1QyMffu1V7/qPg+VZQIjrePmVwg7U2dWjhxmOA1wAJqyhQDY6fW3XbGSZVQ/M2oil gn+uwEamZmDStQ==; From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN> To: Efraim Flashner <efraim@HIDDEN> Subject: Re: bug#63986: Julia is very slow References: <871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN> <87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT> <87cz1n8lq3.fsf@HIDDEN> <871qi24k9z.fsf@HIDDEN> <ZJVi0Wwg5aRq_XxJ@3900XT> <87h6qy71oa.fsf@HIDDEN> <ZJWpKhkhHiMMzHST@3900XT> <87o7kpku0u.fsf@HIDDEN> Date: Sun, 20 Aug 2023 22:53:44 +0200 In-Reply-To: <87o7kpku0u.fsf@HIDDEN> ("Ludovic =?utf-8?Q?Court=C3=A8s=22'?= =?utf-8?Q?s?= message of "Thu, 06 Jul 2023 16:13:21 +0200") Message-ID: <87jztpqvtz.fsf@HIDDEN> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 63986 Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, csantosb@HIDDEN, Simon Tournier <zimon.toutoune@HIDDEN> X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -3.3 (---) Hi! Friendly ping. :-) https://issues.guix.gnu.org/63986 Ludo=E2=80=99. Ludovic Court=C3=A8s <ludo@HIDDEN> skribis: > Hi there! > > What=E2=80=99s the status? Sounds like we have a couple of fixes already. > > Maybe you can submit one of them to guix-patches@HIDDEN so qa.guix can > pick it up. And if one of them is more intrusive (more rebuilds), then > submit it separately so it gets merged later? How does that sound? > > Ludo=E2=80=99.
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at 63986) by debbugs.gnu.org; 6 Jul 2023 14:13:51 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Thu Jul 06 10:13:51 2023 Received: from localhost ([127.0.0.1]:41664 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qHPjz-0001S4-5s for submit <at> debbugs.gnu.org; Thu, 06 Jul 2023 10:13:51 -0400 Received: from eggs.gnu.org ([209.51.188.92]:50142) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <ludo@HIDDEN>) id 1qHPjt-0001Ro-Ji for 63986 <at> debbugs.gnu.org; Thu, 06 Jul 2023 10:13:49 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <ludo@HIDDEN>) id 1qHPjl-0006k0-01; Thu, 06 Jul 2023 10:13:38 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:In-Reply-To:Date:References:Subject:To: From; bh=a23HK9URfYfcH1C1LfoX4QDxE+NItT98qHjCUEap+fI=; b=PiZHkX+gfwcp5LujjAJb wnnbWRaukGp3AlC5UYoRPPrWZX1KwK69mIg0ccAD46/dfMjehcGm6ZAw7QDdadR4bT27AyX8b+pIL FSvXI31Z+YDk88F41H6hwlPTM1vWgd0PS84vE4jLtGfLy/WMj32HOQtsHrQxUgah4bkKRPR4tZLNM P9ZkRbOQuY6KGUBchKuECO6i1jvP2LcDzvnQmzUFy+IU+WVgTzoEGka57OX/5cmXjhL8FOroYkmsC XB6nZIGuzoPEOfg2TcFzLZhTa3ffXaqzjqO9ap/E/A5ogKBVP1cHgoR59zDBAjhjFf1GVISHx4rhM YhZs+PRlXOxoAA==; Received: from [2001:660:6102:320:e120:2c8f:8909:cdfe] (helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <ludo@HIDDEN>) id 1qHPjZ-0005g4-GI; Thu, 06 Jul 2023 10:13:34 -0400 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN> To: Efraim Flashner <efraim@HIDDEN>, Simon Tournier <zimon.toutoune@HIDDEN> Subject: Re: bug#63986: Julia is very slow References: <871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN> <87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT> <87cz1n8lq3.fsf@HIDDEN> <871qi24k9z.fsf@HIDDEN> <ZJVi0Wwg5aRq_XxJ@3900XT> <87h6qy71oa.fsf@HIDDEN> <ZJWpKhkhHiMMzHST@3900XT> Date: Thu, 06 Jul 2023 16:13:21 +0200 In-Reply-To: <ZJWpKhkhHiMMzHST@3900XT> (Efraim Flashner's message of "Fri, 23 Jun 2023 17:16:10 +0300") Message-ID: <87o7kpku0u.fsf@HIDDEN> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 63986 Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, csantosb@HIDDEN X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -3.3 (---) Hi there! What=E2=80=99s the status? Sounds like we have a couple of fixes already. Maybe you can submit one of them to guix-patches@HIDDEN so qa.guix can pick it up. And if one of them is more intrusive (more rebuilds), then submit it separately so it gets merged later? How does that sound? Ludo=E2=80=99.
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at 63986) by debbugs.gnu.org; 23 Jun 2023 14:16:22 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Fri Jun 23 10:16:22 2023 Received: from localhost ([127.0.0.1]:39288 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qChaH-0008H1-RF for submit <at> debbugs.gnu.org; Fri, 23 Jun 2023 10:16:22 -0400 Received: from mail-wm1-f46.google.com ([209.85.128.46]:50259) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <efraim.flashner@HIDDEN>) id 1qChaE-0008Gn-Gk for 63986 <at> debbugs.gnu.org; Fri, 23 Jun 2023 10:16:20 -0400 Received: by mail-wm1-f46.google.com with SMTP id 5b1f17b1804b1-3fa798cf201so8742945e9.0 for <63986 <at> debbugs.gnu.org>; Fri, 23 Jun 2023 07:16:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1687529772; x=1690121772; h=in-reply-to:content-disposition:mime-version:references :mail-followup-to:message-id:subject:cc:to:from:date:sender:from:to :cc:subject:date:message-id:reply-to; bh=Vx3xwOWE0Z/5txufR2s/EzT2VZUyhMtocCYsXjhex5c=; b=eLwNcviplugoywecPR8GV1f8FcIWl4KdWcLOc2msNy5G8Fyx8K5iuTXr7qyHDlOowo Mnlm+i3zUOtQ+SHIDqRBeILfSkfA1rcn7O6EJaBVxou2OKqSmuE9ik4ZMk6iGluF/F6t 0fPG8pF3MbeEjwVdgVnR7omRIyD3Hfz64jgOuFm9x7PDGoRBe/m/YMP/TUZXUvTAVysM WDg1MssCTW8Ta35UJ7J2urTSd4YZ173yJZ2ypnWu0FlFNJs9sp+TNMy1aypLcv5JWc6e JVwNZ5FfBqT7jvmng80I4V51Ov51XdORLqQrAUPkw8F82lnrF83YwK1YOl4rT6ApQhN/ PlrA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1687529772; x=1690121772; h=in-reply-to:content-disposition:mime-version:references :mail-followup-to:message-id:subject:cc:to:from:date:sender :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=Vx3xwOWE0Z/5txufR2s/EzT2VZUyhMtocCYsXjhex5c=; b=Omrp1+xglybYG1DqTmSpEe5VG/QNLj+Sr2s+QmhrUjuJXzHmkbaDfP/spp2ungVxVB KbMZw1L8G+c4pZu7mj06Bm92yZc3JESPkspz70eKAWZBs7dp3X7OfWoJaHmZGFWGaScI nkQigNfUXtanGEcdnet3VU0FMiZwuThpmCCUMWj3d+e/FBy+Og2MfjNOVTHcrb7RoLZd wZp0nnhYGPYZLfeY4uKBmZERb1d316l+v1LNe1rBK3oPM48y95ckc5ESLmnrlilqPNe7 E4PIR+EEW+7sYcoGQp6iCYnT5WVrnPjkOKBfb5Km/hAGS9j2i9oZBTzhNV6F5g0pVmjk zOzg== X-Gm-Message-State: AC+VfDwbqNEula4RkT9yb9sBPrv7da5Tt5aF9jHUw5iV/DRc/pfpJBUL aBPQO5VdWTV/FhKJlUbKww8= X-Google-Smtp-Source: ACHHUZ7q5MuGeOrlwV6ONsJFY6cll2GYVxWzAd+kE4XOtHK4WtU94lmBNe3qtoYTh/L9zaeBPFeQLw== X-Received: by 2002:a1c:4c05:0:b0:3fa:787b:5185 with SMTP id z5-20020a1c4c05000000b003fa787b5185mr2915767wmf.13.1687529772286; Fri, 23 Jun 2023 07:16:12 -0700 (PDT) Received: from localhost ([188.120.129.124]) by smtp.gmail.com with ESMTPSA id l21-20020a1c7915000000b003f605566610sm2493121wme.13.2023.06.23.07.16.10 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 23 Jun 2023 07:16:11 -0700 (PDT) Date: Fri, 23 Jun 2023 17:16:10 +0300 From: Efraim Flashner <efraim@HIDDEN> To: Simon Tournier <zimon.toutoune@HIDDEN> Subject: Re: bug#63986: Julia is very slow Message-ID: <ZJWpKhkhHiMMzHST@3900XT> Mail-Followup-To: Efraim Flashner <efraim@HIDDEN>, Simon Tournier <zimon.toutoune@HIDDEN>, Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>, 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, csantosb@HIDDEN References: <871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN> <87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT> <87cz1n8lq3.fsf@HIDDEN> <871qi24k9z.fsf@HIDDEN> <ZJVi0Wwg5aRq_XxJ@3900XT> <87h6qy71oa.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="zcDsr1hIZVUVbILN" Content-Disposition: inline In-Reply-To: <87h6qy71oa.fsf@HIDDEN> X-PGP-Key-ID: 0x41AAE7DCCA3D8351 X-PGP-Key: https://flashner.co.il/~efraim/efraim_flashner.asc X-PGP-Fingerprint: A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351 X-Spam-Score: 0.2 (/) X-Debbugs-Envelope-To: 63986 Cc: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>, 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, csantosb@HIDDEN X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -0.8 (/) --zcDsr1hIZVUVbILN Content-Type: multipart/mixed; boundary="P1A0iMc2RBMfbKZV" Content-Disposition: inline --P1A0iMc2RBMfbKZV Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Jun 23, 2023 at 03:23:17PM +0200, Simon Tournier wrote: > Hi Efraim, >=20 > On Fri, 23 Jun 2023 at 12:16, Efraim Flashner <efraim@HIDDEN> wro= te: >=20 > > It should be, but julia fails the precompile stage with openblas-ilp64 > > > > Precompilation complete. Summary: > > Total =E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80 1= 006.632176 seconds > > Generation =E2=94=80=E2=94=80 690.274180 seconds 68.5726% > > Execution =E2=94=80=E2=94=80=E2=94=80 316.357997 seconds 31.4274% > > > > signal (15): Terminated > > in expression starting at none:0 > > unknown function (ip: 0xfffff4d81b24) > > unknown function (ip: 0xfffff4ed10bb) > > unknown function (ip: 0xfffff4eda16f) > > _ZN4llvm19MachineFunctionPass13runOnFunctionERNS_8FunctionE at /gnu/sto= re/wa28l476c1bfshfiqcqbmk75zr8ml152-llvm-13.0.1/lib/libLLVM-13jl.so (unknow= n line) > > _ZN4llvm13FPPassManager13runOnFunctionERNS_8FunctionE at /gnu/store/wa2= 8l476c1bfshfiqcqbmk75zr8ml152-llvm-13.0.1/lib/libLLVM-13jl.so (unknown line) > > _ZN4llvm13FPPassManager11runOnModuleERNS_6ModuleE at /gnu/store/wa28l47= 6c1bfshfiqcqbmk75zr8ml152-llvm-13.0.1/lib/libLLVM-13jl.so (unknown line) > > _ZN4llvm6legacy15PassManagerImpl3runERNS_6ModuleE at /gnu/store/wa28l47= 6c1bfshfiqcqbmk75zr8ml152-llvm-13.0.1/lib/libLLVM-13jl.so (unknown line) > > operator() at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/src/aotcomp= ile.cpp:580 [inlined] > > jl_dump_native_impl at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/sr= c/aotcompile.cpp:592 > > jl_write_compiler_output at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8= =2E3/src/precompile.c:94 > > ijl_atexit_hook at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/src/in= it.c:207 > > jl_repl_entrypoint at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/src= /jlapi.c:720 > > main at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/cli/loader_exe.c:= 59 > > __libc_start_call_main at /gnu/store/a19xbynxc3sg25xpkwmx7g0mdl7g31hx-g= libc-2.35/lib/libc.so.6 (unknown line) > > __libc_start_main at /gnu/store/a19xbynxc3sg25xpkwmx7g0mdl7g31hx-glibc-= 2.35/lib/libc.so.6 (unknown line) > > _start at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/usr/bin/julia (= unknown line) > > unknown function (ip: (nil)) > > Allocations: 145655328 (Pool: 145582643; Big: 72685); GC: 120 > > *** This error is usually fixed by running `make clean`. If the error p= ersists, try `make cleanall`. *** > > make[1]: *** [sysimage.mk:89: /tmp/guix-build-julia-1.8.3.drv-0/julia-1= =2E8.3/usr/lib/julia/sys-o.a] Error 1 > > make[1]: Leaving directory '/tmp/guix-build-julia-1.8.3.drv-0/julia-1.8= =2E3' > > make: *** [Makefile:88: julia-sysimg-release] Error 2 >=20 > Using my patch, it fails with: >=20 > --8<---------------cut here---------------start------------->8--- > Error in testset OpenBLAS_jll: > Test Failed at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/usr/share/ju= lia/stdlib/v1.8/OpenBLAS_jll/test/runtests.jl:16 > Expression: dlsym(OpenBLAS_jll.libopenblas_handle, #=3D /tmp/guix-build= -julia-1.8.3.drv-0/julia-1.8.3/usr/share/julia/stdlib/v1.8/OpenBLAS_jll/tes= t/runtests.jl:16 =3D# @blasfunc(openblas_set_num_threads); throw_error =3D = false) !=3D nothing > Evaluated: nothing !=3D nothing > ERROR: LoadError: Test run finished with errors > in expression starting at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/t= est/runtests.jl:93 > --8<---------------cut here---------------end--------------->8--- Mine was on aarch64 > Well, I am still missing why the expression >=20 > dlsym(OpenBLAS_jll.libopenblas_handle, > #=3D /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/usr/share/julia/stdl= ib/v1.8/OpenBLAS_jll/test/runtests.jl:16 =3D# > @blasfunc(openblas_set_num_threads); throw_error =3D false) >=20 > is evaluated to nothing. Any idea? It is something about the wrong internal interface in openblas, I don't remember exactly what that error came from. Try with the attached diff. --=20 Efraim Flashner <efraim@HIDDEN> =D7=A8=D7=A0=D7=A9=D7=9C=D7=A4 = =D7=9D=D7=99=D7=A8=D7=A4=D7=90 GPG key =3D A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351 Confidentiality cannot be guaranteed on emails sent or received unencrypted --P1A0iMc2RBMfbKZV Content-Type: text/plain; charset=utf-8 Content-Disposition: attachment; filename="julia-openblas-ilp64.patch" Content-Transfer-Encoding: quoted-printable diff --git a/gnu/packages/julia.scm b/gnu/packages/julia.scm index ba54175822..8ba2b480ce 100644 --- a/gnu/packages/julia.scm +++ b/gnu/packages/julia.scm @@ -269,7 +269,10 @@ (define-public julia (substitute* (jlpath "nghttp2") (((from "libnghttp2")) (to "libnghttp2" "libnghttp2"))) (substitute* (jlpath "OpenBLAS") - (((from "libopenblas")) (to "openblas" "libopenblas"))) + (((from "libopenblas")) + ,@(if (target-x86-64?) + `((to "openblas" "libopenblas64_" "libopenblas")) + `((to "openblas" "libopenblas"))))) (substitute* (jlpath "OpenLibm") (((from "libopenlibm")) (to "openlibm" "libopenlibm"))) (substitute* (jlpath "PCRE2") @@ -479,12 +482,13 @@ (define-public julia "NO_GIT=3D1" ; build from release tarball. "USE_GPL_LIBS=3D1" ; proudly =20 - ,@(if (target-aarch64?) - `("USE_BLAS64=3D0") - '()) - - "LIBBLAS=3D-lopenblas" - "LIBBLASNAME=3Dlibopenblas" + ,@(if (target-x86-64?) + `("USE_BLAS64=3D1" + "LIBBLAS=3D-lopenblas64_" + "LIBBLASNAME=3Dlibopenblas64_") + `("USE_BLAS64=3D0" + "LIBBLAS=3D-lopenblas" + "LIBBLASNAME=3Dlibopenblas")) =20 (string-append "UTF8PROC_INC=3D" (assoc-ref %build-inputs "utf8proc") @@ -513,7 +517,9 @@ (define-public julia ("llvm" ,llvm-julia) ("mbedtls-apache" ,mbedtls-apache) ("mpfr" ,mpfr) - ("openblas" ,openblas) + ,@(if (target-x86-64?) + `(("openblas" ,openblas-ilp64)) + `(("openblas" ,openblas))) ("openlibm" ,openlibm) ("p7zip" ,p7zip) ("pcre2" ,pcre2) diff --git a/gnu/packages/maths.scm b/gnu/packages/maths.scm index f5a2181905..2d3ce41cb7 100644 --- a/gnu/packages/maths.scm +++ b/gnu/packages/maths.scm @@ -4645,7 +4645,9 @@ (define-public openblas-ilp64 (arguments (substitute-keyword-arguments (package-arguments openblas) ((#:make-flags flags #~'()) - #~(append (list "INTERFACE64=3D1" "LIBNAMESUFFIX=3Dilp64") + #~(append (list "INTERFACE64=3D1" + "SYMBOLSUFFIX=3D64_" + "LIBPREFIX=3Dlibopenblas64_") #$flags)))) (synopsis "Optimized BLAS library based on GotoBLAS (ILP64 version)") (license license:bsd-3))) --P1A0iMc2RBMfbKZV-- --zcDsr1hIZVUVbILN Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAmSVqScACgkQQarn3Mo9 g1Hf5BAAvmP9BmsscY/Dc+6fLF8WhpBwIr7TSh/SKi73ON0gumUJcaISQaEnhQGp QD11JVj3l0OBsf2OuQYaxfmhUa4WKIEFl5XYDhE8QzX1wetw10Ai7qy8TaqYv0Po KN1TKdMy0pLj0JLfbRkfkeYYYQSIUILspnwzygxcYUYhgG3tUfKpYAJFlf7BpYDj NvFoxQfv+Wct2ea87feCANfNc+MbADnKCvmS5KAr2jm0i7INmp/KZs+KosmE77fU CxHPDnDvh42yhvR5ezDlazXNXjrRVYm3twh3hKPxVEKG/ZpchThd5Zs0o3EFdv6K 0AeXQtNJXUqSfCwxVEA6jFoenHsOkAJJftVs9Ml8N8e768rrpZOSXKkaG8g75cNH OF5rTWxordYr5DGHg4U5uZuhnKj9C38V37wUebEah/xAsBqF+fm2TdATP147SRdn HX4ulpnE5YO57ME7ZHAVB9WYO3Ekh7HUbUVHdkHAU6yaIb70ECIkgUItlCj9T6BE JHcm7A4ZzE/qtFV+9f0K3bo9p4TZ8ekKmqU2HIUtB20VyDmDaLqxSx7R4uvmWBCO x5HjJRi1bqbJSqm/v8mepfTR1ZtcsNgh43a9XePVdCpcvYKrYSFkA8GZXEEJWTbR 33/41BYgDp+YveqFfzZjjLxKHncVJUYbfh+yVGQz4iRhS1v+8+k= =VWxD -----END PGP SIGNATURE----- --zcDsr1hIZVUVbILN--
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at 63986) by debbugs.gnu.org; 23 Jun 2023 14:04:09 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Fri Jun 23 10:04:09 2023 Received: from localhost ([127.0.0.1]:39277 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qChOT-0007ya-0X for submit <at> debbugs.gnu.org; Fri, 23 Jun 2023 10:04:09 -0400 Received: from mail-wr1-f53.google.com ([209.85.221.53]:41080) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <zimon.toutoune@HIDDEN>) id 1qChON-0007y3-S8 for 63986 <at> debbugs.gnu.org; Fri, 23 Jun 2023 10:04:07 -0400 Received: by mail-wr1-f53.google.com with SMTP id ffacd0b85a97d-3110f94915eso179601f8f.0 for <63986 <at> debbugs.gnu.org>; Fri, 23 Jun 2023 07:04:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1687529038; x=1690121038; h=content-transfer-encoding:mime-version:message-id:date:references :in-reply-to:subject:cc:to:from:from:to:cc:subject:date:message-id :reply-to; bh=UJM7eyVMjXmQcVLm17SUJxDMZ0uNZg9JQ3rFJSmA2nY=; b=oNIMBqh+3syHF1vtylU9KKFtL2GkBTyoOU/zZ9R8vgF73gfFv1DhiVMTftAOF3WZr8 A8NsaHhY4pp9dJeWQfetg9w7CjB/FGL/j4DA5H93CMDaiyDMa8dJMl1aEekkIVTQbTkA IdhCl59WmTG3baOxRdf9RFDZu/NPAZuU/U2xKUzlQK+A0F3oz0YZtOYcL7U95711oNFP 2o5QCgxY1VExl7ly87u5NplTkEyg++0VQXUTGP4tFN9yjNxaiwVhBz5TzM0GtO6PE96S tZn2WfSaYe8WfZwgW1yqAJsn70/ECKQjpPwIZXYfzeLPA22OlwYeGf2/h0CNX++FsuLm +YVQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1687529038; x=1690121038; h=content-transfer-encoding:mime-version:message-id:date:references :in-reply-to:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=UJM7eyVMjXmQcVLm17SUJxDMZ0uNZg9JQ3rFJSmA2nY=; b=Y+dsuPcmtybRIHwgKd3nE0QIJ8NPTesCmZn6Sb71yqMv/2g2rqmRcIS9RBH7PwI1TL V7MH+/zGnSmTSOM7uGeuKhpRGinbJw7HoZjlpJ+CQEGxmG3bM83ZMA1K7zog6uDrwEf5 YkPlscNHTBd3lpsWHRSiSk3zz+idGUqlaBRdr+mu3O0mhGspF012VhNAvrQHXXrOK6mJ bOBbLH32QrCCNkWgSBzXE1aUHpSBvAYb/ity9jrjWHufTdo2ZW8yb3oBGCKAEdVwypVR dc3BwdGPXXcvjqtobhtknu1D4ULp0nuypO2DDY35b0hlvLz+Yx4mvO6CmhAy0nRB/Qlk Iq9Q== X-Gm-Message-State: AC+VfDyL7A7Zq0vIrgOqyUF1ITnml1SuNwqphBzwGv0uRQbmVx2rM1qe pHZoT345ywOSBQIPkKIH/Fk= X-Google-Smtp-Source: ACHHUZ7ZWPXzov9RGuBheaxS30cWYc9msQIEjWUnJdK6aN0qVZQA0eoRYz0AJM/uzVa1yX1lpan5Iw== X-Received: by 2002:adf:ec45:0:b0:2c7:1c72:699f with SMTP id w5-20020adfec45000000b002c71c72699fmr18791477wrn.4.1687529037819; Fri, 23 Jun 2023 07:03:57 -0700 (PDT) Received: from pfiuh07 ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id r7-20020adfce87000000b0030af54c5f33sm9638634wrn.113.2023.06.23.07.03.57 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 23 Jun 2023 07:03:57 -0700 (PDT) From: Simon Tournier <zimon.toutoune@HIDDEN> To: Efraim Flashner <efraim@HIDDEN>, Ludovic =?utf-8?Q?Court=C3=A8?= =?utf-8?Q?s?= <ludovic.courtes@HIDDEN> Subject: Re: bug#63986: Julia is very slow In-Reply-To: <ZJVi0Wwg5aRq_XxJ@3900XT> References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN> <871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN> <87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT> <87cz1n8lq3.fsf@HIDDEN> <871qi24k9z.fsf@HIDDEN> <ZJVi0Wwg5aRq_XxJ@3900XT> Date: Fri, 23 Jun 2023 15:23:17 +0200 Message-ID: <87h6qy71oa.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 63986 Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, csantosb@HIDDEN X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) Hi Efraim, On Fri, 23 Jun 2023 at 12:16, Efraim Flashner <efraim@HIDDEN> wrote: > It should be, but julia fails the precompile stage with openblas-ilp64 > > Precompilation complete. Summary: > Total =E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80 100= 6.632176 seconds > Generation =E2=94=80=E2=94=80 690.274180 seconds 68.5726% > Execution =E2=94=80=E2=94=80=E2=94=80 316.357997 seconds 31.4274% > > signal (15): Terminated > in expression starting at none:0 > unknown function (ip: 0xfffff4d81b24) > unknown function (ip: 0xfffff4ed10bb) > unknown function (ip: 0xfffff4eda16f) > _ZN4llvm19MachineFunctionPass13runOnFunctionERNS_8FunctionE at /gnu/store= /wa28l476c1bfshfiqcqbmk75zr8ml152-llvm-13.0.1/lib/libLLVM-13jl.so (unknown = line) > _ZN4llvm13FPPassManager13runOnFunctionERNS_8FunctionE at /gnu/store/wa28l= 476c1bfshfiqcqbmk75zr8ml152-llvm-13.0.1/lib/libLLVM-13jl.so (unknown line) > _ZN4llvm13FPPassManager11runOnModuleERNS_6ModuleE at /gnu/store/wa28l476c= 1bfshfiqcqbmk75zr8ml152-llvm-13.0.1/lib/libLLVM-13jl.so (unknown line) > _ZN4llvm6legacy15PassManagerImpl3runERNS_6ModuleE at /gnu/store/wa28l476c= 1bfshfiqcqbmk75zr8ml152-llvm-13.0.1/lib/libLLVM-13jl.so (unknown line) > operator() at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/src/aotcompil= e.cpp:580 [inlined] > jl_dump_native_impl at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/src/= aotcompile.cpp:592 > jl_write_compiler_output at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3= /src/precompile.c:94 > ijl_atexit_hook at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/src/init= .c:207 > jl_repl_entrypoint at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/src/j= lapi.c:720 > main at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/cli/loader_exe.c:59 > __libc_start_call_main at /gnu/store/a19xbynxc3sg25xpkwmx7g0mdl7g31hx-gli= bc-2.35/lib/libc.so.6 (unknown line) > __libc_start_main at /gnu/store/a19xbynxc3sg25xpkwmx7g0mdl7g31hx-glibc-2.= 35/lib/libc.so.6 (unknown line) > _start at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/usr/bin/julia (un= known line) > unknown function (ip: (nil)) > Allocations: 145655328 (Pool: 145582643; Big: 72685); GC: 120 > *** This error is usually fixed by running `make clean`. If the error per= sists, try `make cleanall`. *** > make[1]: *** [sysimage.mk:89: /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8= .3/usr/lib/julia/sys-o.a] Error 1 > make[1]: Leaving directory '/tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3' > make: *** [Makefile:88: julia-sysimg-release] Error 2 Using my patch, it fails with: --8<---------------cut here---------------start------------->8--- Error in testset OpenBLAS_jll: Test Failed at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/usr/share/juli= a/stdlib/v1.8/OpenBLAS_jll/test/runtests.jl:16 Expression: dlsym(OpenBLAS_jll.libopenblas_handle, #=3D /tmp/guix-build-j= ulia-1.8.3.drv-0/julia-1.8.3/usr/share/julia/stdlib/v1.8/OpenBLAS_jll/test/= runtests.jl:16 =3D# @blasfunc(openblas_set_num_threads); throw_error =3D fa= lse) !=3D nothing Evaluated: nothing !=3D nothing ERROR: LoadError: Test run finished with errors in expression starting at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/tes= t/runtests.jl:93 --8<---------------cut here---------------end--------------->8--- Well, I am still missing why the expression dlsym(OpenBLAS_jll.libopenblas_handle, #=3D /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/usr/share/julia/stdlib= /v1.8/OpenBLAS_jll/test/runtests.jl:16 =3D# @blasfunc(openblas_set_num_threads); throw_error =3D false) is evaluated to nothing. Any idea? Cheers, simon
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at 63986) by debbugs.gnu.org; 23 Jun 2023 13:08:59 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Fri Jun 23 09:08:59 2023 Received: from localhost ([127.0.0.1]:37865 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qCgX5-00069A-Ce for submit <at> debbugs.gnu.org; Fri, 23 Jun 2023 09:08:59 -0400 Received: from mail-wr1-f51.google.com ([209.85.221.51]:41101) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <zimon.toutoune@HIDDEN>) id 1qCgX0-00068m-TQ for 63986 <at> debbugs.gnu.org; Fri, 23 Jun 2023 09:08:57 -0400 Received: by mail-wr1-f51.google.com with SMTP id ffacd0b85a97d-3110f94915eso165888f8f.0 for <63986 <at> debbugs.gnu.org>; Fri, 23 Jun 2023 06:08:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1687525729; x=1690117729; h=mime-version:message-id:date:references:in-reply-to:subject:cc:to :from:from:to:cc:subject:date:message-id:reply-to; bh=OsBXLFk63JqU/TVN/HEawf+jFy1GWmIZrVof5OXzask=; b=AJb70rDJj9N1UDRNHgO7BkYlSOrvCjppRQcweEJ117fdgvg7Y32LnjuQePjrVJqC2o eemPpJ6xuOjScmH4SciWiswSeielumXbvVIIaHBKtHMnt0bIQJmPfwFwKEAh+B0rEIjO SaUkNBUzy1WHOyrub9udX4l2aWIuutSo/weRKFtblonbQYZImFLyv8Ig6k1vR44+njoy z6rQBGqN4/jyndeVMC18gbc3nedddPqsd0HA6EpVPHL6J/sa9jwOZdhQmJ6/53zQ5Xi/ 7jOVYSndWTLNmjakn5nBUFv3029ABrCkJmes9Y9UA9ydBQJAlGVAEa6tRR25AV2k4eLe MEWw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1687525729; x=1690117729; h=mime-version:message-id:date:references:in-reply-to:subject:cc:to :from:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=OsBXLFk63JqU/TVN/HEawf+jFy1GWmIZrVof5OXzask=; b=dwNJn5dWVbfOISd+4n+qGH7h2K5Sf3uzFn8NYDSU7xehMJAmidhBYDuiRNCvXqNSq8 5mzPGNT2IJMWcnhnZatslHoyLIoaG3LMGTfn1Grb/nXkkxpmBM4s3AN+IOrkwa2/PO6c 5SWBrj4D4hgMYJFBGaFwbQjWUg571AqEAdAndFXFEfJZewpu97YA/5rIMqk8oivDzARU VM4kWvAryHgxGKjYSeHU+yX3JiyNz+vPETNzX3XKXBibGxZiZRcFeWN+X/P7NgYY4cME 1DBY5nDakwLnQ6Q5C42RXCbygrSSArcFki0squx8QVV8QVFxqW1VFGYsANlx5UR05S7i 0F8g== X-Gm-Message-State: AC+VfDwe3NMyQy8JuTKIDSQcG2lQoAE/nBSM+BIRAbSBeuuEHQ25VAT5 XzQPVj5kUob+ITlScFDbeic= X-Google-Smtp-Source: ACHHUZ7xA5TygW62EincumoXZr2UnBm+VnQfn9gn1nUOoUT6bhqVBi/zBU25Rdjm9OoL3b7Ax+vb7Q== X-Received: by 2002:adf:f290:0:b0:305:f3c1:184e with SMTP id k16-20020adff290000000b00305f3c1184emr17405478wro.3.1687525728753; Fri, 23 Jun 2023 06:08:48 -0700 (PDT) Received: from pfiuh07 ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id p7-20020a056000018700b003095bd71159sm9575225wrx.7.2023.06.23.06.08.48 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 23 Jun 2023 06:08:48 -0700 (PDT) From: Simon Tournier <zimon.toutoune@HIDDEN> To: Efraim Flashner <efraim@HIDDEN> Subject: Re: bug#63986: Julia is very slow In-Reply-To: <ZJSrU5ZqofMV3t4T@3900XT> References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN> <871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN> <87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT> <875y7f8hbf.fsf@HIDDEN> <ZJSrU5ZqofMV3t4T@3900XT> Date: Fri, 23 Jun 2023 14:06:12 +0200 Message-ID: <87v8fe758r.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 63986 Cc: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>, 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, csantosb@HIDDEN X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) Hi Efraim, On Thu, 22 Jun 2023 at 23:13, Efraim Flashner <efraim@HIDDEN> wrote: > - ,@(if (target-aarch64?) > - `("USE_BLAS64=0") > - '()) [...] > + ,@(if (target-64bit?) > + `("USE_BLAS64=1" Well, I do not know but using this change USE_BLAS64=1 will be applied to aarch64 when it was specifically not previously. Is it expected? > diff --git a/gnu/packages/python-xyz.scm b/gnu/packages/python-xyz.scm > index b650b71f3b..deeffb67ae 100644 > --- a/gnu/packages/python-xyz.scm > +++ b/gnu/packages/python-xyz.scm > @@ -6953,19 +6953,36 @@ (define-public python-numpy This change leads to a large rebuild. Therefore, it should go first to a dedicated branch, no? Cheers, simon
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at 63986) by debbugs.gnu.org; 23 Jun 2023 13:08:59 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Fri Jun 23 09:08:59 2023 Received: from localhost ([127.0.0.1]:37863 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qCgX5-000698-47 for submit <at> debbugs.gnu.org; Fri, 23 Jun 2023 09:08:59 -0400 Received: from mail-wm1-f50.google.com ([209.85.128.50]:41067) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <zimon.toutoune@HIDDEN>) id 1qCgX1-00068o-Et for 63986 <at> debbugs.gnu.org; Fri, 23 Jun 2023 09:08:57 -0400 Received: by mail-wm1-f50.google.com with SMTP id 5b1f17b1804b1-3f9b38e4e29so1805935e9.0 for <63986 <at> debbugs.gnu.org>; Fri, 23 Jun 2023 06:08:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1687525729; x=1690117729; h=content-transfer-encoding:mime-version:message-id:date:references :in-reply-to:subject:cc:to:from:from:to:cc:subject:date:message-id :reply-to; bh=rXrt9HE9QUb7XBCUjaGMn/mP2BFughPbBQoKsPvOaY4=; b=qW11W7nVBcY4Vd3vHDNJ5smCF4r4niZwDG6v78XhJ4ROplhOKpSJ40Sy197fXsuxDL ZWKCrjODUzlW+xBeVlerAetzTL4J0VtqvJpbt5k8fIr+8litGq1X5TX0bRgZ9gBbWCir mgFzbu25pQyv3HxrugxroEoRkhNlQqj+SxPx6Vvum9ZjiJnndMA6l8F/LTFoW8UVX+08 AClgu7dzVl++y3UNRgwRtMSaNydeORi4sSPqa1S7bJN55ccNbmSBxsCyXMAfqmoPtoYS +D+8mHI71pNFh3x9y6USCl8rMhKnccPspze4MYtvByg0j9RqPsf9mbzgvXLdE8pzdR4d Ifmg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1687525729; x=1690117729; h=content-transfer-encoding:mime-version:message-id:date:references :in-reply-to:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=rXrt9HE9QUb7XBCUjaGMn/mP2BFughPbBQoKsPvOaY4=; b=TUTAmcs308b72WDFe9IBt2JiDPnBclCR1lGF1X6eETVlUrPjrDrhHMe+Fjo8NX9WER +K+FrJEYrWIXR1Ka5nNN8TWyfAKNIZescuRnD6LkSzjOsHqI5gnLG/YhbciJKT6PwgjY +No3saOCW8uyCLuNLMHmJ5UT4IC4onX2oacp+VtmyPb/zP9CRa08WERbQKBWBccNXXk+ 16SfrWN5yPWdnYXxc14FMc2KnwK48TT0uv/sAI3sac5jehQsda3pAvYK3oWxwFM/KfO9 Q4BI9mtLvEpXxgF9Hi99dIsjAtLXN7TPX/eyB7ASpKp7mvv6gWR6j6TPCRczl+fwo4hn QU8g== X-Gm-Message-State: AC+VfDzTPhpE0uP32/RijvQyYyu2wyXBLi7dMSclu0akuRklEonRF2rk arijdrz8acBpFnrlUVURZk8= X-Google-Smtp-Source: ACHHUZ5IoqWLqAjKFg5Z2XkLMCT+PHfYKKa/K/olWzzaqrgXCiuibf/UzOhP3zbkMkiOM0ryQPabaA== X-Received: by 2002:a1c:ed17:0:b0:3f5:f543:d81f with SMTP id l23-20020a1ced17000000b003f5f543d81fmr22576316wmh.3.1687525729420; Fri, 23 Jun 2023 06:08:49 -0700 (PDT) Received: from pfiuh07 ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id az27-20020a05600c601b00b003f9bb026e5fsm6442449wmb.0.2023.06.23.06.08.49 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 23 Jun 2023 06:08:49 -0700 (PDT) From: Simon Tournier <zimon.toutoune@HIDDEN> To: Efraim Flashner <efraim@HIDDEN>, Ludovic =?utf-8?Q?Court=C3=A8?= =?utf-8?Q?s?= <ludovic.courtes@HIDDEN> Subject: Re: bug#63986: Julia is very slow In-Reply-To: <ZJVi0Wwg5aRq_XxJ@3900XT> References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN> <871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN> <87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT> <87cz1n8lq3.fsf@HIDDEN> <871qi24k9z.fsf@HIDDEN> <ZJVi0Wwg5aRq_XxJ@3900XT> Date: Fri, 23 Jun 2023 14:11:40 +0200 Message-ID: <87lega74zn.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 63986 Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, csantosb@HIDDEN X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) Hi, On Fri, 23 Jun 2023 at 12:16, Efraim Flashner <efraim@HIDDEN> wrote: >> Should it be =E2=80=98target-64bit?=E2=80=99 instead? > > It should be, but julia fails the precompile stage with openblas-ilp64 Well, I picked target-x86-64? because the recipe contains, ,@(if (target-aarch64?) `("USE_BLAS64=3D0") '()) so using target-64bit? would apply USE_BLAS64=3D1 to aarch64 when it was not. Well, since I know few about this architecture, I have tried to keep the way it was. Somehow, I have no opinion about what is best. :-) Cheers, simon
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at 63986) by debbugs.gnu.org; 23 Jun 2023 09:16:12 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Fri Jun 23 05:16:12 2023 Received: from localhost ([127.0.0.1]:37686 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qCctn-0005e9-KO for submit <at> debbugs.gnu.org; Fri, 23 Jun 2023 05:16:12 -0400 Received: from mail-wr1-f44.google.com ([209.85.221.44]:51218) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <efraim.flashner@HIDDEN>) id 1qCctl-0005dw-95 for 63986 <at> debbugs.gnu.org; Fri, 23 Jun 2023 05:16:10 -0400 Received: by mail-wr1-f44.google.com with SMTP id ffacd0b85a97d-312863a983fso462390f8f.2 for <63986 <at> debbugs.gnu.org>; Fri, 23 Jun 2023 02:16:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1687511763; x=1690103763; h=in-reply-to:content-disposition:mime-version:references :mail-followup-to:message-id:subject:cc:to:from:date:sender:from:to :cc:subject:date:message-id:reply-to; bh=zwFGrSq+r3HmHSCUXfCkm01ROQzafXR6dPcULdnQETs=; b=E5V27uEYF31lO+lG2Hnlwa7qHN6kqWhFJ2bztkxWoU1Acqx9CebHT0jAACnN6KCK1C +qHhD52QeMjwq3SiDJAKRy0Kf8fwIryKrjMHjr6LKZy2k0U+Z6lOWJln9F3JZpccUlBK CFMNgAh5iJlKn7IrEqHlWmkZl5foSvFjq2X3pN9yEKShEdWZOy/OFiBPhmk8CekjhrUX w5AJdeDz1jiU8u19N1wcMAoujpYuw891pcCHRU5hN+a5Yt9RgfoUq7Kv1RDQ9n1CtNKc MOCu4+u2IqTEBNSEUhNilKWfAjcbVeiyf3jheJ4VOWDlxAjRSSPp9VTjud8Fbup1KDPS mZ8A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1687511763; x=1690103763; h=in-reply-to:content-disposition:mime-version:references :mail-followup-to:message-id:subject:cc:to:from:date:sender :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=zwFGrSq+r3HmHSCUXfCkm01ROQzafXR6dPcULdnQETs=; b=BJAhU9ZnTgRWTEPsDErmGJaiGJ0boRzhnWK2hQrInEDY0lFYH1jrKGV2VjUEKhwprj hUWbAyrwE0+YOcqY4FSCpICTkcsixXcvbLf6JILvPPJt//IWjH6tYbrboJVIuNslH7Ty DOzH2JL69PLI+92BIo3jPu3/oWTi0QvTovGkyRhjvFNVTe6lxJ9WOtbtZw5y893+fGZY TI1vutuDEphIas+/qJ7I/67bWRpmC07F1tM8EPOcK0wQUch7+Qy0+ggp69YScDZctoNH O45txMxCd/UKgyJsRhPzhUKy789EQpQFDGgtysGXsjRzSNQZac0MMY2Hn/IqYQ+S72i8 Wc3A== X-Gm-Message-State: AC+VfDzRP7lDJtADcZTHEi4Na+lGIXJ7UY4NFm2X4RsaD4AU1f4i37jx TsMGnJXxLFsjXTvbgxB6f4U= X-Google-Smtp-Source: ACHHUZ7TSkWHHIR4TOFDpmfEONJBPHRRou90mle+rqAvfkkr2+fgHGfIsbVQVgC3CX+fJgKYjPAT/w== X-Received: by 2002:a5d:595a:0:b0:30d:d85c:4472 with SMTP id e26-20020a5d595a000000b0030dd85c4472mr15652657wri.62.1687511763244; Fri, 23 Jun 2023 02:16:03 -0700 (PDT) Received: from localhost ([188.120.129.124]) by smtp.gmail.com with ESMTPSA id x6-20020adff0c6000000b00307972e46fasm8978745wro.107.2023.06.23.02.16.02 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 23 Jun 2023 02:16:02 -0700 (PDT) Date: Fri, 23 Jun 2023 12:16:01 +0300 From: Efraim Flashner <efraim@HIDDEN> To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN> Subject: Re: bug#63986: Julia is very slow Message-ID: <ZJVi0Wwg5aRq_XxJ@3900XT> Mail-Followup-To: Efraim Flashner <efraim@HIDDEN>, Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>, Simon Tournier <zimon.toutoune@HIDDEN>, 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, csantosb@HIDDEN References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN> <871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN> <87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT> <87cz1n8lq3.fsf@HIDDEN> <871qi24k9z.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="m3keaYW7d3WYN+WZ" Content-Disposition: inline In-Reply-To: <871qi24k9z.fsf@HIDDEN> X-PGP-Key-ID: 0x41AAE7DCCA3D8351 X-PGP-Key: https://flashner.co.il/~efraim/efraim_flashner.asc X-PGP-Fingerprint: A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351 X-Spam-Score: 0.2 (/) X-Debbugs-Envelope-To: 63986 Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, csantosb@HIDDEN, Simon Tournier <zimon.toutoune@HIDDEN> X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -0.8 (/) --m3keaYW7d3WYN+WZ Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Jun 23, 2023 at 11:09:44AM +0200, Ludovic Court=C3=A8s wrote: > Hi! >=20 > Simon Tournier <zimon.toutoune@HIDDEN> skribis: >=20 > > + ,@(if (target-x86-64?) > > + `("USE_BLAS64=3D1" > > + "LIBBLAS=3D-lopenblas_ilp64" > > + "LIBBLASNAME=3Dlibopenblas_ilp64") > > + `("LIBBLAS=3D-lopenblas" > > + "LIBBLASNAME=3Dlibopenblas")) > > =20 > > (string-append "UTF8PROC_INC=3D" > > (assoc-ref %build-inputs "utf8proc") > > @@ -513,7 +517,9 @@ (define-public julia > > ("llvm" ,llvm-julia) > > ("mbedtls-apache" ,mbedtls-apache) > > ("mpfr" ,mpfr) > > - ("openblas" ,openblas) > > + ,@(if (target-x86-64?) > > + `(("openblas" ,openblas-ilp64)) > > + `(("openblas" ,openblas))) >=20 > Should it be =E2=80=98target-64bit?=E2=80=99 instead? It should be, but julia fails the precompile stage with openblas-ilp64 Precompilation complete. Summary: Total =E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80 1006.= 632176 seconds Generation =E2=94=80=E2=94=80 690.274180 seconds 68.5726% Execution =E2=94=80=E2=94=80=E2=94=80 316.357997 seconds 31.4274% signal (15): Terminated in expression starting at none:0 unknown function (ip: 0xfffff4d81b24) unknown function (ip: 0xfffff4ed10bb) unknown function (ip: 0xfffff4eda16f) _ZN4llvm19MachineFunctionPass13runOnFunctionERNS_8FunctionE at /gnu/store/w= a28l476c1bfshfiqcqbmk75zr8ml152-llvm-13.0.1/lib/libLLVM-13jl.so (unknown li= ne) _ZN4llvm13FPPassManager13runOnFunctionERNS_8FunctionE at /gnu/store/wa28l47= 6c1bfshfiqcqbmk75zr8ml152-llvm-13.0.1/lib/libLLVM-13jl.so (unknown line) _ZN4llvm13FPPassManager11runOnModuleERNS_6ModuleE at /gnu/store/wa28l476c1b= fshfiqcqbmk75zr8ml152-llvm-13.0.1/lib/libLLVM-13jl.so (unknown line) _ZN4llvm6legacy15PassManagerImpl3runERNS_6ModuleE at /gnu/store/wa28l476c1b= fshfiqcqbmk75zr8ml152-llvm-13.0.1/lib/libLLVM-13jl.so (unknown line) operator() at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/src/aotcompile.= cpp:580 [inlined] jl_dump_native_impl at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/src/ao= tcompile.cpp:592 jl_write_compiler_output at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/s= rc/precompile.c:94 ijl_atexit_hook at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/src/init.c= :207 jl_repl_entrypoint at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/src/jla= pi.c:720 main at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/cli/loader_exe.c:59 __libc_start_call_main at /gnu/store/a19xbynxc3sg25xpkwmx7g0mdl7g31hx-glibc= -2.35/lib/libc.so.6 (unknown line) __libc_start_main at /gnu/store/a19xbynxc3sg25xpkwmx7g0mdl7g31hx-glibc-2.35= /lib/libc.so.6 (unknown line) _start at /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3/usr/bin/julia (unkn= own line) unknown function (ip: (nil)) Allocations: 145655328 (Pool: 145582643; Big: 72685); GC: 120 *** This error is usually fixed by running `make clean`. If the error persi= sts, try `make cleanall`. *** make[1]: *** [sysimage.mk:89: /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3= /usr/lib/julia/sys-o.a] Error 1 make[1]: Leaving directory '/tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.3' make: *** [Makefile:88: julia-sysimg-release] Error 2 > Thumbs up for finding the solution! >=20 > Ludo=E2=80=99. --=20 Efraim Flashner <efraim@HIDDEN> =D7=A8=D7=A0=D7=A9=D7=9C=D7=A4 = =D7=9D=D7=99=D7=A8=D7=A4=D7=90 GPG key =3D A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351 Confidentiality cannot be guaranteed on emails sent or received unencrypted --m3keaYW7d3WYN+WZ Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAmSVYs4ACgkQQarn3Mo9 g1FeKQ/8CmpsiVH5Re1hDe3VzRI6l2dPfIO+WB2e5YlCmCjgJH3OHIeIyuI84PQX 8wvxfbbngNp2qQ4/JUUuijI28VeSl+9voBTQxmB3eWOt4Bdrd0O7XX5q+7CmTRWg Gdci6jvdugbwbjW4P5gGt0aYBxC3OazQ9b6449dvsodyIEiYrRVMOLQvSQ/zzvfe LqlZQPbB4RYsJ1RnFvPTlxAwt4LLVGzzxpjkgaOxUk/JwMqfTpzS2jynRhdx3JID HbbxPf0XgyzIV5EKXYB29T0IdUD3PNlmxU2Xn9iN8A27uDPRB5wkNLRh2KHF1Ipw X3JA+NE8kDXz7oWMBVbkezhOXwNaHC3/zpxBOXrvvaehrFDZe3ypBeAFcLmdI/XM 5wDZ8lU0gtbqz2+gEyOkbr4xQhEZz7lthAN2m65rFZBA9k/NIFdof2I7N0GU2pvo q9bfVdgoIy42Cmi2bnLRC8qc9xIdhAs1ZjH9JMX1yBnhQeK+AgFwEgOZkW2O8FjR Wqr9PsGsowGShr7h644Ty9P9ZwfJGf7FAqxOz6WbkmXFBg3XZRzW72HSpD/5nsso C/Rkmsa6qh4C6js8qBpgmM8BQ+46VwgBXmcHXaONIUPKB0v2jjPUoUrYCcZwRBXl VMleI99dlcVNRg6MH/P4Ryz4ShWtFnDWa2thTR3PzfCro0+6/vI= =uPlc -----END PGP SIGNATURE----- --m3keaYW7d3WYN+WZ--
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at 63986) by debbugs.gnu.org; 23 Jun 2023 09:09:56 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Fri Jun 23 05:09:56 2023 Received: from localhost ([127.0.0.1]:37682 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qCcnj-0005U3-Rk for submit <at> debbugs.gnu.org; Fri, 23 Jun 2023 05:09:56 -0400 Received: from mail3-relais-sop.national.inria.fr ([192.134.164.104]:61702) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <ludovic.courtes@HIDDEN>) id 1qCcnh-0005Tl-NR for 63986 <at> debbugs.gnu.org; Fri, 23 Jun 2023 05:09:54 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:references:date:in-reply-to: message-id:mime-version:content-transfer-encoding; bh=unP7cNdMiPCmCtBA3dFR62BGPTtjizcR96dTsFScw24=; b=ECWvRPj7L7HePeQ8aZKIfn+OC6k1CRmKV909WIOHx0sox6q7DcHfb57g IdundLrNh4fhebIxm7oFxMh5oIgZpPZCgk1SLQIAtiLPTW7M2T2gD531N 9J/0txF9BGlUPT9nNIuIr7EX2dsdfr5OtMlYCtcaatU9VoMYoZA0jXZRT s=; Authentication-Results: mail3-relais-sop.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=ludovic.courtes@HIDDEN; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.01,151,1684792800"; d="scan'208";a="59626948" Received: from lsm-cpl.in2p3.fr (HELO ribbon) ([134.158.178.2]) by mail3-relais-sop.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 23 Jun 2023 11:09:48 +0200 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludovic.courtes@HIDDEN> To: Simon Tournier <zimon.toutoune@HIDDEN> Subject: Re: bug#63986: Julia is very slow References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN> <871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN> <87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT> <87cz1n8lq3.fsf@HIDDEN> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: Quintidi 5 Messidor an 231 de la =?utf-8?Q?R=C3=A9vo?= =?utf-8?Q?lution=2C?= jour du Mulet X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Fri, 23 Jun 2023 11:09:44 +0200 In-Reply-To: <87cz1n8lq3.fsf@HIDDEN> (Simon Tournier's message of "Thu, 22 Jun 2023 19:12:36 +0200") Message-ID: <871qi24k9z.fsf@HIDDEN> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 63986 Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, Efraim Flashner <efraim@HIDDEN>, csantosb@HIDDEN X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) Hi! Simon Tournier <zimon.toutoune@HIDDEN> skribis: > + ,@(if (target-x86-64?) > + `("USE_BLAS64=3D1" > + "LIBBLAS=3D-lopenblas_ilp64" > + "LIBBLASNAME=3Dlibopenblas_ilp64") > + `("LIBBLAS=3D-lopenblas" > + "LIBBLASNAME=3Dlibopenblas")) >=20=20 > (string-append "UTF8PROC_INC=3D" > (assoc-ref %build-inputs "utf8proc") > @@ -513,7 +517,9 @@ (define-public julia > ("llvm" ,llvm-julia) > ("mbedtls-apache" ,mbedtls-apache) > ("mpfr" ,mpfr) > - ("openblas" ,openblas) > + ,@(if (target-x86-64?) > + `(("openblas" ,openblas-ilp64)) > + `(("openblas" ,openblas))) Should it be =E2=80=98target-64bit?=E2=80=99 instead? Thumbs up for finding the solution! Ludo=E2=80=99.
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at 63986) by debbugs.gnu.org; 22 Jun 2023 20:13:20 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Thu Jun 22 16:13:20 2023 Received: from localhost ([127.0.0.1]:36858 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qCQgB-0007Bm-TL for submit <at> debbugs.gnu.org; Thu, 22 Jun 2023 16:13:20 -0400 Received: from mail-wm1-f44.google.com ([209.85.128.44]:51400) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <efraim.flashner@HIDDEN>) id 1qCQg8-0007BU-Nh for 63986 <at> debbugs.gnu.org; Thu, 22 Jun 2023 16:13:18 -0400 Received: by mail-wm1-f44.google.com with SMTP id 5b1f17b1804b1-3f900cd3f96so66563295e9.2 for <63986 <at> debbugs.gnu.org>; Thu, 22 Jun 2023 13:13:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1687464790; x=1690056790; h=in-reply-to:content-disposition:mime-version:references :mail-followup-to:message-id:subject:cc:to:from:date:sender:from:to :cc:subject:date:message-id:reply-to; bh=Ky8Xs7f6tCQ0/1DiEKVSUMPCsNJgIfwZsJoAStEQ9zY=; b=UFASvvkEbF+0bklbcOwKUqVd98Zd6DV95YcFBvZUj6LfSoCdXrcu2ZA9tIMzxhQCZZ 9+uNZWCwW9s2q0sSw+dOL6JeTcjt7UUbSJK8c6+MdwZZ16ZqPJ2i5iNeAZ6KmDToYaDn 28gGCE79h6kf2HsdA0hbUJs9MneCMP+rk+MPXD1kR+N4HoGnM5t37a6lKkF1y0msBzr5 6xLZ5laY9RV2E0OHx4rzsr4eXvs+9VoQ7UaoZmH12ivqGhqhw5AD4fPJezwjAFXN/oCC g2kYgt1goR8YOailxbIpy/GurBalgca1TUOwjEQ0aEUZFxksKnuP0/BNmyoF5sBtgO9p eK/Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1687464790; x=1690056790; h=in-reply-to:content-disposition:mime-version:references :mail-followup-to:message-id:subject:cc:to:from:date:sender :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=Ky8Xs7f6tCQ0/1DiEKVSUMPCsNJgIfwZsJoAStEQ9zY=; b=Ny1LLnvS8E4IdMkqssdX2vq5s3Gj8nYQbq3oBzTHXP5nNnyHpfYzq3olb1jxWimWFH /71SwSUYbs7eSE40y+o3qAUMdNRIoIWL4HZXEW372MX7isGocIS+4pO2Ulzrph8NpQdR Q1RcTyNAuI6o/hk0aKryeKTYLZ8gAjg4cyyQtn2Ko26oIS1XM8fVF/jnKIXpH4r41917 +aEoAawyLxkdkr/xZGHBws/YvGnUGl9oDFSdPU7t0BYHa4vNv59uodZrOxyGGc2SjVA0 QdvX5+B2t2koLzlMe/BbGrqspFHlM/9XmqBlP13QStPDfdW4/lWfKr8SWaUdTAcL9yYB 7FzQ== X-Gm-Message-State: AC+VfDwqRUTqVxkRI3KCxMTruUpNgG5Zi8Yo4tXNgQqtuj15FrBAVwBc B6D6EX+zQXzubk7O2AUZasI= X-Google-Smtp-Source: ACHHUZ5ocX4oVNLHhXzvPZLSWWXwMRNrsl5ykIIZ4lSRx3CqPAalMcquNulOQuwK6lZ9IiK7K/5e6g== X-Received: by 2002:adf:f3d0:0:b0:30d:7c09:b677 with SMTP id g16-20020adff3d0000000b0030d7c09b677mr16203892wrp.39.1687464789644; Thu, 22 Jun 2023 13:13:09 -0700 (PDT) Received: from localhost ([188.120.129.124]) by smtp.gmail.com with ESMTPSA id p1-20020adfcc81000000b0030ada01ca78sm7791448wrj.10.2023.06.22.13.13.08 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 22 Jun 2023 13:13:08 -0700 (PDT) Date: Thu, 22 Jun 2023 23:13:07 +0300 From: Efraim Flashner <efraim@HIDDEN> To: Simon Tournier <zimon.toutoune@HIDDEN> Subject: Re: bug#63986: Julia is very slow Message-ID: <ZJSrU5ZqofMV3t4T@3900XT> Mail-Followup-To: Efraim Flashner <efraim@HIDDEN>, Simon Tournier <zimon.toutoune@HIDDEN>, Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>, 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, csantosb@HIDDEN References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN> <871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN> <87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT> <875y7f8hbf.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="gdMZlgtagU6t38UE" Content-Disposition: inline In-Reply-To: <875y7f8hbf.fsf@HIDDEN> X-PGP-Key-ID: 0x41AAE7DCCA3D8351 X-PGP-Key: https://flashner.co.il/~efraim/efraim_flashner.asc X-PGP-Fingerprint: A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351 X-Spam-Score: 0.2 (/) X-Debbugs-Envelope-To: 63986 Cc: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>, 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, csantosb@HIDDEN X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -0.8 (/) --gdMZlgtagU6t38UE Content-Type: multipart/mixed; boundary="VONVFpOeYgn05Vzw" Content-Disposition: inline --VONVFpOeYgn05Vzw Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Jun 22, 2023 at 08:47:48PM +0200, Simon Tournier wrote: > Hi, >=20 > On Thu, 22 Jun 2023 at 19:25, Efraim Flashner <efraim@HIDDEN> wro= te: >=20 > > (ins)efraim@3900XT ~/workspace/guix$ cat /gnu/store/v6z5ykkjfzbc72x1x90= 0xflspqc5wd5r-openblas-ilp64-0.3.20/lib/pkgconfig/openblas.pc > > libdir=3D/gnu/store/v6z5ykkjfzbc72x1x900xflspqc5wd5r-openblas-ilp64-0.3= =2E20/lib > > includedir=3D/gnu/store/v6z5ykkjfzbc72x1x900xflspqc5wd5r-openblas-ilp64= -0.3.20/include > > openblas_config=3D USE_64BITINT=3D DYNAMIC_ARCH=3D1 DYNAMIC_OLDER=3D1 N= O_CBLAS=3D NO_LAPACK=3D NO_LAPACKE=3D NO_AFFINITY=3D1 USE_OPENMP=3D generic= MAX_THREADS=3D128 > > version=3D0.3.20 > > extralib=3D-lm -lpthread -lgfortran -lm -lpthread -lgfortran > > Name: openblas > > Description: OpenBLAS is an optimized BLAS library based on GotoBLAS2 1= =2E13 BSD version > > Version: ${version} > > URL: https://github.com/xianyi/OpenBLAS > > Libs: -L${libdir} -lopenblas > > Libs.private: ${extralib} > > Cflags: -I${includedir} > > > > Looks like it should be "LIBBLAS=3D-lopenblas" >=20 > I propose to tweak openblas-ilp64. Currently it looks like: >=20 > --8<---------------cut here---------------start------------->8--- > $ tree $(guix build openblas-ilp64)/lib > /gnu/store/v6z5ykkjfzbc72x1x900xflspqc5wd5r-openblas-ilp64-0.3.20/lib > =E2=94=9C=E2=94=80=E2=94=80 cmake > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 openblas > =E2=94=82=C2=A0=C2=A0 =E2=94=9C=E2=94=80=E2=94=80 OpenBLASConfig.cmake > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 OpenBLASConfigVersi= on.cmake > =E2=94=9C=E2=94=80=E2=94=80 libopenblas_ilp64p-r0.3.20.so > =E2=94=9C=E2=94=80=E2=94=80 libopenblas_ilp64.so -> libopenblas_ilp64p-r0= =2E3.20.so > =E2=94=9C=E2=94=80=E2=94=80 libopenblas_ilp64.so.0 -> libopenblas_ilp64p-= r0.3.20.so > =E2=94=94=E2=94=80=E2=94=80 pkgconfig > =E2=94=94=E2=94=80=E2=94=80 openblas.pc > --8<---------------cut here---------------end--------------->8--- >=20 > which is inconsistent with pkgconfig as you noticed above. Therefore, I > am proposing the addition of a symlink of libopenblas_ilp64p.so to > libopenblas.so. For instance this attached patch. I've attached the patch that I've made it to. julia is built with openblas-ilp64 on 64-bit architectures, openblas-ilp64 has its configure-flags adjusted to match what other programs are expecting, and I've also patched python-numpy to use openblas-ilp64 as another test target. --=20 Efraim Flashner <efraim@HIDDEN> =D7=A8=D7=A0=D7=A9=D7=9C=D7=A4 = =D7=9D=D7=99=D7=A8=D7=A4=D7=90 GPG key =3D A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351 Confidentiality cannot be guaranteed on emails sent or received unencrypted --VONVFpOeYgn05Vzw Content-Type: text/plain; charset=utf-8 Content-Disposition: attachment; filename="julia-openblas-ilp64.patch" Content-Transfer-Encoding: quoted-printable diff --git a/gnu/packages/julia.scm b/gnu/packages/julia.scm index ba54175822..e96131dfc0 100644 --- a/gnu/packages/julia.scm +++ b/gnu/packages/julia.scm @@ -269,7 +269,10 @@ (define-public julia (substitute* (jlpath "nghttp2") (((from "libnghttp2")) (to "libnghttp2" "libnghttp2"))) (substitute* (jlpath "OpenBLAS") - (((from "libopenblas")) (to "openblas" "libopenblas"))) + (((from "libopenblas")) + ,@(if (target-64bit?) + `((to "openblas" "libopenblas64_" "libopenblas")) + `((to "openblas" "libopenblas"))))) (substitute* (jlpath "OpenLibm") (((from "libopenlibm")) (to "openlibm" "libopenlibm"))) (substitute* (jlpath "PCRE2") @@ -479,12 +482,12 @@ (define-public julia "NO_GIT=3D1" ; build from release tarball. "USE_GPL_LIBS=3D1" ; proudly =20 - ,@(if (target-aarch64?) - `("USE_BLAS64=3D0") - '()) - - "LIBBLAS=3D-lopenblas" - "LIBBLASNAME=3Dlibopenblas" + ,@(if (target-64bit?) + `("USE_BLAS64=3D1" + "LIBBLAS=3D-lopenblas64_" + "LIBBLASNAME=3Dlibopenblas64_") + `("LIBBLAS=3D-lopenblas" + "LIBBLASNAME=3Dlibopenblas")) =20 (string-append "UTF8PROC_INC=3D" (assoc-ref %build-inputs "utf8proc") @@ -513,7 +516,9 @@ (define-public julia ("llvm" ,llvm-julia) ("mbedtls-apache" ,mbedtls-apache) ("mpfr" ,mpfr) - ("openblas" ,openblas) + ,@(if (target-64bit?) + `(("openblas" ,openblas-ilp64)) + `(("openblas" ,openblas))) ("openlibm" ,openlibm) ("p7zip" ,p7zip) ("pcre2" ,pcre2) diff --git a/gnu/packages/maths.scm b/gnu/packages/maths.scm index f5a2181905..2d3ce41cb7 100644 --- a/gnu/packages/maths.scm +++ b/gnu/packages/maths.scm @@ -4645,7 +4645,9 @@ (define-public openblas-ilp64 (arguments (substitute-keyword-arguments (package-arguments openblas) ((#:make-flags flags #~'()) - #~(append (list "INTERFACE64=3D1" "LIBNAMESUFFIX=3Dilp64") + #~(append (list "INTERFACE64=3D1" + "SYMBOLSUFFIX=3D64_" + "LIBPREFIX=3Dlibopenblas64_") #$flags)))) (synopsis "Optimized BLAS library based on GotoBLAS (ILP64 version)") (license license:bsd-3))) diff --git a/gnu/packages/python-xyz.scm b/gnu/packages/python-xyz.scm index b650b71f3b..deeffb67ae 100644 --- a/gnu/packages/python-xyz.scm +++ b/gnu/packages/python-xyz.scm @@ -6953,19 +6953,36 @@ (define-public python-numpy (lambda _ (setenv "NPY_NUM_BUILD_JOBS" (number->string (parallel-job-count))))) - (add-before 'build 'configure-blas - (lambda* (#:key inputs #:allow-other-keys) - (call-with-output-file "site.cfg" - (lambda (port) - (format port - "\ + #$@(if (target-64bit?) + #~((add-before 'build 'configure-blas + (lambda* (#:key inputs #:allow-other-keys) + (setenv "NPY_USE_BLAS_ILP64" "1") + (setenv "NPY_BLAS_ILP64_ORDER" "openblas64_") + (setenv "NPY_LAPACK_ILP64_ORDER" "openblas64_") + (call-with-output-file "site.cfg" + (lambda (port) + (format port + "\ +[openblas64_] +libraries =3D openblas64_ +library_dirs =3D ~a/lib +include_dirs =3D ~:*~a/include~%" + (dirname (dirname + (search-input-file + inputs "include/openblas_config.h")))= )))))) + #~((add-before 'build 'configure-blas + (lambda* (#:key inputs #:allow-other-keys) + (call-with-output-file "site.cfg" + (lambda (port) + (format port + "\ [openblas] libraries =3D openblas library_dirs =3D ~a/lib include_dirs =3D ~:*~a/include~%" (dirname (dirname (search-input-file - inputs "include/openblas_config.h")))= ))))) + inputs "include/openblas_config.h")))= ))))))) (add-before 'build 'fix-executable-paths (lambda* (#:key inputs #:allow-other-keys) ;; Make /gnu/store/...-bash-.../bin/sh the default shell, @@ -7021,7 +7038,11 @@ (define-public python-numpy python-pytest-xdist python-typing-extensions gfortran)) - (inputs (list bash openblas)) + (inputs + (list bash + (if (target-64bit?) + openblas-ilp64 + openblas))) (home-page "https://numpy.org") (synopsis "Fundamental package for scientific computing with Python") (description "NumPy is the fundamental package for scientific computing --VONVFpOeYgn05Vzw-- --gdMZlgtagU6t38UE Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAmSUq1AACgkQQarn3Mo9 g1EKKA/+MMJCz0bec5w1dDBBZFaPNvmamno2xZD+sjeZCIWwruLAjnShYynJ8+qz I9GoOQc7Yzgd52VKd6DekCFXPTlviKRTzpR1wdNmWPgVTz8VKm0kEpjZdGzcz9aq aCoTnZrQs15aEY0B5yDXyXwtWjx4D8FbZLRs/QlBk0a0WRGHm9gxfCRzMOJJS3Iw hFPWftIET4YVtF5W2W/cZqVHJO1OrgFPdfKPglYJGQl2U4WVxpMWOe5xjyjlM27c /uV5l4BzAOhIUDFweIHmNthfG8X+Bn7T2XqKbmWLolOB+rT1ScETWMxiHs/uH6V2 kWaU9v6BhVOVYshqGvxdDzSyqF3YtXiEt1DG9ZwSvWnb3OtzRwzEMSJV4OrVeJzQ 82u822DLRw0IYylFOmhr39Qx4ZV85ekmlPkyz4BI6Hzw38xsorjN18CrnJxYmKDy FVeVRXoQHW6IZJPIYv9XW8LziGeRych2vJWMaU9DkJUbpWFLO2xDA7FZr7Ra5tag JCqoETfRDovpiUeJ89oa3fwR5OseriXJcLYBn8NYET9xsgNtUnQI+7lQfiExNzBN X6iwRqNJ3JqB0pn1iNyms4uX+RlCEokBYS2xZFzTYKI2C/eVme0eEhtWHod6UrEs kFhIfqMGUhO94rwQCoUvheL1YruAuok0br6/4daiZe2gg6E1RYQ= =wake -----END PGP SIGNATURE----- --gdMZlgtagU6t38UE--
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at 63986) by debbugs.gnu.org; 22 Jun 2023 18:55:27 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Thu Jun 22 14:55:27 2023 Received: from localhost ([127.0.0.1]:36742 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qCPSp-0008UJ-8N for submit <at> debbugs.gnu.org; Thu, 22 Jun 2023 14:55:27 -0400 Received: from mail-wm1-f46.google.com ([209.85.128.46]:58811) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <efraim.flashner@HIDDEN>) id 1qCPSl-0008U2-OQ for 63986 <at> debbugs.gnu.org; Thu, 22 Jun 2023 14:55:25 -0400 Received: by mail-wm1-f46.google.com with SMTP id 5b1f17b1804b1-3f9b4a71623so42172655e9.1 for <63986 <at> debbugs.gnu.org>; Thu, 22 Jun 2023 11:55:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1687460118; x=1690052118; h=in-reply-to:content-disposition:mime-version:references :mail-followup-to:message-id:subject:cc:to:from:date:sender:from:to :cc:subject:date:message-id:reply-to; bh=ANqVlzFUPFGBCFGLmuLmlp52BrGF8o/ek7tSUgBWEO8=; b=o0iO8M6Ow0mtyGUhOqmu0MosKKQh3uWAj5KOiCqVjQIgSVlbSQTHVp5xgdBg3/z0Ec 1hTJPsZCgm1vIz9ZblE5pq/pW4TWTSqIVcfvPSLhBZl3JE67/jvCa6d0STpRvY5qcGN0 PArrRrpZP0gmd9VLCCv1ut6bVBHlCdq+hRdRxOskKWMR4puw9Lk7k2M1tDdyaCLtxRzQ 9kucEYcNygZxGeJqk5UQ9Uzrd5YtM5LTEmcs1VOKAo4NC10h1UinTjqdcroSo0OMMzwM YACwzYPT8YNG/T7tQL/MAZ4A7/90+0cZZs3qkz0pKXpvN1yZHAszs/kIya6776tmBt63 hLlQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1687460118; x=1690052118; h=in-reply-to:content-disposition:mime-version:references :mail-followup-to:message-id:subject:cc:to:from:date:sender :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=ANqVlzFUPFGBCFGLmuLmlp52BrGF8o/ek7tSUgBWEO8=; b=TI6XhdwhK12cwIFh2STo0GHMQJFNrmF3SAjr0qDEmxESbdMs6ESg2bq1jF4SmQq5Fj Bv7eha5jFQR6CYoe+Ow7p9UFNLKwQ0qg1pcRpMEQ4G/sL9pmpypbJA0wrIzejcLPb2zV 3wCwuGZS88QHS4CkUBEmXIGAJZb8W44Vw2pXjgert52RndIx0lxqmJ+9p6ANhYBqP9Uw TxlwQqD8Sywq6wDPRzArvdUncyyUqWmP58AC1yML3kyYzfnoiGyZP1VZQoraag7tdFFu 7Le5z+P3SZ9y+e5fUkLQ78G0p6lMjKxvSOpR5JKCMUzTjV+4uZsQHthOtRIJ4oJoua5x mjew== X-Gm-Message-State: AC+VfDwd2WSR5wmqoVHsDS9QMFICb6WU2JIENvA8cuQzBkBOtd4JmVHJ JBhwYl2FMNkRIq1NX5t295I= X-Google-Smtp-Source: ACHHUZ6xAPBXU38/tJ7QgzTMP/v7AfycxSzkd550t6XcfGgipyHBaZPa4J9aZI8d3FBKDS6tDL81bw== X-Received: by 2002:a1c:4b08:0:b0:3f7:b1dd:954b with SMTP id y8-20020a1c4b08000000b003f7b1dd954bmr2203107wma.31.1687460117612; Thu, 22 Jun 2023 11:55:17 -0700 (PDT) Received: from localhost ([188.120.129.124]) by smtp.gmail.com with ESMTPSA id n10-20020a7bc5ca000000b003f42314832fsm244466wmk.18.2023.06.22.11.55.16 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 22 Jun 2023 11:55:17 -0700 (PDT) Date: Thu, 22 Jun 2023 21:55:15 +0300 From: Efraim Flashner <efraim@HIDDEN> To: Simon Tournier <zimon.toutoune@HIDDEN> Subject: Re: bug#63986: Julia is very slow Message-ID: <ZJSZExs94_1yjjZh@3900XT> Mail-Followup-To: Efraim Flashner <efraim@HIDDEN>, Simon Tournier <zimon.toutoune@HIDDEN>, Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>, 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, csantosb@HIDDEN References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN> <871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN> <87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT> <875y7f8hbf.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="gEMngYjU58n67i/L" Content-Disposition: inline In-Reply-To: <875y7f8hbf.fsf@HIDDEN> X-PGP-Key-ID: 0x41AAE7DCCA3D8351 X-PGP-Key: https://flashner.co.il/~efraim/efraim_flashner.asc X-PGP-Fingerprint: A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351 X-Spam-Score: 0.2 (/) X-Debbugs-Envelope-To: 63986 Cc: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>, 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, csantosb@HIDDEN X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -0.8 (/) --gEMngYjU58n67i/L Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Jun 22, 2023 at 08:47:48PM +0200, Simon Tournier wrote: > Hi, >=20 > On Thu, 22 Jun 2023 at 19:25, Efraim Flashner <efraim@HIDDEN> wro= te: >=20 > > (ins)efraim@3900XT ~/workspace/guix$ cat /gnu/store/v6z5ykkjfzbc72x1x90= 0xflspqc5wd5r-openblas-ilp64-0.3.20/lib/pkgconfig/openblas.pc > > libdir=3D/gnu/store/v6z5ykkjfzbc72x1x900xflspqc5wd5r-openblas-ilp64-0.3= =2E20/lib > > includedir=3D/gnu/store/v6z5ykkjfzbc72x1x900xflspqc5wd5r-openblas-ilp64= -0.3.20/include > > openblas_config=3D USE_64BITINT=3D DYNAMIC_ARCH=3D1 DYNAMIC_OLDER=3D1 N= O_CBLAS=3D NO_LAPACK=3D NO_LAPACKE=3D NO_AFFINITY=3D1 USE_OPENMP=3D generic= MAX_THREADS=3D128 > > version=3D0.3.20 > > extralib=3D-lm -lpthread -lgfortran -lm -lpthread -lgfortran > > Name: openblas > > Description: OpenBLAS is an optimized BLAS library based on GotoBLAS2 1= =2E13 BSD version > > Version: ${version} > > URL: https://github.com/xianyi/OpenBLAS > > Libs: -L${libdir} -lopenblas > > Libs.private: ${extralib} > > Cflags: -I${includedir} > > > > Looks like it should be "LIBBLAS=3D-lopenblas" >=20 > I propose to tweak openblas-ilp64. Currently it looks like: >=20 > --8<---------------cut here---------------start------------->8--- > $ tree $(guix build openblas-ilp64)/lib > /gnu/store/v6z5ykkjfzbc72x1x900xflspqc5wd5r-openblas-ilp64-0.3.20/lib > =E2=94=9C=E2=94=80=E2=94=80 cmake > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 openblas > =E2=94=82=C2=A0=C2=A0 =E2=94=9C=E2=94=80=E2=94=80 OpenBLASConfig.cmake > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 OpenBLASConfigVersi= on.cmake > =E2=94=9C=E2=94=80=E2=94=80 libopenblas_ilp64p-r0.3.20.so > =E2=94=9C=E2=94=80=E2=94=80 libopenblas_ilp64.so -> libopenblas_ilp64p-r0= =2E3.20.so > =E2=94=9C=E2=94=80=E2=94=80 libopenblas_ilp64.so.0 -> libopenblas_ilp64p-= r0.3.20.so > =E2=94=94=E2=94=80=E2=94=80 pkgconfig > =E2=94=94=E2=94=80=E2=94=80 openblas.pc > --8<---------------cut here---------------end--------------->8--- >=20 > which is inconsistent with pkgconfig as you noticed above. Therefore, I > am proposing the addition of a symlink of libopenblas_ilp64p.so to > libopenblas.so. For instance this attached patch. If we drop the "LIBNAMESUFFIX=3Dilp64" from openblas-ilp64 then we get libopenblas.so by default without needing to also symlink it into place. One benefit of this is we'd be able to easily do some package transformations between openblas and openblas-ilp64. Currently I'm looking around online to see what the consensus seems to be with naming openblas-ilp64, and there seems to be a lot of options. > From 0c8c7e9371d11972f4a6012ef503ef3057c91364 Mon Sep 17 00:00:00 2001 > Message-Id: <0c8c7e9371d11972f4a6012ef503ef3057c91364.1687459454.git.zimo= n.toutoune@HIDDEN> > From: Simon Tournier <zimon.toutoune@HIDDEN> > Date: Thu, 22 Jun 2023 20:31:26 +0200 > Subject: [PATCH v3 1/2] gnu: openblas-ilp64: Install symlink to libopenbl= as. >=20 > * gnu/packages/maths.scm (openblas-ilp64)[arguments]: Add phases for > installing symlink to libopenblas. > --- > gnu/packages/maths.scm | 8 +++++++- > 1 file changed, 7 insertions(+), 1 deletion(-) >=20 > diff --git a/gnu/packages/maths.scm b/gnu/packages/maths.scm > index f5a2181905..5c39ab8b94 100644 > --- a/gnu/packages/maths.scm > +++ b/gnu/packages/maths.scm > @@ -4646,7 +4646,13 @@ (define-public openblas-ilp64 > (substitute-keyword-arguments (package-arguments openblas) > ((#:make-flags flags #~'()) > #~(append (list "INTERFACE64=3D1" "LIBNAMESUFFIX=3Dilp64") > - #$flags)))) > + #$flags)) > + ((#:phases phases) > + #~(modify-phases #$phases > + (add-after 'install 'install-symlink > + (lambda _ > + (symlink "libopenblas_ilp64.so" > + (string-append #$output "/lib/libopenblas.so"))= )))))) > (synopsis "Optimized BLAS library based on GotoBLAS (ILP64 version)") > (license license:bsd-3))) > =20 >=20 > base-commit: 37c2e94cec6cb8b5e0e93e7b6c712c3b187ca5db > --=20 > 2.38.1 >=20 >=20 > Then, the patch for Julia looks like the other attached patch. >=20 > From 8563a738703d133b44ae05b91b7448ca56d280b5 Mon Sep 17 00:00:00 2001 > Message-Id: <8563a738703d133b44ae05b91b7448ca56d280b5.1687459454.git.zimo= n.toutoune@HIDDEN> > In-Reply-To: <0c8c7e9371d11972f4a6012ef503ef3057c91364.1687459454.git.zim= on.toutoune@HIDDEN> > References: <0c8c7e9371d11972f4a6012ef503ef3057c91364.1687459454.git.zimo= n.toutoune@HIDDEN> > From: Simon Tournier <zimon.toutoune@HIDDEN> > Date: Thu, 22 Jun 2023 17:45:50 +0200 > Subject: [PATCH v3 2/2] gnu: julia: Conditionally use openblas with ILP64 > support. >=20 > Fixes <https://bugs.gnu.org/63986>. > Reported by Cayetano Santos <csantosb@HIDDEN>. >=20 > * gnu/packages/julia.scm (julia)[arguments]<#:make-flags>: Conditionally = use > 64-bit BLAS for x86-64 target. > [inputs]: Conditionally replace openblas by openblas-ilp64 for x86-64 tar= get. > --- > gnu/packages/julia.scm | 10 ++++++---- > 1 file changed, 6 insertions(+), 4 deletions(-) >=20 > diff --git a/gnu/packages/julia.scm b/gnu/packages/julia.scm > index ba54175822..17a27f4928 100644 > --- a/gnu/packages/julia.scm > +++ b/gnu/packages/julia.scm > @@ -479,9 +479,9 @@ (define-public julia > "NO_GIT=3D1" ; build from release tarball. > "USE_GPL_LIBS=3D1" ; proudly > =20 > - ,@(if (target-aarch64?) > - `("USE_BLAS64=3D0") > - '()) > + ,@(if (target-x86-64?) > + `("USE_BLAS64=3D1") > + '()) > =20 > "LIBBLAS=3D-lopenblas" > "LIBBLASNAME=3Dlibopenblas" > @@ -513,7 +513,9 @@ (define-public julia > ("llvm" ,llvm-julia) > ("mbedtls-apache" ,mbedtls-apache) > ("mpfr" ,mpfr) > - ("openblas" ,openblas) > + ,@(if (target-x86-64?) > + `(("openblas" ,openblas-ilp64)) > + `(("openblas" ,openblas))) > ("openlibm" ,openlibm) > ("p7zip" ,p7zip) > ("pcre2" ,pcre2) > --=20 > 2.38.1 >=20 >=20 > WDYT? >=20 > Well, I am running all the testsuite for checking if all is correct. > Somehow, I think this is direction. Otherwise, what would you suggest? >=20 > Cheers, > simon >=20 >=20 >=20 --=20 Efraim Flashner <efraim@HIDDEN> =D7=A8=D7=A0=D7=A9=D7=9C=D7=A4 = =D7=9D=D7=99=D7=A8=D7=A4=D7=90 GPG key =3D A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351 Confidentiality cannot be guaranteed on emails sent or received unencrypted --gEMngYjU58n67i/L Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAmSUmQ8ACgkQQarn3Mo9 g1HAzBAApzwRY8knjwQjcNMckKOnvm3ijPtcg/obG60V/rc8Lt0FSoR6vQItN1Yx /lyf+WMkSntOt3BbCUa47GI+BzHBgoUvlhh9oxUyIiNDYKceVdTCXk8EqxT8woLb Tx6jYWJyqun/v/ToyOr0m+MHyljoER93/TlRt2zWHwRvC+d6OdDos1GvRM4/dtEp nlsI5R7pcjLsCb97+wLc9nfzxOLHvVykDNMqWHVFCdRdNPO9PxJoN9TFtL/h0Btp 7RHgVBBl16ljHi82qvVJp2vrMEObTkaL4UIe0fbYmZfylJIiKWfFL+JSdM5sX8oi 6+7uNev3x7lzn+bxWj3pi/ZR9m5l3lXPa1+HKUbAtz2SR1zTJFqQgtuT/E50jFzd wgcL64tXaIo7FkRYvXexsSJVkFIxs/ZTCOV7R65m4haXVsF37B9pylrCrYDmvt9J 26IoWZazmex1G2WjUQ8rrn9EKiLkzLURwSqwtABRZ+6CMYNd5eEQZ5/oQ+WYJMKY rgqeuLe44Uz4ozysP7BNbcsuF/C6z8oFg8Nd7xAhiW+y9l5Ux6uKrOKFtuqjcJMT 5nyAN8CuX7zbr1MKe7K154T0QyerIkW2lWCrcPfLa7gMEcalzmk/bUQON03kUHhP pcI5orfVRWH5a27E/mZ6ee36w31gfKOfe1z3Eb03gg8OyeTqhZI= =jfnB -----END PGP SIGNATURE----- --gEMngYjU58n67i/L--
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at 63986) by debbugs.gnu.org; 22 Jun 2023 18:48:00 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Thu Jun 22 14:48:00 2023 Received: from localhost ([127.0.0.1]:36734 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qCPLb-0008H2-Ly for submit <at> debbugs.gnu.org; Thu, 22 Jun 2023 14:48:00 -0400 Received: from mail-wr1-f42.google.com ([209.85.221.42]:39937) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <zimon.toutoune@HIDDEN>) id 1qCPLZ-0008GD-Q3 for 63986 <at> debbugs.gnu.org; Thu, 22 Jun 2023 14:47:58 -0400 Received: by mail-wr1-f42.google.com with SMTP id ffacd0b85a97d-3112599fd5cso1864140f8f.0 for <63986 <at> debbugs.gnu.org>; Thu, 22 Jun 2023 11:47:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1687459672; x=1690051672; h=mime-version:message-id:date:references:in-reply-to:subject:cc:to :from:from:to:cc:subject:date:message-id:reply-to; bh=0y2jwc9zoMvk3rZO1kB3N5leeibatl97Uk95S7oUrDA=; b=avU+VIOFvj7NVUfU4m0X7CQgP0X3L3dabmyhzX65/Vbe4oMSkAIX2+XmdSs9/P4RCJ BQX4cTElggqRj1FH2Rxk++TB/Ez83FravC8q2B8sKowlPBbpTGMW1CeYr9X08+Ae0iuG Ab847BctucGTPjI5uxnoMBLTuxcnsF2goCt407kKqxH5q1P51rxqDse5m9R1l4811RNJ Jf0eDqkNn+QGBrgTp8OyGGlt7uG43d5wEfVMKmG1HJD9YqIMfzRHzXHeHXdk/aCPVuk6 PtHmGDQ+42JkrlRc1aCa+p3ded0Ibk9bN5LDHFlAFNksEYNIhbChz7Zt3jwdNVzpeDj6 E/tg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1687459672; x=1690051672; h=mime-version:message-id:date:references:in-reply-to:subject:cc:to :from:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=0y2jwc9zoMvk3rZO1kB3N5leeibatl97Uk95S7oUrDA=; b=Z1ozi0FKePObB35PmwrdzI2PWoJgDKqpxw+a7tCGy8qlyDCKb3i740IQEzJFP4fZIk c2tC3oYmjW+uuvSzXrKAQhenJP89iE4J0TjBjnDkATCnsVB7qtf9hbk37sKCG8kjWYwW Qa4vDQZghUWOSm0h/xbLNfQieTBy716tncUAKtyjKLqIHiOQFEXqkSBPoHiQ8YxFRN10 1CTBpRLGt9Fi/6C35TkcYvnoxvAUSQ03NyjGOY0ItzaBd3pgJk9Hs1Pi4NNMXltlNhaq jORwF/jTRmU6NGdSuT01WD6SZcqlC61lNth7WRPBwcjzQ7PShyMPNdUxFTVyS6zQIGFj MuIA== X-Gm-Message-State: AC+VfDzcroTiGlVQEfHxaFJxZyCPx/7Rxzvl16c6L3zrS5Ok2VceFO/5 zgjcp091kj8xnqRQVVO7+dU= X-Google-Smtp-Source: ACHHUZ4pStzuxaCGMmJm6RluYCnmi8a/0FXSIabaZLhS0t7Ugn+9nMSZePlrHbVFphmfhFde/rsL4w== X-Received: by 2002:adf:ef8d:0:b0:30f:ca51:629e with SMTP id d13-20020adfef8d000000b0030fca51629emr15377397wro.5.1687459671648; Thu, 22 Jun 2023 11:47:51 -0700 (PDT) Received: from pfiuh07 ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id c9-20020a056000104900b0030631a599a0sm7528073wrx.24.2023.06.22.11.47.50 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 22 Jun 2023 11:47:51 -0700 (PDT) From: Simon Tournier <zimon.toutoune@HIDDEN> To: Efraim Flashner <efraim@HIDDEN> Subject: Re: bug#63986: Julia is very slow In-Reply-To: <ZJR14QoB4SoqhsrP@3900XT> References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN> <871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN> <87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT> Date: Thu, 22 Jun 2023 20:47:48 +0200 Message-ID: <875y7f8hbf.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="=-=-=" X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 63986 Cc: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>, 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, csantosb@HIDDEN X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hi, On Thu, 22 Jun 2023 at 19:25, Efraim Flashner <efraim@HIDDEN> wrote: > (ins)efraim@3900XT ~/workspace/guix$ cat /gnu/store/v6z5ykkjfzbc72x1x900x= flspqc5wd5r-openblas-ilp64-0.3.20/lib/pkgconfig/openblas.pc > libdir=3D/gnu/store/v6z5ykkjfzbc72x1x900xflspqc5wd5r-openblas-ilp64-0.3.2= 0/lib > includedir=3D/gnu/store/v6z5ykkjfzbc72x1x900xflspqc5wd5r-openblas-ilp64-0= .3.20/include > openblas_config=3D USE_64BITINT=3D DYNAMIC_ARCH=3D1 DYNAMIC_OLDER=3D1 NO_= CBLAS=3D NO_LAPACK=3D NO_LAPACKE=3D NO_AFFINITY=3D1 USE_OPENMP=3D generic M= AX_THREADS=3D128 > version=3D0.3.20 > extralib=3D-lm -lpthread -lgfortran -lm -lpthread -lgfortran > Name: openblas > Description: OpenBLAS is an optimized BLAS library based on GotoBLAS2 1.1= 3 BSD version > Version: ${version} > URL: https://github.com/xianyi/OpenBLAS > Libs: -L${libdir} -lopenblas > Libs.private: ${extralib} > Cflags: -I${includedir} > > Looks like it should be "LIBBLAS=3D-lopenblas" I propose to tweak openblas-ilp64. Currently it looks like: --8<---------------cut here---------------start------------->8--- $ tree $(guix build openblas-ilp64)/lib /gnu/store/v6z5ykkjfzbc72x1x900xflspqc5wd5r-openblas-ilp64-0.3.20/lib =E2=94=9C=E2=94=80=E2=94=80 cmake =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 openblas =E2=94=82=C2=A0=C2=A0 =E2=94=9C=E2=94=80=E2=94=80 OpenBLASConfig.cmake =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 OpenBLASConfigVersion= .cmake =E2=94=9C=E2=94=80=E2=94=80 libopenblas_ilp64p-r0.3.20.so =E2=94=9C=E2=94=80=E2=94=80 libopenblas_ilp64.so -> libopenblas_ilp64p-r0.3= .20.so =E2=94=9C=E2=94=80=E2=94=80 libopenblas_ilp64.so.0 -> libopenblas_ilp64p-r0= .3.20.so =E2=94=94=E2=94=80=E2=94=80 pkgconfig =E2=94=94=E2=94=80=E2=94=80 openblas.pc --8<---------------cut here---------------end--------------->8--- which is inconsistent with pkgconfig as you noticed above. Therefore, I am proposing the addition of a symlink of libopenblas_ilp64p.so to libopenblas.so. For instance this attached patch. --=-=-= Content-Type: text/x-diff Content-Disposition: inline; filename=v3-0001-gnu-openblas-ilp64-Install-symlink-to-libopenblas.patch Content-Description: p3-openblas-ilp64.patch From 0c8c7e9371d11972f4a6012ef503ef3057c91364 Mon Sep 17 00:00:00 2001 Message-Id: <0c8c7e9371d11972f4a6012ef503ef3057c91364.1687459454.git.zimon.toutoune@HIDDEN> From: Simon Tournier <zimon.toutoune@HIDDEN> Date: Thu, 22 Jun 2023 20:31:26 +0200 Subject: [PATCH v3 1/2] gnu: openblas-ilp64: Install symlink to libopenblas. * gnu/packages/maths.scm (openblas-ilp64)[arguments]: Add phases for installing symlink to libopenblas. --- gnu/packages/maths.scm | 8 +++++++- 1 file changed, 7 insertions(+), 1 deletion(-) diff --git a/gnu/packages/maths.scm b/gnu/packages/maths.scm index f5a2181905..5c39ab8b94 100644 --- a/gnu/packages/maths.scm +++ b/gnu/packages/maths.scm @@ -4646,7 +4646,13 @@ (define-public openblas-ilp64 (substitute-keyword-arguments (package-arguments openblas) ((#:make-flags flags #~'()) #~(append (list "INTERFACE64=1" "LIBNAMESUFFIX=ilp64") - #$flags)))) + #$flags)) + ((#:phases phases) + #~(modify-phases #$phases + (add-after 'install 'install-symlink + (lambda _ + (symlink "libopenblas_ilp64.so" + (string-append #$output "/lib/libopenblas.so")))))))) (synopsis "Optimized BLAS library based on GotoBLAS (ILP64 version)") (license license:bsd-3))) base-commit: 37c2e94cec6cb8b5e0e93e7b6c712c3b187ca5db -- 2.38.1 --=-=-= Content-Type: text/plain Then, the patch for Julia looks like the other attached patch. --=-=-= Content-Type: text/x-diff Content-Disposition: inline; filename=v3-0002-gnu-julia-Conditionally-use-openblas-with-ILP64-s.patch Content-Description: p3.patch From 8563a738703d133b44ae05b91b7448ca56d280b5 Mon Sep 17 00:00:00 2001 Message-Id: <8563a738703d133b44ae05b91b7448ca56d280b5.1687459454.git.zimon.toutoune@HIDDEN> In-Reply-To: <0c8c7e9371d11972f4a6012ef503ef3057c91364.1687459454.git.zimon.toutoune@HIDDEN> References: <0c8c7e9371d11972f4a6012ef503ef3057c91364.1687459454.git.zimon.toutoune@HIDDEN> From: Simon Tournier <zimon.toutoune@HIDDEN> Date: Thu, 22 Jun 2023 17:45:50 +0200 Subject: [PATCH v3 2/2] gnu: julia: Conditionally use openblas with ILP64 support. Fixes <https://bugs.gnu.org/63986>. Reported by Cayetano Santos <csantosb@HIDDEN>. * gnu/packages/julia.scm (julia)[arguments]<#:make-flags>: Conditionally use 64-bit BLAS for x86-64 target. [inputs]: Conditionally replace openblas by openblas-ilp64 for x86-64 target. --- gnu/packages/julia.scm | 10 ++++++---- 1 file changed, 6 insertions(+), 4 deletions(-) diff --git a/gnu/packages/julia.scm b/gnu/packages/julia.scm index ba54175822..17a27f4928 100644 --- a/gnu/packages/julia.scm +++ b/gnu/packages/julia.scm @@ -479,9 +479,9 @@ (define-public julia "NO_GIT=1" ; build from release tarball. "USE_GPL_LIBS=1" ; proudly - ,@(if (target-aarch64?) - `("USE_BLAS64=0") - '()) + ,@(if (target-x86-64?) + `("USE_BLAS64=1") + '()) "LIBBLAS=-lopenblas" "LIBBLASNAME=libopenblas" @@ -513,7 +513,9 @@ (define-public julia ("llvm" ,llvm-julia) ("mbedtls-apache" ,mbedtls-apache) ("mpfr" ,mpfr) - ("openblas" ,openblas) + ,@(if (target-x86-64?) + `(("openblas" ,openblas-ilp64)) + `(("openblas" ,openblas))) ("openlibm" ,openlibm) ("p7zip" ,p7zip) ("pcre2" ,pcre2) -- 2.38.1 --=-=-= Content-Type: text/plain WDYT? Well, I am running all the testsuite for checking if all is correct. Somehow, I think this is direction. Otherwise, what would you suggest? Cheers, simon --=-=-=--
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at 63986) by debbugs.gnu.org; 22 Jun 2023 17:13:09 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Thu Jun 22 13:13:09 2023 Received: from localhost ([127.0.0.1]:36635 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qCNrp-0005nK-3J for submit <at> debbugs.gnu.org; Thu, 22 Jun 2023 13:13:09 -0400 Received: from mail-wr1-f49.google.com ([209.85.221.49]:39266) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <zimon.toutoune@HIDDEN>) id 1qCNrn-0005mi-1d for 63986 <at> debbugs.gnu.org; Thu, 22 Jun 2023 13:13:07 -0400 Received: by mail-wr1-f49.google.com with SMTP id ffacd0b85a97d-3110e74bf3cso1700787f8f.1 for <63986 <at> debbugs.gnu.org>; Thu, 22 Jun 2023 10:13:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1687453981; x=1690045981; h=mime-version:message-id:date:references:in-reply-to:subject:cc:to :from:from:to:cc:subject:date:message-id:reply-to; bh=CCIvvJGyvYD1aXPcYmmZShvGhfoviO6cdJxb4jDJoOU=; b=e/Fq714yk9fF283IBlkGzrtK4CY8I1JxlhL40NVL+Nt1JD/Ntxxib+FWcv4CVCpxEC 2LEBMoRBmBxZQaVe2MZdqbeeVksEhlXQ8xs8gpYtTtOsoglXlK/Ch92+4lOwblBiOH3C 41i9liyeQv8rG4GlIa0wNozO4T1Zt9UF02ROJWPU0C+XSEmPdYS1fW7krcSR8KIRLiRi HnZjVpFRLWNDcV0486aVV6FgUMT70S1onyMKhfRe9abctSjOLz5udTL5qzLSw6XYlio1 GDlHG8SPsf5vaqpwM2Vkxwhw+7VYE89aDBrJ5hNqqHb6yoVvk7MJboUmeqXWAqtzDkZ7 Im3A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1687453981; x=1690045981; h=mime-version:message-id:date:references:in-reply-to:subject:cc:to :from:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=CCIvvJGyvYD1aXPcYmmZShvGhfoviO6cdJxb4jDJoOU=; b=GOBfYt2YYjokPq1tliybihABQIPOOwlN+Akcq55BHJ14OxivfoTOFD67l9bScVs+Kv /AEAcusHWcx1d2CoN0FMsNPUql1vbGv9FFTYS48DhoT+MgkgV8YO4OUfMJMsvXUI+bCB nCz8692HY5GeVSDVYT+FahHqxCWDV1FhcOF+5vhfGOcswvXMHWVqP9/WRCrTTR7mJ7w6 Ep8rtMNPe/oXjyEWT6SMSMPC+wVjr3zcErJJBTlTGMqYErh/Ld78XxlzZhKzJNS1ruKB H7zQ+OJ3i2YnOEdp8AISgyz9BYTcCEmf+MTY2sU+IQYYQzNI64A8nih+0SixwrNmSuj4 BPqg== X-Gm-Message-State: AC+VfDwy7ypiz/BMd7ObbYY8vD60lveuowBv29HViXqOQwqAN46BVBzC Y5xlFEshwUB3lFOrJv3Mp74= X-Google-Smtp-Source: ACHHUZ65BF1smcs3xSnRLW+wBcCjoBo1SKBU2dUflls1HV+n1IGlGmOcFZbq+UGft4CfpfCZxRIW6g== X-Received: by 2002:adf:f682:0:b0:2e4:c9ac:c491 with SMTP id v2-20020adff682000000b002e4c9acc491mr14634305wrp.1.1687453981050; Thu, 22 Jun 2023 10:13:01 -0700 (PDT) Received: from pfiuh07 ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id c11-20020a056000104b00b003063a92bbf5sm7568938wrx.70.2023.06.22.10.13.00 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 22 Jun 2023 10:13:00 -0700 (PDT) From: Simon Tournier <zimon.toutoune@HIDDEN> To: Efraim Flashner <efraim@HIDDEN> Subject: Re: bug#63986: Julia is very slow In-Reply-To: <ZJR14QoB4SoqhsrP@3900XT> References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN> <871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN> <87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT> Date: Thu, 22 Jun 2023 19:12:36 +0200 Message-ID: <87cz1n8lq3.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="=-=-=" X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 63986 Cc: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>, 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, csantosb@HIDDEN X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) --=-=-= Content-Type: text/plain Hi, On Thu, 22 Jun 2023 at 19:25, Efraim Flashner <efraim@HIDDEN> wrote: > It might need some tuning anyway, currently we have julia for i686 and > switching to solely openblas-ilp64 we'd lose 32-bit support. Yes, indeed. This attached patch conditionally switches. --=-=-= Content-Type: text/x-diff Content-Disposition: inline; filename=v2-0001-gnu-julia-Conditionally-use-openblas-with-ILP64-s.patch Content-Description: p2.patch From 9e1912148d4a691a5484fc7f87597b579ba61785 Mon Sep 17 00:00:00 2001 Message-Id: <9e1912148d4a691a5484fc7f87597b579ba61785.1687453627.git.zimon.toutoune@HIDDEN> From: Simon Tournier <zimon.toutoune@HIDDEN> Date: Thu, 22 Jun 2023 17:45:50 +0200 Subject: [PATCH v2] gnu: julia: Conditionally use openblas with ILP64 support. Fixes <https://bugs.gnu.org/63986>. Reported by Cayetano Santos <csantosb@HIDDEN>. * gnu/packages/julia.scm (julia)[arguments]<#:make-flags>: Conditionally use OpenBLAS with ILP64 support for x86-64 target. [inputs]: Conditionally replace openblas by openblas-ilp64 for x86-64 target. --- gnu/packages/julia.scm | 12 +++++++++--- 1 file changed, 9 insertions(+), 3 deletions(-) diff --git a/gnu/packages/julia.scm b/gnu/packages/julia.scm index ba54175822..3ffd1fa4cb 100644 --- a/gnu/packages/julia.scm +++ b/gnu/packages/julia.scm @@ -483,8 +483,12 @@ (define-public julia `("USE_BLAS64=0") '()) - "LIBBLAS=-lopenblas" - "LIBBLASNAME=libopenblas" + ,@(if (target-x86-64?) + `("USE_BLAS64=1" + "LIBBLAS=-lopenblas_ilp64" + "LIBBLASNAME=libopenblas_ilp64") + `("LIBBLAS=-lopenblas" + "LIBBLASNAME=libopenblas")) (string-append "UTF8PROC_INC=" (assoc-ref %build-inputs "utf8proc") @@ -513,7 +517,9 @@ (define-public julia ("llvm" ,llvm-julia) ("mbedtls-apache" ,mbedtls-apache) ("mpfr" ,mpfr) - ("openblas" ,openblas) + ,@(if (target-x86-64?) + `(("openblas" ,openblas-ilp64)) + `(("openblas" ,openblas))) ("openlibm" ,openlibm) ("p7zip" ,p7zip) ("pcre2" ,pcre2) base-commit: 37c2e94cec6cb8b5e0e93e7b6c712c3b187ca5db -- 2.38.1 --=-=-= Content-Type: text/plain Well, the current recipe could be improved but let focus on the current bug report. And I guess the slowness come from an incorrect use of BLAS for x86-64. That seems fixed by the patch, no? Cheers, simon --=-=-=--
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at 63986) by debbugs.gnu.org; 22 Jun 2023 16:59:33 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Thu Jun 22 12:59:33 2023 Received: from localhost ([127.0.0.1]:36601 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qCNef-0005Le-E2 for submit <at> debbugs.gnu.org; Thu, 22 Jun 2023 12:59:33 -0400 Received: from latitanza.investici.org ([82.94.249.234]:55285) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <csantosb@HIDDEN>) id 1qCNed-0005LT-8c for 63986 <at> debbugs.gnu.org; Thu, 22 Jun 2023 12:59:32 -0400 Received: from mx3.investici.org (unknown [127.0.0.1]) by latitanza.investici.org (Postfix) with ESMTP id 4Qn66T5X7RzGp0l; Thu, 22 Jun 2023 16:59:29 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inventati.org; s=stigmate; t=1687453169; bh=szCTjG06zkw2H62SY9FRAnsUJjXqn6+6u/+/oLHGF6Y=; h=References:From:To:Cc:Subject:Date:Reply-To:In-reply-to:From; b=Qi8CyzZSuTy1xb+VdezNVvBYBjvNpN8CDpdMwyz4pok74E9Q+AF4iw/TF5jkGCF5B Cpod4jLQ4quqtLBd5BDedmqI7vtY0IBsZhQiX9YTji4hdT/URQizYrc/KEcnFOnERn vxMQHDd7Py/A8x8T0kcaLbdNvVmI/Yz89BNLqXX4= Received: from [82.94.249.234] (mx3.investici.org [82.94.249.234]) (Authenticated sender: cayetano.santos@HIDDEN) by localhost (Postfix) with ESMTPSA id 4Qn66T2P3zzGp0W; Thu, 22 Jun 2023 16:59:29 +0000 (UTC) References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN> <871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN> <87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN> <ZJR14QoB4SoqhsrP@3900XT> User-agent: mu4e 1.10.3; emacs 29.0.91 From: Cayetano Santos <csantosb@HIDDEN> To: Efraim Flashner <efraim@HIDDEN> Subject: Re: bug#63986: Julia is very slow Date: Thu, 22 Jun 2023 18:56:30 +0200 In-reply-to: <ZJR14QoB4SoqhsrP@3900XT> Message-ID: <874jmz8mc0.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 63986 Cc: Ludovic =?utf-8?Q?Court?= =?utf-8?Q?=C3=A8s?= <ludovic.courtes@HIDDEN>, 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, Simon Tournier <zimon.toutoune@HIDDEN> X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Reply-To: csantosb@HIDDEN Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) > Looks like it should be "LIBBLAS=3D-lopenblas" > > It might need some tuning anyway, currently we have julia for i686 and > switching to solely openblas-ilp64 we'd lose 32-bit support. > > I also noticed the julia expects the 64-bit openblas to be libopenblas64 > (which happens to be what Debian=C2=B9 has). Would we need to adapt anyth= ing > in stdlib/OpenBLAS_jll/src/OpenBLAS_jll.jl? > > Also, are we supposed to build lapack with our openblas as an input? Being used to Arch, it seems to me the way they do things is the way to go, or at least, a good reference (other than the support for 32-bit) https://archlinux.org/packages/?sort=3D&q=3Dblas&maintainer=3D&flagged=3D https://gitlab.archlinux.org/archlinux/packaging/packages/julia/-/blob/main= /PKGBUILD C.
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at 63986) by debbugs.gnu.org; 22 Jun 2023 16:25:16 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Thu Jun 22 12:25:16 2023 Received: from localhost ([127.0.0.1]:36567 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qCN7T-0004G0-U5 for submit <at> debbugs.gnu.org; Thu, 22 Jun 2023 12:25:16 -0400 Received: from mail-wr1-f50.google.com ([209.85.221.50]:56653) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <efraim.flashner@HIDDEN>) id 1qCN7R-0004Fl-Qi for 63986 <at> debbugs.gnu.org; Thu, 22 Jun 2023 12:25:15 -0400 Received: by mail-wr1-f50.google.com with SMTP id ffacd0b85a97d-3111547c8f9so8510750f8f.1 for <63986 <at> debbugs.gnu.org>; Thu, 22 Jun 2023 09:25:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1687451108; x=1690043108; h=in-reply-to:content-disposition:mime-version:references :mail-followup-to:message-id:subject:cc:to:from:date:sender:from:to :cc:subject:date:message-id:reply-to; bh=vvhWHnCHM+ij5aVKhS0iJmCdHC/FRM5UQ9cey6hHr8c=; b=CBEyCOiJGUqP3TqETuTYsOwy5I3seQKO5kPF3KbE2QfH9uaJprwokpSjfExp9lpq4L BFLIjYIJdLKpdwB8FtYGBm+dDiMru+B3aYgzQjN8HvQ3hiupzx039wFGAGJi35HIIt1P 7Czpmy+Zy+ey9BLbd4nqUBtOcnynKoQYPdDaoabF1nVHzFGQ+sglgNLaOhi5ZUIT/T68 uXs30yWa9s8gevkhvfacap61T7lNV+V7Ny+3ehBDG6KJ/tM+phG+vdmMCAntqWfLi4B1 L9Q++1qb/v4olc9hHPzhX5iP1ZNHNo0c7EoLjwpeq9sNKJ/XzjN9nryg78HK9YKgKVl3 lsdg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1687451108; x=1690043108; h=in-reply-to:content-disposition:mime-version:references :mail-followup-to:message-id:subject:cc:to:from:date:sender :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=vvhWHnCHM+ij5aVKhS0iJmCdHC/FRM5UQ9cey6hHr8c=; b=JxJ8csYmPGjka525b4CrImab8qe97r+Y+2PTl6WXc1wI5u6xXUnwW+0gR6JBEf7Bn6 qbHWgHyRoHJCQK9hMsfv+xUJSuLVuHpbi8K/+L/tkJdaXzCV2SrdSwAvcAFlussI7EBc T6S1s4OyUS8qlqw2APB1yJjMVK5ftU431Cy4B6vXoGqM3roxfbW3Lhpx8PECCAVT9J7j a9kf2mSN2BAFuMdKL6DBKCmw27BKi1CbcqNl7ONyO/FPqmkrnQ0ykPrwSnXcnGGot2g5 7Nd7uxHVJll7jHL09BgeGaxl+1C4ujYC1MP0fWgvzUKrXS0npdDn8SN090VKCfP8OETj 35QQ== X-Gm-Message-State: AC+VfDwcDcxGal20TdfbNbHsR3UUJ87W08y124zEk4FGqAnqPP0s+QqE k+nQo6+B9Acklz7Tqhvc3oo= X-Google-Smtp-Source: ACHHUZ6hn0nziJbQiLpQ0uiOP6JVy3qZSenhvZF9FdQjbJTq3+M/ZXm5mgo59aM8DK8GO4hjGQ/Djg== X-Received: by 2002:a5d:4711:0:b0:311:19df:dad2 with SMTP id y17-20020a5d4711000000b0031119dfdad2mr16569276wrq.47.1687451107638; Thu, 22 Jun 2023 09:25:07 -0700 (PDT) Received: from localhost ([188.120.129.124]) by smtp.gmail.com with ESMTPSA id m7-20020a7bca47000000b003f90b9b2c31sm13233255wml.28.2023.06.22.09.25.06 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 22 Jun 2023 09:25:06 -0700 (PDT) Date: Thu, 22 Jun 2023 19:25:05 +0300 From: Efraim Flashner <efraim@HIDDEN> To: Simon Tournier <zimon.toutoune@HIDDEN> Subject: Re: bug#63986: Julia is very slow Message-ID: <ZJR14QoB4SoqhsrP@3900XT> Mail-Followup-To: Efraim Flashner <efraim@HIDDEN>, Simon Tournier <zimon.toutoune@HIDDEN>, csantosb@HIDDEN, Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>, 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN> References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN> <871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN> <87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN> <87h6qz8pg0.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="ddGpKuQheAwz6IMG" Content-Disposition: inline In-Reply-To: <87h6qz8pg0.fsf@HIDDEN> X-PGP-Key-ID: 0x41AAE7DCCA3D8351 X-PGP-Key: https://flashner.co.il/~efraim/efraim_flashner.asc X-PGP-Fingerprint: A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351 X-Spam-Score: 0.2 (/) X-Debbugs-Envelope-To: 63986 Cc: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>, 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, csantosb@HIDDEN X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -0.8 (/) --ddGpKuQheAwz6IMG Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Jun 22, 2023 at 05:52:15PM +0200, Simon Tournier wrote: > Hi, >=20 > On Thu, 22 Jun 2023 at 15:26, Cayetano Santos via Bug reports for GNU Gui= x <bug-guix@HIDDEN> wrote: > >> Are we following all instructions here ? > >> > >> https://docs.julialang.org/en/v1.8/devdocs/build/distributing/#Notes= -on-BLAS-and-LAPACK >=20 > [...] >=20 > > Base.USE_BLAS64 > > > > gives "true" when running fast. Guix julia gives "false". >=20 > When I try USE_BLAS64=3D1, then I get: >=20 > --8<---------------cut here---------------start------------->8--- > =E2=94=8C Error: No loaded BLAS libraries were built with ILP64 support > =E2=94=94 @ LinearAlgebra.BLAS /tmp/guix-build-julia-1.8.3.drv-0/julia-1.= 8.3/usr/share/julia/stdlib/v1.8/LinearAlgebra/src/blas.jl:155 > Quitting. > --8<---------------cut here---------------end--------------->8--- >=20 > And from the documentation above, it reads: >=20 > [...] while on 64-bit architectures, Julia builds OpenBLAS to > use 64-bit integers (ILP64). It is essential that all Julia > functions that call BLAS and LAPACK API routines use integers of > the correct width. >=20 > Well using the patch attached, I get: >=20 > 6.884 ms (2 allocations: 7.63 MiB) >=20 > compared to the previous >=20 > 494.345 ms (2 allocations: 7.63 MiB) >=20 > WDYT about this patch? (ins)efraim@3900XT ~/workspace/guix$ cat /gnu/store/v6z5ykkjfzbc72x1x900xfl= spqc5wd5r-openblas-ilp64-0.3.20/lib/pkgconfig/openblas.pc libdir=3D/gnu/store/v6z5ykkjfzbc72x1x900xflspqc5wd5r-openblas-ilp64-0.3.20/= lib includedir=3D/gnu/store/v6z5ykkjfzbc72x1x900xflspqc5wd5r-openblas-ilp64-0.3= =2E20/include openblas_config=3D USE_64BITINT=3D DYNAMIC_ARCH=3D1 DYNAMIC_OLDER=3D1 NO_CB= LAS=3D NO_LAPACK=3D NO_LAPACKE=3D NO_AFFINITY=3D1 USE_OPENMP=3D generic MAX= _THREADS=3D128 version=3D0.3.20 extralib=3D-lm -lpthread -lgfortran -lm -lpthread -lgfortran Name: openblas Description: OpenBLAS is an optimized BLAS library based on GotoBLAS2 1.13 = BSD version Version: ${version} URL: https://github.com/xianyi/OpenBLAS Libs: -L${libdir} -lopenblas Libs.private: ${extralib} Cflags: -I${includedir} Looks like it should be "LIBBLAS=3D-lopenblas" It might need some tuning anyway, currently we have julia for i686 and switching to solely openblas-ilp64 we'd lose 32-bit support. I also noticed the julia expects the 64-bit openblas to be libopenblas64 (which happens to be what Debian=C2=B9 has). Would we need to adapt anything in stdlib/OpenBLAS_jll/src/OpenBLAS_jll.jl? Also, are we supposed to build lapack with our openblas as an input? =C2=B9 https://sources.debian.org/src/openblas/0.3.21%2Bds-4/debian/rules/#= L71 > From 024c92fac091f59dcdbd3a78eb6ea77bb15b2170 Mon Sep 17 00:00:00 2001 > Message-Id: <024c92fac091f59dcdbd3a78eb6ea77bb15b2170.1687449033.git.zimo= n.toutoune@HIDDEN> > From: Simon Tournier <zimon.toutoune@HIDDEN> > Date: Thu, 22 Jun 2023 17:45:50 +0200 > Subject: [PATCH] gnu: julia: Use openblas with ILP64 support. >=20 > Fixes <https://bugs.gnu.org/63986>. > Reported by Cayetano Santos <csantosb@HIDDEN>. >=20 > * gnu/packages/julia.scm (julia)[arguments]<#:make-flags>: Use OpenBLAS w= ith > ILP64 support. > [inputs]: Replace openblas by openblas-ilp64. > --- > gnu/packages/julia.scm | 8 ++++---- > 1 file changed, 4 insertions(+), 4 deletions(-) >=20 > diff --git a/gnu/packages/julia.scm b/gnu/packages/julia.scm > index ba54175822..a034cbf543 100644 > --- a/gnu/packages/julia.scm > +++ b/gnu/packages/julia.scm > @@ -481,10 +481,10 @@ (define-public julia > =20 > ,@(if (target-aarch64?) > `("USE_BLAS64=3D0") > - '()) > + `("USE_BLAS64=3D1")) > =20 > - "LIBBLAS=3D-lopenblas" > - "LIBBLASNAME=3Dlibopenblas" > + "LIBBLAS=3D-lopenblas_ilp64" > + "LIBBLASNAME=3Dlibopenblas_ilp64" > =20 > (string-append "UTF8PROC_INC=3D" > (assoc-ref %build-inputs "utf8proc") > @@ -513,7 +513,7 @@ (define-public julia > ("llvm" ,llvm-julia) > ("mbedtls-apache" ,mbedtls-apache) > ("mpfr" ,mpfr) > - ("openblas" ,openblas) > + ("openblas" ,openblas-ilp64) > ("openlibm" ,openlibm) > ("p7zip" ,p7zip) > ("pcre2" ,pcre2) >=20 > base-commit: 37c2e94cec6cb8b5e0e93e7b6c712c3b187ca5db > --=20 > 2.38.1 >=20 >=20 > Well, I need to do more tests but I guess that=E2=80=99s the good directi= on. :-) >=20 > Cheers, > simon --=20 Efraim Flashner <efraim@HIDDEN> =D7=A8=D7=A0=D7=A9=D7=9C=D7=A4 = =D7=9D=D7=99=D7=A8=D7=A4=D7=90 GPG key =3D A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351 Confidentiality cannot be guaranteed on emails sent or received unencrypted --ddGpKuQheAwz6IMG Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAmSUdd4ACgkQQarn3Mo9 g1ESrRAAgXQ6J4sf6gpxitgDtYAgogbuyH71S/VJyIDyPDZK0LCrEFvRwPThlD39 W/2ZPjjvtriPtUChiRvNPrykVNugzMJ7uUAOwUflKIFq+b30B/2uZt2P8EgAUkuE FEbgpWOoT2CvmN80LHMl5vlOEsd4wd1W8ZexIspZeOIF11CjmxDbSXrftir0gLTs koSplycsYnfpp6WJAlk4ATYkkTy6QO24ZRLz5WpXYD4DNQNLRbMa3bkVrxZmScGE ZQ8gawgKojceyyhOYu39cXk36EiSLxH1ok0jKm1n5nHVWeSDm3Xi8rlMhE9e/Lkm 6DZUAylZ2sRu+qqCYyjIw9pEptv98crDoh+1tmWo44S3Vx6ezNgb/ltyTf2gGa1z eh0UxunoLRGun03On5r4QDKSFsSpkLo6WzHV/mNxIlP5Ew/P7dasbT1+lR4T5x4Y KvERCHsgKggn2U3bUvxvH5pzaOva4WtpwF6I7xStdQ2VX3HQu9VVFfL97YurC+lr SDjwrHri3MqGY7CqEetlizNEyK0nUQdrAt9D9QfjWCf6GpgE/xfPGVNcy5oqoLAb lM0O/RI1f6d11xn5aELyJBZ5tIHrTpM+8ZIINHGEfslk+kBel85MYT0VtLMtiGtx 8woKv9uBaKjJOmyLwy8rnbN8UmlCOok2NGFgEaijVWQ5QiPA2gM= =/GU9 -----END PGP SIGNATURE----- --ddGpKuQheAwz6IMG--
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at 63986) by debbugs.gnu.org; 22 Jun 2023 15:52:27 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Thu Jun 22 11:52:27 2023 Received: from localhost ([127.0.0.1]:36539 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qCMbj-0000ni-75 for submit <at> debbugs.gnu.org; Thu, 22 Jun 2023 11:52:27 -0400 Received: from mail-wr1-f49.google.com ([209.85.221.49]:39372) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <zimon.toutoune@HIDDEN>) id 1qCMbg-0000nO-PA for 63986 <at> debbugs.gnu.org; Thu, 22 Jun 2023 11:52:25 -0400 Received: by mail-wr1-f49.google.com with SMTP id ffacd0b85a97d-3110e74bf3cso1678063f8f.1 for <63986 <at> debbugs.gnu.org>; Thu, 22 Jun 2023 08:52:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1687449139; x=1690041139; h=mime-version:message-id:date:references:in-reply-to:subject:to:from :from:to:cc:subject:date:message-id:reply-to; bh=BKLSOe03WjqB9Tg1GzTxn2Grh/M1D9CqDAFoSGTgjaE=; b=KPlE7ZuLhzjp57HkSVd+E8aZnMnzf5ml6YhCJ/I1h/hzD7CYes5YW/05w8yRT+gdFd 2iKNMEyIheq14rTghrbyUpvmr0+Pt8eL1tj5s19juq+RS6EzmwNVooHr/ONKvUbGfeKf +6nGvhmWbBAN3ABk2ZwSUbaMvF++xmYI+bXw0rl9V2D15lHlP4YlTxEerrPhjsbVV6+N QviQz6kN7bWwmat5WXTdVfUTerEWTiJfSRS1L1zrANAQeXoLFyGFAdZNZoDRX9nFzp7R sCF97L4zeX738yXaAbBE01RrQ3VhAkOzflvuc4ESYVda0/Nnn1W/UvA3nd4HXgNATon+ I5Mw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1687449139; x=1690041139; h=mime-version:message-id:date:references:in-reply-to:subject:to:from :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=BKLSOe03WjqB9Tg1GzTxn2Grh/M1D9CqDAFoSGTgjaE=; b=KYp/nm9Rsa8NE+cqb5ymovVcP3s/MQcihogrHq3Qc1IS88rQPxDhwhmSaV+ldbe8cB Utk6fnugySVMhYwwLKU1HSE+y26cXAPTvrPWBZPRLRLwBuU0sB8Fs8Kjxs7J9trHjb+A RWs7ocdDwZSBSlFLRxNgR/eRe/xkzufXjRxZ79BCbTCacXbqgrh+9tZBYLzqcGMVQtvq e4jtIdwhPjtdp00xwoAZSJXnGDvPX8NIHSgfzDrSQGmbgVjdnB2jabEYGCeAwf9LxSnZ iNev/aYGWsZyyQmxuIlwXedhJ+loSWuK9ASeL9e+xiNRaal0IUWL1k178kYQfq8pTj3n cpWQ== X-Gm-Message-State: AC+VfDzWrVrLiHDqVhiX2Xuc7BM+7Zox1bx7S0xzQJ59x6HU8axeEIhA Ytas82v4gOOs2jb9zlmvCt4= X-Google-Smtp-Source: ACHHUZ6hjmeEwzHMGeWnBCWR9OAyOUb2lCBUWhsbDwphFg2TzcsXx1pL5H+DrOqeXXP+Ign1nKRONQ== X-Received: by 2002:a5d:66d0:0:b0:311:166b:b3b0 with SMTP id k16-20020a5d66d0000000b00311166bb3b0mr13746627wrw.7.1687449138772; Thu, 22 Jun 2023 08:52:18 -0700 (PDT) Received: from pfiuh07 ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id w7-20020a5d6807000000b003127741d7desm7342098wru.58.2023.06.22.08.52.17 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 22 Jun 2023 08:52:18 -0700 (PDT) From: Simon Tournier <zimon.toutoune@HIDDEN> To: csantosb@HIDDEN, Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>, 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, Efraim Flashner <efraim@HIDDEN> Subject: Re: bug#63986: Julia is very slow In-Reply-To: <87wmzvmxt8.fsf@HIDDEN> References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN> <871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN> <87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN> Date: Thu, 22 Jun 2023 17:52:15 +0200 Message-ID: <87h6qz8pg0.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="=-=-=" X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 63986 X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hi, On Thu, 22 Jun 2023 at 15:26, Cayetano Santos via Bug reports for GNU Guix = <bug-guix@HIDDEN> wrote: >> Are we following all instructions here ? >> >> https://docs.julialang.org/en/v1.8/devdocs/build/distributing/#Notes-o= n-BLAS-and-LAPACK [...] > Base.USE_BLAS64 > > gives "true" when running fast. Guix julia gives "false". When I try USE_BLAS64=3D1, then I get: --8<---------------cut here---------------start------------->8--- =E2=94=8C Error: No loaded BLAS libraries were built with ILP64 support =E2=94=94 @ LinearAlgebra.BLAS /tmp/guix-build-julia-1.8.3.drv-0/julia-1.8.= 3/usr/share/julia/stdlib/v1.8/LinearAlgebra/src/blas.jl:155 Quitting. --8<---------------cut here---------------end--------------->8--- And from the documentation above, it reads: [...] while on 64-bit architectures, Julia builds OpenBLAS to use 64-bit integers (ILP64). It is essential that all Julia functions that call BLAS and LAPACK API routines use integers of the correct width. Well using the patch attached, I get: 6.884 ms (2 allocations: 7.63 MiB) compared to the previous 494.345 ms (2 allocations: 7.63 MiB) WDYT about this patch? --=-=-= Content-Type: text/x-diff Content-Disposition: inline; filename=0001-gnu-julia-Use-openblas-with-ILP64-support.patch Content-Description: p.patch From 024c92fac091f59dcdbd3a78eb6ea77bb15b2170 Mon Sep 17 00:00:00 2001 Message-Id: <024c92fac091f59dcdbd3a78eb6ea77bb15b2170.1687449033.git.zimon.toutoune@HIDDEN> From: Simon Tournier <zimon.toutoune@HIDDEN> Date: Thu, 22 Jun 2023 17:45:50 +0200 Subject: [PATCH] gnu: julia: Use openblas with ILP64 support. Fixes <https://bugs.gnu.org/63986>. Reported by Cayetano Santos <csantosb@HIDDEN>. * gnu/packages/julia.scm (julia)[arguments]<#:make-flags>: Use OpenBLAS with ILP64 support. [inputs]: Replace openblas by openblas-ilp64. --- gnu/packages/julia.scm | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/gnu/packages/julia.scm b/gnu/packages/julia.scm index ba54175822..a034cbf543 100644 --- a/gnu/packages/julia.scm +++ b/gnu/packages/julia.scm @@ -481,10 +481,10 @@ (define-public julia ,@(if (target-aarch64?) `("USE_BLAS64=0") - '()) + `("USE_BLAS64=1")) - "LIBBLAS=-lopenblas" - "LIBBLASNAME=libopenblas" + "LIBBLAS=-lopenblas_ilp64" + "LIBBLASNAME=libopenblas_ilp64" (string-append "UTF8PROC_INC=" (assoc-ref %build-inputs "utf8proc") @@ -513,7 +513,7 @@ (define-public julia ("llvm" ,llvm-julia) ("mbedtls-apache" ,mbedtls-apache) ("mpfr" ,mpfr) - ("openblas" ,openblas) + ("openblas" ,openblas-ilp64) ("openlibm" ,openlibm) ("p7zip" ,p7zip) ("pcre2" ,pcre2) base-commit: 37c2e94cec6cb8b5e0e93e7b6c712c3b187ca5db -- 2.38.1 --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Well, I need to do more tests but I guess that=E2=80=99s the good direction= . :-) Cheers, simon --=-=-=--
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at 63986) by debbugs.gnu.org; 22 Jun 2023 14:37:41 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Thu Jun 22 10:37:41 2023 Received: from localhost ([127.0.0.1]:36468 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qCLRN-00075k-5k for submit <at> debbugs.gnu.org; Thu, 22 Jun 2023 10:37:41 -0400 Received: from mail-wr1-f44.google.com ([209.85.221.44]:49520) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <efraim.flashner@HIDDEN>) id 1qCLRL-00075W-E5 for 63986 <at> debbugs.gnu.org; Thu, 22 Jun 2023 10:37:40 -0400 Received: by mail-wr1-f44.google.com with SMTP id ffacd0b85a97d-311275efaf8so5713395f8f.3 for <63986 <at> debbugs.gnu.org>; Thu, 22 Jun 2023 07:37:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1687444653; x=1690036653; h=in-reply-to:content-disposition:mime-version:references :mail-followup-to:message-id:subject:cc:to:from:date:sender:from:to :cc:subject:date:message-id:reply-to; bh=ZofPEYQrpib6IX5MT5nBg3oBYR51rESp/kRgJshA8YY=; b=LQzOiwYu22REw3utKiyQO7Zsy4NdpaCKqbdEWvhRy8SPZ9nnPARBDtcK3fUcQJLyBJ Xizjp3hDiayfWsaXHscE7kIXzpSTx4aJOkTatisyyvy6K6c9rXog25PgGCyDZwBtZo7z Qc/wENJ52v7mqsYrNbanqEiz/ZVEoxX2f+MHqp2jhZQg9HCjPDbQ1IM+wL6Yvp0DWe7/ 2XxZalD0H9epJk779r4YRhthZIOFiyPWAs5rABFy6NeXTwNEXR0FQBWl3Lb+Mh2z9P+I rqhlI93waCtu+mintpxh2NnAYe9DWKMTPloTeisP18oxMtwdx6kIBybCr1KLYszkDz+r qE8g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1687444653; x=1690036653; h=in-reply-to:content-disposition:mime-version:references :mail-followup-to:message-id:subject:cc:to:from:date:sender :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=ZofPEYQrpib6IX5MT5nBg3oBYR51rESp/kRgJshA8YY=; b=glVUTT+vkA/4JavC6O8jgUYgbEWUscHpEygRyQdYjCPE3ic42SGzJnhV4ELsTcQeLG XJcr9VAk1wmIcSUETm0vD4i+xc05NL0IvSqZLPQx170nDZpnERyHnqqrMyVL6unz1SJQ nreMoBOTQLiPq4ABQ8v/FhFu3IqGTirz60pcssFoCgZFXCPlhPqRRfvSm1gOkdnp/OAz e7azdPG1kDY2aJuY56Kr1vXAB01wkns7vwn27QHvtxPHTzwghqETdC743Qa/FxsWO/7K R6bGcViZiHYHiyOoNIuqQu8dS7gmpfqw21ldfNyEba1RoFsh6XZhdWXBHbhMNSqAOhjE OPaQ== X-Gm-Message-State: AC+VfDyUVmM+D7aASBs/3TC/qFcV3wXdwxmdkkGBtPSqxYViqmwYVbH1 SH+2TP3XAX1s0pxo2RJfqIA= X-Google-Smtp-Source: ACHHUZ7PJzE0teRZgJV2fR6xtHiznaoukKpI/DwpJ+JL4OjDKYteTw96EqK0zgFc19KfOxB8oqj7uQ== X-Received: by 2002:a5d:50d2:0:b0:311:f8a:1ca4 with SMTP id f18-20020a5d50d2000000b003110f8a1ca4mr13739663wrt.31.1687444653402; Thu, 22 Jun 2023 07:37:33 -0700 (PDT) Received: from localhost ([188.120.129.124]) by smtp.gmail.com with ESMTPSA id t13-20020a1c770d000000b003f91e32b1ebsm12465017wmi.17.2023.06.22.07.37.32 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 22 Jun 2023 07:37:32 -0700 (PDT) Date: Thu, 22 Jun 2023 17:37:31 +0300 From: Efraim Flashner <efraim@HIDDEN> To: Cayetano Santos <csantosb@HIDDEN> Subject: Re: bug#63986: Julia is very slow Message-ID: <ZJRcq8BieSPFPIEk@3900XT> Mail-Followup-To: Efraim Flashner <efraim@HIDDEN>, Cayetano Santos <csantosb@HIDDEN>, Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>, Simon Tournier <zimon.toutoune@HIDDEN>, 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN> References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN> <871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN> <87ttv0mth3.fsf@HIDDEN> <87wmzvmxt8.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="SRceopnWyrJRrsaM" Content-Disposition: inline In-Reply-To: <87wmzvmxt8.fsf@HIDDEN> X-PGP-Key-ID: 0x41AAE7DCCA3D8351 X-PGP-Key: https://flashner.co.il/~efraim/efraim_flashner.asc X-PGP-Fingerprint: A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351 X-Spam-Score: 0.2 (/) X-Debbugs-Envelope-To: 63986 Cc: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>, 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, Simon Tournier <zimon.toutoune@HIDDEN> X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -0.8 (/) --SRceopnWyrJRrsaM Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Jun 22, 2023 at 03:26:30PM +0200, Cayetano Santos wrote: >=20 >=20 > >mer. 21 juin 2023 at 22:39, Cayetano Santos <csantosb@HIDDEN> wro= te: >=20 > >>mer. 21 juin 2023 at 16:36, Ludovic Court=C3=A8s <ludovic.courtes@inria= =2Efr> wrote: > > > >> Hey! > >> > >> The benchmark you posted, Cayetano, is: > >> > >> julia -e 'using Pkg; Pkg.add("BenchmarkTools"); using BenchmarkTools= ; N =3D 1000; A =3D rand(N, N); B =3D rand(N, N); @btime $A*$B' I've been having a hard time with that command, so I've been running julia -e 'using Pkg; Pkg.add("BenchmarkTools"); using BenchmarkTools; N =3D= 1000; A =3D rand(N, N); B =3D rand(N, N); @time A*B' I'm not sure if that's useful or not but I didn't see a different with LIBBLAS* set. > >> > >> This is a matrix multiplication that gets delegated to the underlying > >> BLAS right. Running it under =E2=80=98perf record=E2=80=99 confirms i= t: > >> > >> Samples: 139K of event 'cycles:u', Event count (approx.): 99624880590 > >> Overhead Command Shared Object Symbol > >> 35.27% .julia-real libblas.so.3.9.0 [.] dgemm_ > >> 3.99% .julia-real libjulia-internal.so.1.8 [.] gc_mark_loop > >> 2.60% .julia-real libjulia-internal.so.1.8 [.] apply_cl > >> 1.06% .julia-real libjulia-internal.so.1.8 [.] jl_get_binding_ > >> > >> We=E2=80=99re using libblas.so (presumably from the =E2=80=98lapack=E2= =80=99 package) and not > >> OpenBLAS, so no wonder it=E2=80=99s slow. > >> > >> Could it be that: > >> > >> "LIBBLAS=3D-lopenblas" > >> "LIBBLASNAME=3Dlibopenblas" > >> > >> is ineffective? I think we have a lead! > > > > Are we following all instructions here ? > > > > https://docs.julialang.org/en/v1.8/devdocs/build/distributing/#Notes-= on-BLAS-and-LAPACK > > > > I=E2=80=99m thinking about the variables LIBLAPACK and LIBLAPACKNAME. >=20 > To complete my previous comment, I just realised that >=20 > Base.USE_BLAS64 >=20 > gives "true" when running fast. Guix julia gives "false". >=20 > C. I'll see what comes with switching it to blas64 --=20 Efraim Flashner <efraim@HIDDEN> =D7=A8=D7=A0=D7=A9=D7=9C=D7=A4 = =D7=9D=D7=99=D7=A8=D7=A4=D7=90 GPG key =3D A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351 Confidentiality cannot be guaranteed on emails sent or received unencrypted --SRceopnWyrJRrsaM Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAmSUXKgACgkQQarn3Mo9 g1EjSg//dfiNlu7SXBgZ1yh1v+3mrJDopwHX8Hi+GQzslVxXrGAdkhvETGyor2YI 4hUQhWlKI5bqoPknACVnWcvD0ZhAepViv1a/lWzOFhKkyWJzB3zs0XjYLWON3/Nl Hixv6Hsl6+s9LajaBO1dcG2dQul5qNDUpYg/jyW0V+gAkeAjvMjv2IAbOnfzyGlf TaejEpiXzcWLT/V8uwXtNBkCD0i2ICbi63+2amxEPzjqatZ0KH2pV9imRx1SmVtU lbicU21UOqnJWgSA6MlAfUCW1RkkJp/A8vqayCA5cZG+bBtTqBIPoJvwAUXlXgEI TZFcyb/QUe2FWCy6FZWh58VDSDdwIHIyUJ1N8XpfdCHzY6CkaV57yqWqcjr8UVUl YK1XClHJ2Ml7/dHg/nyXgvXg7cpjNOGo8/kugYWoi5QQK4ON9AFhrK4eVBEV1Cse 8PMqzMMvjwglhhwD72sTA8Y42J1DtNeNSippibTL8UmgdasQI0/JvfF7QlMpq7oS 5CxUAItMHqwjHq7ALD291AhDsrcyr8Gyo3x3CnfVscr+ndvdSi4AQtYEJTGseEhh 73pXoo37yROstuTByUUyOc1CnvyGTUxG8vxPfkXjIMVQwjxKxQdCDBJCytYOl5ga JaMps//U03ygl6Ei12TNLNqYx6YvaQl3lIVINvEWAUq/yq1dCqI= =0OVi -----END PGP SIGNATURE----- --SRceopnWyrJRrsaM--
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at 63986) by debbugs.gnu.org; 22 Jun 2023 13:27:53 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Thu Jun 22 09:27:53 2023 Received: from localhost ([127.0.0.1]:35149 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qCKLp-0002TJ-1S for submit <at> debbugs.gnu.org; Thu, 22 Jun 2023 09:27:53 -0400 Received: from devianza.investici.org ([198.167.222.108]:61991) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <csantosb@HIDDEN>) id 1qCKLm-0002T9-C1 for 63986 <at> debbugs.gnu.org; Thu, 22 Jun 2023 09:27:51 -0400 Received: from mx2.investici.org (unknown [127.0.0.1]) by devianza.investici.org (Postfix) with ESMTP id 4Qn1QF0Fx8z6v6B; Thu, 22 Jun 2023 13:27:49 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inventati.org; s=stigmate; t=1687440469; bh=iKePJyzGkJIlg8E9ZsUsZ5xduzWU761lT8epjbLu3kc=; h=References:From:To:Subject:Date:Reply-To:In-reply-to:From; b=EWAa2j2lY1+LEB4MACQ3KLYE6VluIkJm6m3EmbhzBobouvRyKaGNtap9QI/bkuXQR 1P2AsrRN28wz0QLvbtXISxBB0jQjHUDD+AyKIcd8WY10xbUYwwBPlt1fM+IjXWPpXR TYIx0jhd5SQ9ZztJHGwPwDriKH2QZl9bnc6P9H9Q= Received: from [198.167.222.108] (mx2.investici.org [198.167.222.108]) (Authenticated sender: cayetano.santos@HIDDEN) by localhost (Postfix) with ESMTPSA id 4Qn1QD4ZR6z6v2n; Thu, 22 Jun 2023 13:27:48 +0000 (UTC) References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN> <871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN> <87ttv0mth3.fsf@HIDDEN> User-agent: mu4e 1.10.3; emacs 29.0.91 From: Cayetano Santos <csantosb@HIDDEN> To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>, Simon Tournier <zimon.toutoune@HIDDEN>, 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, Efraim Flashner <efraim@HIDDEN> Subject: Re: bug#63986: Julia is very slow Date: Thu, 22 Jun 2023 15:26:30 +0200 In-reply-to: <87ttv0mth3.fsf@HIDDEN> Message-ID: <87wmzvmxt8.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 63986 X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Reply-To: csantosb@HIDDEN Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) >mer. 21 juin 2023 at 22:39, Cayetano Santos <csantosb@HIDDEN> wrote: >>mer. 21 juin 2023 at 16:36, Ludovic Court=C3=A8s <ludovic.courtes@HIDDEN= r> wrote: > >> Hey! >> >> The benchmark you posted, Cayetano, is: >> >> julia -e 'using Pkg; Pkg.add("BenchmarkTools"); using BenchmarkTools; = N =3D 1000; A =3D rand(N, N); B =3D rand(N, N); @btime $A*$B' >> >> This is a matrix multiplication that gets delegated to the underlying >> BLAS right. Running it under =E2=80=98perf record=E2=80=99 confirms it: >> >> Samples: 139K of event 'cycles:u', Event count (approx.): 99624880590 >> Overhead Command Shared Object Symbol >> 35.27% .julia-real libblas.so.3.9.0 [.] dgemm_ >> 3.99% .julia-real libjulia-internal.so.1.8 [.] gc_mark_loop >> 2.60% .julia-real libjulia-internal.so.1.8 [.] apply_cl >> 1.06% .julia-real libjulia-internal.so.1.8 [.] jl_get_binding_ >> >> We=E2=80=99re using libblas.so (presumably from the =E2=80=98lapack=E2= =80=99 package) and not >> OpenBLAS, so no wonder it=E2=80=99s slow. >> >> Could it be that: >> >> "LIBBLAS=3D-lopenblas" >> "LIBBLASNAME=3Dlibopenblas" >> >> is ineffective? I think we have a lead! > > Are we following all instructions here ? > > https://docs.julialang.org/en/v1.8/devdocs/build/distributing/#Notes-on= -BLAS-and-LAPACK > > I=E2=80=99m thinking about the variables LIBLAPACK and LIBLAPACKNAME. To complete my previous comment, I just realised that Base.USE_BLAS64 gives "true" when running fast. Guix julia gives "false". C.
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at 63986) by debbugs.gnu.org; 21 Jun 2023 20:49:20 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Wed Jun 21 16:49:19 2023 Received: from localhost ([127.0.0.1]:34299 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qC4lT-00032m-Hx for submit <at> debbugs.gnu.org; Wed, 21 Jun 2023 16:49:19 -0400 Received: from confino.investici.org ([93.190.126.19]:33597) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <csantosb@HIDDEN>) id 1qC4lQ-00032b-IO for 63986 <at> debbugs.gnu.org; Wed, 21 Jun 2023 16:49:17 -0400 Received: from mx1.investici.org (unknown [127.0.0.1]) by confino.investici.org (Postfix) with ESMTP id 4QmbG314yKz11GK; Wed, 21 Jun 2023 20:49:15 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inventati.org; s=stigmate; t=1687380555; bh=rjbRY0Bg8vpTMQrQYEJiwdtdOzn1pNMIlSPuNZgMpQY=; h=References:From:To:Cc:Subject:Date:Reply-To:In-reply-to:From; b=PYOb1CNc+Hcz55fgh9+K95+wJi6tEVTgRdVf38lEs06M214aWVl/284by0M9ccjoo EL4G7+2+CPr6r+CGMEOcdRcZSoEveNz9hkyRbSBmIVoJghMiUb5UpEq05cQ6ME/jlA ST5Xhgy3BMTxBj8uNKAg7lU3Ig3V6IoWortFHp1E= Received: from [93.190.126.19] (mx1.investici.org [93.190.126.19]) (Authenticated sender: cayetano.santos@HIDDEN) by localhost (Postfix) with ESMTPSA id 4QmbG22zXwz11H0; Wed, 21 Jun 2023 20:49:14 +0000 (UTC) References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN> <871qi7a0qr.fsf@HIDDEN> <87pm5o7uh9.fsf@HIDDEN> User-agent: mu4e 1.10.3; emacs 29.0.91 From: Cayetano Santos <csantosb@HIDDEN> To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN> Subject: Re: bug#63986: Julia is very slow Date: Wed, 21 Jun 2023 22:39:52 +0200 In-reply-to: <87pm5o7uh9.fsf@HIDDEN> Message-ID: <87ttv0mth3.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 63986 Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, Efraim Flashner <efraim@HIDDEN>, Simon Tournier <zimon.toutoune@HIDDEN> X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Reply-To: csantosb@HIDDEN Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) >mer. 21 juin 2023 at 16:36, Ludovic Court=C3=A8s <ludovic.courtes@HIDDEN= > wrote: > Hey! > > The benchmark you posted, Cayetano, is: > > julia -e 'using Pkg; Pkg.add("BenchmarkTools"); using BenchmarkTools; N= =3D 1000; A =3D rand(N, N); B =3D rand(N, N); @btime $A*$B' > > This is a matrix multiplication that gets delegated to the underlying > BLAS right. Running it under =E2=80=98perf record=E2=80=99 confirms it: > > Samples: 139K of event 'cycles:u', Event count (approx.): 99624880590 > Overhead Command Shared Object Symbol > 35.27% .julia-real libblas.so.3.9.0 [.] dgemm_ > 3.99% .julia-real libjulia-internal.so.1.8 [.] gc_mark_loop > 2.60% .julia-real libjulia-internal.so.1.8 [.] apply_cl > 1.06% .julia-real libjulia-internal.so.1.8 [.] jl_get_binding_ > > We=E2=80=99re using libblas.so (presumably from the =E2=80=98lapack=E2=80= =99 package) and not > OpenBLAS, so no wonder it=E2=80=99s slow. > > Could it be that: > > "LIBBLAS=3D-lopenblas" > "LIBBLASNAME=3Dlibopenblas" > > is ineffective? I think we have a lead! Are we following all instructions here ? https://docs.julialang.org/en/v1.8/devdocs/build/distributing/#Notes-on= -BLAS-and-LAPACK I=E2=80=99m thinking about the variables LIBLAPACK and LIBLAPACKNAME. C.
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at 63986) by debbugs.gnu.org; 21 Jun 2023 14:36:48 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Wed Jun 21 10:36:48 2023 Received: from localhost ([127.0.0.1]:33909 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qBywx-0005yP-Ml for submit <at> debbugs.gnu.org; Wed, 21 Jun 2023 10:36:47 -0400 Received: from mail2-relais-roc.national.inria.fr ([192.134.164.83]:51523) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <ludovic.courtes@HIDDEN>) id 1qBywu-0005y5-PR for 63986 <at> debbugs.gnu.org; Wed, 21 Jun 2023 10:36:46 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:references:date:in-reply-to: message-id:mime-version:content-transfer-encoding; bh=6oJnykTpXbWJVw5JZB94cKt571bgz6zmrYXXEBZLtN0=; b=XcRB/JFxkcyYTOZtgq/m8VvAwnU/QFg9OlQt4pCjeqQuOC0R6x66/SLj 5Rw+4uhwqS4Fyz+ANES+2aVOpHqcLA+UHEpuLECEKEMUU6WVVmHp+V+Ue Ej47lsyDOGIK/iAv63FZ6V6JHuvJxr88XcvxPlALNbL1MpmEBf09jFzmR Q=; Authentication-Results: mail2-relais-roc.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=ludovic.courtes@HIDDEN; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.00,260,1681164000"; d="scan'208";a="114039724" Received: from unknown (HELO ribbon) ([109.190.253.15]) by mail2-relais-roc.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 21 Jun 2023 16:36:37 +0200 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludovic.courtes@HIDDEN> To: Simon Tournier <zimon.toutoune@HIDDEN> Subject: Re: bug#63986: Julia is very slow References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN> <871qi7a0qr.fsf@HIDDEN> Date: Wed, 21 Jun 2023 16:36:34 +0200 In-Reply-To: <871qi7a0qr.fsf@HIDDEN> (Simon Tournier's message of "Mon, 19 Jun 2023 18:13:48 +0200") Message-ID: <87pm5o7uh9.fsf@HIDDEN> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 63986 Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, Cayetano Santos <csantosb@HIDDEN>, Efraim Flashner <efraim@HIDDEN> X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -3.3 (---) Hey! The benchmark you posted, Cayetano, is: julia -e 'using Pkg; Pkg.add("BenchmarkTools"); using BenchmarkTools; N = =3D 1000; A =3D rand(N, N); B =3D rand(N, N); @btime $A*$B' This is a matrix multiplication that gets delegated to the underlying BLAS right. Running it under =E2=80=98perf record=E2=80=99 confirms it: --8<---------------cut here---------------start------------->8--- Samples: 139K of event 'cycles:u', Event count (approx.): 99624880590=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20 Overhead Command Shared Object Symbol=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20 35.27% .julia-real libblas.so.3.9.0 [.] dgemm_ 3.99% .julia-real libjulia-internal.so.1.8 [.] gc_mark_loop 2.60% .julia-real libjulia-internal.so.1.8 [.] apply_cl 1.06% .julia-real libjulia-internal.so.1.8 [.] jl_get_binding_ --8<---------------cut here---------------end--------------->8--- We=E2=80=99re using libblas.so (presumably from the =E2=80=98lapack=E2=80= =99 package) and not OpenBLAS, so no wonder it=E2=80=99s slow. Could it be that: "LIBBLAS=3D-lopenblas" "LIBBLASNAME=3Dlibopenblas" is ineffective? I think we have a lead! Ludo=E2=80=99.
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at 63986) by debbugs.gnu.org; 19 Jun 2023 16:36:27 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Mon Jun 19 12:36:27 2023 Received: from localhost ([127.0.0.1]:57145 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1qBHre-0004q2-IT for submit <at> debbugs.gnu.org; Mon, 19 Jun 2023 12:36:27 -0400 Received: from mail-wm1-f49.google.com ([209.85.128.49]:41367) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <zimon.toutoune@HIDDEN>) id 1qBHrd-0004pb-0q for 63986 <at> debbugs.gnu.org; Mon, 19 Jun 2023 12:36:25 -0400 Received: by mail-wm1-f49.google.com with SMTP id 5b1f17b1804b1-3f99aa36d18so3589905e9.1 for <63986 <at> debbugs.gnu.org>; Mon, 19 Jun 2023 09:36:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1687192579; x=1689784579; h=content-transfer-encoding:mime-version:message-id:date:references :in-reply-to:subject:cc:to:from:from:to:cc:subject:date:message-id :reply-to; bh=ZcUH8qQXjO1AO6zqsBgLlZlizTYB9gGb6Q13jkadH1Y=; b=auB/dNZRAzyahfDZHsnpI8rxRCtDvT4Mwi5eYVDzVITa3OzBcMLuap7LoZV+ytMavr h6G5PhH3voj2PCRQ8tQ9UEdfJwYBSWI6NiFe96cwL39lj8kbiU+988Akq+yPXKw8tq0C Av4MHegCowNyBl/7PH3LQ/1CS0Wyrw6sSpDPQ79FRiVwu2evPNQo+UTYZpOBuI/agTa6 znEQ7E8rqBIV8mOijccCHYjry7hWPyjsvQWpttZBqUi+iV59BSCB62meReEbvlj24Lxm u0DcYyZiPGK/VQqoQlfDsoLpTpmoSF2+WG45qkecuaoUZz4TpfHJjtQm4loYwQVNL5/U tw5w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1687192579; x=1689784579; h=content-transfer-encoding:mime-version:message-id:date:references :in-reply-to:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=ZcUH8qQXjO1AO6zqsBgLlZlizTYB9gGb6Q13jkadH1Y=; b=iLEiH78ICK9Y2BzG27W+1PqrsALL0G2T5a0j3Nmhs0vbzR/puVG2ciHCpOR8sS5PAG YkUduH1OS5kaand8gQzFcy0d7TNTIp9mTFFyKT5O8lnmNxIgsP/IQCzhpgt35z8/kHWR X6SCwor2mqt9+xXX7jte0YoKLvGmEua6GtXYdMLQgLTIgy/yESk9eAH1ppnZZIwtTkal rskd+7daofFGejDcMf8EL/vivgR8VrbslTyuRy97Yw6uckE89R1mfWx9gVkGqfwBnN59 5lTiE8j+SBYhEDmHQhhxXh4GhcpveBhIFrIQb8S1doDeUWuGFKPHlT3Wk2OnvIFQk4ky qEEg== X-Gm-Message-State: AC+VfDz2+BjjX6q2GKc2SH+LQSHg4rMVZz23TwJqyHaGqfsFEuphnYzQ dqQSLZwu5mivADzQSZ9NWhs= X-Google-Smtp-Source: ACHHUZ5CuFQyiWvDxlNgMQuajmqdoE5Pp1wyarVC6Gh5BrreiCFWnyy+9ow2FJ2QMj6jW9kQimsZuQ== X-Received: by 2002:a1c:ed17:0:b0:3f5:f543:d81f with SMTP id l23-20020a1ced17000000b003f5f543d81fmr11017421wmh.3.1687192579107; Mon, 19 Jun 2023 09:36:19 -0700 (PDT) Received: from pfiuh07 ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id v8-20020a05600c214800b003f42314832fsm173372wml.18.2023.06.19.09.36.18 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 19 Jun 2023 09:36:18 -0700 (PDT) From: Simon Tournier <zimon.toutoune@HIDDEN> To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>, Cayetano Santos <csantosb@HIDDEN> Subject: Re: bug#63986: Julia is very slow In-Reply-To: <87jzw6rq48.fsf@HIDDEN> References: <87legsl3cm.fsf@HIDDEN> <87jzw6rq48.fsf@HIDDEN> Date: Mon, 19 Jun 2023 18:13:48 +0200 Message-ID: <871qi7a0qr.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 1.7 (+) X-Spam-Report: Spam detection software, running on the system "debbugs.gnu.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see the administrator of that system for details. Content preview: Hi, On Wed, 14 Jun 2023 at 18:00, Ludovic Courtès wrote: > Cc’in Efraim, Simon, and Nicolas who’ve looked into Julia packaging in > the past. Hopefully we can get inspiration from Arch’s build recipe! Content analysis details: (1.7 points, 10.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider (zimon.toutoune[at]gmail.com) 0.0 SPF_HELO_NONE SPF: HELO does not publish an SPF Record -0.0 RCVD_IN_MSPIKE_H2 RBL: Average reputation (+2) [209.85.128.49 listed in wl.mailspike.net] -0.0 SPF_PASS SPF: sender matches SPF record 1.7 URIBL_BLACK Contains an URL listed in the URIBL blacklist [URIs: libz.so] -0.0 RCVD_IN_DNSWL_NONE RBL: Sender listed at https://www.dnswl.org/, no trust [209.85.128.49 listed in list.dnswl.org] X-Debbugs-Envelope-To: 63986 Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, Efraim Flashner <efraim@HIDDEN> X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: 0.7 (/) Hi, On Wed, 14 Jun 2023 at 18:00, Ludovic Court=C3=A8s <ludo@HIDDEN> wrote: > Cc=E2=80=99in Efraim, Simon, and Nicolas who=E2=80=99ve looked into Julia= packaging in > the past. Hopefully we can get inspiration from Arch=E2=80=99s build rec= ipe! Hum, the difference seems: USE_SYSTEM_DSFMT=3D0 USE_SYSTEM_LIBUV=3D0 which are set to 1 in our Guix recipe; I guess it does not come from that. And we link against OpenBLAS and they link against some NETLIB; I guess it does not come from that. Well, the other difference could be =E2=80=9Cmake release=E2=80=9D that we do not run. Maybe? Somehow, it seems from the ability to exploit the multicore, IIUC. Using the binary generated by upstream: --8<---------------cut here---------------start------------->8--- $ ldd julia-1.9.1/bin/julia=20 linux-vdso.so.1 (0x00007fffd83f1000) libdl.so.2 =3D> /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f08fb274000) libpthread.so.0 =3D> /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f08fb25= 1000) libc.so.6 =3D> /lib/x86_64-linux-gnu/libc.so.6 (0x00007f08fb05f000) libjulia.so.1 =3D> /tmp/julia-1.9.1/bin/../lib/libjulia.so.1 (0x00007f08fb= 03c000) /lib64/ld-linux-x86-64.so.2 (0x00007f08fb28e000) $ ldd julia-1.6.7/bin/julia=20 linux-vdso.so.1 (0x00007fffcdbd7000) libdl.so.2 =3D> /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f822423f000) libpthread.so.0 =3D> /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f822421= c000) libc.so.6 =3D> /lib/x86_64-linux-gnu/libc.so.6 (0x00007f822402a000) libjulia.so.1 =3D> /tmp/julia-1.6.7/bin/../lib/libjulia.so.1 (0x00007f8223= e04000) /lib64/ld-linux-x86-64.so.2 (0x00007f8224259000) --8<---------------cut here---------------end--------------->8--- And please note it also contain all these binaries: --8<---------------cut here---------------start------------->8--- libamd.so -> libamd.so.2.4.6 libamd.so.2 -> libamd.so.2.4.6 libamd.so.2.4.6 libatomic.so -> libatomic.so.1.2.0 libatomic.so.1 -> libatomic.so.1.2.0 libatomic.so.1.2.0 libblastrampoline.so -> libblastrampoline.so.5 libblastrampoline.so.5 libblastrampoline.so.5.4.0 -> libblastrampoline.so.5 [...] libsuitesparseconfig.so -> libsuitesparseconfig.so.5.10.1 libsuitesparseconfig.so.5 -> libsuitesparseconfig.so.5.10.1 libsuitesparseconfig.so.5.10.1 libumfpack.so -> libumfpack.so.5.7.9 libumfpack.so.5 -> libumfpack.so.5.7.9 libumfpack.so.5.7.9 libunwind.so -> libunwind.so.8.0.1 libunwind.so.8 -> libunwind.so.8.0.1 libunwind.so.8.0.1 libuv.so -> libuv.so.2.0.0 libuv.so.2 -> libuv.so.2.0.0 libuv.so.2.0.0 libz.so -> libz.so.1 libz.so.1 -> libz.so.1.2.13 libz.so.1.2.13 sys.so --8<---------------cut here---------------end--------------->8--- I get these time: + ~7ms v1.9.1 + ~18ms v1.6.7 compared to ~500ms of v1.8.3 provided by Guix. I guess the issue is about =E2=80=9Cthreading=E2=80=9D. Most of the time i= s about =E2=80=99futex=E2=80=99 in the Guix version. --8<---------------cut here---------------start------------->8--- $ head v1.9.1.txt=20 % time seconds usecs/call calls errors syscall ------ ----------- ----------- --------- --------- ---------------- 83.48 5.682198 6 926675 sched_yield 14.87 1.011882 987 1025 futex 0.42 0.028269 2 12308 rt_sigprocmask 0.35 0.023628 9 2592 madvise 0.18 0.012532 6266 2 wait4 0.18 0.012353 10 1227 epoll_wait 0.17 0.011707 2 5015 13 read 0.09 0.006235 13 448 brk $ head v1.6.7.txt 245193 ????( <detached ...> % time seconds usecs/call calls errors syscall ------ ----------- ----------- --------- --------- ---------------- 86.41 5.870043 5 1008236 sched_yield 12.85 0.872865 467 1869 futex 0.26 0.017538 3 5165 madvise 0.09 0.006171 2 2173 12 read 0.07 0.004486 13 321 brk 0.06 0.004242 2 1772 rt_sigprocmask 0.05 0.003197 2 1554 456 statx $ head vguix.txt % time seconds usecs/call calls errors syscall ------ ----------- ----------- --------- --------- ---------------- 88.96 7.843293 4621 1697 2 futex 6.88 0.606245 31 19080 sched_yield 1.74 0.153092 153092 1 1 rt_sigtimedwait 0.48 0.041975 1 26317 1 read 0.36 0.032148 1 27602 rt_sigprocmask 0.34 0.030236 10078 3 1 wait4 0.33 0.028833 1 20780 mincore 0.33 0.028801 1 22424 write --8<---------------cut here---------------end--------------->8--- Hum, I do not know=E2=80=A6 It needs some investigations. Thanks for the report. Cheers, simon
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at 63986) by debbugs.gnu.org; 14 Jun 2023 16:00:25 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Wed Jun 14 12:00:25 2023 Received: from localhost ([127.0.0.1]:45212 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1q9Sv3-0001Fz-38 for submit <at> debbugs.gnu.org; Wed, 14 Jun 2023 12:00:25 -0400 Received: from eggs.gnu.org ([209.51.188.92]:34616) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <ludo@HIDDEN>) id 1q9Sv1-0000v5-0J for 63986 <at> debbugs.gnu.org; Wed, 14 Jun 2023 12:00:23 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <ludo@HIDDEN>) id 1q9Sut-0004c8-EG; Wed, 14 Jun 2023 12:00:15 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:In-Reply-To:Date:References:Subject:To: From; bh=w4scQW22TYPgAXDlnfE5s4yeo5djIfRebO1KcToSuMk=; b=Heab+TdQHx6L3yCvuVFl Sy3t9wZ/366YOBf2rYywIoDaGwdJEsxXLhBITa5t3DfPXsRlqmmMfNmoCytJVTY5EKQwUKpq/NwvO aBDw5c806pdrAxN94oQLiSiiWCEQRKNvCa/cBUhvBuXU8UnXoRHhk41hjeKgQf7Dov9CfFiLfDY6J HTJAUjAtNwBlO4Yn5RgR/dKGFnvbpv+7shijbQYMN8xX+iZ1TLS7GXKc2BmW48ThxFuYfGKSgR+Vt v/vQHbhYijnDjE6P2sm1+kdaLOy/nPNd2gUf3A/hy67n3LDcKNpwltfRKWJpsREf9Iyor74+BkmKa fiEF2sM7Fww5WA==; Received: from 91-160-117-201.subs.proxad.net ([91.160.117.201] helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <ludo@HIDDEN>) id 1q9Sun-0003fY-OU; Wed, 14 Jun 2023 12:00:14 -0400 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN> To: Cayetano Santos <csantosb@HIDDEN> Subject: Re: bug#63986: Julia is very slow References: <87legsl3cm.fsf@HIDDEN> Date: Wed, 14 Jun 2023 18:00:07 +0200 In-Reply-To: <87legsl3cm.fsf@HIDDEN> (Cayetano Santos's message of "Fri, 09 Jun 2023 23:42:00 +0200") Message-ID: <87jzw6rq48.fsf@HIDDEN> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 63986 Cc: 63986 <at> debbugs.gnu.org, Nicolas Graves <ngraves@HIDDEN>, Efraim Flashner <efraim@HIDDEN>, Simon Tournier <zimon.toutoune@HIDDEN> X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -3.3 (---) Hi Cayetano, Cc=E2=80=99in Efraim, Simon, and Nicolas who=E2=80=99ve looked into Julia p= ackaging in the past. Hopefully we can get inspiration from Arch=E2=80=99s build recip= e! Thanks, Ludo=E2=80=99. Cayetano Santos <csantosb@HIDDEN> skribis: > Hi guix, > > I just noticed that the following line > > julia -e 'using Pkg; Pkg.add("BenchmarkTools"); using BenchmarkTools;= N =3D 1000; A =3D rand(N, N); B =3D rand(N, N); @btime $A*$B' > > gives around 530 ms in my laptop when using guix provided julia. Same > behavior when running within a guix container. > > This very same code, using the binary one may download from the julia > site gives 15 ms. > > I=E2=80=99m using here an up to date guix. As a reference, julia binary > provided by archlinux takes also 15 ms. > > Thanks, > > Cayetano Santos
bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.Received: (at submit) by debbugs.gnu.org; 9 Jun 2023 21:42:50 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Fri Jun 09 17:42:49 2023 Received: from localhost ([127.0.0.1]:32900 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1q7jsf-00010X-MZ for submit <at> debbugs.gnu.org; Fri, 09 Jun 2023 17:42:49 -0400 Received: from lists.gnu.org ([209.51.188.17]:60990) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <csantosb@HIDDEN>) id 1q7jsd-00010O-Ce for submit <at> debbugs.gnu.org; Fri, 09 Jun 2023 17:42:47 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <csantosb@HIDDEN>) id 1q7jsY-00013j-Mp for bug-guix@HIDDEN; Fri, 09 Jun 2023 17:42:44 -0400 Received: from confino.investici.org ([2a11:7980:1::2:0]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <csantosb@HIDDEN>) id 1q7jsU-0003GK-8J for bug-guix@HIDDEN; Fri, 09 Jun 2023 17:42:41 -0400 Received: from mx1.investici.org (unknown [127.0.0.1]) by confino.investici.org (Postfix) with ESMTP id 4QdF143rdFz115P for <bug-guix@HIDDEN>; Fri, 9 Jun 2023 21:42:32 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inventati.org; s=stigmate; t=1686346952; bh=vC3FXmPwx3wC63Ohwn4y/S1cP+5KIGvho4cVu3oyxy0=; h=From:To:Subject:Date:Reply-To:From; b=JndiZhbKswi2JKH7gx9goCKD9dycA2v6qR792wC3+a7P74M4hEm3T7YtHyS7eLgAm aJ8vDbCxK4+JhX6EfvB2DleI/t2Bwy6oqe0CzI9wJEzZ/hSI6k4LrVfRqBttr7eg1f fszsOt7XL9w0fDHKALYC+cfE69UBenAWG0NgraNU= Received: from [93.190.126.19] (mx1.investici.org [93.190.126.19]) (Authenticated sender: cayetano.santos@HIDDEN) by localhost (Postfix) with ESMTPSA id 4QdF142496z115M for <bug-guix@HIDDEN>; Fri, 9 Jun 2023 21:42:32 +0000 (UTC) User-agent: mu4e 1.10.2; emacs 29.0.91 From: Cayetano Santos <csantosb@HIDDEN> To: bug-guix@HIDDEN Subject: Julia is very slow Date: Fri, 09 Jun 2023 23:42:00 +0200 Message-ID: <87legsl3cm.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=2a11:7980:1::2:0; envelope-from=csantosb@HIDDEN; helo=confino.investici.org X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: -1.4 (-) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Reply-To: csantosb@HIDDEN Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -2.4 (--) Hi guix, I just noticed that the following line julia -e 'using Pkg; Pkg.add("BenchmarkTools"); using BenchmarkTools; N= =3D 1000; A =3D rand(N, N); B =3D rand(N, N); @btime $A*$B' gives around 530 ms in my laptop when using guix provided julia. Same behavior when running within a guix container. This very same code, using the binary one may download from the julia site gives 15 ms. I=E2=80=99m using here an up to date guix. As a reference, julia binary provided by archlinux takes also 15 ms. Thanks, Cayetano Santos
csantosb@HIDDEN
:bug-guix@HIDDEN
.
Full text available.bug-guix@HIDDEN
:bug#63986
; Package guix
.
Full text available.
GNU bug tracking system
Copyright (C) 1999 Darren O. Benham,
1997 nCipher Corporation Ltd,
1994-97 Ian Jackson.