GNU bug report logs - #44053
Poor profile generation performance on spinning disks

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: guix; Severity: important; Reported by: Maxim Cournoyer <maxim.cournoyer@HIDDEN>; dated Sun, 18 Oct 2020 03:37:02 UTC; Maintainer for guix is bug-guix@HIDDEN.

Message received at 44053 <at> debbugs.gnu.org:


Received: (at 44053) by debbugs.gnu.org; 23 Mar 2022 12:40:48 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed Mar 23 08:40:48 2022
Received: from localhost ([127.0.0.1]:43013 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1nX0IC-0006YZ-6t
	for submit <at> debbugs.gnu.org; Wed, 23 Mar 2022 08:40:48 -0400
Received: from mail-wm1-f49.google.com ([209.85.128.49]:39903)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <zimon.toutoune@HIDDEN>) id 1nX0IA-0006YJ-8E
 for 44053 <at> debbugs.gnu.org; Wed, 23 Mar 2022 08:40:46 -0400
Received: by mail-wm1-f49.google.com with SMTP id
 bi13-20020a05600c3d8d00b0038c2c33d8f3so5216619wmb.4
 for <44053 <at> debbugs.gnu.org>; Wed, 23 Mar 2022 05:40:46 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112;
 h=from:to:cc:subject:references:date:in-reply-to:message-id
 :user-agent:mime-version;
 bh=HDURdHphuqjx49Cj78njl6cunYYikYnUrQ0hdsWLS40=;
 b=A4vLdScRedOz+OCaPDn2qG8mHOUPRDxDIeY29MbUpK+kN3GvFPu8Of1GdXZJMVOUyr
 Xa1GIUFbPlafqthP4/r+6vMZ/djlqIYNoR66XfSuY49BFcDtqKkyQ0uVLZPC1VR85rfy
 u0mlJSOWHt4giuMhSPZ7KtcVlIAG49RzAAHmuQiOdtkXM9y1J+BFhFZZ/RKtbhMS7Q0H
 MXbzt90AWI9y+VbAr7esGnK0dwGB/PgpioiXe0oRlCccHkvfS0m6yXvaMvbnreJChSw8
 TXzjHTpchDPUtM+F1S7nFLX7TfF536GtUNlmrvAjT6KKyZo69ueQEiuUqDuyF4aVjiw+
 xo6g==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20210112;
 h=x-gm-message-state:from:to:cc:subject:references:date:in-reply-to
 :message-id:user-agent:mime-version;
 bh=HDURdHphuqjx49Cj78njl6cunYYikYnUrQ0hdsWLS40=;
 b=HlinKTKc8GkSn2V9iL2njbZjcTfpCxICVxJX3eOp114rMbsVMBLu76WAaK3ThXa1fK
 bbQRcicrz/Jxc11aHtwFSatpyQc8WZLXHI/qw7IxupMXvFwPHr7v3OF2ZoUXeKtoWBKo
 LLIsE32s+3/+xtHSUjcf6rGd9aClD2XhvWmc7N4p+FYSWfyE5xNAi5kRj1g5ki6EYTbU
 pExMs5PRE54Y7gwLueiDwXg3wyv6IaXpJZbmnVCXk7faHUkS8Dmmg4oJ3UYpPWFizL35
 wcIV9ZlxNQ53JnUgz1wqGTiEr0p7H1J9I9u1bG5y42Zhbhv2moMAk485L2bVSAayqDfO
 GrJQ==
X-Gm-Message-State: AOAM530bYCy7hTSvK4KiEAKvVovNkJ59PbLWyJQIBD9bbvGFDebsEH1i
 EWXqhkseV0TaZ/4R5WkVE9Pa7nT16BY=
X-Google-Smtp-Source: ABdhPJxwz7skMXdk0clOhuNIRtzb+yPbywPXw9a6wAevtPDFRra9ZDVhioIICqzp62+UvhU6bwdkyQ==
X-Received: by 2002:a05:600c:364f:b0:38c:c9f9:f867 with SMTP id
 y15-20020a05600c364f00b0038cc9f9f867mr1345750wmq.155.1648039240129; 
 Wed, 23 Mar 2022 05:40:40 -0700 (PDT)
Received: from lili (client-eduroam632.canalip.upmc.fr. [134.157.122.122])
 by smtp.gmail.com with ESMTPSA id
 185-20020a1c19c2000000b0038a1d06e862sm4230156wmz.14.2022.03.23.05.40.39
 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
 Wed, 23 Mar 2022 05:40:39 -0700 (PDT)
From: zimoun <zimon.toutoune@HIDDEN>
To: Maxim Cournoyer <maxim.cournoyer@HIDDEN>
Subject: Re: bug#44053: Poor profile generation performance on spinning disks
References: <87zh4k435a.fsf@HIDDEN>
Date: Wed, 23 Mar 2022 13:38:33 +0100
In-Reply-To: <87zh4k435a.fsf@HIDDEN> (Maxim Cournoyer's message of "Sat, 17
 Oct 2020 23:35:45 -0400")
Message-ID: <86tubozvw6.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: 44053
Cc: 44053 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Hi Maxim,

About performance reported by [1],

1: <http://issues.guix.gnu.org/issue/44053>

the commit [2],

2: <https://git.savannah.gnu.org/cgit/guix.git/commit/?id=76ea70bd70aeb76570445c11cea2f98139192b54>

improves the situation.  Although I agree the performance are poor for
spinning disk, what is the next actionable step associated to this
report?

Maybe we can close, WDYT?


Cheers,
simon




Information forwarded to bug-guix@HIDDEN:
bug#44053; Package guix. Full text available.

Message received at 44053 <at> debbugs.gnu.org:


Received: (at 44053) by debbugs.gnu.org; 8 Nov 2020 16:32:08 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sun Nov 08 11:32:08 2020
Received: from localhost ([127.0.0.1]:32931 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1kbnbs-0001SG-4A
	for submit <at> debbugs.gnu.org; Sun, 08 Nov 2020 11:32:08 -0500
Received: from eggs.gnu.org ([209.51.188.92]:44714)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <ludo@HIDDEN>) id 1kbnbo-0001Rl-J7
 for 44053 <at> debbugs.gnu.org; Sun, 08 Nov 2020 11:32:06 -0500
Received: from fencepost.gnu.org ([2001:470:142:3::e]:51593)
 by eggs.gnu.org with esmtp (Exim 4.90_1)
 (envelope-from <ludo@HIDDEN>)
 id 1kbnbh-0007A7-Q6; Sun, 08 Nov 2020 11:31:58 -0500
Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=44036 helo=ribbon)
 by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256)
 (Exim 4.82) (envelope-from <ludo@HIDDEN>)
 id 1kbnbg-0006bi-SA; Sun, 08 Nov 2020 11:31:57 -0500
From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN>
To: Luis Felipe <luis.felipe.la@HIDDEN>
Subject: Re: bug#44053: =?utf-8?Q?=E2=80=98xdg-mime-database=E2=80=99?=
 profile hook is slow
References: <87o8l7pple.fsf@HIDDEN> <87v9f7gspm.fsf@HIDDEN>
 <874kmn9adz.fsf_-_@HIDDEN> <87ft5zqn2a.fsf@HIDDEN>
 <87sg9sm2qf.fsf@HIDDEN> <87ft5rncn5.fsf@HIDDEN>
 <86blgeggo8.fsf@HIDDEN>
 <wfCkfOh1kZkBBqR2DYrffbz9xGwrXpB5lNfNNbLywaXO2i620ONaFST7pkyF_vskC20eUnLuV36YyO6t8v6__7oyVbOzaCoba1muCHDP0S4=@protonmail.com>
 <87blga3l7e.fsf@HIDDEN>
 <bMZ76QeMfjltWvLabLrXiBZyPPfTxrDHumnzqmIyDYRiU4BpAXwS8Z0zo4fnvHlbFLP23GpP27GJBS6Q6YZYDJ7sXXRzMOFJGtvujtprDNo=@protonmail.com>
X-URL: http://www.fdn.fr/~lcourtes/
X-Revolutionary-Date: 18 Brumaire an 229 de la =?utf-8?Q?R=C3=A9volution?=
X-PGP-Key-ID: 0x090B11993D9AEBB5
X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc
X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4  0CFB 090B 1199 3D9A EBB5
X-OS: x86_64-pc-linux-gnu
Date: Sun, 08 Nov 2020 17:31:55 +0100
In-Reply-To: <bMZ76QeMfjltWvLabLrXiBZyPPfTxrDHumnzqmIyDYRiU4BpAXwS8Z0zo4fnvHlbFLP23GpP27GJBS6Q6YZYDJ7sXXRzMOFJGtvujtprDNo=@protonmail.com>
 (Luis Felipe's message of "Fri, 06 Nov 2020 13:57:49 +0000")
Message-ID: <87pn4nvmh0.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: 44053
Cc: guix-devel <guix-devel@HIDDEN>,
 "44053 <at> debbugs.gnu.org" <44053 <at> debbugs.gnu.org>,
 Maxim Cournoyer <maxim.cournoyer@HIDDEN>, zimoun <zimon.toutoune@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

Hi,

Luis Felipe <luis.felipe.la@HIDDEN> skribis:

> Compared to grafting, the last step "construyendo perfil con X paquetes..=
." ("building profile with X packages..."), just stays there without change=
 for several minutes, so it actually seems slower to me. Initially, I thoug=
ht that guix had frozen.
>
> Also, even though, the "building profile" step has a throbber (| / - \) t=
o indicate that something is being done, it frequently stops in one of the =
frames of the sequence and stays there until the end.

Interesting, so we should profile that step and see what can be done.  I
suspect it=E2=80=99s I/O-bound, but maybe we can at least improve feedback.

Thanks,
Ludo=E2=80=99.




Information forwarded to bug-guix@HIDDEN:
bug#44053; Package guix. Full text available.

Message received at 44053 <at> debbugs.gnu.org:


Received: (at 44053) by debbugs.gnu.org; 6 Nov 2020 13:58:05 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Fri Nov 06 08:58:05 2020
Received: from localhost ([127.0.0.1]:55414 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1kb2Fh-0006SR-2P
	for submit <at> debbugs.gnu.org; Fri, 06 Nov 2020 08:58:05 -0500
Received: from mail-40132.protonmail.ch ([185.70.40.132]:38783)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <luis.felipe.la@HIDDEN>) id 1kb2Ff-0006Rx-7Y
 for 44053 <at> debbugs.gnu.org; Fri, 06 Nov 2020 08:58:03 -0500
Date: Fri, 06 Nov 2020 13:57:49 +0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com;
 s=protonmail; t=1604671076;
 bh=u4NE+5NSbmWyJNbRdPr99q0Dszi4RKnyK1r46hMefyE=;
 h=Date:To:From:Cc:Reply-To:Subject:In-Reply-To:References:From;
 b=LAPQum4fQPTU/3HWOYqu6etKcZkuK2SovBsvqHFaWTbjegdMd+l8vuz5wdr2mXn2A
 CWG8dikTbaVeelQCSiLCfFRLVfVA36zMvTjtVzDu8O0WNNxiVRKjeZcShD+7JXA0FM
 f/DSNawLo8ZBbDseA+GnVhbFPL2fhTtR0xmKbBvU=
To: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN>
From: Luis Felipe <luis.felipe.la@HIDDEN>
Subject: =?utf-8?Q?Re:_bug#44053:_=E2=80=98xdg-mime-database=E2=80=99_profile_hook_is_slow?=
Message-ID: <bMZ76QeMfjltWvLabLrXiBZyPPfTxrDHumnzqmIyDYRiU4BpAXwS8Z0zo4fnvHlbFLP23GpP27GJBS6Q6YZYDJ7sXXRzMOFJGtvujtprDNo=@protonmail.com>
In-Reply-To: <87blga3l7e.fsf@HIDDEN>
References: <87o8l7pple.fsf@HIDDEN> <87v9f7gspm.fsf@HIDDEN>
 <874kmn9adz.fsf_-_@HIDDEN> <87ft5zqn2a.fsf@HIDDEN>
 <87sg9sm2qf.fsf@HIDDEN> <87ft5rncn5.fsf@HIDDEN> <86blgeggo8.fsf@HIDDEN>
 <wfCkfOh1kZkBBqR2DYrffbz9xGwrXpB5lNfNNbLywaXO2i620ONaFST7pkyF_vskC20eUnLuV36YyO6t8v6__7oyVbOzaCoba1muCHDP0S4=@protonmail.com>
 <87blga3l7e.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Status: No, score=-1.2 required=10.0 tests=ALL_TRUSTED,DKIM_SIGNED,
 DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM shortcircuit=no
 autolearn=disabled version=3.4.4
X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on
 mailout.protonmail.ch
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 44053
Cc: guix-devel <guix-devel@HIDDEN>,
 "44053 <at> debbugs.gnu.org" <44053 <at> debbugs.gnu.org>,
 Maxim Cournoyer <maxim.cournoyer@HIDDEN>, zimoun <zimon.toutoune@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Reply-To: Luis Felipe <luis.felipe.la@HIDDEN>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90 Original Me=
ssage =E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90
On Friday, November 6, 2020 9:10 AM, Ludovic Court=C3=A8s <ludo@HIDDEN> wr=
ote:

> Hi,
>
> Luis Felipe luis.felipe.la@HIDDEN skribis:
>
> > =E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90 Origina=
l Message =E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=
=90
> > On Tuesday, November 3, 2020 11:32 PM, zimoun zimon.toutoune@HIDDEN =
wrote:
> >
> > > Hi,
> > >
> > > > https://git.savannah.gnu.org/cgit/guix.git/commit/?id=3D76ea70bd70a=
eb76570445c11cea2f98139192b54
> > >
> > > Clever workaround! What are now the performances on previous examples
> > > (same profiles and same packages)?
> >
> > In my case there seem to be no improvement (using Guix 5e7cf66fb35780f9=
30ad0bc5fe21ac330df4411d).
>
> Please note that the change above addresses only one specific source of
> slowness, the =E2=80=98xdg-mime-database=E2=80=99 hook, and only in speci=
fic cases.
>
> It=E2=80=99s good to look at the overall timing of =E2=80=98guix install=
=E2=80=99, because
> that=E2=80=99s what matters in the end, but as we work on optimizing it, =
we have
> to look at specific aspects of it.
>
> > $ time guix package -i perl --max-jobs=3D1


Yeah, sorry I was more focused on the general issue (#44053), but I underst=
and.


> [...]
>
> > injertando 12 paquetes en /gnu/store/anknpdyhmfirw3rz2k9zm9kiyak8yy1s-c=
ups-filters-1.27.4.drv ...
> > construyendo la base de datos MIME XDG...
> > injertando 3 paquetes en /gnu/store/xgny7xbl635g8na8x03x4cdr7abiphiw-cu=
ps-2.3.3.drv ...
> > injertando 20 paquetes en /gnu/store/yhjl68x7kcjbv40v823x4hl8rvv8l50b-g=
tk+-2.24.32.drv ...
> > injertando 21 paquetes en /gnu/store/kq37fnw8335f1hqc3j4hhqqcdnhl371p-g=
tk+-3.24.20.drv ...
> > creando la cach=C3=A9 de temas de iconos de GTK+...
> > construyendo los ficheros de cach=C3=A9 para los m=C3=A9todos de entrad=
a de GTK+...
> > construyendo perfil con 86 paquetes...
> > real 8m38,121s
> > user 0m2,742s
> > sys 0m0,338s
>
> Here it=E2=80=99s likely that grafting is what=E2=80=99s taking the most =
time on a
> spinning disk.

It does take some time, but since I can see the output change from grafting=
 to grafting, I at least can tell guix is doing something, so I just let it=
 be.

Compared to grafting, the last step "construyendo perfil con X paquetes..."=
 ("building profile with X packages..."), just stays there without change f=
or several minutes, so it actually seems slower to me. Initially, I thought=
 that guix had frozen.

Also, even though, the "building profile" step has a throbber (| / - \) to =
indicate that something is being done, it frequently stops in one of the fr=
ames of the sequence and stays there until the end.


> We should hack (guix status) so it can optionally prefix each event with
> a timestamp.
>
> As far as =E2=80=98xdg-mime-database=E2=80=99 is concerned, it should be =
down to 0s,
> unless your profile contains one of the packages I cited (libreoffice,
> gcr, hugin, etc.).

Yes, I have Libreoffice installed.






Information forwarded to bug-guix@HIDDEN:
bug#44053; Package guix. Full text available.

Message received at 44053 <at> debbugs.gnu.org:


Received: (at 44053) by debbugs.gnu.org; 6 Nov 2020 12:56:32 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Fri Nov 06 07:56:31 2020
Received: from localhost ([127.0.0.1]:55342 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1kb1I7-0004zP-Nr
	for submit <at> debbugs.gnu.org; Fri, 06 Nov 2020 07:56:31 -0500
Received: from mail-wr1-f45.google.com ([209.85.221.45]:33706)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <zimon.toutoune@HIDDEN>) id 1kb1I5-0004z6-Sb
 for 44053 <at> debbugs.gnu.org; Fri, 06 Nov 2020 07:56:30 -0500
Received: by mail-wr1-f45.google.com with SMTP id b8so1241394wrn.0
 for <44053 <at> debbugs.gnu.org>; Fri, 06 Nov 2020 04:56:29 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;
 h=from:to:cc:subject:in-reply-to:references:date:message-id
 :mime-version:content-transfer-encoding;
 bh=bP7lO8G8mC/ddDVQgZ194QRWScd9PbA11/I4MXdwCyM=;
 b=OZLUk2rzR2WQ+W9g9yp2BUmkFTwMaLUjgr2UQmwGI39sfLEdO74++YShYmLjUDOEMv
 AQjBrUkvhQquEHfdijitCTRwG3SEqZyms1jvJgFf/bBB3/W/xWnbDoSR+x93Ad4D6IGe
 isA0F5RZf0rQQu1qHWiE3WnhUJ/UQ2rfwleirfYhUN3wJVmDuZSzbTTQMBpw4Z5XrMGC
 JNSXPjuLfZsW/Dem3e7Ny/3lwGzTpA46i/r8AD9Vh2AScXjqm9rRDIUnVRPPf2zmtPRm
 /y10jcdVJr/9MjjasZWoz834V+a9b8hB1UMQ2KX8eIGnO7XbAtCZz1HP/1inXMB/VzaS
 J4tQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:from:to:cc:subject:in-reply-to:references:date
 :message-id:mime-version:content-transfer-encoding;
 bh=bP7lO8G8mC/ddDVQgZ194QRWScd9PbA11/I4MXdwCyM=;
 b=JhpWIJY4VS1nYWuynpkspUwts+YxAyj1AhI38VVJOsyIW3mk23vDjuzyPToPeBiw2t
 qwayXi6RXEJMtSfp8GV6dN21ho01aJ2iWVunHKYBU16MBbeA37p8bUhRAcV0lUwhv+7U
 ZAiZbrH+S4/jlY1UNF/TrAvXKD4hrgn7QZaKLK1XBpHf/WEuGFRsb6DL2bIx1S1YROFj
 J8sUd+AaybboG1GDTgZ5zfsiXn07hRp0mZVP3K3U9j1F5+TW2DsJBp8duLZdum6j2nMR
 MUPW5zLs7LyVJplUzFCjyS91yhs+qrxexo3VgrTJ8hkIWqRAtMzXITFL/urPYZlKPiIJ
 ZXQQ==
X-Gm-Message-State: AOAM532BYWVpFZ2VBkuNlzeVk/0shpvlN6rYye0nwNsjojH75pgFlJmV
 U6zhJ4OXaTlmV1ipq75mXBQ=
X-Google-Smtp-Source: ABdhPJxzqJ7YL+lkdQ0oqCRJttaGnva2eP2aaKdAqzxB+s33RX2bxn9qzG1cEaHEOL6o/8zZgYfcdQ==
X-Received: by 2002:adf:9bc1:: with SMTP id e1mr2587032wrc.203.1604667383913; 
 Fri, 06 Nov 2020 04:56:23 -0800 (PST)
Received: from lili ([88.126.110.68])
 by smtp.gmail.com with ESMTPSA id c64sm2140521wmd.41.2020.11.06.04.56.23
 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
 Fri, 06 Nov 2020 04:56:23 -0800 (PST)
From: zimoun <zimon.toutoune@HIDDEN>
To: Luis Felipe <luis.felipe.la@HIDDEN>
Subject: Re: bug#44053: =?utf-8?Q?=E2=80=98xdg-mime-database=E2=80=99?=
 profile hook is slow
In-Reply-To: <mOI7DET2ltI7DDsuW_psxIqhFvJxKjWOWmGpwEJKTL5rN49dnI-dvMMxquvNl33w9N9gxqJT8KA8hanP03RENzWZTwUY4Y7cNvctDfucOik=@protonmail.com>
References: <87o8l7pple.fsf@HIDDEN> <87v9f7gspm.fsf@HIDDEN>
 <874kmn9adz.fsf_-_@HIDDEN> <87ft5zqn2a.fsf@HIDDEN>
 <87sg9sm2qf.fsf@HIDDEN> <87ft5rncn5.fsf@HIDDEN>
 <86blgeggo8.fsf@HIDDEN>
 <wfCkfOh1kZkBBqR2DYrffbz9xGwrXpB5lNfNNbLywaXO2i620ONaFST7pkyF_vskC20eUnLuV36YyO6t8v6__7oyVbOzaCoba1muCHDP0S4=@protonmail.com>
 <86imajg4xs.fsf@HIDDEN>
 <mOI7DET2ltI7DDsuW_psxIqhFvJxKjWOWmGpwEJKTL5rN49dnI-dvMMxquvNl33w9N9gxqJT8KA8hanP03RENzWZTwUY4Y7cNvctDfucOik=@protonmail.com>
Date: Fri, 06 Nov 2020 13:55:50 +0100
Message-ID: <864km2fxux.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 44053
Cc: guix-devel <guix-devel@HIDDEN>,
 Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>,
 "44053 <at> debbugs.gnu.org" <44053 <at> debbugs.gnu.org>,
 Maxim Cournoyer <maxim.cournoyer@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Hi,

On Thu, 05 Nov 2020 at 17:59, Luis Felipe <luis.felipe.la@HIDDEN> w=
rote:

Therefore, it is nice improvement! :-)

> real	0m56,245s
> user	0m4,324s
> sys	0m0,218s

> real	0m43,272s
> user	0m4,214s
> sys	0m0,200s

Because, I bet that most of the time is spent in the =E2=80=9Ctime-machine=
=E2=80=9D
part.  I mean, compare with:

 time guix time-machine --commit=3D$new -- help


All the best,
simon




Information forwarded to bug-guix@HIDDEN:
bug#44053; Package guix. Full text available.

Message received at 44053 <at> debbugs.gnu.org:


Received: (at 44053) by debbugs.gnu.org; 6 Nov 2020 09:12:37 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Fri Nov 06 04:12:37 2020
Received: from localhost ([127.0.0.1]:55070 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1kaxnR-0007km-E5
	for submit <at> debbugs.gnu.org; Fri, 06 Nov 2020 04:12:37 -0500
Received: from eggs.gnu.org ([209.51.188.92]:32856)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <ludo@HIDDEN>) id 1kaxnQ-0007kW-6o
 for 44053 <at> debbugs.gnu.org; Fri, 06 Nov 2020 04:12:36 -0500
Received: from fencepost.gnu.org ([2001:470:142:3::e]:49507)
 by eggs.gnu.org with esmtp (Exim 4.90_1)
 (envelope-from <ludo@HIDDEN>)
 id 1kaxnK-0006MK-VI; Fri, 06 Nov 2020 04:12:30 -0500
Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=57168 helo=ribbon)
 by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256)
 (Exim 4.82) (envelope-from <ludo@HIDDEN>)
 id 1kaxnI-0003qy-PX; Fri, 06 Nov 2020 04:12:29 -0500
From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN>
To: zimoun <zimon.toutoune@HIDDEN>
Subject: Re: bug#44053: =?utf-8?Q?=E2=80=98xdg-mime-database=E2=80=99?=
 profile hook is slow
References: <87o8l7pple.fsf@HIDDEN>
 <sqv1qTRO4PZuOuanFOc1Dw6QlIMeczAQjg9erpoU9CmuWjuqYl7H87lpEfl7w2zNAT755yE_djMRXz8fKFiXZ8ddUJSdtLkSCoWIl9KREnw=@protonmail.com>
 <87h7qxhncq.fsf@HIDDEN>
 <3aQjRn5jGhxHrhAmuB3MfLRjSxAp3PVFu1vL7_GV1ucGibzYURCtMqHN4oeyGb5xez2xYM3loEJIECrVdnAGZBZvf0N1bGXN-80mO6Ymr6k=@protonmail.com>
 <87sgagv8qt.fsf@HIDDEN> <87o8l279eb.fsf@HIDDEN>
 <CAJ3okZ3DR0qDq5qwY-ZBboBUFcCnv5bAYR8RuUSW0dSj8SRyyA@HIDDEN>
 <4JD1z15e92ccv6WXcMS5IiNJnDwR6P3bkIwtPWLUPYDVCUHYDoekpifyj3GQtnEq1LCKftbL-FV1hp162A1mid2EmjLMbWlxQ05aE9vGyf0=@protonmail.com>
 <87v9f842uu.fsf@HIDDEN>
 <CAJ3okZ2WTcZ+JLYUCEcU6CESpOOjHcdFEWirSOCfrZFbXeLzAg@HIDDEN>
 <87v9f7gspm.fsf@HIDDEN> <874kmn9adz.fsf_-_@HIDDEN>
 <87ft5zqn2a.fsf@HIDDEN> <87sg9sm2qf.fsf@HIDDEN>
 <87ft5rncn5.fsf@HIDDEN> <86blgeggo8.fsf@HIDDEN>
X-URL: http://www.fdn.fr/~lcourtes/
X-Revolutionary-Date: 16 Brumaire an 229 de la =?utf-8?Q?R=C3=A9volution?=
X-PGP-Key-ID: 0x090B11993D9AEBB5
X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc
X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4  0CFB 090B 1199 3D9A EBB5
X-OS: x86_64-pc-linux-gnu
Date: Fri, 06 Nov 2020 10:12:27 +0100
In-Reply-To: <86blgeggo8.fsf@HIDDEN> (zimoun's message of "Wed, 04 Nov 2020
 00:32:39 +0100")
Message-ID: <875z6i3l38.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: 44053
Cc: guix-devel <guix-devel@HIDDEN>,
 Luis Felipe <luis.felipe.la@HIDDEN>, 44053 <at> debbugs.gnu.org,
 Maxim Cournoyer <maxim.cournoyer@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

Hello,

zimoun <zimon.toutoune@HIDDEN> skribis:

>> So it would seem we cannot simply used the pre-built database from
>> =E2=80=98shared-mime-info=E2=80=99 and merge it with that of the other p=
ackages, at
>> least not without changing =E2=80=98update-mime-database=E2=80=99 or re-=
implementing
>> parts of it on our side.
>
> =E2=80=99shared-mime-info=E2=80=99 is simply a package, right?  So what d=
oes it means:
> =C2=ABFind a way to avoid reprocessing 'shared-mime-info'=C2=BB in:
>
>                  ;; the database.  TODO: Find a way to avoid reprocessing
>                  ;; 'shared-mime-info', which is the most expensive one.
> [...]
>                  (invoke #+(file-append shared-mime-info
>                                         "/bin/update-mime-database")
>                          destdir)))))))

=E2=80=98shared-mime-info=E2=80=99 contains =E2=80=98share/mime/freedesktop=
.org.xml=E2=80=99, which is
by far where =E2=80=98update-mime-database=E2=80=99 spends most of its time.

But it=E2=80=99s wasteful because =E2=80=98shared-mime-info=E2=80=99 alread=
y contains the result
of running =E2=80=98update-mime-database=E2=80=99 on itself.

HTH!

Ludo=E2=80=99.




Information forwarded to bug-guix@HIDDEN:
bug#44053; Package guix. Full text available.

Message received at 44053 <at> debbugs.gnu.org:


Received: (at 44053) by debbugs.gnu.org; 6 Nov 2020 09:10:45 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Fri Nov 06 04:10:45 2020
Received: from localhost ([127.0.0.1]:55066 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1kaxlc-0007hh-Vg
	for submit <at> debbugs.gnu.org; Fri, 06 Nov 2020 04:10:45 -0500
Received: from eggs.gnu.org ([209.51.188.92]:60628)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <ludo@HIDDEN>) id 1kaxlb-0007hT-JV
 for 44053 <at> debbugs.gnu.org; Fri, 06 Nov 2020 04:10:43 -0500
Received: from fencepost.gnu.org ([2001:470:142:3::e]:49386)
 by eggs.gnu.org with esmtp (Exim 4.90_1)
 (envelope-from <ludo@HIDDEN>)
 id 1kaxlW-0005be-Bi; Fri, 06 Nov 2020 04:10:38 -0500
Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=57166 helo=ribbon)
 by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256)
 (Exim 4.82) (envelope-from <ludo@HIDDEN>)
 id 1kaxlV-0003Xi-HD; Fri, 06 Nov 2020 04:10:37 -0500
From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN>
To: Luis Felipe <luis.felipe.la@HIDDEN>
Subject: Re: bug#44053: =?utf-8?Q?=E2=80=98xdg-mime-database=E2=80=99?=
 profile hook is slow
Message-ID: <87blga3l7e.fsf@HIDDEN>
References: <87o8l7pple.fsf@HIDDEN> <87v9f842uu.fsf@HIDDEN>
 <CAJ3okZ2WTcZ+JLYUCEcU6CESpOOjHcdFEWirSOCfrZFbXeLzAg@HIDDEN>
 <87v9f7gspm.fsf@HIDDEN> <874kmn9adz.fsf_-_@HIDDEN>
 <87ft5zqn2a.fsf@HIDDEN> <87sg9sm2qf.fsf@HIDDEN>
 <87ft5rncn5.fsf@HIDDEN> <86blgeggo8.fsf@HIDDEN>
 <wfCkfOh1kZkBBqR2DYrffbz9xGwrXpB5lNfNNbLywaXO2i620ONaFST7pkyF_vskC20eUnLuV36YyO6t8v6__7oyVbOzaCoba1muCHDP0S4=@protonmail.com>
X-URL: http://www.fdn.fr/~lcourtes/
X-Revolutionary-Date: 16 Brumaire an 229 de la =?utf-8?Q?R=C3=A9volution?=
X-PGP-Key-ID: 0x090B11993D9AEBB5
X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc
X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4  0CFB 090B 1199 3D9A EBB5
X-OS: x86_64-pc-linux-gnu
Date: Fri, 06 Nov 2020 10:10:35 +0100
In-Reply-To: <wfCkfOh1kZkBBqR2DYrffbz9xGwrXpB5lNfNNbLywaXO2i620ONaFST7pkyF_vskC20eUnLuV36YyO6t8v6__7oyVbOzaCoba1muCHDP0S4=@protonmail.com>
 (Luis Felipe's message of "Thu, 05 Nov 2020 14:47:55 +0000")
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: 44053
Cc: guix-devel <guix-devel@HIDDEN>,
 "44053 <at> debbugs.gnu.org" <44053 <at> debbugs.gnu.org>,
 Maxim Cournoyer <maxim.cournoyer@HIDDEN>, zimoun <zimon.toutoune@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

Hi,

Luis Felipe <luis.felipe.la@HIDDEN> skribis:

> =E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90 Original =
Message =E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90
> On Tuesday, November 3, 2020 11:32 PM, zimoun <zimon.toutoune@HIDDEN> =
wrote:
>
>> Hi,
>>
>> > https://git.savannah.gnu.org/cgit/guix.git/commit/?id=3D76ea70bd70aeb7=
6570445c11cea2f98139192b54
>>
>> Clever workaround! What are now the performances on previous examples
>> (same profiles and same packages)?
>
> In my case there seem to be no improvement (using Guix 5e7cf66fb35780f930=
ad0bc5fe21ac330df4411d).

Please note that the change above addresses only one specific source of
slowness, the =E2=80=98xdg-mime-database=E2=80=99 hook, and only in specifi=
c cases.

It=E2=80=99s good to look at the overall timing of =E2=80=98guix install=E2=
=80=99, because
that=E2=80=99s what matters in the end, but as we work on optimizing it, we=
 have
to look at specific aspects of it.

> $ time guix package -i perl --max-jobs=3D1

[...]

> injertando 12 paquetes en /gnu/store/anknpdyhmfirw3rz2k9zm9kiyak8yy1s-cup=
s-filters-1.27.4.drv ...
> construyendo la base de datos MIME XDG...
> injertando 3 paquetes en /gnu/store/xgny7xbl635g8na8x03x4cdr7abiphiw-cups=
-2.3.3.drv ...
> injertando 20 paquetes en /gnu/store/yhjl68x7kcjbv40v823x4hl8rvv8l50b-gtk=
+-2.24.32.drv ...
> injertando 21 paquetes en /gnu/store/kq37fnw8335f1hqc3j4hhqqcdnhl371p-gtk=
+-3.24.20.drv ...
> creando la cach=C3=A9 de temas de iconos de GTK+...
> construyendo los ficheros de cach=C3=A9 para los m=C3=A9todos de entrada =
de GTK+...
> construyendo perfil con 86 paquetes...
>
>
> real	8m38,121s
> user	0m2,742s
> sys	0m0,338s

Here it=E2=80=99s likely that grafting is what=E2=80=99s taking the most ti=
me on a
spinning disk.

We should hack (guix status) so it can optionally prefix each event with
a timestamp.

As far as =E2=80=98xdg-mime-database=E2=80=99 is concerned, it should be do=
wn to 0s,
unless your profile contains one of the packages I cited (libreoffice,
gcr, hugin, etc.).

Thanks,
Ludo=E2=80=99.




Information forwarded to bug-guix@HIDDEN:
bug#44053; Package guix. Full text available.

Message received at 44053 <at> debbugs.gnu.org:


Received: (at 44053) by debbugs.gnu.org; 5 Nov 2020 18:00:17 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Thu Nov 05 13:00:17 2020
Received: from localhost ([127.0.0.1]:54072 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1kajYW-0001q7-Rq
	for submit <at> debbugs.gnu.org; Thu, 05 Nov 2020 13:00:17 -0500
Received: from mail-40141.protonmail.ch ([185.70.40.141]:25289)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <luis.felipe.la@HIDDEN>) id 1kajYV-0001pr-EK
 for 44053 <at> debbugs.gnu.org; Thu, 05 Nov 2020 13:00:16 -0500
Date: Thu, 05 Nov 2020 17:59:59 +0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com;
 s=protonmail; t=1604599208;
 bh=o5366yhEPw5lIOLe6nS1fooDisgNKmcLT+TwqO0/1XY=;
 h=Date:To:From:Cc:Reply-To:Subject:In-Reply-To:References:From;
 b=GBaAOR4TMwKQgo9BlKyxSncrqAUPpjVd8/7ipXr1zYCuFPUp3PEXPnfk5x+Ndz+Sx
 Gq3ibhXNyx2xCS8wOrpppg8Us1AojcPjso0MXBT921tj8bbKQfRxleKdbMONW9fWnM
 s6Bng0WQL7VTrs+ha+xEwP2ucISLLFFwtlFChkzA=
To: zimoun <zimon.toutoune@HIDDEN>
From: Luis Felipe <luis.felipe.la@HIDDEN>
Subject: =?utf-8?Q?Re:_bug#44053:_=E2=80=98xdg-mime-database=E2=80=99_profile_hook_is_slow?=
Message-ID: <mOI7DET2ltI7DDsuW_psxIqhFvJxKjWOWmGpwEJKTL5rN49dnI-dvMMxquvNl33w9N9gxqJT8KA8hanP03RENzWZTwUY4Y7cNvctDfucOik=@protonmail.com>
In-Reply-To: <86imajg4xs.fsf@HIDDEN>
References: <87o8l7pple.fsf@HIDDEN> <87v9f7gspm.fsf@HIDDEN>
 <874kmn9adz.fsf_-_@HIDDEN> <87ft5zqn2a.fsf@HIDDEN>
 <87sg9sm2qf.fsf@HIDDEN> <87ft5rncn5.fsf@HIDDEN> <86blgeggo8.fsf@HIDDEN>
 <wfCkfOh1kZkBBqR2DYrffbz9xGwrXpB5lNfNNbLywaXO2i620ONaFST7pkyF_vskC20eUnLuV36YyO6t8v6__7oyVbOzaCoba1muCHDP0S4=@protonmail.com>
 <86imajg4xs.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Status: No, score=-1.2 required=10.0 tests=ALL_TRUSTED,DKIM_SIGNED,
 DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM shortcircuit=no
 autolearn=disabled version=3.4.4
X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on
 mailout.protonmail.ch
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: 44053
Cc: guix-devel <guix-devel@HIDDEN>,
 =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN>,
 "44053 <at> debbugs.gnu.org" <44053 <at> debbugs.gnu.org>,
 Maxim Cournoyer <maxim.cournoyer@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Reply-To: Luis Felipe <luis.felipe.la@HIDDEN>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90 Original Me=
ssage =E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90
On Thursday, November 5, 2020 4:10 PM, zimoun <zimon.toutoune@HIDDEN> wr=
ote:

> Hi,
>
> On Thu, 05 Nov 2020 at 14:47, Luis Felipe luis.felipe.la@HIDDEN w=
rote:
>
> > > Clever workaround! What are now the performances on previous examples
> > > (same profiles and same packages)?
> >
> > In my case there seem to be no improvement (using Guix 5e7cf66fb35780f9=
30ad0bc5fe21ac330df4411d).
> > $ time guix package -i perl --max-jobs=3D1
>
> [...]
>
> > real 8m38,121s
> > user 0m2,742s
> > sys 0m0,338s
>
> Thanks. But it is hard to conclude because the previous timing is
> missing.

I don't understand, I posted my original timing in https://issues.guix.gnu.=
org/44053#1 .



> The right experiment should be:
>
> --8<---------------cut here---------------start------------->8---
> old=3Dc73496f433044a76003b33c3855bb35ecd0df87f
> new=3D5e7cf66fb35780f930ad0bc5fe21ac330df4411d
> guix time-machine --commit=3D$old -- help
> guix time-machine --commit=3D$new -- help
>
> drv=3D$(guix gc -R $(guix gc --derivers $(readlink -f ~/.guix-profile)) |=
grep xdg-mime-database.drv)
>
> guix package -I |wc -l
> time guix time-machine --commit=3D$old -- build --check $drv
> time guix time-machine --commit=3D$new -- build --check $drv
> --8<---------------cut here---------------end--------------->8---


I get this:

yo@gnu: ~=E2=9D=AF guix package -I |wc -l
85

yo@gnu: ~=E2=9D=AF time guix time-machine --commit=3D$old -- build --check =
$drv
Actualizando el canal 'guix' del repositorio Git en 'https://git.savannah.g=
nu.org/git/guix.git'...
Actualizando el canal 'luflac-x' del repositorio Git en 'git@HIDDEN:lui=
s-felipe/guix-channel-x.git'...
Se construir=C3=A1 la siguiente extensi=C3=B3n del perfil:
   /gnu/store/8hswzn212w7wqlr7cgsvq5v7zjh62chc-xdg-mime-database.drv
construyendo la base de datos MIME XDG...
/gnu/store/8hswzn212w7wqlr7cgsvq5v7zjh62chc-xdg-mime-database.drv construid=
o satisfactoriamente
/gnu/store/i4qslq2517pwkwb5dyivrg8idsjd8n11-xdg-mime-database

real=090m56,245s
user=090m4,324s
sys=090m0,218s


yo@gnu: ~=E2=9D=AF time guix time-machine --commit=3D$new -- build --check =
$drv
Actualizando el canal 'guix' del repositorio Git en 'https://git.savannah.g=
nu.org/git/guix.git'...
Actualizando el canal 'luflac-x' del repositorio Git en 'git@HIDDEN:lui=
s-felipe/guix-channel-x.git'...
Se construir=C3=A1 la siguiente extensi=C3=B3n del perfil:
   /gnu/store/8hswzn212w7wqlr7cgsvq5v7zjh62chc-xdg-mime-database.drv
construyendo la base de datos MIME XDG...
/gnu/store/8hswzn212w7wqlr7cgsvq5v7zjh62chc-xdg-mime-database.drv construid=
o satisfactoriamente
/gnu/store/i4qslq2517pwkwb5dyivrg8idsjd8n11-xdg-mime-database

real=090m43,272s
user=090m4,214s
sys=090m0,200s




Information forwarded to bug-guix@HIDDEN:
bug#44053; Package guix. Full text available.

Message received at 44053 <at> debbugs.gnu.org:


Received: (at 44053) by debbugs.gnu.org; 5 Nov 2020 16:11:20 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Thu Nov 05 11:11:20 2020
Received: from localhost ([127.0.0.1]:53930 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1kahr6-0007VQ-DM
	for submit <at> debbugs.gnu.org; Thu, 05 Nov 2020 11:11:20 -0500
Received: from mail-wr1-f50.google.com ([209.85.221.50]:44661)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <zimon.toutoune@HIDDEN>) id 1kahr5-0007VA-52
 for 44053 <at> debbugs.gnu.org; Thu, 05 Nov 2020 11:11:19 -0500
Received: by mail-wr1-f50.google.com with SMTP id c17so2394044wrc.11
 for <44053 <at> debbugs.gnu.org>; Thu, 05 Nov 2020 08:11:19 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;
 h=from:to:cc:subject:in-reply-to:references:date:message-id
 :mime-version:content-transfer-encoding;
 bh=h0RnL7UB+mLfQtPyCASCBnvJkifBvgGReEEi/R5nGvs=;
 b=gdLEbJucf+NCSdJt1CGhQFKnHwBDgRF2VKw5cHOHTRAb6r0vgVOS78pAnoPAUsoARF
 o5ymz+G5k+orVmwyF1OON8vfJk+XWczHL8bgA8GGiO2ZCCJaobkzJTVxrF38NCSxHzkJ
 ZY0gwyiWQ0U2Vr8u4EiYsUdZA+9CpLH4rRFHMFqqwZ2Twj59l4jFD5Yc9Qlz5aUpZ3wP
 tb1AFDqDYsr2bN8n8oSEG1oG0WJxVk4CcNWafuSGzqKwNUFfT6JdNJK3uZI1PYf11zNN
 ot2dQiFb6sjTi70NNVpat/wXsYYM9e4Y/XrYvG1HfpwWBSR3flHb1vhT6O0IfSoaEPlu
 f+8w==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:from:to:cc:subject:in-reply-to:references:date
 :message-id:mime-version:content-transfer-encoding;
 bh=h0RnL7UB+mLfQtPyCASCBnvJkifBvgGReEEi/R5nGvs=;
 b=jE2fWnTHcGwNh1Tmq3pTzncVb7Htx9BDVssu25cAzaWz2ekre2bAR+wKwbtmJ/3a0k
 hF5ddzYwfsJzuNIK1wIp06TDqGnqgST36HBlCp6AQBgJ6FwwYqzBUYi2EW3yXl846hjE
 8SLZYfeJTQvqGQif/Rb2B17b2R3KnZkkgff3iVyaTKLF9nzjzrK0kUilrfo60G8bgAmB
 Pwyy/dzHfPjTtNozhIZMQz01XyePeKDEceRHkP5i2l05Tdn5vIte44OZ03FCCiAXefGU
 yS6vR5wSO/C9vXTsqzEQLdNCwKpn2OqJxLbmC4EmmZrpGpflGyFYTBwsnB3JV7jCeAGv
 JyBQ==
X-Gm-Message-State: AOAM5338vkZ+TgxIwWd7uqIWlSoYFcblCms2CIP/jnNPJbmgNKeavztI
 2qNJrgIbNV0lKUqPcb+W7Ec=
X-Google-Smtp-Source: ABdhPJzRUSd3694beJ+THagCUltwpEN/4Q5wpEySqX+7trAbBAZbw3kvxKZK6fQxjvkZPeVvP7eGig==
X-Received: by 2002:adf:d0cf:: with SMTP id z15mr4100473wrh.213.1604592673312; 
 Thu, 05 Nov 2020 08:11:13 -0800 (PST)
Received: from lili ([88.126.110.68])
 by smtp.gmail.com with ESMTPSA id 90sm3314830wrl.30.2020.11.05.08.11.12
 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
 Thu, 05 Nov 2020 08:11:12 -0800 (PST)
From: zimoun <zimon.toutoune@HIDDEN>
To: Luis Felipe <luis.felipe.la@HIDDEN>
Subject: Re: bug#44053: =?utf-8?Q?=E2=80=98xdg-mime-database=E2=80=99?=
 profile hook is slow
In-Reply-To: <wfCkfOh1kZkBBqR2DYrffbz9xGwrXpB5lNfNNbLywaXO2i620ONaFST7pkyF_vskC20eUnLuV36YyO6t8v6__7oyVbOzaCoba1muCHDP0S4=@protonmail.com>
References: <87o8l7pple.fsf@HIDDEN> <87v9f842uu.fsf@HIDDEN>
 <CAJ3okZ2WTcZ+JLYUCEcU6CESpOOjHcdFEWirSOCfrZFbXeLzAg@HIDDEN>
 <87v9f7gspm.fsf@HIDDEN> <874kmn9adz.fsf_-_@HIDDEN>
 <87ft5zqn2a.fsf@HIDDEN> <87sg9sm2qf.fsf@HIDDEN>
 <87ft5rncn5.fsf@HIDDEN> <86blgeggo8.fsf@HIDDEN>
 <wfCkfOh1kZkBBqR2DYrffbz9xGwrXpB5lNfNNbLywaXO2i620ONaFST7pkyF_vskC20eUnLuV36YyO6t8v6__7oyVbOzaCoba1muCHDP0S4=@protonmail.com>
Date: Thu, 05 Nov 2020 17:10:39 +0100
Message-ID: <86imajg4xs.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 44053
Cc: guix-devel <guix-devel@HIDDEN>,
 Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>,
 "44053 <at> debbugs.gnu.org" <44053 <at> debbugs.gnu.org>,
 Maxim Cournoyer <maxim.cournoyer@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Hi,

On Thu, 05 Nov 2020 at 14:47, Luis Felipe <luis.felipe.la@HIDDEN> w=
rote:

>> Clever workaround! What are now the performances on previous examples
>> (same profiles and same packages)?
>
> In my case there seem to be no improvement (using Guix 5e7cf66fb35780f930=
ad0bc5fe21ac330df4411d).
>
>
> $ time guix package -i perl --max-jobs=3D1

[...]

> real	8m38,121s
> user	0m2,742s
> sys	0m0,338s

Thanks.  But it is hard to conclude because the previous timing is
missing.  The right experiment should be:

--8<---------------cut here---------------start------------->8---
old=3Dc73496f433044a76003b33c3855bb35ecd0df87f
new=3D5e7cf66fb35780f930ad0bc5fe21ac330df4411d
guix time-machine --commit=3D$old -- help
guix time-machine --commit=3D$new -- help

drv=3D$(guix gc -R $(guix gc --derivers $(readlink -f ~/.guix-profile)) |gr=
ep xdg-mime-database.drv)

guix package -I |wc -l
time guix time-machine --commit=3D$old -- build --check $drv
time guix time-machine --commit=3D$new -- build --check $drv
--8<---------------cut here---------------end--------------->8---


And personally, I get:

18

Updating channel 'guix' from Git repository at 'https://git.savannah.gnu.or=
g/git/guix.git'...
The following profile hook will be built:
   /gnu/store/2jlwri28aycsayql85rfphrks721ny1k-xdg-mime-database.drv
building XDG MIME database...
successfully built /gnu/store/2jlwri28aycsayql85rfphrks721ny1k-xdg-mime-dat=
abase.drv
/gnu/store/hrcj1h0hl9f6hm1akh682zj1mhpwbx4c-xdg-mime-database

real	0m8.063s
user	0m6.226s
sys	0m0.282s

Updating channel 'guix' from Git repository at 'https://git.savannah.gnu.or=
g/git/guix.git'...
The following profile hook will be built:
   /gnu/store/2jlwri28aycsayql85rfphrks721ny1k-xdg-mime-database.drv
building XDG MIME database...
successfully built /gnu/store/2jlwri28aycsayql85rfphrks721ny1k-xdg-mime-dat=
abase.drv
/gnu/store/hrcj1h0hl9f6hm1akh682zj1mhpwbx4c-xdg-mime-database

real	0m8.016s
user	0m6.223s
sys	0m0.243s

Well, I have only 18 packages in my ~/.guix-profile.  That=E2=80=99s why the
difference is not visible and the =E2=80=9Ctime-machine=E2=80=9D is totally=
 dominating
here.


All the best,
simon




Information forwarded to bug-guix@HIDDEN:
bug#44053; Package guix. Full text available.

Message received at 44053 <at> debbugs.gnu.org:


Received: (at 44053) by debbugs.gnu.org; 5 Nov 2020 14:48:13 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Thu Nov 05 09:48:13 2020
Received: from localhost ([127.0.0.1]:52180 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1kagYf-0004vD-2O
	for submit <at> debbugs.gnu.org; Thu, 05 Nov 2020 09:48:13 -0500
Received: from mail-40130.protonmail.ch ([185.70.40.130]:46258)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <luis.felipe.la@HIDDEN>) id 1kagYd-0004v0-FK
 for 44053 <at> debbugs.gnu.org; Thu, 05 Nov 2020 09:48:12 -0500
Date: Thu, 05 Nov 2020 14:47:55 +0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com;
 s=protonmail; t=1604587684;
 bh=h0q87gLgvM3QInQaRZ9rDOZrw1h3V1XSTkBU3qdnPfs=;
 h=Date:To:From:Cc:Reply-To:Subject:In-Reply-To:References:From;
 b=SlvLlsV1G9fzvTlCBjS+1AUu1Jvc0MPY0Lg0mqBXgh7OsJJNcD4KXQrxo7KO2GJhm
 Ai3wApkU9AsoEp0fcVuqy+xxxJ7yVZSIpObCunbHJDEHgzj5KsZummAw9yAkzsw5CE
 efb7G28ZC1qbybiCEoRtXX9RvlfnOK+V3+1d+KRM=
To: zimoun <zimon.toutoune@HIDDEN>
From: Luis Felipe <luis.felipe.la@HIDDEN>
Subject: =?utf-8?Q?Re:_bug#44053:_=E2=80=98xdg-mime-database=E2=80=99_profile_hook_is_slow?=
Message-ID: <wfCkfOh1kZkBBqR2DYrffbz9xGwrXpB5lNfNNbLywaXO2i620ONaFST7pkyF_vskC20eUnLuV36YyO6t8v6__7oyVbOzaCoba1muCHDP0S4=@protonmail.com>
In-Reply-To: <86blgeggo8.fsf@HIDDEN>
References: <87o8l7pple.fsf@HIDDEN> <87v9f842uu.fsf@HIDDEN>
 <CAJ3okZ2WTcZ+JLYUCEcU6CESpOOjHcdFEWirSOCfrZFbXeLzAg@HIDDEN>
 <87v9f7gspm.fsf@HIDDEN> <874kmn9adz.fsf_-_@HIDDEN>
 <87ft5zqn2a.fsf@HIDDEN> <87sg9sm2qf.fsf@HIDDEN> <87ft5rncn5.fsf@HIDDEN>
 <86blgeggo8.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Status: No, score=-1.2 required=10.0 tests=ALL_TRUSTED,DKIM_SIGNED,
 DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM shortcircuit=no
 autolearn=disabled version=3.4.4
X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on
 mailout.protonmail.ch
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: 44053
Cc: guix-devel <guix-devel@HIDDEN>,
 =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN>,
 "44053 <at> debbugs.gnu.org" <44053 <at> debbugs.gnu.org>,
 Maxim Cournoyer <maxim.cournoyer@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Reply-To: Luis Felipe <luis.felipe.la@HIDDEN>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90 Original Me=
ssage =E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90
On Tuesday, November 3, 2020 11:32 PM, zimoun <zimon.toutoune@HIDDEN> wr=
ote:

> Hi,
>
> > https://git.savannah.gnu.org/cgit/guix.git/commit/?id=3D76ea70bd70aeb76=
570445c11cea2f98139192b54
>
> Clever workaround! What are now the performances on previous examples
> (same profiles and same packages)?

In my case there seem to be no improvement (using Guix 5e7cf66fb35780f930ad=
0bc5fe21ac330df4411d).


$ time guix package -i perl --max-jobs=3D1
Se instalar=C3=A1 el siguiente paquete:
   perl 5.30.2

Se construir=C3=A1 la siguiente derivaci=C3=B3n:
   /gnu/store/48imlmfi2hjmp4ksyidvy99c31ahj44z-profile.drv

Se descargar=C3=A1n 0,6 MB
construyendo empaquetado de certificados de CA...
descargando de https://ci.guix.gnu.org/nar/lzip/j3f5hx6yvhlj3sapiipigkwg05b=
49nwn-freetype-2.10.4 ...
 freetype-2.10.4  555KiB                                       707KiB/s 00:=
01 [##################] 100.0%

injertando 5 paquetes en /gnu/store/s4s7xzswar962p9w1nvf0hfcgmnxyfsh-at-spi=
2-core-2.34.0.drv ...
injertando 1 paquete en /gnu/store/80n340f7bnba0ivp00z10a32rz8g8wsx-fontcon=
fig-2.13.1.drv ...
injertando 4 paquetes en /gnu/store/hm3a895l251mckzb9bhiglcwfb6xli5n-at-spi=
2-atk-2.34.1.drv ...
injertando 6 paquetes en /gnu/store/9vwl8s2h7rbfhvimsarzc1q4gnclwpk2-cairo-=
1.16.0.drv ...
injertando 6 paquetes en /gnu/store/k6gajkzfq4drpcrimbwxk1ls0h7z1nzw-cairo-=
1.16.0.drv ...
injertando 4 paquetes en /gnu/store/klq5sp427s80d0mhz3b5x48xpmhf3ila-gdk-pi=
xbuf-2.40.0.drv ...
injertando 5 paquetes en /gnu/store/ijkpcwanfpj02i0rxk4ys0kfdpj6sz69-ghosts=
cript-with-cups-9.52.drv ...
generando la cach=C3=A9 de esquemas de GLib...
injertando 2 paquetes en /gnu/store/kg8ca3wz01ibhbm5wk707r44jjnrxdg1-harfbu=
zz-2.6.4.drv ...
construyendo el directorio de manuales Info...
injertando 4 paquetes en /gnu/store/97bgi57qs077pcqggvr7di0vhchlshk2-libxft=
-2.3.3.drv ...
construyendo la base de datos de p=C3=A1ginas de manual...
injertando 1 paquete en /gnu/store/gb85hxzczf4m0crzwqpw2imxpr1d67nx-mkfonts=
cale-1.2.1.drv ...
injertando 9 paquetes en /gnu/store/ddiqkw9r0p1lhvqmdlcyrzf8v900pm4r-pango-=
1.42.4.drv ...
injertando 1 paquete en /gnu/store/xd0ca96gvh3vn9bp3bcmczczcxm0bynd-mkfontd=
ir-1.0.7.drv ...
injertando 11 paquetes en /gnu/store/s53s5qx304b90l0dp734lqi42whwd0vd-librs=
vg-2.40.21.drv ...
construyendo el directorio de tipograf=C3=ADas...
injertando 5 paquetes en /gnu/store/qg628jlnjmiyv964c0i4s7bbkwy32c6c-gdk-pi=
xbuf+svg-2.40.0.drv ...
injertando 8 paquetes en /gnu/store/1mj8cjf43nqd9r5151lqrf1sdd1sjg16-pango-=
1.44.7.drv ...
injertando 8 paquetes en /gnu/store/d42vnhn9grcsyiibdgkiryqb7rxhb89j-popple=
r-0.86.1.drv ...
construyendo la cach=C3=A9 de ficheros desktop XDG...
injertando 12 paquetes en /gnu/store/anknpdyhmfirw3rz2k9zm9kiyak8yy1s-cups-=
filters-1.27.4.drv ...
construyendo la base de datos MIME XDG...
injertando 3 paquetes en /gnu/store/xgny7xbl635g8na8x03x4cdr7abiphiw-cups-2=
.3.3.drv ...
injertando 20 paquetes en /gnu/store/yhjl68x7kcjbv40v823x4hl8rvv8l50b-gtk+-=
2.24.32.drv ...
injertando 21 paquetes en /gnu/store/kq37fnw8335f1hqc3j4hhqqcdnhl371p-gtk+-=
3.24.20.drv ...
creando la cach=C3=A9 de temas de iconos de GTK+...
construyendo los ficheros de cach=C3=A9 para los m=C3=A9todos de entrada de=
 GTK+...
construyendo perfil con 86 paquetes...


real=098m38,121s
user=090m2,742s
sys=090m0,338s




Information forwarded to bug-guix@HIDDEN:
bug#44053; Package guix. Full text available.

Message received at 44053 <at> debbugs.gnu.org:


Received: (at 44053) by debbugs.gnu.org; 3 Nov 2020 23:32:49 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue Nov 03 18:32:49 2020
Received: from localhost ([127.0.0.1]:46792 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1ka5nE-0007UR-Pc
	for submit <at> debbugs.gnu.org; Tue, 03 Nov 2020 18:32:49 -0500
Received: from mail-wr1-f54.google.com ([209.85.221.54]:39102)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <zimon.toutoune@HIDDEN>) id 1ka5nD-0007UD-2B
 for 44053 <at> debbugs.gnu.org; Tue, 03 Nov 2020 18:32:47 -0500
Received: by mail-wr1-f54.google.com with SMTP id y12so20182573wrp.6
 for <44053 <at> debbugs.gnu.org>; Tue, 03 Nov 2020 15:32:46 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;
 h=from:to:cc:subject:in-reply-to:references:date:message-id
 :mime-version:content-transfer-encoding;
 bh=BPJvZ+Lk8z1XZDoCVegR9fdlhNHTi8OMImZGhjWHLtw=;
 b=K3gKMvzqZUhFvrS2In7jJ4dro6x+QS9LgZYe806LTynYqDIEpbVnqohXjm8kvfNC3D
 8N30Y7Pn+9Qe8mmUhluOSnXHLSsR532/BmKDGsnOpgnAWD7l6k7U+RsiHQMm5EQywZuD
 B+4TTerHIYrrWnSmGxcO4fcR+tTjgn3Ve8VyYn33kYYyEhZNHZiUNaGotP9OJeDgwEu7
 XONBmARPLSzehyCRFm4CGk630hgTnqZrD78D8QS4dMH1ZtrYpTgC0A1qnsCoE0WbTQsS
 MpER8046U1/vWTNtBvn4ziY71i6sFC2ya6AP7AWXNoOZEnnQA/KMG/2yd+dXIJc3ygdz
 t5Nw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:from:to:cc:subject:in-reply-to:references:date
 :message-id:mime-version:content-transfer-encoding;
 bh=BPJvZ+Lk8z1XZDoCVegR9fdlhNHTi8OMImZGhjWHLtw=;
 b=Zwo87JFVJLCQttI05qlfpISPK+z7PF+rZVE3Su24A+vjZxPI0zGJoYCUXdCDa550u/
 +qcE0yH07JQ6xaQm/ns+RIhEbdaIUDk3HKFnGvWfSK5CXqoSiw+PZ390NcgfUljOSmt9
 sZdO16unMYzTMemnKYtf0iArkHQIWfOfs30hWUVlI7F1+fKsm497yf1vI+LKQXnrZdLC
 YuxV6qrjdGJdpcKE+iEp9LSar7WJ9OwjT48blzPqF5Gvtlv8LNN1awBJHnD5Awmydznc
 nqOVG2dEnthrYHZ63hjgaLbLUQP0oeC3oU57aGqQHFfLjiR8SUYLqUztS5nM+ZF7gydU
 d/mQ==
X-Gm-Message-State: AOAM532Msz1P8ztSjhuTx2FOMJG0UwheC7LCPbi/BBTmGnxgoFgceH88
 Nu5IESgEVJ+gxihCDACJBWg=
X-Google-Smtp-Source: ABdhPJwOKcSPkJXldWJgt/C6cPS6cMIVoaL7yOjhVjGGb+74+4jbnA73KbNbkdVk6Qkd/zH5n2rgnQ==
X-Received: by 2002:adf:e54c:: with SMTP id z12mr981398wrm.350.1604446361267; 
 Tue, 03 Nov 2020 15:32:41 -0800 (PST)
Received: from lili ([2a01:e0a:59b:9120:65d2:2476:f637:db1e])
 by smtp.gmail.com with ESMTPSA id a12sm210820wrr.31.2020.11.03.15.32.40
 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
 Tue, 03 Nov 2020 15:32:40 -0800 (PST)
From: zimoun <zimon.toutoune@HIDDEN>
To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>
Subject: Re: bug#44053: =?utf-8?Q?=E2=80=98xdg-mime-database=E2=80=99?=
 profile hook is slow
In-Reply-To: <87ft5rncn5.fsf@HIDDEN>
References: <87o8l7pple.fsf@HIDDEN>
 <sqv1qTRO4PZuOuanFOc1Dw6QlIMeczAQjg9erpoU9CmuWjuqYl7H87lpEfl7w2zNAT755yE_djMRXz8fKFiXZ8ddUJSdtLkSCoWIl9KREnw=@protonmail.com>
 <87h7qxhncq.fsf@HIDDEN>
 <3aQjRn5jGhxHrhAmuB3MfLRjSxAp3PVFu1vL7_GV1ucGibzYURCtMqHN4oeyGb5xez2xYM3loEJIECrVdnAGZBZvf0N1bGXN-80mO6Ymr6k=@protonmail.com>
 <87sgagv8qt.fsf@HIDDEN> <87o8l279eb.fsf@HIDDEN>
 <CAJ3okZ3DR0qDq5qwY-ZBboBUFcCnv5bAYR8RuUSW0dSj8SRyyA@HIDDEN>
 <4JD1z15e92ccv6WXcMS5IiNJnDwR6P3bkIwtPWLUPYDVCUHYDoekpifyj3GQtnEq1LCKftbL-FV1hp162A1mid2EmjLMbWlxQ05aE9vGyf0=@protonmail.com>
 <87v9f842uu.fsf@HIDDEN>
 <CAJ3okZ2WTcZ+JLYUCEcU6CESpOOjHcdFEWirSOCfrZFbXeLzAg@HIDDEN>
 <87v9f7gspm.fsf@HIDDEN> <874kmn9adz.fsf_-_@HIDDEN>
 <87ft5zqn2a.fsf@HIDDEN> <87sg9sm2qf.fsf@HIDDEN>
 <87ft5rncn5.fsf@HIDDEN>
Date: Wed, 04 Nov 2020 00:32:39 +0100
Message-ID: <86blgeggo8.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 44053
Cc: guix-devel <guix-devel@HIDDEN>,
 Luis Felipe <luis.felipe.la@HIDDEN>, 44053 <at> debbugs.gnu.org,
 Maxim Cournoyer <maxim.cournoyer@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Hi,

>   https://git.savannah.gnu.org/cgit/guix.git/commit/?id=3D76ea70bd70aeb76=
570445c11cea2f98139192b54

Clever workaround!  What are now the performances on previous examples
(same profiles and same packages)?


> Unfortunately, AIUI,
>
>   update-mime-database(X =E2=88=AA Y) =E2=89=A0 update-mime-database(X) =
=E2=88=AA update-mime-database(Y)

Hum?  Interesting=E2=80=A6 well weird!  If it is not a =E2=80=9Cmorphism=E2=
=80=9D then it is not
really an updater.  Anyway.

I am curious about the comparison:

   time(update-mime-database(X =E2=88=AA Y))
vs
   time(update-mime-database(X)) + time(update-mime-database(Y))
vs
   time(update-mime-database(X =E2=88=A9 Y))


> So it would seem we cannot simply used the pre-built database from
> =E2=80=98shared-mime-info=E2=80=99 and merge it with that of the other pa=
ckages, at
> least not without changing =E2=80=98update-mime-database=E2=80=99 or re-i=
mplementing
> parts of it on our side.

=E2=80=99shared-mime-info=E2=80=99 is simply a package, right?  So what doe=
s it means:
=C2=ABFind a way to avoid reprocessing 'shared-mime-info'=C2=BB in:

--8<---------------cut here---------------start------------->8---
                 ;; the database.  TODO: Find a way to avoid reprocessing
                 ;; 'shared-mime-info', which is the most expensive one.
[...]
                 (invoke #+(file-append shared-mime-info
                                        "/bin/update-mime-database")
                         destdir)))))))
--8<---------------cut here---------------end--------------->8---

?  Well, I miss why and how =E2=80=99shared-mime-info=E2=80=99 could be the=
 culprit here
or what could be improved with =E2=80=9Cshared-mime-info=E2=80=9D?  Maybe r=
eplace the
=E2=80=9Clazy reference=E2=80=9D by a strict one if it makes sense.


All the best,
simon




Information forwarded to bug-guix@HIDDEN:
bug#44053; Package guix. Full text available.

Message received at 44053 <at> debbugs.gnu.org:


Received: (at 44053) by debbugs.gnu.org; 2 Nov 2020 14:04:23 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Nov 02 09:04:23 2020
Received: from localhost ([127.0.0.1]:40201 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1kZaRb-0006eB-3U
	for submit <at> debbugs.gnu.org; Mon, 02 Nov 2020 09:04:23 -0500
Received: from eggs.gnu.org ([209.51.188.92]:32798)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <ludo@HIDDEN>) id 1kZaRZ-0006dx-J5
 for 44053 <at> debbugs.gnu.org; Mon, 02 Nov 2020 09:04:22 -0500
Received: from fencepost.gnu.org ([2001:470:142:3::e]:46568)
 by eggs.gnu.org with esmtp (Exim 4.90_1)
 (envelope-from <ludo@HIDDEN>)
 id 1kZaRU-0007vG-Ax; Mon, 02 Nov 2020 09:04:16 -0500
Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=51260 helo=ribbon)
 by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256)
 (Exim 4.82) (envelope-from <ludo@HIDDEN>)
 id 1kZaRT-0006O3-Pq; Mon, 02 Nov 2020 09:04:16 -0500
From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN>
To: zimoun <zimon.toutoune@HIDDEN>
Subject: Re: bug#44053: =?utf-8?Q?=E2=80=98xdg-mime-database=E2=80=99?=
 profile hook is slow
References: <87o8l7pple.fsf@HIDDEN>
 <sqv1qTRO4PZuOuanFOc1Dw6QlIMeczAQjg9erpoU9CmuWjuqYl7H87lpEfl7w2zNAT755yE_djMRXz8fKFiXZ8ddUJSdtLkSCoWIl9KREnw=@protonmail.com>
 <87h7qxhncq.fsf@HIDDEN>
 <3aQjRn5jGhxHrhAmuB3MfLRjSxAp3PVFu1vL7_GV1ucGibzYURCtMqHN4oeyGb5xez2xYM3loEJIECrVdnAGZBZvf0N1bGXN-80mO6Ymr6k=@protonmail.com>
 <87sgagv8qt.fsf@HIDDEN> <87o8l279eb.fsf@HIDDEN>
 <CAJ3okZ3DR0qDq5qwY-ZBboBUFcCnv5bAYR8RuUSW0dSj8SRyyA@HIDDEN>
 <4JD1z15e92ccv6WXcMS5IiNJnDwR6P3bkIwtPWLUPYDVCUHYDoekpifyj3GQtnEq1LCKftbL-FV1hp162A1mid2EmjLMbWlxQ05aE9vGyf0=@protonmail.com>
 <87v9f842uu.fsf@HIDDEN>
 <CAJ3okZ2WTcZ+JLYUCEcU6CESpOOjHcdFEWirSOCfrZFbXeLzAg@HIDDEN>
 <87v9f7gspm.fsf@HIDDEN> <874kmn9adz.fsf_-_@HIDDEN>
 <87ft5zqn2a.fsf@HIDDEN> <87sg9sm2qf.fsf@HIDDEN>
 <87ft5rncn5.fsf@HIDDEN>
Date: Mon, 02 Nov 2020 15:04:14 +0100
In-Reply-To: <87ft5rncn5.fsf@HIDDEN> ("Ludovic =?utf-8?Q?Court=C3=A8s=22'?=
 =?utf-8?Q?s?= message of "Mon, 02 Nov 2020 13:53:18 +0100")
Message-ID: <87blgflush.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: 44053
Cc: guix-devel <guix-devel@HIDDEN>,
 Luis Felipe <luis.felipe.la@HIDDEN>, 44053 <at> debbugs.gnu.org,
 Maxim Cournoyer <maxim.cournoyer@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

Ludovic Court=C3=A8s <ludo@HIDDEN> skribis:

> Ludovic Court=C3=A8s <ludo@HIDDEN> skribis:
>
>> Apart from LibreOffice, I found that =E2=80=98share/mime/packages=E2=80=
=99 is provided
>> by at least: hugin, gcr, fontforge.  Most GUI packages don=E2=80=99t hav=
e it.
>> So in practice, we=E2=80=99re often rebuilding the exact same database.
>
> On closer inspection, the time-consuming bit is processing
> =E2=80=98share/mime/packages/freedesktop.org.xml=E2=80=99 (from =E2=80=98=
shared-mime-info=E2=80=99),
> which is quite large and leads to the creation of hundreds of file.  We
> end up re-processing it every time.  This is particularly wasteful
> because the =E2=80=98shared-mime-info=E2=80=99 package already contains t=
he result of
> applying =E2=80=98update-mime-database=E2=80=99 to itself.

Based on these observations, I added a fast path to the
=E2=80=98xdg-mime-database=E2=80=99 hook:

  https://git.savannah.gnu.org/cgit/guix.git/commit/?id=3D76ea70bd70aeb7657=
0445c11cea2f98139192b54

It=E2=80=99s down to 0s in the common case where the profile doesn=E2=80=99=
t contain any
packages providing =E2=80=98share/mime/packages=E2=80=99.

Ludo=E2=80=99.




Information forwarded to bug-guix@HIDDEN:
bug#44053; Package guix. Full text available.

Message received at 44053 <at> debbugs.gnu.org:


Received: (at 44053) by debbugs.gnu.org; 2 Nov 2020 12:53:29 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Nov 02 07:53:29 2020
Received: from localhost ([127.0.0.1]:40054 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1kZZKz-0002he-Eu
	for submit <at> debbugs.gnu.org; Mon, 02 Nov 2020 07:53:29 -0500
Received: from eggs.gnu.org ([209.51.188.92]:34242)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <ludo@HIDDEN>) id 1kZZKw-0002hQ-TR
 for 44053 <at> debbugs.gnu.org; Mon, 02 Nov 2020 07:53:27 -0500
Received: from fencepost.gnu.org ([2001:470:142:3::e]:44481)
 by eggs.gnu.org with esmtp (Exim 4.90_1)
 (envelope-from <ludo@HIDDEN>)
 id 1kZZKr-0005gA-1d; Mon, 02 Nov 2020 07:53:21 -0500
Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=50918 helo=ribbon)
 by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256)
 (Exim 4.82) (envelope-from <ludo@HIDDEN>)
 id 1kZZKq-0008U8-H5; Mon, 02 Nov 2020 07:53:20 -0500
From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN>
To: zimoun <zimon.toutoune@HIDDEN>
Subject: Re: bug#44053: =?utf-8?Q?=E2=80=98xdg-mime-database=E2=80=99?=
 profile hook is slow
References: <87o8l7pple.fsf@HIDDEN>
 <sqv1qTRO4PZuOuanFOc1Dw6QlIMeczAQjg9erpoU9CmuWjuqYl7H87lpEfl7w2zNAT755yE_djMRXz8fKFiXZ8ddUJSdtLkSCoWIl9KREnw=@protonmail.com>
 <87h7qxhncq.fsf@HIDDEN>
 <3aQjRn5jGhxHrhAmuB3MfLRjSxAp3PVFu1vL7_GV1ucGibzYURCtMqHN4oeyGb5xez2xYM3loEJIECrVdnAGZBZvf0N1bGXN-80mO6Ymr6k=@protonmail.com>
 <87sgagv8qt.fsf@HIDDEN> <87o8l279eb.fsf@HIDDEN>
 <CAJ3okZ3DR0qDq5qwY-ZBboBUFcCnv5bAYR8RuUSW0dSj8SRyyA@HIDDEN>
 <4JD1z15e92ccv6WXcMS5IiNJnDwR6P3bkIwtPWLUPYDVCUHYDoekpifyj3GQtnEq1LCKftbL-FV1hp162A1mid2EmjLMbWlxQ05aE9vGyf0=@protonmail.com>
 <87v9f842uu.fsf@HIDDEN>
 <CAJ3okZ2WTcZ+JLYUCEcU6CESpOOjHcdFEWirSOCfrZFbXeLzAg@HIDDEN>
 <87v9f7gspm.fsf@HIDDEN> <874kmn9adz.fsf_-_@HIDDEN>
 <87ft5zqn2a.fsf@HIDDEN> <87sg9sm2qf.fsf@HIDDEN>
Date: Mon, 02 Nov 2020 13:53:18 +0100
In-Reply-To: <87sg9sm2qf.fsf@HIDDEN> ("Ludovic =?utf-8?Q?Court=C3=A8s=22'?=
 =?utf-8?Q?s?= message of "Mon, 02 Nov 2020 12:12:40 +0100")
Message-ID: <87ft5rncn5.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: 44053
Cc: guix-devel <guix-devel@HIDDEN>,
 Luis Felipe <luis.felipe.la@HIDDEN>, 44053 <at> debbugs.gnu.org,
 Maxim Cournoyer <maxim.cournoyer@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

Ludovic Court=C3=A8s <ludo@HIDDEN> skribis:

> Apart from LibreOffice, I found that =E2=80=98share/mime/packages=E2=80=
=99 is provided
> by at least: hugin, gcr, fontforge.  Most GUI packages don=E2=80=99t have=
 it.
> So in practice, we=E2=80=99re often rebuilding the exact same database.

On closer inspection, the time-consuming bit is processing
=E2=80=98share/mime/packages/freedesktop.org.xml=E2=80=99 (from =E2=80=98sh=
ared-mime-info=E2=80=99),
which is quite large and leads to the creation of hundreds of file.  We
end up re-processing it every time.  This is particularly wasteful
because the =E2=80=98shared-mime-info=E2=80=99 package already contains the=
 result of
applying =E2=80=98update-mime-database=E2=80=99 to itself.

Unfortunately, AIUI,

  update-mime-database(X =E2=88=AA Y) =E2=89=A0 update-mime-database(X) =E2=
=88=AA update-mime-database(Y)

(For example, the files
=E2=80=98share/mime/{globs,magic,XMLnamespaces,subclasses,aliases,types,gen=
eric-icons,icons,treemagic,mime.cache}=E2=80=99
concatenate info from X and Y.)

So it would seem we cannot simply used the pre-built database from
=E2=80=98shared-mime-info=E2=80=99 and merge it with that of the other pack=
ages, at
least not without changing =E2=80=98update-mime-database=E2=80=99 or re-imp=
lementing
parts of it on our side.

Ludo=E2=80=99.




Information forwarded to bug-guix@HIDDEN:
bug#44053; Package guix. Full text available.

Message received at 44053 <at> debbugs.gnu.org:


Received: (at 44053) by debbugs.gnu.org; 2 Nov 2020 11:12:56 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Nov 02 06:12:56 2020
Received: from localhost ([127.0.0.1]:39896 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1kZXlf-0004Gr-S3
	for submit <at> debbugs.gnu.org; Mon, 02 Nov 2020 06:12:56 -0500
Received: from eggs.gnu.org ([209.51.188.92]:42078)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <ludo@HIDDEN>) id 1kZXle-0004Gf-1e
 for 44053 <at> debbugs.gnu.org; Mon, 02 Nov 2020 06:12:54 -0500
Received: from fencepost.gnu.org ([2001:470:142:3::e]:43453)
 by eggs.gnu.org with esmtp (Exim 4.90_1)
 (envelope-from <ludo@HIDDEN>)
 id 1kZXlY-0003Tm-KS; Mon, 02 Nov 2020 06:12:48 -0500
Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=50808 helo=ribbon)
 by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256)
 (Exim 4.82) (envelope-from <ludo@HIDDEN>)
 id 1kZXlS-0007Sp-OZ; Mon, 02 Nov 2020 06:12:44 -0500
From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN>
To: zimoun <zimon.toutoune@HIDDEN>
Subject: Re: bug#44053: =?utf-8?Q?=E2=80=98xdg-mime-database=E2=80=99?=
 profile hook is slow
References: <87o8l7pple.fsf@HIDDEN>
 <sqv1qTRO4PZuOuanFOc1Dw6QlIMeczAQjg9erpoU9CmuWjuqYl7H87lpEfl7w2zNAT755yE_djMRXz8fKFiXZ8ddUJSdtLkSCoWIl9KREnw=@protonmail.com>
 <87h7qxhncq.fsf@HIDDEN>
 <3aQjRn5jGhxHrhAmuB3MfLRjSxAp3PVFu1vL7_GV1ucGibzYURCtMqHN4oeyGb5xez2xYM3loEJIECrVdnAGZBZvf0N1bGXN-80mO6Ymr6k=@protonmail.com>
 <87sgagv8qt.fsf@HIDDEN> <87o8l279eb.fsf@HIDDEN>
 <CAJ3okZ3DR0qDq5qwY-ZBboBUFcCnv5bAYR8RuUSW0dSj8SRyyA@HIDDEN>
 <4JD1z15e92ccv6WXcMS5IiNJnDwR6P3bkIwtPWLUPYDVCUHYDoekpifyj3GQtnEq1LCKftbL-FV1hp162A1mid2EmjLMbWlxQ05aE9vGyf0=@protonmail.com>
 <87v9f842uu.fsf@HIDDEN>
 <CAJ3okZ2WTcZ+JLYUCEcU6CESpOOjHcdFEWirSOCfrZFbXeLzAg@HIDDEN>
 <87v9f7gspm.fsf@HIDDEN> <874kmn9adz.fsf_-_@HIDDEN>
 <87ft5zqn2a.fsf@HIDDEN>
Date: Mon, 02 Nov 2020 12:12:40 +0100
In-Reply-To: <87ft5zqn2a.fsf@HIDDEN> (Joshua Branson's message of "Tue, 27
 Oct 2020 19:14:05 -0400")
Message-ID: <87sg9sm2qf.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: 44053
Cc: guix-devel <guix-devel@HIDDEN>,
 Luis Felipe <luis.felipe.la@HIDDEN>, 44053 <at> debbugs.gnu.org,
 Maxim Cournoyer <maxim.cournoyer@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

Hi,

Joshua Branson <jbranso@HIDDEN> skribis:

> The "XDG MIME database" takes a while.
>
> #+BEGIN_SRC sh :results output :exports both
> time guix build --check $(guix gc -R $(guix gc --derivers $(readlink -f ~=
/.guix-profile)) |grep xdg-mime-database.drv)
> #+END_SRC
>
>
> #+RESULTS:
> : The following profile hook will be built:
> :    /gnu/store/lmhklgdscbfp5c6gl81skyz0azfg156m-xdg-mime-database.drv
> : building XDG MIME database...
> : successfully built /gnu/store/lmhklgdscbfp5c6gl81skyz0azfg156m-xdg-mime=
-database.drv
> : successfully built /gnu/store/lmhklgdscbfp5c6gl81skyz0azfg156m-xdg-mime=
-database.drv
> : /gnu/store/x8q8g9l0jhrpmjjm3xsh3ib1z8l79cyx-xdg-mime-database
> :
> : real	0m43.716s
> : user	0m3.626s
> : sys	0m0.258s

I found that the MIME database is computed only over the subset of the
packages in your profile that provide =E2=80=98share/mime/packages=E2=80=99=
, plus
=E2=80=98shared-mime-info=E2=80=99.

In my profile, only LibreOffice provides that directory, so the union is
made over these two directories and that=E2=80=99s what =E2=80=98update-mim=
e-database=E2=80=99
works on.

Apart from LibreOffice, I found that =E2=80=98share/mime/packages=E2=80=99 =
is provided
by at least: hugin, gcr, fontforge.  Most GUI packages don=E2=80=99t have i=
t.
So in practice, we=E2=80=99re often rebuilding the exact same database.

Here=E2=80=99s the time taken by =E2=80=98update-mime-database=E2=80=99 alo=
ne:

--8<---------------cut here---------------start------------->8---
ludo@ribbon ~$ mkdir -p /tmp/mime/share/mime/packages
ludo@ribbon ~$ cd /tmp/mime/share/mime/packages
ludo@ribbon /tmp/mime/share/mime/packages$ for i in $(guix build libreoffic=
e ^C
ludo@ribbon /tmp/mime/share/mime/packages$ for i in ~/.guix-profile/share/m=
ime/packages/* ; do ln -s $i ; done
ludo@ribbon /tmp/mime/share/mime/packages$ ls -l
totalo 8
lrwxrwxrwx 1 ludo users 64 Nov  2 11:46 freedesktop.org.xml -> /home/ludo/.=
guix-profile/share/mime/packages/freedesktop.org.xml
lrwxrwxrwx 1 ludo users 60 Nov  2 11:46 libreoffice.xml -> /home/ludo/.guix=
-profile/share/mime/packages/libreoffice.xml
ludo@ribbon /tmp/mime/share/mime/packages$ cd /tmp/mime/
ludo@ribbon /tmp/mime$ time update-mime-database -V /tmp/mime/share/mime
Updating MIME database in /tmp/mime/share/mime...

Parsing source file /tmp/mime/share/mime/packages/freedesktop.org.xml...
Parsing source file /tmp/mime/share/mime/packages/libreoffice.xml...
Wrote 1124 strings at 2c - 6310
Wrote aliases at 6310 - 6be4
Wrote parents at 6be4 - 8468
Wrote literal globs at 8468 - 855c
Wrote suffix globs at 855c - 13514
Wrote full globs at 13514 - 13554
Wrote magic at 13554 - 2065c
Wrote namespace list at 2065c - 20798
Wrote icons list at 20798 - 2079c
Wrote generic icons list at 2079c - 213b8
Wrote types list at 213b8 - 22020

Note that '/tmp/mime/share' is not in the search path
set by the XDG_DATA_HOME and XDG_DATA_DIRS
environment variables, so applications may not
be able to find it until you set them. The
directories currently searched are:

- /home/ludo/.local/share
- /home/ludo/.guix-profile/share
- /run/current-system/profile/share
- /home/ludo/.guix-profile/share
- /run/current-system/profile/share


real    0m2.166s
user    0m0.278s
sys     0m0.056s
--8<---------------cut here---------------end--------------->8---

To be compared with:

--8<---------------cut here---------------start------------->8---
$ drv=3D"$(guix gc -R $(guix gc --derivers $(readlink -f ~/.guix-profile)) =
|grep xdg-mime-database.drv)"
$ time guix build --check $drv
The following profile hook will be built:
   /gnu/store/jrmwsxpz3wmq37zx29lvb0r9nvcmdviz-xdg-mime-database.drv
building XDG MIME database...
successfully built /gnu/store/jrmwsxpz3wmq37zx29lvb0r9nvcmdviz-xdg-mime-dat=
abase.drv
/gnu/store/npvj2sr9kxx48znh7zc8zmzwzs6brc90-xdg-mime-database

real    0m3.670s
user    0m1.428s
sys     0m0.029s
--8<---------------cut here---------------end--------------->8---

Thus, the build time itself is entirely taken by =E2=80=98update-mime-datab=
ase=E2=80=99
(the 1.4s above is =E2=80=9Coverhead=E2=80=9D in =E2=80=98guix build=E2=80=
=99 it would seem).

Ludo=E2=80=99.




Information forwarded to bug-guix@HIDDEN:
bug#44053; Package guix. Full text available.
Severity set to 'important' from 'normal' Request was from Ludovic Courtès <ludo@HIDDEN> to control <at> debbugs.gnu.org. Full text available.

Message received at 44053 <at> debbugs.gnu.org:


Received: (at 44053) by debbugs.gnu.org; 28 Oct 2020 21:48:22 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed Oct 28 17:48:22 2020
Received: from localhost ([127.0.0.1]:51041 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1kXtIr-00029x-R2
	for submit <at> debbugs.gnu.org; Wed, 28 Oct 2020 17:48:22 -0400
Received: from mail-40132.protonmail.ch ([185.70.40.132]:20156)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <luis.felipe.la@HIDDEN>) id 1kXtIq-00029k-QV
 for 44053 <at> debbugs.gnu.org; Wed, 28 Oct 2020 17:48:21 -0400
Date: Wed, 28 Oct 2020 21:48:03 +0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com;
 s=protonmail; t=1603921694;
 bh=gCIid5pTIPBdHqHtoEIdM4CvAo4fOHLBWc4g0RkuqQM=;
 h=Date:To:From:Cc:Reply-To:Subject:In-Reply-To:References:From;
 b=vZZzwnYDQaD0HmVH1eH1qQ0z0+oByySHhJ0eTfRyvvJnQshlEWHfFtoDbGgLMLZjL
 bVpL2K2o4P9eUntNB8z8Q1jg/LWTxNpmayZUeBL4SIrH2Tg19V398XnA4SbJBRHGR8
 RdvGGYd6+jLpcB8HqJnwo4r5aFJ3uIqW6/LTw2T0=
To: Joshua Branson <jbranso@HIDDEN>
From: Luis Felipe <luis.felipe.la@HIDDEN>
Subject: =?utf-8?Q?Re:_=E2=80=98xdg-mime-database=E2=80=99_profile_hook_is_slow?=
Message-ID: <teuOd2Q7Dbrx6oqUwBMU0LqyBVxb35-URBXKJ0OS0xjTrTxUYpoeKt5hTCxbfNWxDVq94Ez3Z2X0K-hPxzHJJczuP8PT8zL-SvDNYu5Bpu0=@protonmail.com>
In-Reply-To: <87ft5zqn2a.fsf@HIDDEN>
References: <87o8l7pple.fsf@HIDDEN> <87o8l279eb.fsf@HIDDEN>
 <CAJ3okZ3DR0qDq5qwY-ZBboBUFcCnv5bAYR8RuUSW0dSj8SRyyA@HIDDEN>
 <4JD1z15e92ccv6WXcMS5IiNJnDwR6P3bkIwtPWLUPYDVCUHYDoekpifyj3GQtnEq1LCKftbL-FV1hp162A1mid2EmjLMbWlxQ05aE9vGyf0=@protonmail.com>
 <87v9f842uu.fsf@HIDDEN>
 <CAJ3okZ2WTcZ+JLYUCEcU6CESpOOjHcdFEWirSOCfrZFbXeLzAg@HIDDEN>
 <87v9f7gspm.fsf@HIDDEN> <874kmn9adz.fsf_-_@HIDDEN>
 <87ft5zqn2a.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Status: No, score=-1.2 required=10.0 tests=ALL_TRUSTED,DKIM_SIGNED,
 DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM shortcircuit=no
 autolearn=disabled version=3.4.4
X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on
 mailout.protonmail.ch
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 44053
Cc: guix-devel <guix-devel@HIDDEN>,
 =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN>,
 "44053 <at> debbugs.gnu.org" <44053 <at> debbugs.gnu.org>,
 Maxim Cournoyer <maxim.cournoyer@HIDDEN>, zimoun <zimon.toutoune@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Reply-To: Luis Felipe <luis.felipe.la@HIDDEN>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90 Original Me=
ssage =E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90
On Tuesday, October 27, 2020 11:14 PM, Joshua Branson <jbranso@HIDDEN> =
wrote:

[...]

>
> #+BEGIN_SRC sh :results output :exports both
> time guix build --check $(guix gc -R $(guix gc --derivers $(readlink -f ~=
/.guix-profile)) |grep xdg-mime-database.drv)
> #+END_SRC


I haven't run this command because I don't know what it does (how will it a=
ffect my profile?), but if you think the results from this command would be=
 more useful than what I posted to issue #44053, please let me know and I'l=
l run it.




Information forwarded to bug-guix@HIDDEN:
bug#44053; Package guix. Full text available.

Message received at 44053 <at> debbugs.gnu.org:


Received: (at 44053) by debbugs.gnu.org; 27 Oct 2020 23:14:29 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue Oct 27 19:14:29 2020
Received: from localhost ([127.0.0.1]:46355 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1kXYAe-0004n8-Ia
	for submit <at> debbugs.gnu.org; Tue, 27 Oct 2020 19:14:29 -0400
Received: from mx1.dismail.de ([78.46.223.134]:32363)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <jbranso@HIDDEN>) id 1kXYAU-0004mn-3O
 for 44053 <at> debbugs.gnu.org; Tue, 27 Oct 2020 19:14:27 -0400
Received: from mx1.dismail.de (localhost [127.0.0.1])
 by mx1.dismail.de (OpenSMTPD) with ESMTP id 427384a9;
 Wed, 28 Oct 2020 00:14:11 +0100 (CET)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed; d=dismail.de; h=from:to:cc
 :subject:references:date:in-reply-to:message-id:mime-version
 :content-type; s=20190914; bh=M2pq+b9H9kv3D0JuF1XnqCyMWqX32IIh7d
 8Tef2jogM=; b=M6b7hF4t5seLq8i6/NnqosaRFGZJk5l5WGoA8gTpHpa8Eo6V6F
 SEGwXUoiYNRtr+Ee0KfDWuwId4pmey5Zb+3sPOp/A0jQI9MPnnlaMLylqoQCIltj
 9UQUgfTowC66ctuwRY9D51VEirHDyDg4XXb3K5uinILs7HMxyXFl+akcBEd5o0n4
 pjH7PjxO6YQJMa02T4MuRLy1UubSHyHNmbr4KgIOdcUmaiDQGHMbfox9Zdw0rsr6
 0vDg4l4+XK44mccFgJZ64zAl9HX+CmQNq92Xbpbl80BOm9uPSB94QcWGrE3I9eCy
 0p0mVO05UG86bEqs8i9+3MO8rPGvx3WwhyAQ==
Received: from smtp2.dismail.de (<unknown> [10.240.26.12])
 by mx1.dismail.de (OpenSMTPD) with ESMTP id 8746049c;
 Wed, 28 Oct 2020 00:14:11 +0100 (CET)
Received: from smtp2.dismail.de (localhost [127.0.0.1])
 by smtp2.dismail.de (OpenSMTPD) with ESMTP id 965be6a9;
 Wed, 28 Oct 2020 00:14:10 +0100 (CET)
Received: by dismail.de (OpenSMTPD) with ESMTPSA id b962aa05
 (TLSv1.3:AEAD-AES256-GCM-SHA384:256:NO); 
 Wed, 28 Oct 2020 00:14:10 +0100 (CET)
From: Joshua Branson <jbranso@HIDDEN>
To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>
Subject: Re: =?utf-8?Q?=E2=80=98xdg-mime-database=E2=80=99?= profile hook is
 slow
References: <87o8l7pple.fsf@HIDDEN>
 <sqv1qTRO4PZuOuanFOc1Dw6QlIMeczAQjg9erpoU9CmuWjuqYl7H87lpEfl7w2zNAT755yE_djMRXz8fKFiXZ8ddUJSdtLkSCoWIl9KREnw=@protonmail.com>
 <87h7qxhncq.fsf@HIDDEN>
 <3aQjRn5jGhxHrhAmuB3MfLRjSxAp3PVFu1vL7_GV1ucGibzYURCtMqHN4oeyGb5xez2xYM3loEJIECrVdnAGZBZvf0N1bGXN-80mO6Ymr6k=@protonmail.com>
 <87sgagv8qt.fsf@HIDDEN> <87o8l279eb.fsf@HIDDEN>
 <CAJ3okZ3DR0qDq5qwY-ZBboBUFcCnv5bAYR8RuUSW0dSj8SRyyA@HIDDEN>
 <4JD1z15e92ccv6WXcMS5IiNJnDwR6P3bkIwtPWLUPYDVCUHYDoekpifyj3GQtnEq1LCKftbL-FV1hp162A1mid2EmjLMbWlxQ05aE9vGyf0=@protonmail.com>
 <87v9f842uu.fsf@HIDDEN>
 <CAJ3okZ2WTcZ+JLYUCEcU6CESpOOjHcdFEWirSOCfrZFbXeLzAg@HIDDEN>
 <87v9f7gspm.fsf@HIDDEN> <874kmn9adz.fsf_-_@HIDDEN>
Mail-Followup-To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>, zimoun
 <zimon.toutoune@HIDDEN>, guix-devel <guix-devel@HIDDEN>, Luis
 Felipe <luis.felipe.la@HIDDEN>, Maxim Cournoyer
 <maxim.cournoyer@HIDDEN>, 44053 <at> debbugs.gnu.org
Date: Tue, 27 Oct 2020 19:14:05 -0400
In-Reply-To: <874kmn9adz.fsf_-_@HIDDEN> ("Ludovic =?utf-8?Q?Court=C3=A8s?=
 =?utf-8?Q?=22's?= message of "Wed, 21 Oct 2020 11:49:28 +0200")
Message-ID: <87ft5zqn2a.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: -1.8 (-)
X-Debbugs-Envelope-To: 44053
Cc: guix-devel <guix-devel@HIDDEN>,
 Luis Felipe <luis.felipe.la@HIDDEN>, 44053 <at> debbugs.gnu.org,
 Maxim Cournoyer <maxim.cournoyer@HIDDEN>, zimoun <zimon.toutoune@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.8 (--)



I am just posting my performance numbers.  Hopefully you all find it helpful.
I am running Guix System on a Lenovo Thinkpad T400 with 8GB on a hard drive.

#+BEGIN_SRC sh :results output :exports both
guix describe
#+END_SRC

#+RESULTS:
#+begin_example
Generation 49	Oct 20 2020 01:15:33	(current)
  my-personal-packages 547d900
    repository URL: https://notabug.org/jbranso/guix-packages.git
    branch: master
    commit: 547d900c25d2bb9490946162e0fcb315d6bace68
  guix 93c2518
    repository URL: https://git.savannah.gnu.org/git/guix.git
    branch: master
    commit: 93c251818dcd2bf5f60f42e595504293ee83371a

GUIX_PACKAGE_PATH="/home/joshua/prog/gnu/guix/guix-packages/"
#+end_example

The "XDG MIME database" takes a while.

#+BEGIN_SRC sh :results output :exports both
time guix build --check $(guix gc -R $(guix gc --derivers $(readlink -f ~/.guix-profile)) |grep xdg-mime-database.drv)
#+END_SRC

#+RESULTS:
: The following profile hook will be built:
:    /gnu/store/lmhklgdscbfp5c6gl81skyz0azfg156m-xdg-mime-database.drv
: building XDG MIME database...
: successfully built /gnu/store/lmhklgdscbfp5c6gl81skyz0azfg156m-xdg-mime-database.drv
: successfully built /gnu/store/lmhklgdscbfp5c6gl81skyz0azfg156m-xdg-mime-database.drv
: /gnu/store/x8q8g9l0jhrpmjjm3xsh3ib1z8l79cyx-xdg-mime-database
:
: real	0m43.716s
: user	0m3.626s
: sys	0m0.258s

Cold cache:

#+BEGIN_SRC sh :results output :exports both
drv="$(guix gc -R $(guix gc --derivers $(readlink -f ~/.guix-profile)) |grep xdg-mime-database.drv)"
sudo sh -c 'echo 3 > /proc/sys/vm/drop_caches'

time guix build --check "$drv"
#+END_SRC

#+RESULTS:
: The following profile hook will be built:
:    /gnu/store/lmhklgdscbfp5c6gl81skyz0azfg156m-xdg-mime-database.drv
: building XDG MIME database...
: successfully built /gnu/store/lmhklgdscbfp5c6gl81skyz0azfg156m-xdg-mime-database.drv
: successfully built /gnu/store/lmhklgdscbfp5c6gl81skyz0azfg156m-xdg-mime-database.drv
: /gnu/store/x8q8g9l0jhrpmjjm3xsh3ib1z8l79cyx-xdg-mime-database
:
: real	1m29.606s
: user	0m1.401s
: sys	0m0.238s

I have 64 packages in my profile.

#+BEGIN_SRC sh :results output :exports both
guix package -I | wc --lines
#+END_SRC

#+RESULTS:
: 64

If you want to see all packages:

#+BEGIN_SRC sh :results output :exports both
guix package -I
#+END_SRC

#+RESULTS:
#+begin_example
guile-colorized	0.1	out	/gnu/store/5h0jfssgyx49cq82wrmw57an7ngb7kkz-guile-colorized-0.1
font-hack	3.003	out	/gnu/store/52r8anazd4rnkq9m3vxk700jga5h0i74-font-hack-3.003
font-dejavu	2.37	out	/gnu/store/7y3lvk3xf4im8n44337mc6y0ccysvfia-font-dejavu-2.37
font-adobe-source-code-pro	2.030R-ro-1.050R-it	out	/gnu/store/l5m74158njcan3p784gqhkir6zyk0bcp-font-adobe-source-code-pro-2.030R-ro-1.050R-it
sicp	20170703-1.225c172	out	/gnu/store/x2safq6fvcbhp2rljny89qiq74y1xd13-sicp-20170703-1.225c172
unzip	6.0	out	/gnu/store/1zx8knb7h79q6cr4kwhbz6z6v609309w-unzip-6.0
font-google-noto	20171025	out	/gnu/store/g2szydnbvs7qqy2nf7qylba0rapajmd8-font-google-noto-20171025
font-awesome	4.7.0	out	/gnu/store/gknn01i1nr80apmcx42w36cqcz3zzri2-font-awesome-4.7.0
texinfo	6.7	out	/gnu/store/w8k9hcigvhzrlrblv8lgqj77sm3833rs-texinfo-6.7
gcc-toolchain	10.2.0	out	/gnu/store/pknm43xsza6nlc7bn27djip8fis92akd-gcc-toolchain-10.2.0
recutils	1.8	out	/gnu/store/qlx179h9mfdv4zywx2ias2jmkygvs834-recutils-1.8
guile-readline	3.0.2	out	/gnu/store/va6l1ivclww22fi38w5h99pb4ndn99hg-guile-readline-3.0.2
gtypist	2.9.5	out	/gnu/store/03wd707lyz49f2r14cm9ybyzh7vfvi0j-gtypist-2.9.5
scsh	0.0.0-1.1144324	out	/gnu/store/57frd08q6gyd7ysq3aqwlxxmify3w53h-scsh-0.0.0-1.1144324
make	4.3	out	/gnu/store/4k33n2nhsnnaxk2ip75gj7xiqdjns5hq-make-4.3
isync	1.3.3	out	/gnu/store/745qmx9mmnwq0j3zrd50qcdd2bgv5clz-isync-1.3.3
jmacs	27.1	out	/gnu/store/0hqdddkvhi2acxjdssdi5as3wj6cgvnz-jmacs-27.1
glibc-locales	2.31	out	/gnu/store/x9c4dk4zc9mi5j9hm3lq1q539kkdhkln-glibc-locales-2.31
guile	3.0.4	out	/gnu/store/ah16zr8mmfkqy23rr7jy5a842ca1q9h1-guile-3.0.4
guile-json	4.3.2	out	/gnu/store/12y1s0p3585ydf336gq85kjh5217pnzp-guile-json-4.3.2
guile-syntax-highlight	0.1	out	/gnu/store/dwjqscckpypqfq38hc97x5ipc9fplpp9-guile-syntax-highlight-0.1
haunt	0.2.4	out	/gnu/store/ccvqa9a6yclgkpi9izhpgf1vgjaghqvr-haunt-0.2.4
gnutls	3.6.14	out	/gnu/store/0f6agk6xk8rcz99907d39nd1vzmc4abq-gnutls-3.6.14
wget	1.20.3	out	/gnu/store/d7b16jqrgb1jz65hl7vnz261dbxmjh3s-wget-1.20.3
gnupg	2.2.23	out	/gnu/store/89cjqnar4aacg58wl6cm1h41rym9mv4l-gnupg-2.2.23
sassc	3.6.1	out	/gnu/store/6pqn2i0r12ypss13mdvsypskkcpaagji-sassc-3.6.1
qterminal	0.15.0	out	/gnu/store/y7qrfa78y785xfajb3gvvhwcm2d02l81-qterminal-0.15.0
dmenu	5.0	out	/gnu/store/393frjc5xjaab6nvp3wxpajb1rc6gynr-dmenu-5.0
openssh	8.4p1	out	/gnu/store/k8lnv9cqk6m15k18hhzg7w696r1vxx1v-openssh-8.4p1
grim	1.3.1	out	/gnu/store/9v5i9q7kwcmq1q31qri0icjkhh3csh9r-grim-1.3.1
evince	3.36.5	out	/gnu/store/arwvpbrzsch4w6afkpqln6625dfl0bz8-evince-3.36.5
pulseaudio	13.0	out	/gnu/store/19wcjfwdr3hzq1a4wcpld1zdrjichck0-pulseaudio-13.0
libreoffice	6.4.6.2	out	/gnu/store/7rbk52nzqmakd5whds5a6f07xrd2k870-libreoffice-6.4.6.2
termite	15	out	/gnu/store/8lqfy0mxqnq3xg24gwsxvzpxnvv6firh-termite-15
mpv	0.32.0	out	/gnu/store/2i2gzn7fa8qq0f1jkqhiyl0xw63fjr4w-mpv-0.32.0
pinentry	1.1.0	out	/gnu/store/bdsk9yq48lx1f7y7xr9sv4yrmm4ync9b-pinentry-1.1.0
glib	2.62.6	doc	/gnu/store/ql2226knbh4q04bbdiqcppvs5rjyl3ga-glib-2.62.6-doc
pidgin	2.13.0	out	/gnu/store/fd06njmc5maid7b474v224iazy7bc20h-pidgin-2.13.0
gimp	2.10.20	out	/gnu/store/m397hvwhsd0l6v5d0vqxxkm4iyp0p9w3-gimp-2.10.20
sway	1.4	out	/gnu/store/27ggd92in0hpgmkgk79n2iy4angjxwvl-sway-1.4
wf-recorder	0.2.1	out	/gnu/store/glc6y75l4czpfyrgbrbgxg38ig004v1p-wf-recorder-0.2.1
wofi	1.1.2	out	/gnu/store/qaylx0k6wg3awsamn2rqr41q9c8iwypg-wofi-1.1.2
linphoneqt	4.1.1	out	/gnu/store/wlcviacpagxqnw1737x131if0fj7kzjv-linphoneqt-4.1.1
qbittorrent	4.2.5	out	/gnu/store/29cjbdmz809pdvmylbx307l2p7zv0ma9-qbittorrent-4.2.5
pavucontrol	4.0	out	/gnu/store/0ilm4lncr6gpg4h3zdvaxg1pibkm6934-pavucontrol-4.0
git	2.28.0	send-email	/gnu/store/g5x559qk5yxs19jcxqplqv8b9y32vak2-git-2.28.0-send-email
flatpak	1.8.2	out	/gnu/store/ywfsnccvlr0j6afb5vnl3z4ismvcfbz6-flatpak-1.8.2
xdg-desktop-portal	1.7.2	out	/gnu/store/jkjx5dd7s3dp58p2hwsm8n2rm15z90ys-xdg-desktop-portal-1.7.2
xdg-desktop-portal-gtk	1.7.1	out	/gnu/store/zhssisyp66vggjnqi5y8nb1xnk55vnw1-xdg-desktop-portal-gtk-1.7.1
xeyes	1.1.2	out	/gnu/store/4jx8i19xd94d421n4acy2c1p0nn9h6d0-xeyes-1.1.2
emacs-polymode	0.2	out	/gnu/store/gmm1y1xahg44yw9ghsf0kwd40w86q7mf-emacs-polymode-0.2
notmuch	0.31	out	/gnu/store/0js5dwj8nxj0x0hxfllgzz4zxlsmyrz4-notmuch-0.31
msmtp	1.8.12	out	/gnu/store/s1g4nskvnsx9ww0032xg23548h7mnwvq-msmtp-1.8.12
youtube-viewer	3.7.9	out	/gnu/store/jm7q53lpda3a4rs2z7xv7cgig7adpncb-youtube-viewer-3.7.9
guile-curl	0.6	out	/gnu/store/9nnclxjxakwx9yc381arqrk1nhld21b5-guile-curl-0.6
qemu	5.1.0	out	/gnu/store/qzi36f60d2zlrdj9mg6b5y4i00w1fzfq-qemu-5.1.0
icecat	78.3.1-guix0-preview1	out	/gnu/store/71fkykdajhkshsvzwrnqm4lsc6qgycg2-icecat-78.3.1-guix0-preview1
git	2.28.0	out	/gnu/store/j66k3x1wz0bc6nh09dwa6i4jwahqcabi-git-2.28.0
guix	1.1.0-29.4e3ed9b	out	/gnu/store/irirj169rncank4y7i6n8qyiiqbs76qr-guix-1.1.0-29.4e3ed9b
ffmpeg	4.3.1	out	/gnu/store/sg4yq9i0v1lphvs1vx33dw9mn801adrd-ffmpeg-4.3.1
pavucontrol-qt	0.15.0	out	/gnu/store/9d0zp4wps5kpbqsl4yvjb96spb5xwz9b-pavucontrol-qt-0.15.0
clementine	1.3.1-2.4619a4c	out	/gnu/store/5392fysgmmi2jmn98maz9ihzn9ahzhw9-clementine-1.3.1-2.4619a4c
mako	1.4	out	/gnu/store/k83v9wz6szf6k2p2sz1amvwqm687j3h2-mako-1.4
ungoogled-chromium	86.0.4240.75-0.c34a56d	out	/gnu/store/m0s9mrbirbssis5nn9agx8k4sl2ck0y9-ungoogled-chromium-86.0.4240.75-0.c34a56d
#+end_example


Thanks,

--
Joshua Branson
Sent from Emacs and Gnus
https://gnucode.me
https://video.hardlimit.com/accounts/joshua_branson/video-channels
"You can have whatever you want, as long as you help enough other people get what they want." - Zig Ziglar




Information forwarded to bug-guix@HIDDEN:
bug#44053; Package guix. Full text available.

Message received at 44053 <at> debbugs.gnu.org:


Received: (at 44053) by debbugs.gnu.org; 19 Oct 2020 18:18:43 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Oct 19 14:18:43 2020
Received: from localhost ([127.0.0.1]:42309 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1kUZk2-0004u5-NM
	for submit <at> debbugs.gnu.org; Mon, 19 Oct 2020 14:18:43 -0400
Received: from mail-io1-f46.google.com ([209.85.166.46]:36659)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <maxim.cournoyer@HIDDEN>) id 1kUZjx-0004tp-DB
 for 44053 <at> debbugs.gnu.org; Mon, 19 Oct 2020 14:18:41 -0400
Received: by mail-io1-f46.google.com with SMTP id u19so821316ion.3
 for <44053 <at> debbugs.gnu.org>; Mon, 19 Oct 2020 11:18:37 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;
 h=from:to:cc:subject:references:date:in-reply-to:message-id
 :user-agent:mime-version;
 bh=4Qy9tir5c9ssrhdi1MVIkkHwUbROBjPuXtBl0F8Bbqo=;
 b=tKHWaO1sBTvfsCERlNeRl+PYbQ6PoaDVinOWWjq1SJsmFDsusaEkoQqaWuxS+46utk
 NP9ckLWDHCFogPL33llRk6xDj2favPfurTr1nHU08x7oM4in20qBOYOl1xVsZcABLskQ
 inXzSBWjLRof635IdKqalH2Avyqa7lTkABlpT4Y+6sfEJhUkrN5Y0oFSqYepZf8ZEzBL
 aV06BVDET2W2mGyYMZr8Hi8BOR6O7bzH08IWDJ2ILdwL/8ZJMEd3DTYQ76k4sntjCjnU
 35ViCiJiqOSkA71Jf7lm+heyLgoflcLVo3QWoibK4IjFkMNS4ToVivjvgIPBQxksrt3S
 jldg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:from:to:cc:subject:references:date:in-reply-to
 :message-id:user-agent:mime-version;
 bh=4Qy9tir5c9ssrhdi1MVIkkHwUbROBjPuXtBl0F8Bbqo=;
 b=DrKCwydRXGa/xx2fKEKbiQSaz0+DShEGhYJRrQ6PL0++6a+aiRqM+lGuI+XSeqFI29
 axzc8Tm5iawXC2IoCABK4dhjxsWZhjX9KLsrVlKT2LPAi1WFQdHXNjnBMW0s1/TO7SxW
 OCQ3aHSuZC9u/I5lu8MZLpr2OSFMKwnqtgqhfq04ZiAMg8gcNcYHwvMMw/8zCiodU9zK
 FOZyNoWryBwE7Nu54sZ7pUgLdJtsAHvsUOqdm7tM34/PKYR3kkm9xgSEfpdrp/LlT0Lq
 Zb4YX7jIf5/lfiJIsiGKsoLof/zexpSGrXHum+QMYlPwbicxikAR4TcpTLz+dK5lIBsJ
 Yr6g==
X-Gm-Message-State: AOAM531839xw4RsgU3qMsZOWDQ/GUZwaS6cLpZKKT3RR3g403gEKKaGx
 KBskpB2Kb2oYEoGmbYrFuXD6dCzDzX4=
X-Google-Smtp-Source: ABdhPJxEUd9xr2R2sfAeHNDDZO9QqYNQ32HSiSU9gIG4iXUMnLls8ZnmJ8dbXy1r+XMt4b88s3OlHA==
X-Received: by 2002:a02:7685:: with SMTP id z127mr1016513jab.45.1603131511464; 
 Mon, 19 Oct 2020 11:18:31 -0700 (PDT)
Received: from hurd (dsl-141-39.b2b2c.ca. [66.158.141.39])
 by smtp.gmail.com with ESMTPSA id y16sm324927iow.34.2020.10.19.11.18.29
 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
 Mon, 19 Oct 2020 11:18:29 -0700 (PDT)
From: Maxim Cournoyer <maxim.cournoyer@HIDDEN>
To: zimoun <zimon.toutoune@HIDDEN>
Subject: Re: bug#44053: Poor profile generation performance on spinning disks
References: <87zh4k435a.fsf@HIDDEN>
 <CAJ3okZ1AMUteo3qpAHb0m6RS3ApawCrdfQwVNkDg6Xtc515LcA@HIDDEN>
Date: Mon, 19 Oct 2020 14:18:29 -0400
In-Reply-To: <CAJ3okZ1AMUteo3qpAHb0m6RS3ApawCrdfQwVNkDg6Xtc515LcA@HIDDEN>
 (zimoun's message of "Mon, 19 Oct 2020 10:18:43 +0200")
Message-ID: <87d01e5bbe.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux)
MIME-Version: 1.0
Content-Type: multipart/mixed; boundary="=-=-="
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 44053
Cc: 44053 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

--=-=-=
Content-Type: text/plain

Hello Simon,

zimoun <zimon.toutoune@HIDDEN> writes:

> Hi Maxim,
>
> On Sun, 18 Oct 2020 at 05:37, Maxim Cournoyer <maxim.cournoyer@HIDDEN> wrote:
>
>> On my home machine, will is still relying on 2 x 1 TB spinning drives in
>> RAID1, rebuilding my user profile, which contains 182 entries, takes on
>> average about 20 minutes, even when there are no packages to be built:
>
> The database build time seems correlated to the number of packages in
> the very profile.  Well, I have not benchmarked to see if it is
> linear, quadratic; or worse or better.

It is.  Small profiles operations are much faster than large profiles.
Attached is a slightly trimmed version of the manifest I currently use
for my user profile, if you'd like to benchmark it on your system.

--=-=-=
Content-Type: text/plain
Content-Disposition: attachment; filename=manifest.scm

(use-modules (gnu packages)
             (gnu packages emacs)
             (guix build-system emacs)
             (guix profiles))

(concatenate-manifests
 (list
 ;;; Emacs packages.
  (specifications->manifest
   '("emacs"
     "emacs-auctex"
     "emacs-bash-completion"
     "emacs-bbdb"
     "emacs-cmake-mode"
     "emacs-company"
     "emacs-company-quickhelp"
     "emacs-counsel"
     "emacs-csv-mode"
     "emacs-debbugs"
     "emacs-diff-hl"
     "emacs-el-mock"
     "emacs-elpy"
     "emacs-emms"
     "emacs-ggtags"
     "emacs-go-mode"
     "emacs-grep-a-lot"
     "emacs-guix"
     "emacs-htmlize"
     "emacs-ivy"
     "emacs-magit"
     "emacs-org"
     "emacs-org-reveal"
     "emacs-paredit"
     "emacs-pdf-tools"
     "emacs-qml-mode"
     "emacs-realgud"
     "emacs-string-inflection"
     "emacs-swiper"
     "emacs-w3m"
     "emacs-ws-butler"
     "emacs-yasnippet"
     "emacs-yasnippet-snippets"))

  ;; Other software.
  (specifications->manifest
   '("adb"
     "acpi"
     "alsa-utils"
     "anthy"
     "arc-icon-theme"
     "arc-theme"
     "aspell"
     "aspell-dict-en"
     "aspell-dict-fr"
     "autoconf"
     "automake"
     "autossh"
     "bash"
     "bc"
     "beep"
     "bind:utils"              ;for 'dig'
     "bluez"
     "bridge-utils"
     "cheese"
     "compsize"
     "cqfd"
     "cryptsetup"
     "curl"
     "dbus"
     "dconf"
     "ddcutil"
     "diffoscope"
     "docker-cli"
     "dosfstools"
     "evince"
     "file"
     "font-adobe-source-han-sans"
     "font-dejavu"
     "font-google-roboto"
     "font-hack"
     "gcc-toolchain"
     "gdb"
     "geeqie"
     "ghostscript-with-x"
     "gimp"
     "git"
     "git:send-email"
     "glibc-locales"
     "global"
     "gnome-bluetooth"
     "gnome-boxes"
     "adwaita-icon-theme"
     "hicolor-icon-theme"
     "gnu-standards"
     "gnucash"
     "gnucash:doc"
     "gnupg"
     "graphviz"
     "gtk-engines"
     "guile"
     "guile-readline"
     "guile-sqlite3"
     "guile-ssh"
     "hackneyed-x11-cursors"
     "hicolor-icon-theme"
     "hunspell"
     "hunspell-dict-fr"
     "ibus"
     "ibus-anthy"
     "icecat"
     "imagemagick"
     "inetutils"
     "inkscape"
     "iotop"
     "jack"
     "jami"
     "keepassxc"
     "libjpeg"
     "libmtp"
     "libpcap"
     "libreoffice"
     "libssh"
     "libx11"
     "linphoneqt"
     "lm-sensors"
     "lsof"
     "ltrace"
     "lvm2"                               ;for dmsetup
     "make"
     "man-pages"
     "mesa-utils"
     "mpv"
     "mtr"
     "nmap"
     "openssh"
     "openvpn"
     "parted"
     "pavucontrol"
     "perl"
     "pinentry"
     "pkg-config"
     "poppler"
     "pulseaudio"
     "pv"
     "python"
     "python-wrapper"
     "qemu"
     "recutils"
     "rsync"
     "rtorrent"
     "screen"
     "setxkbmap"
     "shepherd"
     "sicp"
     "smartmontools"
     "spacefm"
     "stow"
     "strace"
     "sysstat"				;for iostat
     "tcpdump"
     "the-silver-searcher"                ;ag
     "time"                             ;aliased to time+
     "transmission"
     "transmission:gui"
     "tree"
     "unzip"
     "vinagre"
     "vorbis-tools"
     "weechat"
     "wget"
     "workrave"
     "wpa-supplicant"
     "xdpyinfo"
     "xdg-utils"
     "xev"
     "xmodmap"
     "xournal"
     "xrandr"
     "xrdb"
     "xsetroot"
     "yelp"
     "gxtuner"
     "shellcheck"))

  ;; Others.
  (specifications->manifest
   '("docker-compose"
     "emacs-adoc-mode"
     "emacs-clang-format"
     "emacs-clang-rename"
     "emacs-feature-mode"
     "picocom"
     "python-git-review"
     "sshpass"
     "ungoogled-chromium"
     "ddrescue"))))

--=-=-=
Content-Type: text/plain


I'm betting that the part to optimize is:

--8<---------------cut here---------------start------------->8---
  ;; Make the symlinks.
  (union-build output inputs
               #:symlink symlink
               #:log-port (%make-void-port "w"))
--8<---------------cut here---------------end--------------->8---

from the 'build-profile' procedure in (guix build profiles).

>
>> --8<---------------cut here---------------start------------->8---
> [...]
>> building XDG MIME database...
>> successfully built /gnu/store/cir84qj587i6is4akgqand7ahg9bj938-xdg-mime-database.drv
>> successfully built /gnu/store/cir84qj587i6is4akgqand7ahg9bj938-xdg-mime-database.drv
>> /gnu/store/j0bznlj2ibnhirijhnwpkkxzz4qfk8wb-xdg-mime-database
>>
>> real    1m7.344s
>> user    0m1.331s
>> sys     0m0.053s
>> --8<---------------cut here---------------end--------------->8---
>
> Well, it is all clear to me, but I do not know if we can do better
> because these 2 XDG updates seem relying on the external binaries
> "/bin/update-desktop-database" and "/bin/update-mime-database".  I
> have not timed the function 'xdg-desktop-database' but all the time
> should be spent on these, I bet. :-)

They do, and this is indeed what takes time.  But, this doesn't stop
motivated wizards from implementing our own database generator in Scheme
that would do the same.  Ludovic had done just that for the man-db
database generator.  The custom code in Guix can do it much faster that
it initially could back when it was relying on man-db to do that (that's
also probably the reason why we have issues such as
https://issues.guix.gnu.org/38838; perhaps the generated database is
slightly different -- but that's another topic :-)).

Thanks,

Maxim

--=-=-=--




Information forwarded to bug-guix@HIDDEN:
bug#44053; Package guix. Full text available.

Message received at 44053 <at> debbugs.gnu.org:


Received: (at 44053) by debbugs.gnu.org; 19 Oct 2020 08:19:02 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Oct 19 04:19:02 2020
Received: from localhost ([127.0.0.1]:39888 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1kUQNh-00038D-Ph
	for submit <at> debbugs.gnu.org; Mon, 19 Oct 2020 04:19:02 -0400
Received: from mail-qv1-f54.google.com ([209.85.219.54]:44235)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <zimon.toutoune@HIDDEN>) id 1kUQNg-00037r-30
 for 44053 <at> debbugs.gnu.org; Mon, 19 Oct 2020 04:19:00 -0400
Received: by mail-qv1-f54.google.com with SMTP id s17so3946293qvr.11
 for <44053 <at> debbugs.gnu.org>; Mon, 19 Oct 2020 01:19:00 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;
 h=mime-version:references:in-reply-to:from:date:message-id:subject:to
 :cc; bh=Y6R7bUOsVCVV3n9qJcG28DjVtCwbDazSaRmy3kDaSG0=;
 b=GPb0RrK7C0iPgUGLcXbToDplXf/lHDFkl6/GB4/SybLqIoZSdBTU/QssQo2Gp3iV6T
 R0eNwU1dQmhMukU5u2zqoj6a5g5q5VjBLT4kITP7i6Qsf+XjAHXpV2WwZhW19/p1LPAA
 vZ5uwVbebCh/mluUqLUPqBvHIRFGjbQiilc0auf6To/v2fHq3J2D6mou1U5+llHJz+pP
 EWsLCpryO/EQQXeTOK4boQgqRd2pLxqqfFhsqBybTKWzxp7hkJYvW/0GdMxScXcVn29Y
 747d41RxHtOrCiJH5P4Dsy7EAcYSroNxK7s9I4GEbUoqoP+cRRMqcl0Hr1C9Q9hWVgAw
 GSRQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:mime-version:references:in-reply-to:from:date
 :message-id:subject:to:cc;
 bh=Y6R7bUOsVCVV3n9qJcG28DjVtCwbDazSaRmy3kDaSG0=;
 b=pll6TYty60k9tS9T9NHX8pTelUgjWrBK1iaxvaiZjelTlgCa+uqpGxDCIuqutSuIwl
 SVnIFjK92qsbdiog3ZvkK8I8HboBvw1alKenzcXD5AzAK+wODX3aVqX283Y3NW/rzavH
 /OLQwjCJIadpiT4CEhHSaJWTUSBL/WTqjvgf6aUPk6x4ZjBYWDz82Uav9Ru5l6n8MXEX
 3dzX3Qa8wU13a/xvCK5oiDS4keatjwtKSXLunBnPlsx6oitQ9Al6DFMRnfoa9cFsdSVO
 Jqerc0eaQgyRcBTFn8ZlxUnhPLRydAkuuTOkXd/8cHEhDX7UWmKbB3zFCYufXLe489IT
 THHQ==
X-Gm-Message-State: AOAM5329VsTu3w1ZDaS4OzBVRXTKWgT/wCMG7r2AQ2cw7lm/TKlYKUS0
 Qr6MuIXz531vPrGbq/8ImL03qhpeuokFAMHNZYw=
X-Google-Smtp-Source: ABdhPJzPPPUiakSLPW6PDy7lI0XGMlrd4bPjiC5t6AtHIfUbu9ssUE5NwE0BJYPgdIWcqZawcWaZWkkKA6k9ebNQ4yw=
X-Received: by 2002:ad4:4eaf:: with SMTP id ed15mr16304955qvb.40.1603095534641; 
 Mon, 19 Oct 2020 01:18:54 -0700 (PDT)
MIME-Version: 1.0
References: <87zh4k435a.fsf@HIDDEN>
In-Reply-To: <87zh4k435a.fsf@HIDDEN>
From: zimoun <zimon.toutoune@HIDDEN>
Date: Mon, 19 Oct 2020 10:18:43 +0200
Message-ID: <CAJ3okZ1AMUteo3qpAHb0m6RS3ApawCrdfQwVNkDg6Xtc515LcA@HIDDEN>
Subject: Re: bug#44053: Poor profile generation performance on spinning disks
To: Maxim Cournoyer <maxim.cournoyer@HIDDEN>
Content-Type: text/plain; charset="UTF-8"
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 44053
Cc: 44053 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Hi Maxim,

On Sun, 18 Oct 2020 at 05:37, Maxim Cournoyer <maxim.cournoyer@HIDDEN> wrote:

> On my home machine, will is still relying on 2 x 1 TB spinning drives in
> RAID1, rebuilding my user profile, which contains 182 entries, takes on
> average about 20 minutes, even when there are no packages to be built:

The database build time seems correlated to the number of packages in
the very profile.  Well, I have not benchmarked to see if it is
linear, quadratic; or worse or better.


> --8<---------------cut here---------------start------------->8---
[...]
> building XDG MIME database...
> successfully built /gnu/store/cir84qj587i6is4akgqand7ahg9bj938-xdg-mime-database.drv
> successfully built /gnu/store/cir84qj587i6is4akgqand7ahg9bj938-xdg-mime-database.drv
> /gnu/store/j0bznlj2ibnhirijhnwpkkxzz4qfk8wb-xdg-mime-database
>
> real    1m7.344s
> user    0m1.331s
> sys     0m0.053s
> --8<---------------cut here---------------end--------------->8---

Well, it is all clear to me, but I do not know if we can do better
because these 2 XDG updates seem relying on the external binaries
"/bin/update-desktop-database" and "/bin/update-mime-database".  I
have not timed the function 'xdg-desktop-database' but all the time
should be spent on these, I bet. :-)


All the best,
simon




Information forwarded to bug-guix@HIDDEN:
bug#44053; Package guix. Full text available.

Message received at 44053 <at> debbugs.gnu.org:


Received: (at 44053) by debbugs.gnu.org; 18 Oct 2020 23:05:29 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sun Oct 18 19:05:29 2020
Received: from localhost ([127.0.0.1]:39334 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1kUHk1-0001ZQ-Hm
	for submit <at> debbugs.gnu.org; Sun, 18 Oct 2020 19:05:29 -0400
Received: from mail-40141.protonmail.ch ([185.70.40.141]:28648)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <luis.felipe.la@HIDDEN>) id 1kUHjy-0001ZC-W4
 for 44053 <at> debbugs.gnu.org; Sun, 18 Oct 2020 19:05:28 -0400
Date: Sun, 18 Oct 2020 23:05:10 +0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com;
 s=protonmail; t=1603062320;
 bh=NBffpbsu1l1qROCFvViBKCQyH7ZKm47CQ/8YUHWpvBw=;
 h=Date:To:From:Reply-To:Subject:From;
 b=Iz2M130LZlNFBHWgLS83LQZT7y5Q8JuTIeMu2/27/9RHO5TVFMDtb9XOdGm8Hbr8V
 TIbcH2fnUVXzwQAgYass8vu5X3oSGrJ4tckcbnDmQaKquTgbTdPksS8yvFComngvF+
 OoFJbRK96iMyhavDPdkHl50CV1acbQjowABgeSfU=
To: "44053 <at> debbugs.gnu.org" <44053 <at> debbugs.gnu.org>
From: Luis Felipe <luis.felipe.la@HIDDEN>
Subject: Poor profile generation performance on spinning disks
Message-ID: <yuID-gVO5clS0T8k81R_AzM7g91lm_6kDlH9rJFE8OOv5XMxEsdFo6hCH_QGnJGMW4nyDfuduHS_cXzKOm0qov8BalGmi8NPGKwR_eInGFk=@protonmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Status: No, score=-1.2 required=10.0 tests=ALL_TRUSTED,DKIM_SIGNED,
 DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM shortcircuit=no
 autolearn=disabled version=3.4.4
X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on
 mailout.protonmail.ch
X-Spam-Score: 2.7 (++)
X-Spam-Report: Spam detection software, running on the system "debbugs.gnu.org",
 has NOT identified this incoming email as spam.  The original
 message has been attached to this so you can view it or label
 similar future email.  If you have any questions, see
 the administrator of that system for details.
 Content preview:  I've never used SDDs, so I've been experiencing this since
 I installed Guix (~5 years ago). And yes, building the profile seems to be
 the more resource intensive operation. I usually can't do anything [...] 
 Content analysis details:   (2.7 points, 10.0 required)
 pts rule name              description
 ---- ---------------------- --------------------------------------------------
 -0.0 RCVD_IN_MSPIKE_H2      RBL: Average reputation (+2)
 [185.70.40.141 listed in wl.mailspike.net]
 -0.0 SPF_PASS               SPF: sender matches SPF record
 0.0 FREEMAIL_FROM          Sender email is commonly abused enduser mail
 provider (luis.felipe.la[at]protonmail.com)
 -0.0 SPF_HELO_PASS          SPF: HELO matches SPF record
 2.7 AC_FROM_MANY_DOTS      Multiple periods in From user name
X-Debbugs-Envelope-To: 44053
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Reply-To: Luis Felipe <luis.felipe.la@HIDDEN>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

I've never used SDDs, so I've been experiencing this since I installed Guix=
 (~5 years ago). And yes, building the profile seems to be the more resourc=
e intensive operation. I usually can't do anything else while that happens =
because the computer becomes unresponsive.

Running the same command Maxim mentioned took the following time in my case=
:


$ time guix package -i perl --max-jobs=3D1
Se instalar=C3=A1 el siguiente paquete:
=C2=A0=C2=A0 perl 5.30.2
Se construir=C3=A1 la siguiente derivaci=C3=B3n:
=C2=A0=C2=A0 /gnu/store/86g48nh8dhgdhzb8r9bxjk6mmszlssss-profile.drv
construyendo empaquetado de certificados de CA...
construyendo el directorio de tipograf=C3=ADas...
generando la cach=C3=A9 de esquemas de GLib...
creando la cach=C3=A9 de temas de iconos de GTK+...
construyendo los ficheros de cach=C3=A9 para los m=C3=A9todos de entrada de=
 GTK+...
construyendo el directorio de manuales Info...
construyendo la base de datos de p=C3=A1ginas de manual...
construyendo la cach=C3=A9 de ficheros desktop XDG...
construyendo la base de datos MIME XDG...
construyendo perfil con 87 paquetes...


real=C2=A0=C2=A0=C2=A0 8m3,043s
user=C2=A0=C2=A0=C2=A0 0m2,656s
sys=C2=A0=C2=A0=C2=A0 0m0,239s


My computer:

Intel=C2=AE Core=E2=84=A2 i3-8100 CPU @ 3.60GHz =C3=97 4
RAM: 4 GiB
1 TB HDD





Information forwarded to bug-guix@HIDDEN:
bug#44053; Package guix. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 18 Oct 2020 03:36:10 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sat Oct 17 23:36:10 2020
Received: from localhost ([127.0.0.1]:35973 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1kTzUQ-0005c9-DS
	for submit <at> debbugs.gnu.org; Sat, 17 Oct 2020 23:36:10 -0400
Received: from lists.gnu.org ([209.51.188.17]:55440)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <maxim.cournoyer@HIDDEN>) id 1kTzUP-0005c1-3R
 for submit <at> debbugs.gnu.org; Sat, 17 Oct 2020 23:36:09 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10]:50610)
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <maxim.cournoyer@HIDDEN>)
 id 1kTzUO-0000FZ-TE
 for bug-guix@HIDDEN; Sat, 17 Oct 2020 23:36:08 -0400
Received: from mail-io1-xd31.google.com ([2607:f8b0:4864:20::d31]:33072)
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128)
 (Exim 4.90_1) (envelope-from <maxim.cournoyer@HIDDEN>)
 id 1kTzUL-0003wx-8e
 for bug-guix@HIDDEN; Sat, 17 Oct 2020 23:36:08 -0400
Received: by mail-io1-xd31.google.com with SMTP id r4so9101837ioh.0
 for <bug-guix@HIDDEN>; Sat, 17 Oct 2020 20:36:04 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;
 h=from:to:subject:date:message-id:mime-version;
 bh=EQL4wUvP0JzwEWDcs8iEsIPm/XDUsVG66N4fK8x/OEI=;
 b=o7GDX4qfbo3wYyLroWwt9kI3lXhypiQ1dvg8OkHLF8Y3cs7BvcKiEbcgS/i6ZyiUYK
 rO6q/gtm28vv87WqwGJUVkgIkhQKMxjS2u+zbKYzji/laPjoRnE3RuzeUh894wAQkRIf
 29O4ywFs4X2XObC621gfkqq1yZiTIjbbFf6dJAJDKCGbjxOcQ5QChiWdYEqLm3r4fVoN
 YUHJXJi4nci2tmZq+Anyex+4bhovorzKpsp6/tMtAmwYLvmyPeEGFwQr1IKWppaJi9AV
 d51Q+cqwZdSnG5S6CQdwNfhN1vHqkObMYZICCJowO1Snh/blL6CxjlP/7eqVzk98jlHM
 uvXg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:from:to:subject:date:message-id:mime-version;
 bh=EQL4wUvP0JzwEWDcs8iEsIPm/XDUsVG66N4fK8x/OEI=;
 b=Y3s32c0pf67qzdJy+7Q+pAFX7f1MFzqkJPTwnXS7RRWsJz3t4qjH0Gyu1+eC13H9lc
 vw/xbqmJso5CJ7ve8WKnY/YsRqcN+x7vupkwiRfEBp0zoyse/bGRxlveT7Urqxk+tIaD
 3is05SdSsLngz8M9pK4AnPV9ZkAOfFQk3/VKFCqdKw1usYDHOn5xU/GKLYdi9jwsC7uM
 73IWX2qw0nKiUcMdKOi9DFFamrDL3/UUyn1ejWFu72S/nNRZxS6yMU4Xpp9X4lZXpyTF
 cBnxcpc+aFbQwQp0w2/cefwdbmTC1s8kVoTgMdU6mlU8ol6dyIcqFs1g3QSx2bcU4+s7
 7IYg==
X-Gm-Message-State: AOAM531uVN26Ug9u08kGzjm7KV59z4ZgCw5gLLLkeBB/UbrP/9p4IfOs
 kddgHgSgCSYOeOUL0l459MiCARcWes4=
X-Google-Smtp-Source: ABdhPJw8iYb3PoK5GTIrwuSgnOB5FZnuKUtOQOZc/z72kyn0mOKvUZsy85AYFr+8prXyTXydKo8D6g==
X-Received: by 2002:a6b:1542:: with SMTP id 63mr7022979iov.64.1602992163761;
 Sat, 17 Oct 2020 20:36:03 -0700 (PDT)
Received: from hurd (dsl-205-233-125-118.b2b2c.ca. [205.233.125.118])
 by smtp.gmail.com with ESMTPSA id t10sm6408050iog.49.2020.10.17.20.36.02
 for <bug-guix@HIDDEN>
 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
 Sat, 17 Oct 2020 20:36:03 -0700 (PDT)
From: Maxim Cournoyer <maxim.cournoyer@HIDDEN>
To: bug-guix <bug-guix@HIDDEN>
Subject: Poor profile generation performance on spinning disks
Date: Sat, 17 Oct 2020 23:35:45 -0400
Message-ID: <87zh4k435a.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain
Received-SPF: pass client-ip=2607:f8b0:4864:20::d31;
 envelope-from=maxim.cournoyer@HIDDEN; helo=mail-io1-xd31.google.com
X-detected-operating-system: by eggs.gnu.org: No matching host in p0f cache.
 That's all we know.
X-Spam_score_int: -20
X-Spam_score: -2.1
X-Spam_bar: --
X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
 DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001,
 RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001,
 SPF_PASS=-0.001 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: 0.7 (/)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.3 (--)

Hello!

I've noticed on multiple occasions that using Guix on traditional
spinning drives can be quite slow.

On my home machine, will is still relying on 2 x 1 TB spinning drives in
RAID1, rebuilding my user profile, which contains 182 entries, takes on
average about 20 minutes, even when there are no packages to be built:

--8<---------------cut here---------------start------------->8--- $ time
guix package -i perl --max-jobs=1 The following package will be
upgraded: perl (dependencies or package changed)

The following derivation will be built:
   /gnu/store/lhywla1z2zcz16df4hbvvvngr9zmswr7-profile.drv

building CA certificate bundle...
building fonts directory...
generating GLib schema cache...
creating GTK+ icon theme cache...
building cache files for GTK+ input methods...
building directory of Info manuals...
building database for manual pages...
building XDG desktop file cache...
building XDG MIME database...
building profile with 182 packages...

real    19m0.126s
user    0m5.648s
sys     0m0.333s
--8<---------------cut here---------------end--------------->8---

Most of the time remains spent after the message 'building profile with
182 package...'.  That part seems IO-bound, with the spinning disks
grinding heavily and the CPU mostly idling.  The rest of the time (3
minutes), was used by the profile hooks.

The same operation on a second, more modern machine equipped with M2
SSDs does much better and takes about 1 minute to accomplish the same,
so it seems the bad performance can be mostly attributed to the much
slower disk seek times of the spinning disks.

On the older machine, two profile hooks are also sticking out w.r.t. the
time they take (they take more than one minute opposed to a few
seconds):

--8<---------------cut here---------------start------------->8---
The following profile hook will be built:
   /gnu/store/08fanpydi7z4i3qnlqbr8iz23zdgsamw-manual-database.drv
building database for manual pages...
Creating manual page database...
[2139/2139] building list of man-db entries...
175322 entries processed in 95.1 s
successfully built /gnu/store/08fanpydi7z4i3qnlqbr8iz23zdgsamw-manual-database.drv
successfully built /gnu/store/08fanpydi7z4i3qnlqbr8iz23zdgsamw-manual-database.drv
/gnu/store/wzp4mk2r7r4ysciw74gqbfkyai0zmrcc-manual-database

real    1m36.378s
user    0m1.674s
sys     0m0.108s

The following profile hook will be built:
   /gnu/store/cir84qj587i6is4akgqand7ahg9bj938-xdg-mime-database.drv
building XDG MIME database...
successfully built /gnu/store/cir84qj587i6is4akgqand7ahg9bj938-xdg-mime-database.drv
successfully built /gnu/store/cir84qj587i6is4akgqand7ahg9bj938-xdg-mime-database.drv
/gnu/store/j0bznlj2ibnhirijhnwpkkxzz4qfk8wb-xdg-mime-database

real    1m7.344s
user    0m1.331s
sys     0m0.053s
--8<---------------cut here---------------end--------------->8---

So we should profile what's going on while generating the profile (no
pun intended) and try to improve this at first since this is where most
of the time is spent on spinning drives (17 minutes out of the 20 in the
above example).

After that we could look into the two above profile hooks.

Thanks,

Maxim




Acknowledgement sent to Maxim Cournoyer <maxim.cournoyer@HIDDEN>:
New bug report received and forwarded. Copy sent to bug-guix@HIDDEN. Full text available.
Report forwarded to bug-guix@HIDDEN:
bug#44053; Package guix. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Wed, 23 Mar 2022 12:45:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.