GNU bug report logs - #76926
31.0.50; Hyperbole tarball bloat

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: emacs; Severity: wishlist; Reported by: Stefan Monnier <monnier@HIDDEN>; dated Mon, 10 Mar 2025 20:17:02 UTC; Maintainer for emacs is bug-gnu-emacs@HIDDEN.

Message received at 76926 <at> debbugs.gnu.org:


Received: (at 76926) by debbugs.gnu.org; 10 Mar 2025 21:13:17 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Mar 10 17:13:16 2025
Received: from localhost ([127.0.0.1]:40160 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1trkR2-0004A9-F1
	for submit <at> debbugs.gnu.org; Mon, 10 Mar 2025 17:13:16 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10]:48408)
 by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.84_2) (envelope-from <matsl@HIDDEN>) id 1trkQz-00049s-Da
 for 76926 <at> debbugs.gnu.org; Mon, 10 Mar 2025 17:13:14 -0400
Received: from fencepost.gnu.org ([2001:470:142:3::e])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <matsl@HIDDEN>)
 id 1trkQr-0006b8-On; Mon, 10 Mar 2025 17:13:07 -0400
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org;
 s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To:
 From; bh=pPDJ6t7SAmP5YDJHkgUGgc5wDpuVVnijIlW2cfbP8bI=; b=MdHDGPPhomqRaeigWiRJ
 3ZBGKGOTgKGXjelbfyeRT9m5WI7dmGLfOTwj4p3a2U4roizT+0bxZOaW0yKZSuT5+ENBWeDCr/pUa
 Krgg3Tj1GnNNxMEeUJZ7evjtYJSZJOQoVv59pT5dg+k2ijs/ayvqPLLq2l0fIx5wiPIPhxRTqTD5I
 M4ZLFmGNCB0gLBIOrt2Vhq0IkahavHQ7n5IqO+uNcVdpIi3fXt41e0IquFJGRYuBWHhDfTCOj5J3A
 CL8M9RdFmzpuvuFhC3NwdSFXpzt+T0vGBkwJnq+Hx+t4yc+Y10dRMvecyH2fJRKIoCmSg5SlNKJyI
 vml2bx7mLt/3vQ==;
From: Mats Lidell <matsl@HIDDEN>
To: Stefan Monnier <monnier@HIDDEN>
Subject: Re: bug#76926: 31.0.50; Hyperbole tarball bloat
In-Reply-To: <jwvsenkadw5.fsf-monnier+@gnu.org>
References: <jwvsenkadw5.fsf-monnier+@gnu.org>
Date: Mon, 10 Mar 2025 22:12:52 +0100
Message-ID: <87bju8wpwr.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13)
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: 76926
Cc: Robert Weiner <rsw@HIDDEN>, 76926 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

Hi Stefan,

> Stefan Monnier writes:
> Package: Emacs
> Version: 31.0.50
>
>
> The current Hyperbole code is a bit less than 3MB of ELisp code, but the
> resulting tarball in GNU ELPA is more than 20MB.
>
> Skipping the worst offenders
>
>     *.eps
>     *.pdf
>     *.html
>     HY-TALK/improve-performance.png
>     man/im/wgrid4x3.png
>
> would bring it down to about a third of the current size, but I suggest
> you think about which of the files in the Git could be skipped in the
> tarball (e.g. because they're only useful for the website) or even
> completely removed from Git (like `man/im/wgrid[34]*.png` files which
> don't seem to be used for anything, or the non-source files like
> `hyperbole.pdf` or the `.eps` files which could be replaced by
> appropriate Makefile rules).

Point taken. We'll see how we can clean git from big files.

The tarball is built with the idea that users would get everything needed
without having any extra tools nor to be required to run any make
targets. That might be an old fashioned goal these days and users are bettered
served by fetching things from the net. Especially if we already provide those
through different channels.

> There's no point skipping small files, so usually I encourage package
> maintainers to include pretty much everything, but here I think we went
> a bit overboard.

> On a related note, have you tried to use `x-export-frames` to generate
> screenshots in PDF or SVG format?  It might (should?) lead to images
> that are more compact than `wgrid4x3.png` while giving a higher quality
> rendering.

No, we have not tried that. I did not know that was available. Thanks for the
suggestion.  (So many things in Emacs I learn new stuff every day ;-) I will
take a look what can be done about the images. They might need regeneration
anyway with next release due to things have changed since we produced them. We
can try to make them more compact when we update them.

> Also, I see there's a `man/hyperbole.texi` but the current package's
> spec doesn't specify any manual.  I guess we should add
>
>     :doc "man/hyperbole.texi"
>
> right? [ That would auto-generate `hyperbole.info` and `dir` files so
> users who install your packages get it in `M-x info`, as well as add an
> HTML rendering of that same manual over at
> https://elpa.gnu.org/packages/hyperbole.html.  You don't need to
> include `hyperbole.html` and `dir` and `hyperbole.info` in the Git for that.  ]

I think our current solution also works in making Hyperbole available in
info. But if we can get the necessary files generated, using the standard
machinery, there would be less to ship. Thanks for the suggestion.

Yours
-- 
%% Mats




Information forwarded to bug-gnu-emacs@HIDDEN:
bug#76926; Package emacs. Full text available.
Severity set to 'wishlist' from 'normal' Request was from Stefan Kangas <stefankangas@HIDDEN> to control <at> debbugs.gnu.org. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 10 Mar 2025 20:16:39 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Mar 10 16:16:39 2025
Received: from localhost ([127.0.0.1]:40002 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1trjYF-0001Oa-BO
	for submit <at> debbugs.gnu.org; Mon, 10 Mar 2025 16:16:39 -0400
Received: from lists.gnu.org ([2001:470:142::17]:38280)
 by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.84_2) (envelope-from <monnier@HIDDEN>)
 id 1trjYA-0001O8-Ky
 for submit <at> debbugs.gnu.org; Mon, 10 Mar 2025 16:16:35 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10])
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <monnier@HIDDEN>)
 id 1trjXZ-0001I4-9e
 for bug-gnu-emacs@HIDDEN; Mon, 10 Mar 2025 16:15:58 -0400
Received: from mailscanner.iro.umontreal.ca ([132.204.25.50])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <monnier@HIDDEN>)
 id 1trjXQ-0006Rg-Tw
 for bug-gnu-emacs@HIDDEN; Mon, 10 Mar 2025 16:15:56 -0400
Received: from pmg1.iro.umontreal.ca (localhost.localdomain [127.0.0.1])
 by pmg1.iro.umontreal.ca (Proxmox) with ESMTP id 2A6E5100040;
 Mon, 10 Mar 2025 16:15:45 -0400 (EDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=iro.umontreal.ca;
 s=mail; t=1741637744;
 bh=CEj/bpTeM0WXmqqrJgk6on1Uy+r1o0lSxueiMyqdhZ0=;
 h=From:To:Subject:Date:From;
 b=mbMk6DKdVJZMSh58BiKOZHMgpAZDXsQBbQe8FWGUkpbfRXWhgdwoalyfiAg2KZhOS
 BmRdG+B7SlYKpNWSAXIXSFMxJCNlFw1ihDn30zr4AwladoFfTO8yR0nqfx/2K2Lb1B
 IDev7ovV2WntkrGeJfFlb1Sih7fVRsgJXf3VF4DEu4IAY+mMkUBzTGMOYcwuFNRkec
 50MJI0bHMo5u55PDC0IYsw1x3BQnt2ATsqp5OSec7/fxWAgeOeF5AqDDNe55ngYK1I
 RJ/1kSskHqsEUj1UN6majAwbKiDPWzKH59k7Xq2/ZTi9sDMs3dSxpFwXARHAKxM9yX
 FJlc/iPK8vpBQ==
Received: from mail01.iro.umontreal.ca (unknown [172.31.2.1])
 by pmg1.iro.umontreal.ca (Proxmox) with ESMTP id 78B9D10002E;
 Mon, 10 Mar 2025 16:15:44 -0400 (EDT)
Received: from pastel (unknown [104.247.242.5])
 by mail01.iro.umontreal.ca (Postfix) with ESMTPSA id 5D56A1202A0;
 Mon, 10 Mar 2025 16:15:44 -0400 (EDT)
From: Stefan Monnier <monnier@HIDDEN>
To: bug-gnu-emacs@HIDDEN
Subject: 31.0.50; Hyperbole tarball bloat
Message-ID: <jwvsenkadw5.fsf-monnier+@gnu.org>
X-Debbugs-Cc: monnier@HIDDEN, Robert Weiner <rsw@HIDDEN>, Mats
 Lidell <matsl@HIDDEN>
Date: Mon, 10 Mar 2025 16:15:43 -0400
MIME-Version: 1.0
Content-Type: text/plain
X-SPAM-INFO: Spam detection results:  0
 ALL_TRUSTED                -1 Passed through trusted hosts only via SMTP
 AWL -0.327 Adjusted score from AWL reputation of From: address
 BAYES_00                 -1.9 Bayes spam probability is 0 to 1%
 DKIM_SIGNED               0.1 Message has a DKIM or DK signature,
 not necessarily valid
 DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature
 DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's
 domain
 DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from
 domain
 KAM_SHORT               0.001 Use of a URL Shortener for very short URL
X-SPAM-LEVEL: 
Received-SPF: pass client-ip=132.204.25.50;
 envelope-from=monnier@HIDDEN; helo=mailscanner.iro.umontreal.ca
X-Spam_score_int: -42
X-Spam_score: -4.3
X-Spam_bar: ----
X-Spam_report: (-4.3 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
 DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_MED=-2.3,
 RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, RCVD_IN_VALIDITY_SAFE_BLOCKED=0.001,
 SPF_HELO_NONE=0.001, T_SPF_TEMPERROR=0.01 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Package: Emacs
Version: 31.0.50


The current Hyperbole code is a bit less than 3MB of ELisp code, but the
resulting tarball in GNU ELPA is more than 20MB.

Skipping the worst offenders

    *.eps
    *.pdf
    *.html
    HY-TALK/improve-performance.png
    man/im/wgrid4x3.png

would bring it down to about a third of the current size, but I suggest
you think about which of the files in the Git could be skipped in the
tarball (e.g. because they're only useful for the website) or even
completely removed from Git (like `man/im/wgrid[34]*.png` files which
don't seem to be used for anything, or the non-source files like
`hyperbole.pdf` or the `.eps` files which could be replaced by
appropriate Makefile rules).

There's no point skipping small files, so usually I encourage package
maintainers to include pretty much everything, but here I think we went
a bit overboard.

On a related note, have you tried to use `x-export-frames` to generate
screenshots in PDF or SVG format?  It might (should?) lead to images
that are more compact than `wgrid4x3.png` while giving a higher quality
rendering.

Also, I see there's a `man/hyperbole.texi` but the current package's
spec doesn't specify any manual.  I guess we should add

    :doc "man/hyperbole.texi"

right? [ That would auto-generate `hyperbole.info` and `dir` files so
users who install your packages get it in `M-x info`, as well as add an
HTML rendering of that same manual over at
https://elpa.gnu.org/packages/hyperbole.html.  You don't need to
include `hyperbole.html` and `dir` and `hyperbole.info` in the Git for that.  ]


        Stefan





Acknowledgement sent to Stefan Monnier <monnier@HIDDEN>:
New bug report received and forwarded. Copy sent to monnier@HIDDEN, rsw@HIDDEN, matsl@HIDDEN, bug-gnu-emacs@HIDDEN. Full text available.
Report forwarded to monnier@HIDDEN, rsw@HIDDEN, matsl@HIDDEN, bug-gnu-emacs@HIDDEN:
bug#76926; Package emacs. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Mon, 10 Mar 2025 21:15:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.