GNU logs - #21022, boring messages

Message sent to bug-gzip@HIDDEN:

Subject: bug#21022: see how much cloudflare's zlib-improving techniques can help gzip
Resent-From: Jim Meyering <jim@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gzip@HIDDEN
Resent-Date: Thu, 09 Jul 2015 23:32:01 +0000
Resent-Message-ID: <handler.21022.B.14364846921728 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: 21022 <at> debbugs.gnu.org
MIME-Version: 1.0
From: Jim Meyering <jim@HIDDEN>
Date: Thu, 9 Jul 2015 16:31:00 -0700
Message-ID: <CA+8g5KH7wUkh52MyWsFU2-Vd8c9cEOKyx5X383io+XzWbByXtA@HIDDEN>
Content-Type: text/plain; charset=UTF-8
Precedence: list
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>

https://blog.cloudflare.com/cloudflare-fights-cancer/

Message sent:

Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-Mailer: MIME-tools 5.503 (Entity 5.503)
Content-Type: text/plain; charset=utf-8
X-Loop: help-debbugs@HIDDEN
From: help-debbugs@HIDDEN (GNU bug Tracking System)
To: Jim Meyering <jim@HIDDEN>
Subject: bug#21022: Acknowledgement (see how much cloudflare's
 zlib-improving techniques can help gzip)
Message-ID: <handler.21022.B.14364846921728.ack <at> debbugs.gnu.org>
References: <CA+8g5KH7wUkh52MyWsFU2-Vd8c9cEOKyx5X383io+XzWbByXtA@HIDDEN>
X-Gnu-PR-Message: ack 21022
X-Gnu-PR-Package: gzip
Reply-To: 21022 <at> debbugs.gnu.org
Date: Thu, 09 Jul 2015 23:32:02 +0000

Thank you for filing a new bug report with debbugs.gnu.org.

This is an automatically generated reply to let you know your message
has been received.

Your message is being forwarded to the package maintainers and other
interested parties for their attention; they will reply in due course.

Your message has been sent to the package maintainer(s):
 bug-gzip@HIDDEN

If you wish to submit further information on this problem, please
send it to 21022 <at> debbugs.gnu.org.

Please do not send mail to help-debbugs@HIDDEN unless you wish
to report a problem with the Bug-tracking system.

--=20
21022: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D21022
GNU Bug Tracking System
Contact help-debbugs@HIDDEN with problems

Message sent to bug-gzip@HIDDEN:

Subject: bug#21022: see how much cloudflare's zlib-improving techniques can help gzip
Resent-From: Paul Eggert <eggert@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gzip@HIDDEN
Resent-Date: Fri, 10 Jul 2015 05:52:02 +0000
Resent-Message-ID: <handler.21022.B21022.14365074964246 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: Jim Meyering <jim@HIDDEN>, 21022 <at> debbugs.gnu.org
Message-ID: <559F5D5C.9070509@HIDDEN>
Date: Thu, 09 Jul 2015 22:51:24 -0700
From: Paul Eggert <eggert@HIDDEN>
User-Agent: Mozilla/5.0 (X11; Linux i686;
 rv:31.0) Gecko/20100101 Thunderbird/31.7.0
MIME-Version: 1.0
References: <CA+8g5KH7wUkh52MyWsFU2-Vd8c9cEOKyx5X383io+XzWbByXtA@HIDDEN>
In-Reply-To: <CA+8g5KH7wUkh52MyWsFU2-Vd8c9cEOKyx5X383io+XzWbByXtA@HIDDEN>
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit
Precedence: list
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>

On 07/09/2015 04:31 PM, Jim Meyering wrote:
> https://blog.cloudflare.com/cloudflare-fights-cancer/
>

A few years ago I started to rewrite gzip to use zlib rather than to do 
its own compression and decompression.  If we finished that, we could 
use cloudfare's zlib implementation trivially.

Message sent to bug-gzip@HIDDEN:

Subject: bug#21022: see how much cloudflare's zlib-improving techniques can help gzip
Resent-From: Mark Adler <madler@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gzip@HIDDEN
Resent-Date: Fri, 10 Jul 2015 05:57:02 +0000
Resent-Message-ID: <handler.21022.B21022.14365078074700 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: Paul Eggert <eggert@HIDDEN>
Cc: 21022 <at> debbugs.gnu.org, Jim Meyering <jim@HIDDEN>
Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2102\))
Content-Type: text/plain; charset=us-ascii
From: Mark Adler <madler@HIDDEN>
In-Reply-To: <559F5D5C.9070509@HIDDEN>
Date: Thu, 9 Jul 2015 22:56:36 -0700
Content-Transfer-Encoding: quoted-printable
Message-Id: <B2FDC817-8F92-4BAF-AAD1-E450F891DA9C@HIDDEN>
References: <CA+8g5KH7wUkh52MyWsFU2-Vd8c9cEOKyx5X383io+XzWbByXtA@HIDDEN>
 <559F5D5C.9070509@HIDDEN>
Precedence: list
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>

As a side note, there already is a gzip replacement that I wrote that =
uses zlib and that also provides parallel compression called pigz.

> On Jul 9, 2015, at 10:51 PM, Paul Eggert <eggert@HIDDEN> wrote:
>=20
> On 07/09/2015 04:31 PM, Jim Meyering wrote:
>> https://blog.cloudflare.com/cloudflare-fights-cancer/
>>=20
>=20
> A few years ago I started to rewrite gzip to use zlib rather than to =
do its own compression and decompression.  If we finished that, we could =
use cloudfare's zlib implementation trivially.
>=20
>=20
>=20

Message sent to bug-gzip@HIDDEN:

X-Loop: help-debbugs@HIDDEN
Subject: bug#21022: see how much cloudflare's zlib-improving techniques can help gzip
Resent-From: Jim Meyering <jim@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gzip@HIDDEN
Resent-Date: Fri, 10 Jul 2015 16:02:02 +0000
Resent-Message-ID: <handler.21022.B21022.143654408123662 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 21022
X-GNU-PR-Package: gzip
X-GNU-PR-Keywords: 
To: Mark Adler <madler@HIDDEN>
Cc: 21022 <at> debbugs.gnu.org, Paul Eggert <eggert@HIDDEN>
Received: via spool by 21022-submit <at> debbugs.gnu.org id=B21022.143654408123662
          (code B ref 21022); Fri, 10 Jul 2015 16:02:02 +0000
Received: (at 21022) by debbugs.gnu.org; 10 Jul 2015 16:01:21 +0000
Received: from localhost ([127.0.0.1]:46345 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1ZDajp-00069W-B9
	for submit <at> debbugs.gnu.org; Fri, 10 Jul 2015 12:01:21 -0400
Received: from mail-yk0-f176.google.com ([209.85.160.176]:33847)
 by debbugs.gnu.org with esmtp (Exim 4.80)
 (envelope-from <meyering@HIDDEN>) id 1ZDajn-00069B-88
 for 21022 <at> debbugs.gnu.org; Fri, 10 Jul 2015 12:01:19 -0400
Received: by ykax123 with SMTP id x123so19029085yka.1
 for <21022 <at> debbugs.gnu.org>; Fri, 10 Jul 2015 09:01:13 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:sender:in-reply-to:references:from:date:message-id
 :subject:to:cc:content-type;
 bh=XQqXIgG+/sZGdN6d3U/KECplSJEM8V9UNcyD8fqiQJs=;
 b=SFvxEJHZ7RMysJYz+1p/kxvGq7PIn+UKMl/qw5sQonPwdON09g+4fybAO7UPYN/KEM
 p1VmgQqKttG37JOsgiAVrvKFuVzE50TS+/KZ3t27ZfrSsbi6bT7Q/wD+d785fdkNvBGz
 kBxeB7D6jxJljKSTsz//kywXXP9TpANBR5/eqROREY/t2tEqXC4EEu3b/laX1CnGkjdc
 kyqIUoydp8gvLux9i7tb97K13hJq+iUmfeK5azha0zy31bRulSRRRhvwLs0oB0Xlnnzw
 pEfTel8B1M/nwkFKyhdraLhO8iEXMUrLBBnfBKK+r88KQLYBgoiwYioqnMti5Ha5XwJf
 jIYw==
X-Received: by 10.129.93.136 with SMTP id r130mr24880431ywb.52.1436544073353; 
 Fri, 10 Jul 2015 09:01:13 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.37.201.66 with HTTP; Fri, 10 Jul 2015 09:00:53 -0700 (PDT)
In-Reply-To: <B2FDC817-8F92-4BAF-AAD1-E450F891DA9C@HIDDEN>
References: <CA+8g5KH7wUkh52MyWsFU2-Vd8c9cEOKyx5X383io+XzWbByXtA@HIDDEN>
 <559F5D5C.9070509@HIDDEN>
 <B2FDC817-8F92-4BAF-AAD1-E450F891DA9C@HIDDEN>
From: Jim Meyering <jim@HIDDEN>
Date: Fri, 10 Jul 2015 09:00:53 -0700
X-Google-Sender-Auth: S90xd1jsiOqJmHZvPa9_duFLpnc
Message-ID: <CA+8g5KEVO4MB-BiugBgeZggc2M6NE_S_TTpJirjhBT_FpijtDA@HIDDEN>
Content-Type: text/plain; charset=UTF-8
X-Spam-Score: -0.7 (/)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.7 (/)

On Thu, Jul 9, 2015 at 10:56 PM, Mark Adler <madler@HIDDEN> wrote:
> As a side note, there already is a gzip replacement that I wrote that uses zlib and that also provides parallel compression called pigz.
>
>> On Jul 9, 2015, at 10:51 PM, Paul Eggert <eggert@HIDDEN> wrote:
>>
>> On 07/09/2015 04:31 PM, Jim Meyering wrote:
>>> https://blog.cloudflare.com/cloudflare-fights-cancer/
>>>
>>
>> A few years ago I started to rewrite gzip to use zlib rather than to do its own compression and decompression.  If we finished that, we could use cloudfare's zlib implementation trivially.

Hi Mark,

How close is pigz to being a strict superset of the functionality of gzip?
I.e., would we lose anything if we were to install pigz with the name gzip?

Message sent to bug-gzip@HIDDEN:

X-Loop: help-debbugs@HIDDEN
Subject: bug#21022: see how much cloudflare's zlib-improving techniques can help gzip
Resent-From: Mark Adler <madler@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gzip@HIDDEN
Resent-Date: Fri, 10 Jul 2015 17:26:02 +0000
Resent-Message-ID: <handler.21022.B21022.143654916031136 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 21022
X-GNU-PR-Package: gzip
X-GNU-PR-Keywords: 
To: Jim Meyering <jim@HIDDEN>
Cc: 21022 <at> debbugs.gnu.org, Paul Eggert <eggert@HIDDEN>
Received: via spool by 21022-submit <at> debbugs.gnu.org id=B21022.143654916031136
          (code B ref 21022); Fri, 10 Jul 2015 17:26:02 +0000
Received: (at 21022) by debbugs.gnu.org; 10 Jul 2015 17:26:00 +0000
Received: from localhost ([127.0.0.1]:46387 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.80)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1ZDc3j-000867-Jr
	for submit <at> debbugs.gnu.org; Fri, 10 Jul 2015 13:26:00 -0400
Received: from mail.alumni.caltech.edu ([131.215.242.114]:39133)
 by debbugs.gnu.org with smtp (Exim 4.80)
 (envelope-from <madler@HIDDEN>) id 1ZDc3h-00085r-42
 for 21022 <at> debbugs.gnu.org; Fri, 10 Jul 2015 13:25:58 -0400
Received: from [10.0.1.5] (unknown [138.229.211.204])
 (Authenticated sender: madler)
 by mail.alumni.caltech.edu (Postfix) with ESMTPSA id B40581200DD;
 Fri, 10 Jul 2015 10:25:49 -0700 (PDT)
DKIM-Filter: OpenDKIM Filter v2.10.3 mail.alumni.caltech.edu B40581200DD
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=alumni.caltech.edu;
 s=enforce; t=1436549149;
 bh=9K2SBEritrV2qYRPZ2skigWeTygEBtiWlKL5pV3vwLc=;
 h=Subject:From:In-Reply-To:Date:Cc:References:To:From;
 b=R5jVRoYP8rtWN3gCiU4m9IQAXQtvtcj/VvwHuLdvfxK98+tzZgSqC3rLOWgbXssaU
 sUbSLun9dspv5b8FOccyyGOOisJ5WmDTUDaPgagev5GGR8SxnOS3QPEQws1rYq382Z
 YxDclQL2jHA5LhA2J/hs5gkOUZx3y0UvdDEjxVOY=
Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2102\))
Content-Type: text/plain; charset=us-ascii
From: Mark Adler <madler@HIDDEN>
In-Reply-To: <CA+8g5KEVO4MB-BiugBgeZggc2M6NE_S_TTpJirjhBT_FpijtDA@HIDDEN>
Date: Fri, 10 Jul 2015 10:25:48 -0700
Content-Transfer-Encoding: quoted-printable
Message-Id: <4FA18781-D413-4D70-B71E-7FBCE63C0D23@HIDDEN>
References: <CA+8g5KH7wUkh52MyWsFU2-Vd8c9cEOKyx5X383io+XzWbByXtA@HIDDEN>
 <559F5D5C.9070509@HIDDEN>
 <B2FDC817-8F92-4BAF-AAD1-E450F891DA9C@HIDDEN>
 <CA+8g5KEVO4MB-BiugBgeZggc2M6NE_S_TTpJirjhBT_FpijtDA@HIDDEN>
X-Mailer: Apple Mail (2.2102)
X-MailScanner-Information-Alumni: 
X-Alumni-MailScanner-ID: B40581200DD.A1A31
X-MailScanner-Alumni: No Virii found
X-Spam-Status-Alumni: not spam, SpamAssassin (not cached, score=-1.1,
 required 5, ALL_TRUSTED -1.00, DKIM_SIGNED 0.10, DKIM_VALID -0.10,
 DKIM_VALID_AU -0.10)
X-MailScanner-From: madler@HIDDEN
X-Spam-Score: -0.6 (/)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.6 (/)

Jim,

On Jul 10, 2015, at 9:00 AM, Jim Meyering <jim@HIDDEN> wrote:
> How close is pigz to being a strict superset of the functionality of =
gzip?
> I.e., would we lose anything if we were to install pigz with the name =
gzip?

It should be very close.  I wrote it to be a drop-in replacement.

As I recall there is a difference in the way arguments are processed.  =
pigz considers the arguments to be an ordered series of instructions, =
whereas I think gzip looks at all of the options first and them applies =
them to all of the names.  Someone reported that as an issue when they =
tried to drop it in where the gzip options followed the name.

pigz does not have unlzh or unpack.  pigz does decompress Unix compress =
files.

pigz currently only compiles on Unix-ish systems with pthreads.

The super part of the superset includes parallel compression with a =
speedup of about n for n cores (and limited parallel improvement on =
decompression), rsyncable compression, compression and decompression of =
zlib and single-entry zip format, and zopfli maximal, but really slow, =
compression.

Mark



gzip124 1.2.4 (18 Aug 93)
usage: gzip124 [-cdfhlLnNrtvV19] [-S suffix] [file ...]
 -c --stdout      write on standard output, keep original files =
unchanged
 -d --decompress  decompress
 -f --force       force overwrite of output file and compress links
 -h --help        give this help
 -l --list        list compressed file contents
 -L --license     display software license
 -n --no-name     do not save or restore the original name and time =
stamp
 -N --name        save or restore the original name and time stamp
 -q --quiet       suppress all warnings
 -r --recursive   operate recursively on directories
 -S .suf  --suffix .suf     use suffix .suf on compressed files
 -t --test        test compressed file integrity
 -v --verbose     verbose mode
 -V --version     display version number
 -1 --fast        compress faster
 -9 --best        compress better
 file...          files to (de)compress. If none given, use standard =
input.



Usage: gzip16 [OPTION]... [FILE]...
Compress or uncompress FILEs (by default, compress FILES in-place).

Mandatory arguments to long options are mandatory for short options too.

  -c, --stdout      write on standard output, keep original files =
unchanged
  -d, --decompress  decompress
  -f, --force       force overwrite of output file and compress links
  -h, --help        give this help
  -k, --keep        keep (don't delete) input files
  -l, --list        list compressed file contents
  -L, --license     display software license
  -n, --no-name     do not save or restore the original name and time =
stamp
  -N, --name        save or restore the original name and time stamp
  -q, --quiet       suppress all warnings
  -r, --recursive   operate recursively on directories
  -S, --suffix=3DSUF  use suffix SUF on compressed files
  -t, --test        test compressed file integrity
  -v, --verbose     verbose mode
  -V, --version     display version number
  -1, --fast        compress faster
  -9, --best        compress better

With no FILE, or when FILE is -, read standard input.

Report bugs to <bug-gzip@HIDDEN>.



Usage: pigz [options] [files ...]
  will compress files in place, adding the suffix '.gz'.  If no files =
are
  specified, stdin will be compressed to stdout.  pigz does what gzip =
does,
  but spreads the work over multiple processors and cores when =
compressing.

Options:
  -0 to -9, -11        Compression level (11 is much slower, a few % =
better)
  --fast, --best       Compression levels 1 and 9 respectively
  -b, --blocksize mmm  Set compression block size to mmmK (default 128K)
  -c, --stdout         Write all processed output to stdout (won't =
delete)
  -d, --decompress     Decompress the compressed input
  -f, --force          Force overwrite, compress .gz, links, and to =
terminal
  -F  --first          Do iterations first, before block split for -11
  -h, --help           Display a help screen and quit
  -i, --independent    Compress blocks independently for damage recovery
  -I, --iterations n   Number of iterations for -11 optimization
  -k, --keep           Do not delete original file after processing
  -K, --zip            Compress to PKWare zip (.zip) single entry format
  -l, --list           List the contents of the compressed input
  -L, --license        Display the pigz license and quit
  -M, --maxsplits n    Maximum number of split blocks for -11
  -n, --no-name        Do not store or restore file name in/from header
  -N, --name           Store/restore file name and mod time in/from =
header
  -O  --oneblock       Do not split into smaller blocks for -11
  -p, --processes n    Allow up to n compression threads (default is the
                       number of online processors, or 8 if unknown)
  -q, --quiet          Print no messages, even on error
  -r, --recursive      Process the contents of all subdirectories
  -R, --rsyncable      Input-determined block locations for rsync
  -S, --suffix .sss    Use suffix .sss instead of .gz (for compression)
  -t, --test           Test the integrity of the compressed input
  -T, --no-time        Do not store or restore mod time in/from header
  -v, --verbose        Provide more verbose output
  -V  --version        Show the version of pigz
  -z, --zlib           Compress to zlib (.zz) instead of gzip format
  --                   All arguments after "--" are treated as files

Last modified: Mon, 25 Nov 2019 12:00:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.