GNU bug report logs - #52250
[cuirass] Feature request: Compare evaluations in the web interface

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: guix; Severity: wishlist; Reported by: Leo Famulari <leo@HIDDEN>; dated Thu, 2 Dec 2021 21:45:01 UTC; Maintainer for guix is bug-guix@HIDDEN.

Message received at 52250 <at> debbugs.gnu.org:


Received: (at 52250) by debbugs.gnu.org; 3 Dec 2021 10:04:19 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Fri Dec 03 05:04:19 2021
Received: from localhost ([127.0.0.1]:50057 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1mt5QR-0007F0-9f
	for submit <at> debbugs.gnu.org; Fri, 03 Dec 2021 05:04:19 -0500
Received: from eggs.gnu.org ([209.51.188.92]:41666)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <othacehe@HIDDEN>) id 1mt5QO-0007Eh-Oh
 for 52250 <at> debbugs.gnu.org; Fri, 03 Dec 2021 05:04:17 -0500
Received: from [2001:470:142:3::e] (port=54328 helo=fencepost.gnu.org)
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <othacehe@HIDDEN>)
 id 1mt5QJ-0000nr-FG; Fri, 03 Dec 2021 05:04:11 -0500
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org;
 s=fencepost-gnu-org; h=MIME-Version:In-Reply-To:Date:References:Subject:To:
 From; bh=bMLmvFdi+WXdne2GYAHyn8cKiCGRnHgUMWWjW5yR6pc=; b=pdYCV1y5HLIPiPMmjoB9
 ymsXbsJ5M9Eu9cp9PNK1lUdUSqPSb0HSeoZ13Aigt6b9fsalFNyNab0+pruwDUvkDOgGyzyZOzD4H
 93jnSbr6wLtexhIFz7AS7Lc79XA4GtxDAaAIJEnwrC9bVIvjpxMoR8Ad8VIW7Wk22ugmmesFvYvCa
 6NQJK/wrEa/ncHIjNsLp3GMngR8Cg6+axB1Jgbd7vyjGmqDK1z5SQkpSHuw6723U327VOFWL/MEPo
 KNDIyWM/+/THC5W2hnIvdoqmBqscng3+NSJNWzUIuWxnUUQ/s/YP8Nesf8typswk41lQD36gP+eDw
 oTQTVHUEbldTdg==;
Received: from [2a01:e0a:19b:d9a0:45b5:a14a:5c75:5737] (port=32918 helo=meije)
 by fencepost.gnu.org with esmtpsa
 (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1)
 (envelope-from <othacehe@HIDDEN>)
 id 1mt5QI-0003qJ-R8; Fri, 03 Dec 2021 05:04:11 -0500
From: Mathieu Othacehe <othacehe@HIDDEN>
To: Leo Famulari <leo@HIDDEN>
Subject: Re: bug#52250: [cuirass] Feature request: Compare evaluations in
 the web interface
References: <Yak+MZYScPKOVxKw@HIDDEN>
Date: Fri, 03 Dec 2021 11:04:07 +0100
In-Reply-To: <Yak+MZYScPKOVxKw@HIDDEN> (Leo Famulari's message of "Thu, 2
 Dec 2021 16:44:17 -0500")
Message-ID: <874k7qt36w.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: 52250
Cc: 52250 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)


Hello Leo,

> "[...] the ability to compare the results of two evaluations
> and show the *differences* between those results, i.e. to enumerate the
> newly failing jobs, the newly succeeding jobs, and the newly aborted
> jobs."

Yes that's something we should definitely add to Cuirass. On the
database side, the Jobs table gives the list of all the builds related
to an evaluation.

Implementing an evaluation diff (new derivations, newly successful
derivations, newly failing derivations, removed derivations) should just
be a matter of displaying data nicely.

The not so trivial part is how to make it somehow user friendly in the
Web UI. The rest of the interface isn't super easy to understand and I
fear that it will add an extra layer of complexity if not integrated
properly.

A first implementation could be a completely separate page, with two
text inputs to enter evaluation A and evaluation B ids. Then, when
clicking on a "GO" button the diff would be displayed under an array
with different tabulations.

WDYT?

Thanks,

Mathieu




Information forwarded to bug-guix@HIDDEN:
bug#52250; Package guix. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 2 Dec 2021 21:44:31 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Thu Dec 02 16:44:31 2021
Received: from localhost ([127.0.0.1]:49474 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1mstsU-0006y3-QO
	for submit <at> debbugs.gnu.org; Thu, 02 Dec 2021 16:44:31 -0500
Received: from lists.gnu.org ([209.51.188.17]:45422)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <leo@HIDDEN>) id 1mstsT-0006xv-1y
 for submit <at> debbugs.gnu.org; Thu, 02 Dec 2021 16:44:29 -0500
Received: from eggs.gnu.org ([209.51.188.92]:57310)
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <leo@HIDDEN>) id 1mstsQ-0004BX-Bj
 for bug-guix@HIDDEN; Thu, 02 Dec 2021 16:44:28 -0500
Received: from wout1-smtp.messagingengine.com ([64.147.123.24]:45395)
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <leo@HIDDEN>) id 1mstsM-000206-PS
 for bug-guix@HIDDEN; Thu, 02 Dec 2021 16:44:25 -0500
Received: from compute6.internal (compute6.nyi.internal [10.202.2.46])
 by mailout.west.internal (Postfix) with ESMTP id 667423201D07;
 Thu,  2 Dec 2021 16:44:20 -0500 (EST)
Received: from mailfrontend2 ([10.202.2.163])
 by compute6.internal (MEProxy); Thu, 02 Dec 2021 16:44:20 -0500
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=famulari.name;
 h=date:from:to:subject:message-id:mime-version:content-type; s=
 mesmtp; bh=lJ1nOWpsARuqru00Wx5cWBEPeO2nBg9FCqCvqes2xDs=; b=KsWHv
 fWtVVrDE3WBT0ft4mdJJwKdnkPPDIB+Q7dHvfH4qPA0FD1W2Daev3Wo/yUgu8j52
 97B068sXiKw8+FvkRCTXX4Hj1f1gYU8mFf6ng+ccxB9p/leNJ8yxbxQhKVt6ZMVJ
 m48wX5wP37OaKSkC1uu6Ox8ouhcQf6YyZBeMmE=
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=
 messagingengine.com; h=content-type:date:from:message-id
 :mime-version:subject:to:x-me-proxy:x-me-proxy:x-me-sender
 :x-me-sender:x-sasl-enc; s=fm1; bh=lJ1nOWpsARuqru00Wx5cWBEPeO2nB
 g9FCqCvqes2xDs=; b=EB3ZwdIXszIEcjlVR4xO5ZKfG2gk+pnz9+DTmhec99tbg
 f6UOW3hExupKfkDZQpLZlsl5dldRHOD8UbnfOJ8P4hvYNF11NSkDySpMVEL9Dp04
 hS556wzY0pqJB3iXLcRKebWjGunkwAYX603tEBFmDa90FdUHsBAp7oDl+q2s+LXP
 0JaiEsCeZFDawgw043Z0IlbxkWKCF+8RL3Q+NmDk1luo5EkpUV1dJ04WQpRsy0F0
 QQp6hFsl1LjSBG4TWIg7ZG7FZyonP1SH/CCW10zxg3y+uvZN2LDIhOv6thcB3UeM
 EWprKchnTv4yXeLbr67PZQzOI2VDfuhFGHQi6dZvg==
X-ME-Sender: <xms:Mz6pYZhG04I7VV179QeonMk0S36Btl57MPrHi5gxIxgbkxWYC0ZsCQ>
 <xme:Mz6pYeC6d7FUoBoVprjuvAggBvHML7XEQlPNhS_gt4EH7A7hcWxjvqDgU3lystiV_
 PNAoTSsk5OKSFv8IQ>
X-ME-Received: <xmr:Mz6pYZEpwJ8892HV1G8fdasGWgRNSHjhSRBNpseFLMoLF_qHl15NIqToZ2kRr8zUCLUBKlE9xrVs0Jfw2nKoLOJqSw>
X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvuddrieehgdduhedvucetufdoteggodetrfdotf
 fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen
 uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkgggtugesthdtredttd
 dtvdenucfhrhhomhepnfgvohcuhfgrmhhulhgrrhhiuceolhgvohesfhgrmhhulhgrrhhi
 rdhnrghmvgeqnecuggftrfgrthhtvghrnhepueeiudeijeduffdvhfejvdegvdehgffgje
 dvveekfeefleefkeeuieejudevtedunecuffhomhgrihhnpehgnhhurdhorhhgnecuvehl
 uhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomheplhgvohesfhgrmh
 hulhgrrhhirdhnrghmvg
X-ME-Proxy: <xmx:Mz6pYeRkuf4lFTlIpqPQ_hSYeKvDe_LvWwGmWVpqhBRVKcS3yUAy4w>
 <xmx:Mz6pYWyRCPwwhqOC3AJerPeElAamrwJZPS2d25ycwJAzbiUz_F0tFA>
 <xmx:Mz6pYU6PwzoiZyTdCnkTAhnQsHNOlytMjFPkhs5-MNyy-Evlior7RQ>
 <xmx:Mz6pYbtppM963rxA4qRCJOQ0oF-HbBt1w-I1Um6rDy5WbeJ5dfHWfg>
Received: by mail.messagingengine.com (Postfix) with ESMTPA for
 <bug-guix@HIDDEN>; Thu, 2 Dec 2021 16:44:19 -0500 (EST)
Date: Thu, 2 Dec 2021 16:44:17 -0500
From: Leo Famulari <leo@HIDDEN>
To: bug-guix@HIDDEN
Subject: [cuirass] Feature request: Compare evaluations in the web interface
Message-ID: <Yak+MZYScPKOVxKw@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
Received-SPF: pass client-ip=64.147.123.24; envelope-from=leo@HIDDEN;
 helo=wout1-smtp.messagingengine.com
X-Spam_score_int: -27
X-Spam_score: -2.8
X-Spam_bar: --
X-Spam_report: (-2.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
 DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1,
 RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_PASS=-0.001,
 SPF_PASS=-0.001 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: -1.4 (-)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.4 (--)

As Mark mentioned recently in #33362 [0], the Cuirass web interface is
still missing an important feature compared to Hyrda:

"[...] the ability to compare the results of two evaluations
and show the *differences* between those results, i.e. to enumerate the
newly failing jobs, the newly succeeding jobs, and the newly aborted
jobs."

I remember using this capability in Hydra and it made the branching
workflow much more efficient than is currently possible.

[0]
https://issues.guix.gnu.org/33362#11




Acknowledgement sent to Leo Famulari <leo@HIDDEN>:
New bug report received and forwarded. Copy sent to bug-guix@HIDDEN. Full text available.
Report forwarded to bug-guix@HIDDEN:
bug#52250; Package guix. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Fri, 3 Dec 2021 10:15:01 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.