GNU bug report logs - #44390
Cuirass reports succesful builds as failed in /var/log/cuirass.log and cuirass-web reports them as scheduled

Previous Next

Package: guix;

Reported by: david larsson <david.larsson <at> selfhosted.xyz>

Date: Mon, 2 Nov 2020 15:05:02 UTC

Severity: normal

Done: Mathieu Othacehe <othacehe <at> gnu.org>

Bug is archived. No further changes may be made.

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 44390 in the body.
You can then email your comments to 44390 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

View this report as an mbox folder, status mbox, maintainer mbox


Report forwarded to bug-guix <at> gnu.org:
bug#44390; Package guix. (Mon, 02 Nov 2020 15:05:02 GMT) Full text and rfc822 format available.

Acknowledgement sent to david larsson <david.larsson <at> selfhosted.xyz>:
New bug report received and forwarded. Copy sent to bug-guix <at> gnu.org. (Mon, 02 Nov 2020 15:05:02 GMT) Full text and rfc822 format available.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: david larsson <david.larsson <at> selfhosted.xyz>
To: bug-guix <at> gnu.org
Subject: Cuirass reports succesful builds as failed in /var/log/cuirass.log
 and cuirass-web reports them as scheduled
Date: Mon, 02 Nov 2020 15:04:31 +0000
Hi!

In /var/log/cuirass.log:

2020-11-02T15:41:34 build succeeded: 
'/gnu/store/aqn31rymjs3qybsd1d2ssn93f8s0jlz5-git-checkout.drv'
2020-11-02T15:41:35 build started: 
'/gnu/store/q7q6s24h05kxib5wvjmnn5zmy6vh3m63-git-checkout.drv'
2020-11-02T15:41:39 build succeeded: 
'/gnu/store/q7q6s24h05kxib5wvjmnn5zmy6vh3m63-git-checkout.drv'
2020-11-02T15:41:39 build started: 
'/gnu/store/hwkdx9qabrp8q3anc1d0brnxfr7xdj2n-orgmk-v0.0.2.drv'
2020-11-02T15:41:40 build succeeded: 
'/gnu/store/hwkdx9qabrp8q3anc1d0brnxfr7xdj2n-orgmk-v0.0.2.drv'
2020-11-02T15:41:41 build started: 
'/gnu/store/2lxjrb5sfi0mxj1871zb5g47nkg76j6z-fwknop-3.0.0.drv'
2020-11-02T15:42:19 build succeeded: 
'/gnu/store/2lxjrb5sfi0mxj1871zb5g47nkg76j6z-fwknop-3.0.0.drv'
2020-11-02T15:42:20 done with 10 derivations
2020-11-02T15:42:20 outputs:
/gnu/store/a462kby1q51ndvxdv3b6p0rsixxrgx1h-hello-2.10
/gnu/store/p02qaingwm7hmlax4zh9af8d72jivdnr-cowsay-3.04
/gnu/store/bj30r24xjv55nh1lx0r24psrlrm5haif-orgmk-v0.0.2
/gnu/store/nbknii5yq7djc6vg90kay7jiplk65n2i-fwknop-3.0.0
/gnu/store/bprgycch5x2bh8gch32nksw9cvrii2lc-python-on-guile-1.2.3.5
/gnu/store/97aggnqbar8gzwfqqxf8mk10rpia9244-libxml2-xpath0-1.1.1-0.0.0.6c7a378
/gnu/store/9bszaplxdxg3l6wid9l7lf6vqnnmkyic-libxml2-xpath0-1.1.1-0.0.0.6c7a378-static
/gnu/store/8nw4nz1l72yxalni2xnfdna2qpxr87r8-guile-bash-parallel-v0.0.7
/gnu/store/cqdqaa0nsvjqv7003sfkfiv9b8r2080k-guile-base64-v0.0.1
/gnu/store/1sq6cnpnpzpxmv9nkpfvim9wild6c303-perl-data-ical-0.24
/gnu/store/4ijsrmkb02z2s18bgkw5kyvf4kpwsdyg-python-pydotplus-2.0.2
2020-11-02T15:42:20 success: 0, fail: 10
2020-11-02T15:42:34 heap: 44.49 MiB; threads: 11; file descriptors: 4



And in the web interface they are reported as "Scheduled":

Input	Commit
git://git.savannah.gnu.org/guix.git	28e20c53530671ece8421ccb4ac815fd1beaf9fe
file:///home/cuirass/my-guix-packages	9f9c644076b088aabee76626598115c0fe6bfbde
Pending builds of evaluation #1

All 10
 Scheduled 10
 Succeeded 0
 Failed 0
ID	Specification	Completion time	Job	Name	System	Log
10	my-pkgs	—	python-pydotplus-2.0.2.x86_64-linux	python-pydotplus-2.0.2	x86_64-linux	—
9	my-pkgs	—	perl-data-ical-0.24.x86_64-linux	perl-data-ical-0.24	x86_64-linux	—
8	my-pkgs	—	guile-base64-v0.0.1.x86_64-linux	guile-base64-v0.0.1	x86_64-linux	—
7	my-pkgs	—	guile-bash-parallel-v0.0.7.x86_64-linux	guile-bash-parallel-v0.0.7	x86_64-linux	—
6	my-pkgs	—	libxml2-xpath0-1.1.1-0.0.0.6c7a378.x86_64-linux	libxml2-xpath0-1.1.1-0.0.0.6c7a378	x86_64-linux	—
5	my-pkgs	—	python-on-guile-1.2.3.5.x86_64-linux	python-on-guile-1.2.3.5	x86_64-linux	—
4	my-pkgs	—	fwknop-3.0.0.x86_64-linux	fwknop-3.0.0	x86_64-linux	—
3	my-pkgs	—	orgmk-v0.0.2.x86_64-linux	orgmk-v0.0.2	x86_64-linux	—
2	my-pkgs	—	cowsay-3.04.x86_64-linux	cowsay-3.04	x86_64-linux	—
1	my-pkgs	—	hello-2.10.x86_64-linux	hello-2.10	x86_64-linux	—


Cuirass config:

(define %cuirass-specs
  #~(
     ;; spec two
     list
  '((#:name . "my-pkgs")
    (#:load-path-inputs . ("guix"))
    ;;(#:package-path-inputs . ("my-guixsd-config.sh"))
    (#:package-path-inputs . ("my-guix-packages"))
    ;;(#:package-path-inputs . ())
    ;;(#:package-path-inputs . ())
    (#:proc-input . "guix")
    (#:proc-file . "build-aux/cuirass/gnu-system.scm")
    (#:proc . cuirass-jobs)
    (#:proc-args .
     (;;(subset . manifests)
      ;;(subset . ("hello" "cowsay" "perl-moose" "jupyter" 
"enlightenment"))
      (subset . ("hello" "cowsay" "orgmk" "fwknop" "python-on-guile" 
"libxml2-xpath0" "guile-bash-parallel" "guile-base64" "perl-data-ical" 
"python-pydotplus"))
      (systems . ("x86_64-linux"))
      ;;(manifests . (("my-guix-packages" . "manifest.scm")))
      ))
    (#:inputs . (
                 ((#:name . "guix")
                  (#:url . "git://git.savannah.gnu.org/guix.git")
                  (#:load-path . ".")
                  (#:branch . "master")
                  (#:no-compile? . #t))

                 ((#:name . "my-guix-packages")
                  (#:url . "file:///home/cuirass/my-guix-packages")
                  (#:load-path . "packages")
                  (#:branch . "master")
                  (#:no-compile? . #t))

                 ;; ((#:name . "my-guix-packages")
                 ;;  (#:url . 
"https://github.com/methuselah-0/my-guix-packages.git")
                 ;;  (#:load-path . "packages")
                 ;;  (#:branch . "master")
                 ;;  (#:no-compile? . #t))

                 ))
    (#:build-outputs . ()))

))


Best regards,
David




Information forwarded to bug-guix <at> gnu.org:
bug#44390; Package guix. (Mon, 02 Nov 2020 16:29:01 GMT) Full text and rfc822 format available.

Message #8 received at 44390 <at> debbugs.gnu.org (full text, mbox):

From: Mathieu Othacehe <othacehe <at> gnu.org>
To: david larsson <david.larsson <at> selfhosted.xyz>
Cc: 44390 <at> debbugs.gnu.org
Subject: Re: bug#44390: Cuirass reports succesful builds as failed in
 /var/log/cuirass.log and cuirass-web reports them as scheduled
Date: Mon, 02 Nov 2020 17:28:48 +0100
Hello David,

> /gnu/store/4ijsrmkb02z2s18bgkw5kyvf4kpwsdyg-python-pydotplus-2.0.2
> 2020-11-02T15:42:20 success: 0, fail: 10
> 2020-11-02T15:42:34 heap: 44.49 MiB; threads: 11; file descriptors: 4

Thanks for the bug report. This bug is the result of some recent
optimizations. The database requests updating the build statuses are
queued and issues by batches of 100 requests.

As you only have 10 builds, those requests are only queued. That's why
the web interface reports them as "scheduled" while the log shows that
they were built.

The "fail: 10" is also a consequence of that problem. Forcing the
pending queries once a batch of builds is done could possibly solve this
problem but I need to think more about it.

Thanks,

Mathieu




Information forwarded to bug-guix <at> gnu.org:
bug#44390; Package guix. (Mon, 02 Nov 2020 16:41:02 GMT) Full text and rfc822 format available.

Message #11 received at 44390 <at> debbugs.gnu.org (full text, mbox):

From: Jonathan Brielmaier <jonathan.brielmaier <at> web.de>
To: 44390 <at> debbugs.gnu.org
Subject: Cuirass reports succesful builds as failed in /var/log/cuirass.log
 and cuirass-web reports them as scheduled
Date: Mon, 2 Nov 2020 17:40:12 +0100
Nice bug report David! I encounter the same problem :P

@Mathieu: Would it be an option to just make it configurable? It seems
that it makes a significant performance impact on larger cuirass
servers. But small servers still could set it to 1 or so...




Information forwarded to bug-guix <at> gnu.org:
bug#44390; Package guix. (Fri, 06 Nov 2020 14:08:01 GMT) Full text and rfc822 format available.

Message #14 received at 44390 <at> debbugs.gnu.org (full text, mbox):

From: Jonathan Brielmaier <jonathan.brielmaier <at> web.de>
To: 44390 <at> debbugs.gnu.org
Subject: Cuirass reports succesful builds as failed in /var/log/cuirass.log
 and cuirass-web reports them as scheduled
Date: Fri, 6 Nov 2020 15:07:15 +0100
In the mean time I did a quick fix on my system in config.scm:

```
(use-modules (gnu)

             (gnu packages ci) (guix packages) (guix utils))


(define-public cuirass/queue-1

  (package/inherit cuirass

    (name "cuirass-queue-1")

    (arguments

     (substitute-keyword-arguments (package-arguments cuirass)

       ((#:phases phases)

        `(modify-phases ,phases

           (add-after 'disable-repo-tests 'set-queue-size

             (lambda _

               (substitute* "src/cuirass/database.scm"

                 (("queue-size 100") "queue-size 1"))

               #t))))))))

```

Plus (cuirass cuirass/queue-1)
 in the cuirass-configuration. So no need from my side to hurry anmyore :)





Information forwarded to bug-guix <at> gnu.org:
bug#44390; Package guix. (Sun, 06 Dec 2020 09:17:01 GMT) Full text and rfc822 format available.

Message #17 received at 44390 <at> debbugs.gnu.org (full text, mbox):

From: david larsson <david.larsson <at> selfhosted.xyz>
To: Jonathan Brielmaier <jonathan.brielmaier <at> web.de>
Cc: bug-Guix <bug-guix-bounces+someone=selfhosted.xyz <at> gnu.org>,
 44390 <at> debbugs.gnu.org
Subject: Re: bug#44390: Cuirass reports succesful builds as failed in
 /var/log/cuirass.log and cuirass-web reports them as scheduled
Date: Sun, 06 Dec 2020 10:16:04 +0100
On 2020-11-06 15:07, Jonathan Brielmaier wrote:
> In the mean time I did a quick fix on my system in config.scm:
> 
> ```
> (use-modules (gnu)
> 
>              (gnu packages ci) (guix packages) (guix utils))
> 
> 
> (define-public cuirass/queue-1
> 
>   (package/inherit cuirass
> 
>     (name "cuirass-queue-1")
> 
>     (arguments
> 
>      (substitute-keyword-arguments (package-arguments cuirass)
> 
>        ((#:phases phases)
> 
>         `(modify-phases ,phases
> 
>            (add-after 'disable-repo-tests 'set-queue-size
> 
>              (lambda _
> 
>                (substitute* "src/cuirass/database.scm"
> 
>                  (("queue-size 100") "queue-size 1"))
> 
>                #t))))))))
> 
> ```
> 
> Plus (cuirass cuirass/queue-1)
>  in the cuirass-configuration. So no need from my side to hurry anmyore 
> :)

Thank you for this. It works well!

Best regards,
David




Reply sent to Mathieu Othacehe <othacehe <at> gnu.org>:
You have taken responsibility. (Tue, 08 Dec 2020 11:10:02 GMT) Full text and rfc822 format available.

Notification sent to david larsson <david.larsson <at> selfhosted.xyz>:
bug acknowledged by developer. (Tue, 08 Dec 2020 11:10:02 GMT) Full text and rfc822 format available.

Message #22 received at 44390-done <at> debbugs.gnu.org (full text, mbox):

From: Mathieu Othacehe <othacehe <at> gnu.org>
To: david larsson <david.larsson <at> selfhosted.xyz>
Cc: bug-Guix <bug-guix-bounces+someone=selfhosted.xyz <at> gnu.org>,
 Jonathan Brielmaier <jonathan.brielmaier <at> web.de>, 44390-done <at> debbugs.gnu.org
Subject: Re: bug#44390: Cuirass reports succesful builds as failed in
 /var/log/cuirass.log and cuirass-web reports them as scheduled
Date: Tue, 08 Dec 2020 12:09:42 +0100
Hello,

Cuirass commit 697fa14584551d9595cd042f1ffeba240e45a127 adds a
"--queue-size" argument.

With Guix commit 770fb659a62d8adab9a4ba7b44e2760722703879, Cuirass is
passed the "queue-size" argument, defaulting to 1.

Thanks,

Mathieu




Information forwarded to bug-guix <at> gnu.org:
bug#44390; Package guix. (Tue, 08 Dec 2020 22:36:02 GMT) Full text and rfc822 format available.

Message #25 received at 44390 <at> debbugs.gnu.org (full text, mbox):

From: Jonathan Brielmaier <jonathan.brielmaier <at> web.de>
To: Mathieu Othacehe <othacehe <at> gnu.org>,
 david larsson <david.larsson <at> selfhosted.xyz>
Cc: 44390 <at> debbugs.gnu.org
Subject: Re: bug#44390: Cuirass reports succesful builds as failed in
 /var/log/cuirass.log and cuirass-web reports them as scheduled
Date: Tue, 8 Dec 2020 23:35:06 +0100
On 08.12.20 12:09, Mathieu Othacehe wrote:
>
> Hello,
>
> Cuirass commit 697fa14584551d9595cd042f1ffeba240e45a127 adds a
> "--queue-size" argument.
>
> With Guix commit 770fb659a62d8adab9a4ba7b44e2760722703879, Cuirass is
> passed the "queue-size" argument, defaulting to 1.

Fix confirmed on my personal Cuirass server :)

Merci Mathieu!




bug archived. Request was from Debbugs Internal Request <help-debbugs <at> gnu.org> to internal_control <at> debbugs.gnu.org. (Wed, 06 Jan 2021 12:24:11 GMT) Full text and rfc822 format available.

This bug report was last modified 3 years and 82 days ago.

Previous Next


GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.