GNU logs - #36823, boring messages

Message sent to help-debbugs@HIDDEN:

Subject: bug#36823: gcc bug prevents go program from starting newer gcc results in race condition
Resent-From: Malte Frank Gerdes <malte.f.gerdes@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: help-debbugs@HIDDEN
Resent-Date: Sat, 27 Jul 2019 17:01:02 +0000
Resent-Message-ID: <handler.36823.B.156424685922188 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: 36823 <at> debbugs.gnu.org
From: Malte Frank Gerdes <malte.f.gerdes@HIDDEN>
Date: Sat, 27 Jul 2019 18:37:41 +0200
Message-ID: <86wog3tove.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.2 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain
Precedence: list
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>

Hi,

The precompiled version of Hugo-extended was not able to find some
runtime dependencies:
   libstdc++.so.6  => not found
   libgcc_s.so.1   => not found

This seems like a version mismatch to me, so i built Hugo with the
following command:
  go build --tags extended

Now the error is (<HASH> = ypiv8dj4lkvsnm82s639h18l87frrh5g):
  /gnu/store/<HASH>-gcc-6.5.0-lib/lib/libstdc++.so.6: version
  `GLIBCXX_3.4.26' not found

The problem seems identical to [1].

I copmiled go-1.4 with gcc:lib from 7, 8 and 9 with no luck (the 9
variant even fails the tests due to a race condition somewhere, i read
that in some other bug report but can't find the ID). Error Message at
the end.

So is there any progress on this? I guess this is necessary to make the
execution of hugo-extended (and maybe other programs?) work.


[1]: https://stackoverflow.com/questions/52663287/glibcxx-3-4-26-not-found

-Malte

##### ../misc/cgo/testsanitizers
--- FAIL: TestShared (0.02s)
    --- FAIL: TestShared/tsan_shared (2.04s)
        cshared_test.go:71: `/tmp/guix-build-go-1.12.7.drv-0/TestShared821009189/tsan_shared` exited with exit status 66
            ==================
            WARNING: ThreadSanitizer: data race (pid=3613)
              Write of size 8 at 0x7ffff6095c20 by thread T1:
                #0 pthread_attr_getstacksize <null> (tsan_shared+0x00000041d5b2)
                #1 x_cgo_init <null> (libtsan_shared.so+0x0000000968e0)
                #2 runtime.rt0_go <null> (libtsan_shared.so+0x00000008cb0e)

              Previous write of size 8 at 0x7ffff6095c20 by main thread:
                #0 <null> <null> (0x000000000001)

              Location is stack of thread T1.

              Thread T1 (tid=3619, running) created by main thread at:
                #0 pthread_create <null> (tsan_shared+0x00000040dec4)
                #1 _cgo_try_pthread_create <null> (libtsan_shared.so+0x0000000967a1)
                #2 x_cgo_sys_thread_create <null> (libtsan_shared.so+0x000000096543)
                #3 _rt0_amd64_lib <null> (libtsan_shared.so+0x00000008ca16)

            SUMMARY: ThreadSanitizer: data race ??:0 pthread_attr_getstacksize
            ==================
            ==================
            WARNING: ThreadSanitizer: data race (pid=3613)
              Read of size 8 at 0x7d080000dfe0 by thread T2:
                #0 threadentry <null> (libtsan_shared.so+0x000000096b03)

              Previous write of size 8 at 0x7d080000dfe0 by thread T1:
                #0 malloc <null> (tsan_shared+0x00000040c2d3)
                #1 x_cgo_thread_start <null> (libtsan_shared.so+0x00000009716c)
                #2 runtime.asmcgocall <null> (libtsan_shared.so+0x00000008e546)

              Location is heap block of size 24 at 0x7d080000dfe0 allocated by thread T1:
                #0 malloc <null> (tsan_shared+0x00000040c2d3)
                #1 x_cgo_thread_start <null> (libtsan_shared.so+0x00000009716c)
                #2 runtime.asmcgocall <null> (libtsan_shared.so+0x00000008e546)

              Thread T2 (tid=3621, running) created by thread T1 at:
                #0 pthread_create <null> (tsan_shared+0x00000040dec4)
                #1 _cgo_try_pthread_create <null> (libtsan_shared.so+0x0000000967a1)
                #2 _cgo_sys_thread_start <null> (libtsan_shared.so+0x000000096a42)
                #3 x_cgo_thread_start <null> (libtsan_shared.so+0x0000000971fa)
                #4 runtime.asmcgocall <null> (libtsan_shared.so+0x00000008e546)

              Thread T1 (tid=3619, running) created by main thread at:
                #0 pthread_create <null> (tsan_shared+0x00000040dec4)
                #1 _cgo_try_pthread_create <null> (libtsan_shared.so+0x0000000967a1)
                #2 x_cgo_sys_thread_create <null> (libtsan_shared.so+0x000000096543)
                #3 _rt0_amd64_lib <null> (libtsan_shared.so+0x00000008ca16)

            SUMMARY: ThreadSanitizer: data race ??:0 threadentry
            ==================
            ==================
            WARNING: ThreadSanitizer: data race (pid=3613)
              Read of size 8 at 0x7ffff7fcc8b8 by thread T2:
                #0 threadentry <null> (libtsan_shared.so+0x000000096b36)

              Previous write of size 8 at 0x7ffff7fcc8b8 by thread T1:
                #0 x_cgo_init <null> (libtsan_shared.so+0x000000096874)
                #1 runtime.rt0_go <null> (libtsan_shared.so+0x00000008cb0e)

              Location is global 'setg_gcc' of size 8 at 0x7ffff7fcc8b8 (libtsan_shared.so+0x00000013a8b8)

              Thread T2 (tid=3621, running) created by thread T1 at:
                #0 pthread_create <null> (tsan_shared+0x00000040dec4)
                #1 _cgo_try_pthread_create <null> (libtsan_shared.so+0x0000000967a1)
                #2 _cgo_sys_thread_start <null> (libtsan_shared.so+0x000000096a42)
                #3 x_cgo_thread_start <null> (libtsan_shared.so+0x0000000971fa)
                #4 runtime.asmcgocall <null> (libtsan_shared.so+0x00000008e546)

              Thread T1 (tid=3619, running) created by main thread at:
                #0 pthread_create <null> (tsan_shared+0x00000040dec4)
                #1 _cgo_try_pthread_create <null> (libtsan_shared.so+0x0000000967a1)
                #2 x_cgo_sys_thread_create <null> (libtsan_shared.so+0x000000096543)
                #3 _rt0_amd64_lib <null> (libtsan_shared.so+0x00000008ca16)

            SUMMARY: ThreadSanitizer: data race ??:0 threadentry
            ==================
            ==================
            WARNING: ThreadSanitizer: data race (pid=3613)
              Read of size 8 at 0x7d080000df80 by thread T6:
                #0 threadentry <null> (libtsan_shared.so+0x000000096b03)

              Previous write of size 8 at 0x7d080000df80 by thread T1:
                #0 malloc <null> (tsan_shared+0x00000040c2d3)
                #1 x_cgo_thread_start <null> (libtsan_shared.so+0x00000009716c)
                #2 runtime.asmcgocall <null> (libtsan_shared.so+0x00000008e507)

              Location is heap block of size 24 at 0x7d080000df80 allocated by thread T1:
                #0 malloc <null> (tsan_shared+0x00000040c2d3)
                #1 x_cgo_thread_start <null> (libtsan_shared.so+0x00000009716c)
                #2 runtime.asmcgocall <null> (libtsan_shared.so+0x00000008e507)

              Thread T6 (tid=3625, running) created by thread T1 at:
                #0 pthread_create <null> (tsan_shared+0x00000040dec4)
                #1 _cgo_try_pthread_create <null> (libtsan_shared.so+0x0000000967a1)
                #2 _cgo_sys_thread_start <null> (libtsan_shared.so+0x000000096a42)
                #3 x_cgo_thread_start <null> (libtsan_shared.so+0x0000000971fa)
                #4 runtime.asmcgocall <null> (libtsan_shared.so+0x00000008e507)

              Thread T1 (tid=3619, running) created by main thread at:
                #0 pthread_create <null> (tsan_shared+0x00000040dec4)
                #1 _cgo_try_pthread_create <null> (libtsan_shared.so+0x0000000967a1)
                #2 x_cgo_sys_thread_create <null> (libtsan_shared.so+0x000000096543)
                #3 _rt0_amd64_lib <null> (libtsan_shared.so+0x00000008ca16)

            SUMMARY: ThreadSanitizer: data race ??:0 threadentry
            ==================
            ThreadSanitizer: reported 4 warnings
FAIL

Message sent:

Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-Mailer: MIME-tools 5.505 (Entity 5.505)
Content-Type: text/plain; charset=utf-8
X-Loop: help-debbugs@HIDDEN
From: help-debbugs@HIDDEN (GNU bug Tracking System)
To: Malte Frank Gerdes <malte.f.gerdes@HIDDEN>
Subject: bug#36823: Acknowledgement (gcc bug prevents go program from
 starting newer gcc results in race condition)
Message-ID: <handler.36823.B.156424685922188.ack <at> debbugs.gnu.org>
References: <86wog3tove.fsf@HIDDEN>
X-Gnu-PR-Message: ack 36823
X-Gnu-PR-Package: debbugs.gnu.org
Reply-To: 36823 <at> debbugs.gnu.org
Date: Sat, 27 Jul 2019 17:01:03 +0000

Thank you for filing a new bug report with debbugs.gnu.org.

This is an automatically generated reply to let you know your message
has been received.

Your message is being forwarded to the package maintainers and other
interested parties for their attention; they will reply in due course.

Your message has been sent to the package maintainer(s):
 help-debbugs@HIDDEN

If you wish to submit further information on this problem, please
send it to 36823 <at> debbugs.gnu.org.

Please do not send mail to help-debbugs@HIDDEN unless you wish
to report a problem with the Bug-tracking system.

--=20
36823: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D36823
GNU Bug Tracking System
Contact help-debbugs@HIDDEN with problems

Message received at control <at> debbugs.gnu.org:

Received: (at control) by debbugs.gnu.org; 27 Jul 2019 17:16:28 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sat Jul 27 13:16:28 2019
Received: from localhost ([127.0.0.1]:45359 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1hrQJ2-0006Jl-0e
	for submit <at> debbugs.gnu.org; Sat, 27 Jul 2019 13:16:28 -0400
Received: from eggs.gnu.org ([209.51.188.92]:40553)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <rgm@HIDDEN>) id 1hrQJ0-0006JV-62
 for control <at> debbugs.gnu.org; Sat, 27 Jul 2019 13:16:26 -0400
Received: from fencepost.gnu.org ([2001:470:142:3::e]:43393)
 by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from <rgm@HIDDEN>)
 id 1hrQIv-00069B-2z
 for control <at> debbugs.gnu.org; Sat, 27 Jul 2019 13:16:21 -0400
Received: from rgm by fencepost.gnu.org with local (Exim 4.82)
 (envelope-from <rgm@HIDDEN>) id 1hrQIu-00071C-Ky
 for control <at> debbugs.gnu.org; Sat, 27 Jul 2019 13:16:20 -0400
Subject: control message for bug 36823
To: <control <at> debbugs.gnu.org>
X-Mailer: mail (GNU Mailutils 2.99.98)
Message-Id: <E1hrQIu-00071C-Ky@HIDDEN>
From: Glenn Morris <rgm@HIDDEN>
Date: Sat, 27 Jul 2019 13:16:20 -0400
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic]
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: control
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

reassign 36823 guix

Message sent to bug-guix@HIDDEN:

Subject: bug#36823: gcc bug prevents go program from starting newer gcc results in race condition
Resent-From: Sarah Morgensen <iskarian@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-guix@HIDDEN
Resent-Date: Sun, 04 Jul 2021 20:43:01 +0000
Resent-Message-ID: <handler.36823.B36823.162543132211953 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: Malte Frank Gerdes <malte.f.gerdes@HIDDEN>
Cc: 36823 <at> debbugs.gnu.org
From: Sarah Morgensen <iskarian@HIDDEN>
References: <86wog3tove.fsf@HIDDEN>
Date: Sun, 04 Jul 2021 13:41:54 -0700
In-Reply-To: <86wog3tove.fsf@HIDDEN> (Malte Frank Gerdes's message of "Sat, 
 27 Jul 2019 18:37:41 +0200")
Message-ID: <86fswtak19.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/mixed; boundary="=-=-="
Precedence: list
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>

--=-=-=
Content-Type: text/plain


Hello,

Thanks for the report.

Malte Frank Gerdes <malte.f.gerdes@HIDDEN> writes:

> Hi,
>
> The precompiled version of Hugo-extended was not able to find some
> runtime dependencies:
>    libstdc++.so.6  => not found
>    libgcc_s.so.1   => not found

In case you haven't discovered this in the past two years (oops), this
is because Guix does not typically work with pre-compiled software that
relies on system libraries being in /lib, since there is no system-wide
/lib.

> This seems like a version mismatch to me, so i built Hugo with the
> following command:
>   go build --tags extended
>
> Now the error is (<HASH> = ypiv8dj4lkvsnm82s639h18l87frrh5g):
>   /gnu/store/<HASH>-gcc-6.5.0-lib/lib/libstdc++.so.6: version
>   `GLIBCXX_3.4.26' not found

If I build hugo with gcc-toolchain@7 in my user profile, it works fine.
However.... I can still repro this issue with gcc-toolchain@8+:

$ go build --tags extended
$ ./hugo --help
./hugo: /gnu/store/01b4w3m6mp55y531kyi1g8shh722kwqm-gcc-7.5.0-lib/lib/libstdc++.so.6: version `GLIBCXX_3.4.26' not found (required by ./hugo)
./hugo: /gnu/store/01b4w3m6mp55y531kyi1g8shh722kwqm-gcc-7.5.0-lib/lib/libstdc++.so.6: version `GLIBCXX_3.4.29' not found (required by ./hugo)

This is because gcc 7's libraries are shadowing the newer gcc's
libraries:

$ readelf -d hugo | grep RUNPATH
 0x000000000000001d (RUNPATH)            Library runpath: [/gnu/store/01b4w3m6mp55y531kyi1g8shh722kwqm-gcc-7.5.0-lib/lib:/gnu/store/fa6wj5bxkj5ll1d7292a70knmyl7a0cr-glibc-2.31/lib:/gnu/store/3h7xd0d47a286b6r9qhz4ybi5iaxkfwi-gcc-11.1.0-lib/lib:/home/sarah/.guix-profile/lib:/gnu/store/3h7xd0d47a286b6r9qhz4ybi5iaxkfwi-gcc-11.1.0-lib/lib/gcc/x86_64-unknown-linux-gnu/11.1.0/../../..]

If I use patchelf to remove the gcc 7 library dir from RUNPATH, hugo
works fine. This is because Go is patched to unconditionally add a
runpath to gcc 7's libraries but erroneously does not explicitly set
CXX. (See also <https://issues.guix.gnu.org/39400>.)

The following patch should explicitly set CXX for Go, so that it always
uses the "system" version:


--=-=-=
Content-Type: text/x-patch
Content-Disposition: inline; filename=go-explicitly-set-CXX.patch
Content-Description: go-explicitly-set-CXX.patch

diff --git a/gnu/packages/golang.scm b/gnu/packages/golang.scm
index 0318918a37..a27f57aa30 100644
--- a/gnu/packages/golang.scm
+++ b/gnu/packages/golang.scm
@@ -395,6 +395,7 @@ in the style of communicating sequential processes (@dfn{CSP}).")
                ;; FIXME: Some of the .a files are not bit-reproducible.
                (let* ((output (assoc-ref outputs "out")))
                  (setenv "CC" (which "gcc"))
+                 (setenv "CXX" (which "g++"))
                  (setenv "GOOS" "linux")
                  (setenv "GOROOT" (dirname (getcwd)))
                  (setenv "GOROOT_FINAL" output)
@@ -577,6 +578,7 @@ in the style of communicating sequential processes (@dfn{CSP}).")
                       (loader (string-append (assoc-ref inputs "libc")
                                              ,(glibc-dynamic-linker))))
                  (setenv "CC" (which "gcc"))
+                 (setenv "CXX" (which "g++"))
                  (setenv "GO_LDSO" loader)
                  (setenv "GOOS" "linux")
                  (setenv "GOROOT" (dirname (getcwd)))

--=-=-=
Content-Type: text/plain


Hope that helps,
Sarah

--=-=-=--

Last modified: Sun, 4 Jul 2021 20:45:01 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.