GNU bug report logs - #73649
OpenMPI + mpi4py broken: rank=0

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: guix; Reported by: Antero Mejr <mail@HIDDEN>; dated Sun, 6 Oct 2024 01:02:02 UTC; Maintainer for guix is bug-guix@HIDDEN.

Message received at 73649 <at> debbugs.gnu.org:


Received: (at 73649) by debbugs.gnu.org; 11 Dec 2024 23:35:40 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed Dec 11 18:35:40 2024
Received: from localhost ([127.0.0.1]:36808 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1tLWF1-0001a7-L0
	for submit <at> debbugs.gnu.org; Wed, 11 Dec 2024 18:35:39 -0500
Received: from sender4-op-o12.zoho.com ([136.143.188.12]:17273)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <mail@HIDDEN>) id 1tLWEy-0001Zs-3r
 for 73649 <at> debbugs.gnu.org; Wed, 11 Dec 2024 18:35:38 -0500
ARC-Seal: i=1; a=rsa-sha256; t=1733960132; cv=none; 
 d=zohomail.com; s=zohoarc; 
 b=LuCLZM9PVtt+VmoLdvELYGiBymlR5gdHZwViX043BnsP/10RGTuk4oxoVmILPaaBKJVqGlXsWbfJXb8cm0jqCPp/PGGFSjU4Q/YE25bW2yYMCm8PL/ILmjXlh06pKm/+renR7WR8P5WTTyomIqacvA87EWo3r56xgzp3wARWP50=
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com;
 s=zohoarc; t=1733960132;
 h=Content-Type:Cc:Cc:Date:Date:From:From:In-Reply-To:MIME-Version:Message-ID:References:Subject:Subject:To:To:Message-Id:Reply-To;
 bh=Xe2TwEikpF9YW8hI1YETLEfyfjwqg8Dc+g8/O1ekS0g=; 
 b=ayfPMj35VqaxAGQ40c3j9AmuiPGLSiMa+X24y9M8d1dwz0dU3BfwICF1/1CyNJTAZio5ZE6lSwSpt0bpxlv+3wmzQeP/KXQhmjTfWP2FO0owp9h8ceXiKke3NNMh2GfhL5cs8BOfNxycEjIT+2nykkKRxTDjuLK6X6ntWi4aNIQ=
ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass  header.i=antr.me;
 spf=pass  smtp.mailfrom=mail@HIDDEN;
 dmarc=pass header.from=<mail@HIDDEN>
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1733960132; 
 s=zmail; d=antr.me; i=mail@HIDDEN;
 h=From:From:To:To:Cc:Cc:Subject:Subject:In-Reply-To:References:Date:Date:Message-ID:MIME-Version:Content-Type:Message-Id:Reply-To;
 bh=Xe2TwEikpF9YW8hI1YETLEfyfjwqg8Dc+g8/O1ekS0g=;
 b=d0q+dCAWkBHufIL3Jxv2bjSziWjYKcipn8uaMjntKYiutmq3eUMw9ZoJbVlpaw9q
 XDToLTOUP2NK4oxfyrzVY9f8DNymMRIi+LlKkwvy3RaoIt3EhMM3JnS5aVBXIF+h4gi
 I/oEG7kGTwuPd2P16+8V4gPHc5Y8H8vsyF9peV0Y=
Received: by mx.zohomail.com with SMTPS id 1733960129560518.8553283750031;
 Wed, 11 Dec 2024 15:35:29 -0800 (PST)
From: Antero Mejr <mail@HIDDEN>
To: Lars Bilke <lars.bilke@HIDDEN>
Subject: Re: bug#73649: OpenMPI + mpi4py broken: rank=0
In-Reply-To: <B416E6A1-3198-4433-AF5C-C3EDE3A2B7EA@HIDDEN> (Lars Bilke's
 message of "Tue, 10 Dec 2024 14:03:44 +0100")
References: <B416E6A1-3198-4433-AF5C-C3EDE3A2B7EA@HIDDEN>
Date: Wed, 11 Dec 2024 18:35:27 -0500
Message-ID: <871pydrdxc.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13)
MIME-Version: 1.0
Content-Type: text/plain
X-ZohoMailClient: External
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 73649
Cc: 73649 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.3 (/)

Lars Bilke <lars.bilke@HIDDEN> writes:

> The issue seems that openmpi is version 5.x but mpi4py is compiled against
> version 4.x.

That does fix it, thanks. Maybe packages built against MPI 4.x should
be upgraded to the default MPI version, because the docs say:

"The Open MPI v5.0.x series shared libraries are ABI compatible with
Open MPI v4.0.x and v4.1.x, with a few exceptions for Fortran."

https://docs.open-mpi.org/en/v5.0.x/version-numbering.html




Information forwarded to bug-guix@HIDDEN:
bug#73649; Package guix. Full text available.

Message received at 73649 <at> debbugs.gnu.org:


Received: (at 73649) by debbugs.gnu.org; 10 Dec 2024 13:03:49 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue Dec 10 08:03:49 2024
Received: from localhost ([127.0.0.1]:57294 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1tKzu0-0003fp-Kk
	for submit <at> debbugs.gnu.org; Tue, 10 Dec 2024 08:03:48 -0500
Received: from mailgate5.ufz.de ([141.65.7.212]:38626 helo=mailgate.ufz.de)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <lars.bilke@HIDDEN>) id 1tKzty-0003fa-5D
 for 73649 <at> debbugs.gnu.org; Tue, 10 Dec 2024 08:03:47 -0500
Received: from imap.intranet.ufz.de (dcs1.intranet.ufz.de [141.65.125.135])
 by mailgate.ufz.de (Mailgate5-UFZ) with ESMTP id C5A271602E7;
 Tue, 10 Dec 2024 14:03:44 +0100 (CET)
MIME-version: 1.0
Content-transfer-encoding: 7BIT
Content-type: text/plain; markup=markdown
Received: from conversion-daemon.imap.intranet.ufz.de by imap.intranet.ufz.de
 (Oracle Communications Messaging Server 8.0.2.6.20200227 64bit
 (built Feb 27 2020)) id <0SOA0070048QBU00@HIDDEN>; Tue,
 10 Dec 2024 14:03:44 +0100 (CET)
Received: from smtp1.ufz.de ([141.65.7.217])
 by imap.intranet.ufz.de (Oracle Communications Messaging Server
 8.0.2.6.20200227 64bit (built Feb 27 2020))
 with ESMTPS id <0SOA00HH44A84320@HIDDEN>; Tue,
 10 Dec 2024 14:03:44 +0100 (CET)
Received: from [100.88.251.128] (unknown [141.65.34.101])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (No client certificate requested)	by smtp1.ufz.de (smtp2-UFZ)
 with ESMTPSA id A07EEE004F;	Tue, 10 Dec 2024 14:03:44 +0100 (CET)
Date: Tue, 10 Dec 2024 14:03:44 +0100
From: Lars Bilke <lars.bilke@HIDDEN>
Subject: Re: bug#73649: OpenMPI + mpi4py broken: rank=0
In-reply-to: <87ttdqjb82.fsf@HIDDEN>
To: mail@HIDDEN
Message-id: <B416E6A1-3198-4433-AF5C-C3EDE3A2B7EA@HIDDEN>
X-Mailer: MailMate (1.14r5937)
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 73649
Cc: 73649 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

The issue seems that openmpi is version 5.x but mpi4py is compiled against version 4.x. You can get a consistent version by using this flag: --with-input=openmpi=openmpi@HIDDEN  I could fix the issue with this call:

guix shell python python-mpi4py openmpi \
  --with-input=openmpi=openmpi@HIDDEN -- \
  mpirun -n 12 python3 ...




Information forwarded to bug-guix@HIDDEN:
bug#73649; Package guix. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 6 Oct 2024 01:01:52 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sat Oct 05 21:01:52 2024
Received: from localhost ([127.0.0.1]:39753 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1sxFei-0002bs-Em
	for submit <at> debbugs.gnu.org; Sat, 05 Oct 2024 21:01:52 -0400
Received: from lists.gnu.org ([209.51.188.17]:56720)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <mail@HIDDEN>) id 1sxFef-0002bk-U5
 for submit <at> debbugs.gnu.org; Sat, 05 Oct 2024 21:01:51 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10])
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <mail@HIDDEN>) id 1sxFeZ-0002Om-RE
 for bug-guix@HIDDEN; Sat, 05 Oct 2024 21:01:44 -0400
Received: from sender4-op-o14.zoho.com ([136.143.188.14])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <mail@HIDDEN>) id 1sxFeW-0004oG-T7
 for bug-guix@HIDDEN; Sat, 05 Oct 2024 21:01:42 -0400
ARC-Seal: i=1; a=rsa-sha256; t=1728176497; cv=none; 
 d=zohomail.com; s=zohoarc; 
 b=WJo1x9YQQURem1ecCo2IyATzqAdmdhA+OXGURA3Y0t1kbIacL6DU0ALCjo11FwOmgbhNGBBiQUnk4PZr9kU1+x5JS/4kuH/jjzAt8FinNs5o0p7HYp0Gw5gfQgHzhj/rvjiqNwkbHpQE8tSjwEhYYelSpTAjzrwpXNlu1pKYwJ0=
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com;
 s=zohoarc; t=1728176497;
 h=Content-Type:Date:Date:From:From:MIME-Version:Message-ID:Subject:Subject:To:To:Message-Id:Reply-To:Cc;
 bh=mz9a5mqICf7G873fWjNLtm+NXD1MYbiV/M5tL3zL4AU=; 
 b=cXLHMJlsV0jmErR2bKPOVC/a9hFmGt4s96IBzWXpqStfJnbxADhGZHX/ZSb6KEX9B/ZbaMPNCuDEaBudXk4uDCG8bxo2ANgiaeOA+vXiL5kzw/U6/mQyj5/vbbFdaIfv+oAvEOX6ffKE62qHDU7VghLzysBjWzh3pm35FQoiDY0=
ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass  header.i=antr.me;
 spf=pass  smtp.mailfrom=mail@HIDDEN;
 dmarc=pass header.from=<mail@HIDDEN>
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1728176497; 
 s=zmail; d=antr.me; i=mail@HIDDEN;
 h=From:From:To:To:Subject:Subject:Date:Date:Message-ID:MIME-Version:Content-Type:Message-Id:Reply-To:Cc;
 bh=mz9a5mqICf7G873fWjNLtm+NXD1MYbiV/M5tL3zL4AU=;
 b=GCpAM1wPTEOkZmGvzYjikBEPY2PSGIzdHkAFztVrVBK/rroEldm5PplZcQU/vkHc
 jeX9S+r4PDZFw/xJnA8oqNB0bLnq7VFakbqR13D1m8I5at4vVgUsRvPYYiF6JOkR4e/
 4HgxjZLQUyeJSNpmNkkFj5JAI7BpFiSdu9EM6yeg=
Received: by mx.zohomail.com with SMTPS id 1728176494852727.7386819903493;
 Sat, 5 Oct 2024 18:01:34 -0700 (PDT)
From: Antero Mejr <mail@HIDDEN>
To: bug-guix@HIDDEN
Subject: OpenMPI + mpi4py broken: rank=0
Date: Sun, 06 Oct 2024 01:01:33 +0000
Message-ID: <87ttdqjb82.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13)
MIME-Version: 1.0
Content-Type: text/plain
X-ZohoMailClient: External
Received-SPF: pass client-ip=136.143.188.14; envelope-from=mail@HIDDEN;
 helo=sender4-op-o14.zoho.com
X-Spam_score_int: -20
X-Spam_score: -2.1
X-Spam_bar: --
X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
 DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1,
 RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001,
 RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, RCVD_IN_VALIDITY_SAFE_BLOCKED=0.001,
 SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: -0.3 (/)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.3 (--)

Running this command:

guix shell python python-mpi4py openmpi -- mpirun -n 12 python3 \
-c "from mpi4py import MPI; comm = MPI.COMM_WORLD;
print(comm.Get_rank())"

should print the numbers 0-11. Instead it prints 0 11 times. The same
behavior occurs in a container or pure environment.

This breaks any code using mpi4py, because ranks >0 must be available
for multi-threaded code to work.




Acknowledgement sent to Antero Mejr <mail@HIDDEN>:
New bug report received and forwarded. Copy sent to bug-guix@HIDDEN. Full text available.
Report forwarded to bug-guix@HIDDEN:
bug#73649; Package guix. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Sun, 12 Jan 2025 05:45:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.