GNU bug report logs - #17614
parallel compilation fails: mv: yat/statistics/.deps/Percentiler.Tpo and yat/statistics/.deps/Percentiler.Tpo are the same file

Previous Next

Package: automake;

Reported by: Peter Johansson <trojkan <at> gmail.com>

Date: Wed, 28 May 2014 04:53:02 UTC

Severity: normal

Tags: moreinfo

Done: Mike Frysinger <vapier <at> gentoo.org>

Bug is archived. No further changes may be made.

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 17614 in the body.
You can then email your comments to 17614 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

View this report as an mbox folder, status mbox, maintainer mbox


Report forwarded to bug-automake <at> gnu.org:
bug#17614; Package automake. (Wed, 28 May 2014 04:53:02 GMT) Full text and rfc822 format available.

Acknowledgement sent to Peter Johansson <trojkan <at> gmail.com>:
New bug report received and forwarded. Copy sent to bug-automake <at> gnu.org. (Wed, 28 May 2014 04:53:04 GMT) Full text and rfc822 format available.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Peter Johansson <trojkan <at> gmail.com>
To: bug-automake <at> gnu.org
Subject: parallel compilation fails
Date: Wed, 28 May 2014 14:52:21 +1000
Hi,

I have a project with a libtool archive built from many source files. 
When I build with 'make -j40' I get error message

mv: `yat/statistics/.deps/Percentiler.Tpo' and 
`yat/statistics/.deps/Percentiler.Plo' are the same file
make[1]: *** [yat/statistics/Percentiler.lo] Error 1


Looks like some kind of race problem, but I cannot see anything wrong in 
the Makefile. Is this a known problem? If not let me know what would be 
useful.

The Makefile is generated with Automake 1.14

Thanks,
Peter

-- 
Peter Johansson





Information forwarded to bug-automake <at> gnu.org:
bug#17614; Package automake. (Wed, 28 May 2014 05:02:02 GMT) Full text and rfc822 format available.

Message #8 received at 17614 <at> debbugs.gnu.org (full text, mbox):

From: Peter Johansson <trojkan <at> gmail.com>
To: 17614 <at> debbugs.gnu.org
Subject: Re: bug#17614: parallel compilation fails
Date: Wed, 28 May 2014 15:01:30 +1000
On 05/28/2014 02:52 PM, Peter Johansson wrote:
> Hi,
>
> I have a project with a libtool archive built from many source files. 
> When I build with 'make -j40' I get error message
>
> mv: `yat/statistics/.deps/Percentiler.Tpo' and 
> `yat/statistics/.deps/Percentiler.Plo' are the same file
> make[1]: *** [yat/statistics/Percentiler.lo] Error 1
>
>
> Looks like some kind of race problem, but I cannot see anything wrong 
> in the Makefile. Is this a known problem? If not let me know what 
> would be useful.
>
I forgot to mention that the source file in question, 'Percentiler.cc', 
is extremely small (only a constructor that copies a bool and a double) 
so the compilation is extremely fast.

Cheers,

-- 
Peter Johansson





Information forwarded to bug-automake <at> gnu.org:
bug#17614; Package automake. (Wed, 19 Jan 2022 08:12:01 GMT) Full text and rfc822 format available.

Message #11 received at 17614 <at> debbugs.gnu.org (full text, mbox):

From: Mike Frysinger <vapier <at> gentoo.org>
To: Peter Johansson <trojkan <at> gmail.com>
Cc: 17614 <at> debbugs.gnu.org
Subject: Re: bug#17614: parallel compilation fails
Date: Wed, 19 Jan 2022 08:10:54 +0000 (UTC)
retitle 17614 parallel compilation fails: mv: yat/statistics/.deps/Percentiler.Tpo and yat/statistics/.deps/Percentiler.Tpo are the same file
tag 17614 = moreinfo
thankyou

On Wed, 28 May 2014 14:52:21 +1000, Peter Johansson wrote:
> I have a project with a libtool archive built from many source files. 
> When I build with 'make -j40' I get error message
>
> mv: `yat/statistics/.deps/Percentiler.Tpo' and 
> `yat/statistics/.deps/Percentiler.Plo' are the same file
> make[1]: *** [yat/statistics/Percentiler.lo] Error 1
>
>
> Looks like some kind of race problem, but I cannot see anything wrong in 
> the Makefile. Is this a known problem? If not let me know what would be 
> useful.
>
> The Makefile is generated with Automake 1.14

assuming it still fails with Automake 1.16 ...

can you link to the project for us to take a look ?  it's very hard for us to
guess at what's going wrong, and would be a lot easier if we could repro on
our own systems.
-mike




Information forwarded to bug-automake <at> gnu.org:
bug#17614; Package automake. (Wed, 19 Jan 2022 08:34:01 GMT) Full text and rfc822 format available.

Message #14 received at 17614 <at> debbugs.gnu.org (full text, mbox):

From: Peter Johansson <trojkan <at> gmail.com>
To: Mike Frysinger <vapier <at> gentoo.org>
Cc: 17614 <at> debbugs.gnu.org
Subject: Re: bug#17614: parallel compilation fails
Date: Wed, 19 Jan 2022 18:32:47 +1000
Hi Mike,

On 19/1/22 18:10, Mike Frysinger wrote:
> retitle 17614 parallel compilation fails: mv: yat/statistics/.deps/Percentiler.Tpo and yat/statistics/.deps/Percentiler.Tpo are the same file
> tag 17614 = moreinfo
> thankyou
>
> On Wed, 28 May 2014 14:52:21 +1000, Peter Johansson wrote:
>> I have a project with a libtool archive built from many source files.
>> When I build with 'make -j40' I get error message
>>
>> mv: `yat/statistics/.deps/Percentiler.Tpo' and
>> `yat/statistics/.deps/Percentiler.Plo' are the same file
>> make[1]: *** [yat/statistics/Percentiler.lo] Error 1
>>
>>
>> Looks like some kind of race problem, but I cannot see anything wrong in
>> the Makefile. Is this a known problem? If not let me know what would be
>> useful.
>>
>> The Makefile is generated with Automake 1.14
> assuming it still fails with Automake 1.16 ...


I'll test when I'm out of this semi-lockdown and have access to a 
computer with more CPUs.

>
> can you link to the project for us to take a look ?

Tar file is available from here

https://sourceforge.net/projects/libyat/

and subversion repo from here if that's preferable

https://dev.thep.lu.se/yat/svn/trunk


Thanks,

Peter






Changed bug title to 'parallel compilation fails: mv: yat/statistics/.deps/Percentiler.Tpo and yat/statistics/.deps/Percentiler.Tpo are the same file' from 'parallel compilation fails' Request was from Mike Frysinger <vapier <at> gentoo.org> to control <at> debbugs.gnu.org. (Tue, 25 Jan 2022 06:20:01 GMT) Full text and rfc822 format available.

Added tag(s) moreinfo. Request was from Mike Frysinger <vapier <at> gentoo.org> to control <at> debbugs.gnu.org. (Tue, 25 Jan 2022 06:20:01 GMT) Full text and rfc822 format available.

Information forwarded to bug-automake <at> gnu.org:
bug#17614; Package automake. (Tue, 25 Jan 2022 06:25:01 GMT) Full text and rfc822 format available.

Message #21 received at 17614 <at> debbugs.gnu.org (full text, mbox):

From: Mike Frysinger <vapier <at> gentoo.org>
To: Peter Johansson <trojkan <at> gmail.com>
Cc: 17614 <at> debbugs.gnu.org
Subject: Re: bug#17614: parallel compilation fails
Date: Tue, 25 Jan 2022 01:24:09 -0500
[Message part 1 (text/plain, inline)]
On 19 Jan 2022 18:32, Peter Johansson wrote:
> On 19/1/22 18:10, Mike Frysinger wrote:
> > retitle 17614 parallel compilation fails: mv: yat/statistics/.deps/Percentiler.Tpo and yat/statistics/.deps/Percentiler.Tpo are the same file
> > tag 17614 = moreinfo
> > thankyou
> >
> > On Wed, 28 May 2014 14:52:21 +1000, Peter Johansson wrote:
> >> I have a project with a libtool archive built from many source files.
> >> When I build with 'make -j40' I get error message
> >>
> >> mv: `yat/statistics/.deps/Percentiler.Tpo' and
> >> `yat/statistics/.deps/Percentiler.Plo' are the same file
> >> make[1]: *** [yat/statistics/Percentiler.lo] Error 1
> >>
> >>
> >> Looks like some kind of race problem, but I cannot see anything wrong in
> >> the Makefile. Is this a known problem? If not let me know what would be
> >> useful.
> >>
> >> The Makefile is generated with Automake 1.14
> > assuming it still fails with Automake 1.16 ...
> 
> 
> I'll test when I'm out of this semi-lockdown and have access to a 
> computer with more CPUs.
> 
> > can you link to the project for us to take a look ?
> 
> Tar file is available from here
> 
> https://sourceforge.net/projects/libyat/
> 
> and subversion repo from here if that's preferable
> 
> https://dev.thep.lu.se/yat/svn/trunk

i grabbed the 0.19 release.  perhaps unsurprising, nothing stood out to me
related to the error above.  you didn't have any recursive makes or any code
that seemed to override the dep generation or create conflicting outputs.

if you can reproduce it, get a full log and send it over, and include the
config.log file i think.  something like `make -O -j... >& log`.

the error you quoted is part of automake's dependency generation.  it's very
weird that you'd get an error about .Tpo & .Plo being the same file when the
rule that creates them creates the .Tpo then moves it to .Plo.  there is no
place where we ever write to .Plo otherwise.
-mike
[signature.asc (application/pgp-signature, inline)]

Information forwarded to bug-automake <at> gnu.org:
bug#17614; Package automake. (Mon, 21 Feb 2022 08:12:01 GMT) Full text and rfc822 format available.

Message #24 received at 17614 <at> debbugs.gnu.org (full text, mbox):

From: Peter Johansson <trojkan <at> gmail.com>
To: 17614 <at> debbugs.gnu.org
Subject: Re: bug#17614: parallel compilation fails
Date: Mon, 21 Feb 2022 12:15:42 +1000
Hi Mike,

On 25/1/22 16:24, Mike Frysinger wrote:
> On 19 Jan 2022 18:32, Peter Johansson wrote:
>> On 19/1/22 18:10, Mike Frysinger wrote:
>>>
>>> assuming it still fails with Automake 1.16 ...
>>
>> I'll test when I'm out of this semi-lockdown and have access to a
>> computer with more CPUs.
>>
>>> can you link to the project for us to take a look ?
>> Tar file is available from here
>>
>> https://sourceforge.net/projects/libyat/
>>
>> and subversion repo from here if that's preferable
>>
>> https://dev.thep.lu.se/yat/svn/trunk
> i grabbed the 0.19 release.  perhaps unsurprising, nothing stood out to me
> related to the error above.  you didn't have any recursive makes or any code
> that seemed to override the dep generation or create conflicting outputs.
>
> if you can reproduce it, get a full log and send it over, and include the
> config.log file i think.  something like `make -O -j... >& log`.
>
> the error you quoted is part of automake's dependency generation.  it's very
> weird that you'd get an error about .Tpo & .Plo being the same file when the
> rule that creates them creates the .Tpo then moves it to .Plo.  there is no
> place where we ever write to .Plo otherwise.

I've tried this now and in short I cannot reproduce it. I tried with 
Automake 1.13 now (bcs it's what available by default) and ran both on 
current code and an older branch, but nothing that looks like this. Many 
things have changed since 2014 when this was filed and I think for 
example that the file system was much slower back then. I suspect that 
the problem was that the same file was compiled twice, but since I can't 
reproduce it, it's impossible to determine whether it was due to 
problematic Makefile.am, generated Makefile, or possibly behaviour of 
make, so if not already closed, please close this and I'll report back 
if something similar returns.

Cheers,

Peter





Reply sent to Mike Frysinger <vapier <at> gentoo.org>:
You have taken responsibility. (Mon, 21 Feb 2022 17:54:02 GMT) Full text and rfc822 format available.

Notification sent to Peter Johansson <trojkan <at> gmail.com>:
bug acknowledged by developer. (Mon, 21 Feb 2022 17:54:02 GMT) Full text and rfc822 format available.

Message #29 received at 17614-done <at> debbugs.gnu.org (full text, mbox):

From: Mike Frysinger <vapier <at> gentoo.org>
To: Peter Johansson <trojkan <at> gmail.com>
Cc: 17614-done <at> debbugs.gnu.org
Subject: Re: bug#17614: parallel compilation fails
Date: Mon, 21 Feb 2022 12:53:15 -0500
[Message part 1 (text/plain, inline)]
On 21 Feb 2022 12:15, Peter Johansson wrote:
> On 25/1/22 16:24, Mike Frysinger wrote:
> > On 19 Jan 2022 18:32, Peter Johansson wrote:
> >> On 19/1/22 18:10, Mike Frysinger wrote:
> >>> assuming it still fails with Automake 1.16 ...
> >>
> >> I'll test when I'm out of this semi-lockdown and have access to a
> >> computer with more CPUs.
> >>
> >>> can you link to the project for us to take a look ?
> >> Tar file is available from here
> >>
> >> https://sourceforge.net/projects/libyat/
> >>
> >> and subversion repo from here if that's preferable
> >>
> >> https://dev.thep.lu.se/yat/svn/trunk
> > i grabbed the 0.19 release.  perhaps unsurprising, nothing stood out to me
> > related to the error above.  you didn't have any recursive makes or any code
> > that seemed to override the dep generation or create conflicting outputs.
> >
> > if you can reproduce it, get a full log and send it over, and include the
> > config.log file i think.  something like `make -O -j... >& log`.
> >
> > the error you quoted is part of automake's dependency generation.  it's very
> > weird that you'd get an error about .Tpo & .Plo being the same file when the
> > rule that creates them creates the .Tpo then moves it to .Plo.  there is no
> > place where we ever write to .Plo otherwise.
> 
> I've tried this now and in short I cannot reproduce it. I tried with 
> Automake 1.13 now (bcs it's what available by default) and ran both on 
> current code and an older branch, but nothing that looks like this. Many 
> things have changed since 2014 when this was filed and I think for 
> example that the file system was much slower back then. I suspect that 
> the problem was that the same file was compiled twice, but since I can't 
> reproduce it, it's impossible to determine whether it was due to 
> problematic Makefile.am, generated Makefile, or possibly behaviour of 
> make, so if not already closed, please close this and I'll report back 
> if something similar returns.

np.  feel free to ping/reopen if something does turn up.
-mike
[signature.asc (application/pgp-signature, inline)]

bug archived. Request was from Debbugs Internal Request <help-debbugs <at> gnu.org> to internal_control <at> debbugs.gnu.org. (Tue, 22 Mar 2022 11:24:04 GMT) Full text and rfc822 format available.

This bug report was last modified 3 years and 106 days ago.

Previous Next


GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.