potential race condition in sbuild post commands

potential race condition in sbuild post commands

[MOESSBAUER, Felix]

Dear devs,

I recently got the following error in multiple layers (do_dpkg_build):

cp: cannot stat '/var/cache/apt/archives/*.deb': No such file or
directory
| 
| E: Command '[ -z "$(find /var/cache/apt/archives -maxdepth 1 -name
'*.deb' -print -quit)" ] || cp -Ln --no-preserve=owner
/var/cache/apt/archives/*.deb -t /home/builder/gasket-module-rt-
amd64/rootfs/var/cache/apt/archives/' failed to run.
| 
| Finished processing commands.

It looks like the copy operation has some race with a cleanup
operation. Is this already a known issue? I did not yet start bisecting
or investigating this.

ISAR version: 1c509852c5a724a2c3ba401108d95fb1bfa36f90

Best regards,
Felix

-- 
Siemens AG, Technology
Linux Expert Center

Re: potential race condition in sbuild post commands

[Anton Mikanovich]

17/01/2024 17:00, 'MOESSBAUER, Felix' via isar-users wrote:
> Dear devs,
>
> I recently got the following error in multiple layers (do_dpkg_build):
>
> cp: cannot stat '/var/cache/apt/archives/*.deb': No such file or
> directory
> |
> | E: Command '[ -z "$(find /var/cache/apt/archives -maxdepth 1 -name
> '*.deb' -print -quit)" ] || cp -Ln --no-preserve=owner
> /var/cache/apt/archives/*.deb -t /home/builder/gasket-module-rt-
> amd64/rootfs/var/cache/apt/archives/' failed to run.
> |
> | Finished processing commands.
>
> It looks like the copy operation has some race with a cleanup
> operation. Is this already a known issue? I did not yet start bisecting
> or investigating this.
>
> ISAR version: 1c509852c5a724a2c3ba401108d95fb1bfa36f90
>
> Best regards,
> Felix
>
Hello Felix,
It looks like a new issue, we will try to reproduce it.
Are there any preconditions that can helpfull?
(DL_DIR path, is it empty on beginning, etc)

Re: potential race condition in sbuild post commands

[MOESSBAUER, Felix]

On Thu, 2024-01-18 at 10:32 +0200, Anton Mikanovich wrote:
> 17/01/2024 17:00, 'MOESSBAUER, Felix' via isar-users wrote:
> > Dear devs,
> > 
> > I recently got the following error in multiple layers
> > (do_dpkg_build):
> > 
> > cp: cannot stat '/var/cache/apt/archives/*.deb': No such file or
> > directory
> > > 
> > > E: Command '[ -z "$(find /var/cache/apt/archives -maxdepth 1 -
> > > name
> > '*.deb' -print -quit)" ] || cp -Ln --no-preserve=owner
> > /var/cache/apt/archives/*.deb -t /home/builder/gasket-module-rt-
> > amd64/rootfs/var/cache/apt/archives/' failed to run.
> > > 
> > > Finished processing commands.
> > 
> > It looks like the copy operation has some race with a cleanup
> > operation. Is this already a known issue? I did not yet start
> > bisecting
> > or investigating this.
> > 
> > ISAR version: 1c509852c5a724a2c3ba401108d95fb1bfa36f90
> > 
> > Best regards,
> > Felix
> > 
> Hello Felix,
> It looks like a new issue, we will try to reproduce it.
> Are there any preconditions that can helpfull?
> (DL_DIR path, is it empty on beginning, etc)

Hi, it looks like the patch 1c509852 makes this more likely to show up.
Also, a big machine with many cores helps to reproduce and running kas-
container clean from time to time (or delete the build/tmp dir) between
the builds.

On one of our internal layers, I ran into this issue almost 100% of the
time. By that I think it will be easy to reproduce.

Best regards,
Felix

> 

-- 
Siemens AG, Technology
Linux Expert Center