public inbox for isar-users@googlegroups.com
 help / color / mirror / Atom feed
From: "'MOESSBAUER, Felix' via isar-users" <isar-users@googlegroups.com>
To: "amikan@ilbers.de" <amikan@ilbers.de>,
	"isar-users@googlegroups.com" <isar-users@googlegroups.com>
Subject: Re: [PATCH 3/3] rootfs: Deny packages download during install
Date: Mon, 15 Jun 2026 09:02:40 +0000	[thread overview]
Message-ID: <9615023294be863ba71d0863ad08a168996ee06a.camel@siemens.com> (raw)
In-Reply-To: <bf4b13309aefe0442e41a3ad76aed8b03ea8c046.camel@siemens.com>

On Mon, 2026-06-15 at 08:55 +0000, 'MOESSBAUER, Felix' via isar-users
wrote:
> On Wed, 2026-06-10 at 09:48 +0300, Anton Mikanovich wrote:
> > During the command rootfs_install_pkgs_install no actuall packages
> > downloading should be done. All the debs must be precached and already
> > placed in /var/cache/apt/archives, so apt-get can reuse them.
> > 
> > Currently any downloads in this command are really succeed because we
> > still have "network" flag on for using sudo, which masks all the
> > caching issues in previous rootfs install commands.
> > 
> > To prevent such a cases add "--no-download" option to apt-get.
> 
> Hi, this at least breaks under rootless during
> rootfs_install_pkgs_install on the sbom-chroot recipe.
> 
> I'm currently investigating this, but here is already a log showing the
> issue. Could it be, that local packages (via file://) are never cached?

Probably that's a rootless problem, as we explicitly have to mount the
isar-apt during rootfs_install_pkgs_isar_download. On non-rootless, we
still have the mount from a previous task.

Felix

> 
> Best regards,
> Felix
> 
> DEBUG: Executing python function sstate_task_prefunc
> DEBUG: Python function sstate_task_prefunc finished
> DEBUG: Executing python function do_rootfs_install
> DEBUG: Executing shell function root_cleandirs
> DEBUG: Shell function root_cleandirs finished
> DEBUG: Executing shell function rootfs_prepare
> DEBUG: Shell function rootfs_prepare finished
> DEBUG: Executing shell function rootfs_configure_isar_apt
> DEBUG: Shell function rootfs_configure_isar_apt finished
> DEBUG: Executing shell function rootfs_configure_apt
> DEBUG: Shell function rootfs_configure_apt finished
> DEBUG: Executing shell function rootfs_disable_initrd_generation
> DEBUG: Shell function rootfs_disable_initrd_generation finished
> DEBUG: Executing python function rootfs_do_mounts
> DEBUG: Python function rootfs_do_mounts finished
> DEBUG: Executing shell function rootfs_install_pkgs_update
> Ign:1 file:/isar-apt isar InRelease
> Get:2 file:/isar-apt isar Release [5099 B]
> Get:2 file:/isar-apt isar Release [5099 B]
> Ign:3 file:/isar-apt isar Release.gpg
> Get:4 file:/isar-apt isar/main Sources [2102 B]
> Get:5 file:/isar-apt isar/main amd64 Packages [1512 B]
> Reading package lists...
> DEBUG: Shell function rootfs_install_pkgs_update finished
> DEBUG: Executing shell function rootfs_install_resolvconf
> DEBUG: Shell function rootfs_install_resolvconf finished
> DEBUG: Executing shell function rootfs_import_package_cache
> DEBUG: Shell function rootfs_import_package_cache finished
> DEBUG: Executing shell function rootfs_install_pkgs_download
> Reading package lists...
> Building dependency tree...
> Reading state information...
> Starting pkgProblemResolver with broken count: 0
> Starting 2 pkgProblemResolver with broken count: 0
> Done
> The following additional packages will be installed:
>   distro-info-data libexpat1 libffi8 libjs-jquery libjs-sphinxdoc
>   libjs-underscore libncursesw6 libpython3-stdlib libpython3.13-minimal
>   libpython3.13-stdlib libreadline8t64 libyaml-0-2 media-types netbase
>   python-apt-common python3 python3-apt python3-beartype python3-
> boolean
>   python3-charset-normalizer python3-click python3-debian python3-
> defusedxml
>   python3-license-expression python3-minimal python3-packageurl
> python3-ply
>   python3-py-serializable python3-pyparsing python3-rdflib
>   python3-semantic-version python3-sortedcontainers python3-uritools
>   python3-xmltodict python3-yaml python3.13 python3.13-minimal
> readline-common
> Suggested packages:
>   python3-doc python3-tk python3-venv python-apt-doc python3-boolean-
> doc
>   python-charset-normalizer-doc python-cyclonedx-lib-doc gpgv zstd
>   python-ply-doc python3-pkg-resources python-pyparsing-doc python-
> rdflib-doc
>   python-semantic-version-doc python-sortedcontainers-doc python3.13-
> venv
>   python3.13-doc binutils binfmt-support readline-doc
> Recommended packages:
>   javascript-common libgpm2 lsb-release iso-codes python3-html5rdf
>   python3-lxml python3-networkx python3-orjson ca-certificates
> The following NEW packages will be installed:
>   distro-info-data libexpat1 libffi8 libjs-jquery libjs-sphinxdoc
>   libjs-underscore libncursesw6 libpython3-stdlib libpython3.13-minimal
>   libpython3.13-stdlib libreadline8t64 libyaml-0-2 media-types netbase
>   python-apt-common python3 python3-apt python3-beartype python3-
> boolean
>   python3-charset-normalizer python3-click python3-cyclonedx-lib
>   python3-debian python3-debsbom python3-defusedxml python3-license-
> expression
>   python3-minimal python3-packageurl python3-ply python3-py-
> serializable
>   python3-pyparsing python3-rdflib python3-semantic-version
>   python3-sortedcontainers python3-spdx-tools python3-uritools
>   python3-xmltodict python3-yaml python3.13 python3.13-minimal
> readline-common
> 0 upgraded, 41 newly installed, 0 to remove and 0 not upgraded.
> Need to get 512 kB/9561 kB of archives.
> After this operation, 42.5 MB of additional disk space will be used.
> Get:1 file:/isar-apt isar/main amd64 python3-debsbom all 0.8.1 [62.5
> kB]
> Get:2 file:/isar-apt isar/main amd64 python3-spdx-tools all 0.8.3 [79.4
> kB]
> Get:3 http://deb.debian.org/debian trixie/main amd64 distro-info-data
> all 0.66+deb13u2 [6792 B]
> Get:4 http://deb.debian.org/debian trixie/main amd64 python-apt-common
> all 3.0.0 [68.2 kB]
> Get:5 http://deb.debian.org/debian trixie/main amd64 python3-apt amd64
> 3.0.0 [164 kB]
> Get:6 http://deb.debian.org/debian trixie/main amd64 python3-defusedxml
> all 0.7.1-3 [43.4 kB]
> Get:7 http://deb.debian.org/debian trixie/main amd64 python3-py-
> serializable all 2.0.0-2 [29.1 kB]
> Get:8 http://deb.debian.org/debian trixie/main amd64 python3-
> sortedcontainers all 2.4.0-2 [31.9 kB]
> Get:9 http://deb.debian.org/debian trixie/main amd64 python3-cyclonedx-
> lib all 9.1.0-2 [168 kB]
> Fetched 512 kB in 0s (5318 kB/s)
> Download complete and in download only mode
> DEBUG: Shell function rootfs_install_pkgs_download finished
> DEBUG: Executing shell function rootfs_export_package_cache
> DEBUG: Shell function rootfs_export_package_cache finished
> DEBUG: Executing shell function rootfs_install_pkgs_isar_download
> Starting pkgProblemResolver with broken count: 0
> Starting 2 pkgProblemResolver with broken count: 0
> Done
> Err:1 file:/isar-apt isar/main amd64 python3-debsbom all 0.8.1
>   File not found - /isar-apt/pool/main/p/python3-debsbom/python3-
> debsbom_0.8.1_all.deb (2: No such file or directory)
> Err:2 file:/isar-apt isar/main amd64 python3-spdx-tools all 0.8.3
>   File not found - /isar-apt/pool/main/p/python3-spdx-tools/python3-
> spdx-tools_0.8.3_all.deb (2: No such file or directory)
> E: Failed to fetch file:/isar-apt/pool/main/p/python3-debsbom/python3-
> debsbom_0.8.1_all.deb  File not found - /isar-apt/pool/main/p/python3-
> debsbom/python3-debsbom_0.8.1_all.deb (2: No such file or directory)
> E: Failed to fetch file:/isar-apt/pool/main/p/python3-spdx-
> tools/python3-spdx-tools_0.8.3_all.deb  File not found - /isar-
> apt/pool/main/p/python3-spdx-tools/python3-spdx-tools_0.8.3_all.deb (2:
> No such file or directory)
> WARNING: exit code 123 from a shell command.
> DEBUG: Executing python function rootfs_do_umounts
> DEBUG: Executing shell function rootfs_do_umounts_priv
> DEBUG: Shell function rootfs_do_umounts_priv finished
> DEBUG: Python function rootfs_do_umounts finished
> DEBUG: Python function do_rootfs_install finished
> 
> > 
> > Signed-off-by: Anton Mikanovich <amikan@ilbers.de>
> > ---
> >  meta/classes-recipe/rootfs.bbclass | 2 +-
> >  1 file changed, 1 insertion(+), 1 deletion(-)
> > 
> > diff --git a/meta/classes-recipe/rootfs.bbclass b/meta/classes-recipe/rootfs.bbclass
> > index 81384340..f4580421 100644
> > --- a/meta/classes-recipe/rootfs.bbclass
> > +++ b/meta/classes-recipe/rootfs.bbclass
> > @@ -402,7 +402,7 @@ rootfs_install_pkgs_install[progress] = "custom:rootfs_progress.PkgsInstallProgr
> >  rootfs_install_pkgs_install[network] = "${TASK_USE_SUDO}"
> >  rootfs_install_pkgs_install() {
> >      sudo -E chroot "${ROOTFSDIR}" \
> > -        /usr/bin/apt-get ${ROOTFS_APT_ARGS} ${ROOTFS_PACKAGES}
> > +        /usr/bin/apt-get ${ROOTFS_APT_ARGS} --no-download ${ROOTFS_PACKAGES}
> >  }
> >  
> >  ROOTFS_INSTALL_COMMAND += "rootfs_restore_initrd_tooling"
> > -- 
> > 2.34.1
> > 
> > -- 
> > You received this message because you are subscribed to the Google Groups "isar-users" group.
> > To unsubscribe from this group and stop receiving emails from it, send an email to isar-users+unsubscribe@googlegroups.com.
> > To view this discussion visit https://groups.google.com/d/msgid/isar-users/20260610064812.4010511-4-amikan%40ilbers.de.
> 
> -- 
> You received this message because you are subscribed to the Google Groups "isar-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to isar-users+unsubscribe@googlegroups.com.
> To view this discussion visit https://groups.google.com/d/msgid/isar-users/bf4b13309aefe0442e41a3ad76aed8b03ea8c046.camel%40siemens.com.

-- 
You received this message because you are subscribed to the Google Groups "isar-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to isar-users+unsubscribe@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/isar-users/9615023294be863ba71d0863ad08a168996ee06a.camel%40siemens.com.

  reply	other threads:[~2026-06-15  9:02 UTC|newest]

Thread overview: 11+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-06-10  6:48 [PATCH 0/3] Rootfs install race fix for isar-apt packages Anton Mikanovich
2026-06-10  6:48 ` [PATCH 1/3] rootfs: Allow locking on single install command Anton Mikanovich
2026-06-10  8:23   ` 'MOESSBAUER, Felix' via isar-users
2026-06-11  7:01     ` Anton Mikanovich
2026-06-11 10:08       ` 'MOESSBAUER, Felix' via isar-users
2026-06-10  6:48 ` [PATCH 2/3] rootfs: Download isar-apt packages under isar-apt lock Anton Mikanovich
2026-06-10  6:48 ` [PATCH 3/3] rootfs: Deny packages download during install Anton Mikanovich
2026-06-15  8:55   ` 'MOESSBAUER, Felix' via isar-users
2026-06-15  9:02     ` 'MOESSBAUER, Felix' via isar-users [this message]
2026-06-15  9:12     ` Anton Mikanovich
2026-06-12 10:53 ` [PATCH 0/3] Rootfs install race fix for isar-apt packages Anton Mikanovich

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=9615023294be863ba71d0863ad08a168996ee06a.camel@siemens.com \
    --to=isar-users@googlegroups.com \
    --cc=amikan@ilbers.de \
    --cc=felix.moessbauer@siemens.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox