public inbox for isar-users@googlegroups.com
 help / color / mirror / Atom feed
From: "'MOESSBAUER, Felix' via isar-users" <isar-users@googlegroups.com>
To: "ubely@ilbers.de" <ubely@ilbers.de>,
	"isar-users@googlegroups.com" <isar-users@googlegroups.com>
Subject: Re: [PATCH v7 00/10] Improving base-apt usage
Date: Thu, 1 Aug 2024 08:57:08 +0000	[thread overview]
Message-ID: <06ec8803dfb228fadd7bd03398817d190914de3f.camel@siemens.com> (raw)
In-Reply-To: <20240725151006.2129-1-ubely@ilbers.de>

On Thu, 2024-07-25 at 18:07 +0300, Uladzimir Bely wrote:
> `base-apt` is a local apt repository containing all upstream (Debian,
> Raspberry Pi OS, Ubuntu...) packages needed for a particular build.
> This series implements upfront repository downloading. This is the
> first step towards local partial mirror management.
> 
> The current approach in `next`:
> 
> - On the first build, debootstrap and sbuild are used for building
> Isar artifacts. The packages downloaded from the Internet are cached
> in local directories.
> - On the next build:
>   - Analyze the logs from the previous build, save packages
> downloaded by the bootstraps, sbuilds and imagers into `base-apt`.
>   - Use `base-apt` for bootstrapping, building and image creation.
> 
> Some issues with the current approach:
> 
> 1. Different policies must be followed for the first and the
> subsequent builds.
> 2. As we have multiple versions of the same package from the main and
> security repositories and rely on build logs and `find` for
> populating `base-apt`, extra care must be taken to ensure that the
> right package version lands in `base-apt`.
> 3. We rely on internal implementation of `debootstrap` and `sbuild`
> for saving and reusing the packages. Changing to e.g. `mmdebstrap`
> breaks the unrelated `base-apt` functionality.

Hi, what is the overall plan w.r.t. this patch series? My understanding
was that we want to switch to mmdebstrap rather sooner than later. But
now you write that this will be incompatible with mmdebstrap.

For me, this series still looks pretty experimental.

Felix

> 4. Source packages are stored in a different flat directory, `apt-get
> source` for upstream packages is not possible.
> 5. At the moment of `base-apt` creation all we have is the package
> name. The knowledge about the upstream repositories is lost and no
> local repository policy implementation is possible (e.g., for the
> "multiple products, multiple distros" use case).
> 6. For implementing further use cases like "fetch all sources
> necessary for bootstrapping the base system itself", additional logic
> is necessary.
> 

-- 
Siemens AG, Technology
Linux Expert Center


-- 
You received this message because you are subscribed to the Google Groups "isar-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to isar-users+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/isar-users/06ec8803dfb228fadd7bd03398817d190914de3f.camel%40siemens.com.

  parent reply	other threads:[~2024-08-01  8:57 UTC|newest]

Thread overview: 13+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2024-07-25 15:07 Uladzimir Bely
2024-07-25 15:07 ` [PATCH v7 01/10] scripts: Add debrepo python script handling base-apt Uladzimir Bely
2024-07-25 15:07 ` [PATCH v7 02/10] meta: Add debrepo bbclass handling base-apt prefetching Uladzimir Bely
2024-07-25 15:07 ` [PATCH v7 03/10] meta: Always use base-apt repo in local mode Uladzimir Bely
2024-07-25 15:07 ` [PATCH v7 04/10] meta: Use cached base-apt repo to debootstrap Uladzimir Bely
2024-07-25 15:07 ` [PATCH v7 05/10] base-apt: Predownload packages to base-apt before install Uladzimir Bely
2024-07-25 15:07 ` [PATCH v7 06/10] meta: Add cache-deb-src functionality in base-apt mode Uladzimir Bely
2024-07-25 15:07 ` [PATCH v7 07/10] testsuite: Set ISAR_PREFETCH_BASE_APT by default Uladzimir Bely
2024-07-25 15:07 ` [PATCH v7 08/10] Disable deb-dl-dir in base-apt prefetch mode Uladzimir Bely
2024-07-25 15:07 ` [PATCH v7 09/10] kas: Add PREFETCH_BASE_APT config entry Uladzimir Bely
2024-07-25 15:07 ` [PATCH v7 10/10] ci_build.sh: Install python3-apt if not installed Uladzimir Bely
2024-08-01  8:57 ` 'MOESSBAUER, Felix' via isar-users [this message]
2024-08-02  5:37   ` [PATCH v7 00/10] Improving base-apt usage Uladzimir Bely

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=06ec8803dfb228fadd7bd03398817d190914de3f.camel@siemens.com \
    --to=isar-users@googlegroups.com \
    --cc=felix.moessbauer@siemens.com \
    --cc=ubely@ilbers.de \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox