public inbox for isar-users@googlegroups.com
 help / color / mirror / Atom feed
From: "Roberto A. Foglietta" <roberto.foglietta@gmail.com>
To: Henning Schild <henning.schild@siemens.com>
Cc: "Moessbauer, Felix (T CED INW-CN)" <felix.moessbauer@siemens.com>,
	"ubely@ilbers.de" <ubely@ilbers.de>,
	 "isar-users@googlegroups.com" <isar-users@googlegroups.com>,
	 "Kiszka, Jan (T CED)" <jan.kiszka@siemens.com>
Subject: Re: [PATCH v3 0/5] Improving apt cache
Date: Mon, 30 Jan 2023 13:24:47 +0100	[thread overview]
Message-ID: <CAJGKYO6b+hdtbrTjk+TSOG=GmrWW2okF4TG4MEtU0eUA6MgPcg@mail.gmail.com> (raw)
In-Reply-To: <20230130114504.51e78b03@md1za8fc.ad001.siemens.net>

On Mon, 30 Jan 2023 at 11:45, Henning Schild <henning.schild@siemens.com> wrote:
>
> Am Mon, 30 Jan 2023 09:45:45 +0100
> schrieb "Moessbauer, Felix (T CED INW-CN)"
> <felix.moessbauer@siemens.com>:
>
> > On Fri, 2023-01-20 at 08:31 +0100, Uladzimir Bely wrote:
> > > Currently, apt cache (e.g. `var/cache/apt/archives`) import and
> > > export
> > > functions are not optimal. Multiple files are copied from global
> > > DL_DIR to package WORKDIR, increasing disk IO and space needed.
> > >
> > > Also, various chroots (bootstrap, buildchroot, sbuild chroot)
> > > include their apt caches to sstate cache files.
> > >
> > > This patchset switches to hardlinks instead of copies and removes
> > > apt cache from bootstrapped images ans sstate caches.
> >
> > I just saw that this pattern does NOT work in case the cache is on a
> > different filesystem. This unfortunately is the case for all CI
> > systems with locally mounted caches, as well as for kas-container
> > builds with DL_DIR outside the KAS_WORK_DIR.
>
> I remember discussing that issue with someone because that is always
> what happens when you implement hard linking. Not sure it was on the
> list because i kept away from this lively discussion.
>
> It is like when someone adds overlayfs and then finds that it can not
> be nested a few weeks later ;).

The overlayfs is not the right way to go because a simpler approach
should prefered. The problem of going for straight simple solutions
(small patches) is that in the long run this brings us to an
overcomplicated system. So, from time to time, it is necessary to
approach the problem from a radical point of view. This is not because
a radical change would be necessary but because we need to re-think
the system and then see how options are viable and then take a choice
among them balancing our choice between various aspects.

Best regards, R-

  reply	other threads:[~2023-01-30 12:25 UTC|newest]

Thread overview: 15+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2023-01-20  7:31 Uladzimir Bely
2023-01-20  7:31 ` [PATCH v3 1/5] Clean apt cache from debootstrapped rootfs dirs Uladzimir Bely
2023-01-20  7:31 ` [PATCH v3 2/5] Use hardlinks in deb-dl-dir import/export Uladzimir Bely
2023-01-20  7:31 ` [PATCH v3 3/5] Exclude apt cache from sstate caches Uladzimir Bely
2023-01-20  7:31 ` [PATCH v3 4/5] Use symlinks when importing debian packages to sbuild chroot Uladzimir Bely
2023-01-20  7:31 ` [PATCH v3 5/5] Lightweight copy of rootfs directories if possible Uladzimir Bely
2023-01-20 13:04 ` [PATCH v3 0/5] Improving apt cache Moessbauer, Felix
2023-01-21  4:12   ` Roberto A. Foglietta
2023-01-24  7:38 ` Uladzimir Bely
2023-01-30  8:45 ` Moessbauer, Felix
2023-01-30  9:56   ` Roberto A. Foglietta
2023-01-30 10:04     ` Roberto A. Foglietta
2023-01-30 10:45   ` Henning Schild
2023-01-30 12:24     ` Roberto A. Foglietta [this message]
2023-01-30 14:16   ` Roberto A. Foglietta

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to='CAJGKYO6b+hdtbrTjk+TSOG=GmrWW2okF4TG4MEtU0eUA6MgPcg@mail.gmail.com' \
    --to=roberto.foglietta@gmail.com \
    --cc=felix.moessbauer@siemens.com \
    --cc=henning.schild@siemens.com \
    --cc=isar-users@googlegroups.com \
    --cc=jan.kiszka@siemens.com \
    --cc=ubely@ilbers.de \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox