From: Adriaan Schmidt <adriaan.schmidt@siemens.com>
To: isar-users@googlegroups.com
Cc: Adriaan Schmidt <adriaan.schmidt@siemens.com>
Subject: [PATCH v2 00/10] Add sstate-cache
Date: Tue, 12 Oct 2021 14:36:15 +0200 [thread overview]
Message-ID: <20211012123625.1703627-1-adriaan.schmidt@siemens.com> (raw)
This series adds the sstate-cache feature from OE to Isar. The cache holds
the results of bootstrapping, rootfs generation (buildchroot, image rootfs),
and deb package generation.
To use the cache, the only configuration neccessary is setting SSTATE_DIR.
The contents of that directory need to be preserved across bitbake invocations.
One known weakness is that the package lists of cached rootfs's can run
out of sync with upstream ("apt-get update" only happens at bootstrap time).
But this also happens with an "old" local build dir, and is something that
may be addressed elsewhere. For now, the recommendation is to frequently
clear the cache (in one of our projects we run a nightly "clear&populate
cache" CI job).
Patches 1..5 fix (unrelated) issues that would otherwise block sstate caching,
patch 6 copies files from OE, and patches 7..10 add caching to Isar.
---
Changes since v1:
* fix copy/paste typo in rootfs.bbclass
* add mounting trick to tar rootfs (because --one-file-system
does not stop at bind mounts)
* have install_imager_deps also depend explicitly on isar-apt
Adriaan Schmidt (10):
oe imports in central location
wic-img: create deploy dir
rootfs: recursively depend on packages
base: remove unneeded "before do_build" task dependencies
dpkg: add explicit dependency to isar-apt
meta: add sstate feature from oe
sstate: configure
sstate: add caching to isar-bootstrap
sstate: add caching to rootfs
sstate: add caching to debian packages
meta/classes/base.bbclass | 32 +-
meta/classes/dpkg-base.bbclass | 33 +-
meta/classes/dpkg.bbclass | 1 +
meta/classes/image-tools-extension.bbclass | 2 +-
meta/classes/patch.bbclass | 5 -
meta/classes/rootfs.bbclass | 29 +-
meta/classes/sstate.bbclass | 1311 +++++++++++++++++
meta/classes/wic-img.bbclass | 1 +
meta/conf/bitbake.conf | 10 +-
meta/lib/oe/gpg_sign.py | 130 ++
meta/lib/oe/sstatesig.py | 603 ++++++++
.../isar-bootstrap/isar-bootstrap.inc | 39 +-
12 files changed, 2171 insertions(+), 25 deletions(-)
create mode 100644 meta/classes/sstate.bbclass
create mode 100644 meta/lib/oe/gpg_sign.py
create mode 100644 meta/lib/oe/sstatesig.py
--
2.30.2
next reply other threads:[~2021-10-12 12:36 UTC|newest]
Thread overview: 19+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-10-12 12:36 Adriaan Schmidt [this message]
2021-10-12 12:36 ` [PATCH v2 01/10] oe imports in central location Adriaan Schmidt
2021-10-12 12:36 ` [PATCH v2 02/10] wic-img: create deploy dir Adriaan Schmidt
2021-10-12 12:36 ` [PATCH v2 03/10] rootfs: recursively depend on packages Adriaan Schmidt
2021-10-13 14:29 ` Jan Kiszka
2021-10-13 14:43 ` Schmidt, Adriaan
2021-10-13 15:09 ` Jan Kiszka
2021-10-13 15:18 ` Schmidt, Adriaan
2021-10-13 16:01 ` Jan Kiszka
2021-10-19 8:10 ` Schmidt, Adriaan
2021-10-12 12:36 ` [PATCH v2 04/10] base: remove unneeded "before do_build" task dependencies Adriaan Schmidt
2021-10-12 12:36 ` [PATCH v2 05/10] dpkg: add explicit dependency to isar-apt Adriaan Schmidt
2021-10-12 12:36 ` [PATCH v2 06/10] meta: add sstate feature from oe Adriaan Schmidt
2021-10-12 12:36 ` [PATCH v2 07/10] sstate: configure Adriaan Schmidt
2021-10-12 12:36 ` [PATCH v2 08/10] sstate: add caching to isar-bootstrap Adriaan Schmidt
2021-10-13 14:17 ` Anton Mikanovich
2021-10-19 8:11 ` Schmidt, Adriaan
2021-10-12 12:36 ` [PATCH v2 09/10] sstate: add caching to rootfs Adriaan Schmidt
2021-10-12 12:36 ` [PATCH v2 10/10] sstate: add caching to debian packages Adriaan Schmidt
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20211012123625.1703627-1-adriaan.schmidt@siemens.com \
--to=adriaan.schmidt@siemens.com \
--cc=isar-users@googlegroups.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox