public inbox for isar-users@googlegroups.com
 help / color / mirror / Atom feed
* [PATCH v2 0/6] Update BitBake in Isar
@ 2026-11-17 14:41 'Clara Kowalsky' via isar-users
  2026-11-17 14:41 ` [PATCH v2 1/6] base: replace BitBake's outdated persist_data 'Clara Kowalsky' via isar-users
                   ` (5 more replies)
  0 siblings, 6 replies; 9+ messages in thread
From: 'Clara Kowalsky' via isar-users @ 2026-11-17 14:41 UTC (permalink / raw)
  To: isar-users; +Cc: Clara Kowalsky

This series updates Isar's BitBake from v2.8.0 to branch 2.18, used in
Yocto 6.0 LTS. Upstream commit 51fd94a67fa17650a9ff623492005972bbc7d26f
was chosen, tagged with yocto-6.0.4. The update includes Isar adaptions
to the intervening fetcher, signature and metadata parser changes.

Debian Buster remains supported as an image target. Its imaging chroot
provides Python 3.7, while BitBake 2.18 requires Python 3.8 and v2.20.0
would need Python 3.9. To be able to satisfy BitBake's Python
requirement, the series moves WIC's Python driver to the build host and
keeps image utilities in the imaging chroot.

As BitBake does not have a consistent text encoding, encoding was
preserved via "git send-email --8bit-encoding=unknown-8bit
--transfer-encoding=base64".
When applying commit "bitbake: update to branch 2.18, tag yocto-6.0.4"
for testing, use "git am --no-utf8 <patch-file>" to avoid encoding
issues.

The testsuite was run using separate work, download and sstate
directories. I tested:

- DevTest.test_dev_apps rootful and rootless
- WicTest.test_wic_nodeploy_partitions and
  WicTest.test_wic_deploy_partitions rootful and rootless
- Buster image builds and EFI/BIOS boot tests rootful and rootless
- WIC image builds for qemuamd64-iso/bookworm rootless
- bananapi/bullseye rootless
- qemui386/buster rootful
- CrossTest.test_cross rootless
- NoCrossTest.test_nocross rootful

Changes since v1:
- send fix "isar-events: close /proc/mounts after cleanup" as
  standalone patch
- drop commit "meta: migrate fetcher references to bb.fetch", as the
  BitBake commit deprecating bb.fetch2 is only part of v2.20.0, not
  branch 2.18
- update wic-chroot script to Python
- move changes from meta/lib/oe/path.py to
  scripts/lib/wic/plugins/source/rootfs.py

Best regards,
Clara Kowalsky

Clara Kowalsky (6):
  base: replace BitBake's outdated persist_data
  isar-events: preserve cleanup for default multiconfig
  wic: run the Python driver outside the imaging chroot
  bitbake.conf: explicitly exclude export and func from signatures
  meta: add missing whitespace around assignment operators
  bitbake: update to branch 2.18, tag yocto-6.0.4

 .gitignore                                    |    2 +-
 RECIPE-API-CHANGELOG.md                       |   17 +
 bitbake/.b4-config                            |    5 +
 bitbake/.gitignore                            |    1 +
 bitbake/.vscode/settings.json                 |   14 +
 bitbake/README                                |    4 +-
 bitbake/TODO                                  |   65 +-
 bitbake/bin/bitbake                           |    2 +-
 bitbake/bin/bitbake-config-build              |    1 +
 bitbake/bin/bitbake-diffsigs                  |    9 +-
 bitbake/bin/bitbake-getvar                    |   15 +-
 bitbake/bin/bitbake-hashclient                |  107 +-
 bitbake/bin/bitbake-hashserv                  |   10 +-
 bitbake/bin/bitbake-layers                    |   40 +-
 bitbake/bin/bitbake-prserv                    |   26 +-
 bitbake/bin/bitbake-selftest                  |    5 +-
 bitbake/bin/bitbake-server                    |    8 +-
 bitbake/bin/bitbake-setup                     | 1384 +++++++
 bitbake/bin/bitbake-worker                    |   33 +-
 bitbake/bin/git-make-shallow                  |    4 +-
 bitbake/bin/toaster                           |   21 +-
 bitbake/contrib/b4-wrapper-bitbake.py         |   40 +
 bitbake/contrib/hashserv/Dockerfile           |    2 +-
 bitbake/contrib/vim/ftdetect/bitbake.vim      |   14 +-
 .../oe-nodistro-master.conf.json              |   47 +
 .../oe-nodistro-whinlatter.conf.json          |   56 +
 .../oe-nodistro-wrynose.conf.json             |   48 +
 .../configurations/poky-master.conf.json      |   73 +
 .../configurations/poky-whinlatter.conf.json  |   80 +
 .../configurations/poky-wrynose.conf.json     |   74 +
 bitbake/doc/.gitignore                        |    3 +
 bitbake/doc/Makefile                          |    2 +-
 .../bitbake-user-manual-environment-setup.rst | 1296 ++++++
 .../bitbake-user-manual-execution.rst         |   35 +-
 .../bitbake-user-manual-fetching.rst          |  287 +-
 .../bitbake-user-manual-intro.rst             |  267 +-
 .../bitbake-user-manual-library-functions.rst |   59 +
 .../bitbake-user-manual-metadata.rst          |  394 +-
 .../bitbake-user-manual-ref-variables.rst     |  379 +-
 bitbake/doc/conf.py                           |   41 +-
 bitbake/doc/index.rst                         |    2 +
 bitbake/doc/releases.rst                      |  174 -
 bitbake/doc/setversions.py                    |  356 ++
 bitbake/doc/sphinx-static/switchers.js        |  233 --
 bitbake/doc/sphinx-static/switchers.js.in     |  249 ++
 bitbake/lib/bb/COW.py                         |   10 +-
 bitbake/lib/bb/__init__.py                    |  144 +-
 bitbake/lib/bb/acl.py                         |    2 -
 bitbake/lib/bb/asyncrpc/__init__.py           |    2 +-
 bitbake/lib/bb/asyncrpc/client.py             |  162 +-
 bitbake/lib/bb/asyncrpc/serv.py               |   44 +-
 bitbake/lib/bb/build.py                       |   27 +-
 bitbake/lib/bb/cache.py                       |   35 +-
 bitbake/lib/bb/checksum.py                    |   25 +
 bitbake/lib/bb/codeparser.py                  |   97 +-
 bitbake/lib/bb/command.py                     |   39 +-
 bitbake/lib/bb/compress/lz4.py                |    4 +-
 bitbake/lib/bb/cooker.py                      |  280 +-
 bitbake/lib/bb/cookerdata.py                  |   30 +-
 bitbake/lib/bb/daemonize.py                   |    3 +
 bitbake/lib/bb/data.py                        |   19 +-
 bitbake/lib/bb/data_smart.py                  |  147 +-
 bitbake/lib/bb/event.py                       |   29 +-
 bitbake/lib/bb/fetch2/__init__.py             |  345 +-
 bitbake/lib/bb/fetch2/az.py                   |    9 +-
 bitbake/lib/bb/fetch2/bzr.py                  |  128 -
 bitbake/lib/bb/fetch2/clearcase.py            |    6 +-
 bitbake/lib/bb/fetch2/crate.py                |   56 +-
 bitbake/lib/bb/fetch2/cvs.py                  |  157 -
 bitbake/lib/bb/fetch2/gcp.py                  |   15 +-
 bitbake/lib/bb/fetch2/git.py                  |  553 ++-
 bitbake/lib/bb/fetch2/gitsm.py                |  127 +-
 bitbake/lib/bb/fetch2/gomod.py                |  273 ++
 bitbake/lib/bb/fetch2/local.py                |    9 +-
 bitbake/lib/bb/fetch2/npm.py                  |   30 +-
 bitbake/lib/bb/fetch2/npmsw.py                |  104 +-
 bitbake/lib/bb/fetch2/osc.py                  |  165 -
 bitbake/lib/bb/fetch2/s3.py                   |    2 +-
 bitbake/lib/bb/fetch2/sftp.py                 |    2 +-
 bitbake/lib/bb/fetch2/ssh.py                  |    3 +-
 bitbake/lib/bb/fetch2/svn.py                  |    5 +-
 bitbake/lib/bb/fetch2/wget.py                 |  195 +-
 bitbake/lib/bb/filter.py                      |  142 +
 bitbake/lib/bb/main.py                        |    6 +-
 bitbake/lib/bb/parse/__init__.py              |   49 +-
 bitbake/lib/bb/parse/ast.py                   |  193 +-
 bitbake/lib/bb/parse/parse_py/BBHandler.py    |   53 +-
 bitbake/lib/bb/parse/parse_py/ConfHandler.py  |   24 +-
 bitbake/lib/bb/persist_data.py                |  271 --
 bitbake/lib/bb/runqueue.py                    |  345 +-
 bitbake/lib/bb/server/process.py              |   86 +-
 bitbake/lib/bb/server/xmlrpcserver.py         |   11 +-
 bitbake/lib/bb/siggen.py                      |   93 +-
 bitbake/lib/bb/taskdata.py                    |    8 +-
 bitbake/lib/bb/tests/codeparser.py            |   40 +
 bitbake/lib/bb/tests/compression.py           |    4 +-
 bitbake/lib/bb/tests/data.py                  |  207 +-
 .../software/miniupnp/download.php            | 3528 +++++++++++++++++
 bitbake/lib/bb/tests/fetch.py                 | 2069 ++++++++--
 bitbake/lib/bb/tests/filter.py                |   88 +
 .../bb/tests/parse-tests/classes/base.bbclass |    5 +
 .../classes/recipe-file-class.bbclass         |    2 +
 .../bb/tests/parse-tests/conf/bitbake.conf    |   15 +
 bitbake/lib/bb/tests/parse.py                 |  413 +-
 bitbake/lib/bb/tests/persist_data.py          |  129 -
 .../tests/runqueue-tests/classes/base.bbclass |    4 +-
 .../lib/bb/tests/runqueue-tests/recipes/g1.bb |    2 +
 .../lib/bb/tests/runqueue-tests/recipes/h1.bb |    0
 bitbake/lib/bb/tests/runqueue.py              |   11 +-
 bitbake/lib/bb/tests/setup.py                 |  728 ++++
 bitbake/lib/bb/tests/siggen.py                |   47 +
 bitbake/lib/bb/tests/support/httpserver.py    |    4 +-
 bitbake/lib/bb/tests/utils.py                 |   19 +
 bitbake/lib/bb/tinfoil.py                     |  192 +-
 bitbake/lib/bb/ui/buildinfohelper.py          |    5 +-
 bitbake/lib/bb/ui/knotty.py                   |  199 +-
 bitbake/lib/bb/ui/taskexp_ncurses.py          |    3 +
 bitbake/lib/bb/ui/teamcity.py                 |   14 +-
 bitbake/lib/bb/ui/uihelper.py                 |   12 +-
 bitbake/lib/bb/utils.py                       |  813 +++-
 bitbake/lib/bblayers/action.py                |    4 +-
 bitbake/lib/bblayers/layerindex.py            |   12 +-
 bitbake/lib/bblayers/query.py                 |   37 +-
 bitbake/lib/bs4/AUTHORS                       |   49 +
 bitbake/lib/bs4/AUTHORS.txt                   |   43 -
 bitbake/lib/bs4/{NEWS.txt => CHANGELOG}       |  779 +++-
 bitbake/lib/bs4/{COPYING.txt => LICENSE}      |   11 +-
 bitbake/lib/bs4/__init__.py                   |  681 +++-
 bitbake/lib/bs4/builder/__init__.py           |  382 +-
 bitbake/lib/bs4/builder/_html5lib.py          |  251 +-
 bitbake/lib/bs4/builder/_htmlparser.py        |  433 +-
 bitbake/lib/bs4/builder/_lxml.py              |  212 +-
 bitbake/lib/bs4/css.py                        |  274 ++
 bitbake/lib/bs4/dammit.py                     |  411 +-
 bitbake/lib/bs4/diagnose.py                   |   84 +-
 bitbake/lib/bs4/element.py                    | 2219 +++++++----
 bitbake/lib/bs4/formatter.py                  |  185 +
 bitbake/lib/bs4/testing.py                    |  686 ----
 bitbake/lib/bs4/tests/__init__.py             |    1 -
 .../lib/bs4/tests/test_builder_registry.py    |  147 -
 bitbake/lib/bs4/tests/test_docs.py            |   32 -
 bitbake/lib/bs4/tests/test_html5lib.py        |   98 -
 bitbake/lib/bs4/tests/test_htmlparser.py      |   31 -
 bitbake/lib/bs4/tests/test_lxml.py            |   70 -
 bitbake/lib/bs4/tests/test_soup.py            |  479 ---
 bitbake/lib/bs4/tests/test_tree.py            | 2004 ----------
 bitbake/lib/hashserv/__init__.py              |   13 +-
 bitbake/lib/hashserv/client.py                |  220 +-
 bitbake/lib/hashserv/server.py                |   56 +-
 bitbake/lib/hashserv/sqlite.py                |   17 +
 bitbake/lib/hashserv/tests.py                 |  295 +-
 bitbake/lib/layerindexlib/__init__.py         |    6 +-
 bitbake/lib/layerindexlib/restapi.py          |    2 +-
 bitbake/lib/ply/yacc.py                       |    1 -
 bitbake/lib/progressbar/progressbar.py        |   16 +-
 bitbake/lib/prserv/__init__.py                |   97 +-
 bitbake/lib/prserv/client.py                  |   15 +-
 bitbake/lib/prserv/db.py                      |  452 +--
 bitbake/lib/prserv/serv.py                    |  140 +-
 bitbake/lib/prserv/tests.py                   |  388 ++
 .../bldcontrol/localhostbecontroller.py       |  154 +-
 .../toaster/orm/fixtures/check_fixtures.py    |   38 +
 .../lib/toaster/orm/fixtures/gen_fixtures.py  |   57 +-
 bitbake/lib/toaster/orm/fixtures/oe-core.xml  |   52 +-
 bitbake/lib/toaster/orm/fixtures/poky.xml     |  166 +-
 .../orm/management/commands/lsupdates.py      |    9 +-
 bitbake/lib/toaster/orm/models.py             |    3 +-
 .../tests/browser/selenium_helpers_base.py    |   50 +-
 .../tests/browser/test_all_builds_page.py     |    7 +-
 .../tests/browser/test_all_projects_page.py   |   12 +-
 .../tests/browser/test_builddashboard_page.py |    2 +-
 .../tests/browser/test_landing_page.py        |   14 +-
 .../tests/browser/test_layerdetails_page.py   |   52 +-
 .../browser/test_new_custom_image_page.py     |    2 +-
 .../tests/browser/test_new_project_page.py    |   12 +-
 bitbake/lib/toaster/tests/builds/buildtest.py |    2 +-
 .../tests/functional/functional_helpers.py    |   86 +
 .../functional/test_create_new_project.py     |  106 +-
 .../tests/functional/test_functional_basic.py |  198 +-
 .../tests/functional/test_project_config.py   |   97 +-
 .../tests/functional/test_project_page.py     |  415 +-
 .../test_project_page_tab_config.py           |  311 +-
 bitbake/lib/toaster/tests/functional/utils.py |   21 +-
 .../tests/toaster-tests-requirements.txt      |    2 +
 .../toastergui/templatetags/projecttags.py    |    1 -
 bitbake/lib/toaster/toastergui/views.py       |   18 +-
 bitbake/lib/toaster/toastermain/settings.py   |    1 -
 .../setup-schema/bitbake-setup.schema.json    |  142 +
 bitbake/setup-schema/layers.schema.json       |   91 +
 doc/technical_overview.md                     |   17 +
 .../installer-add-rootfs.bbclass              |    2 +-
 .../recipes-app/hello-isar/hello-isar.bb      |    2 +-
 meta-isar/recipes-app/libhello/libhello.bb    |    2 +-
 .../bmap-tools/bmap-tools.bb                  |    2 +-
 meta/classes-global/base.bbclass              |   25 +-
 meta/classes-global/isar-events.bbclass       |   11 +-
 meta/classes-recipe/dpkg.bbclass              |    2 +-
 .../image-tools-extension.bbclass             |   17 +-
 meta/classes-recipe/imagetypes_wic.bbclass    |   49 +-
 meta/classes-recipe/rootfs.bbclass            |    4 +-
 meta/classes-recipe/sbuild.bbclass            |    2 +-
 meta/conf/bitbake.conf                        |    2 +-
 .../libubootenv/libubootenv_0.3.5-0.1.bb      |    2 +-
 .../source/bootimg-biosplusefi-isar.py        |    1 +
 .../wic/plugins/source/bootimg-efi-isar.py    |    8 +-
 .../wic/plugins/source/bootimg-pcbios-isar.py |    6 +-
 .../plugins/source/isoimage-isohybrid-isar.py |    4 +-
 .../lib/wic/plugins/source/rootfs-u-boot.py   |   15 +-
 scripts/lib/wic/misc.py                       |   38 +-
 scripts/lib/wic/partition.py                  |    5 +-
 scripts/lib/wic/plugins/imager/direct.py      |    9 +-
 .../lib/wic/plugins/source/bootimg-pcbios.py  |    6 +-
 .../wic/plugins/source/isoimage-isohybrid.py  |    4 +-
 scripts/lib/wic/plugins/source/rawcopy.py     |   20 +-
 scripts/lib/wic/plugins/source/rootfs.py      |   45 +-
 scripts/wic-chroot                            |   38 +
 testsuite/unittests/test_build_uuid.py        |  107 +
 217 files changed, 22871 insertions(+), 10129 deletions(-)
 create mode 100644 bitbake/.b4-config
 create mode 100644 bitbake/.vscode/settings.json
 create mode 120000 bitbake/bin/bitbake-config-build
 create mode 100755 bitbake/bin/bitbake-setup
 create mode 100755 bitbake/contrib/b4-wrapper-bitbake.py
 create mode 100644 bitbake/default-registry/configurations/oe-nodistro-master.conf.json
 create mode 100644 bitbake/default-registry/configurations/oe-nodistro-whinlatter.conf.json
 create mode 100644 bitbake/default-registry/configurations/oe-nodistro-wrynose.conf.json
 create mode 100644 bitbake/default-registry/configurations/poky-master.conf.json
 create mode 100644 bitbake/default-registry/configurations/poky-whinlatter.conf.json
 create mode 100644 bitbake/default-registry/configurations/poky-wrynose.conf.json
 create mode 100644 bitbake/doc/bitbake-user-manual/bitbake-user-manual-environment-setup.rst
 create mode 100644 bitbake/doc/bitbake-user-manual/bitbake-user-manual-library-functions.rst
 delete mode 100644 bitbake/doc/releases.rst
 create mode 100755 bitbake/doc/setversions.py
 delete mode 100644 bitbake/doc/sphinx-static/switchers.js
 create mode 100644 bitbake/doc/sphinx-static/switchers.js.in
 delete mode 100644 bitbake/lib/bb/fetch2/bzr.py
 delete mode 100644 bitbake/lib/bb/fetch2/cvs.py
 create mode 100644 bitbake/lib/bb/fetch2/gomod.py
 delete mode 100644 bitbake/lib/bb/fetch2/osc.py
 create mode 100644 bitbake/lib/bb/filter.py
 delete mode 100644 bitbake/lib/bb/persist_data.py
 create mode 100644 bitbake/lib/bb/tests/fetch-testdata/software/miniupnp/download.php
 create mode 100644 bitbake/lib/bb/tests/filter.py
 create mode 100644 bitbake/lib/bb/tests/parse-tests/classes/base.bbclass
 create mode 100644 bitbake/lib/bb/tests/parse-tests/classes/recipe-file-class.bbclass
 create mode 100644 bitbake/lib/bb/tests/parse-tests/conf/bitbake.conf
 delete mode 100644 bitbake/lib/bb/tests/persist_data.py
 create mode 100644 bitbake/lib/bb/tests/runqueue-tests/recipes/g1.bb
 create mode 100644 bitbake/lib/bb/tests/runqueue-tests/recipes/h1.bb
 create mode 100644 bitbake/lib/bb/tests/setup.py
 create mode 100644 bitbake/lib/bs4/AUTHORS
 delete mode 100644 bitbake/lib/bs4/AUTHORS.txt
 rename bitbake/lib/bs4/{NEWS.txt => CHANGELOG} (56%)
 rename bitbake/lib/bs4/{COPYING.txt => LICENSE} (80%)
 create mode 100644 bitbake/lib/bs4/css.py
 create mode 100644 bitbake/lib/bs4/formatter.py
 delete mode 100644 bitbake/lib/bs4/testing.py
 delete mode 100644 bitbake/lib/bs4/tests/__init__.py
 delete mode 100644 bitbake/lib/bs4/tests/test_builder_registry.py
 delete mode 100644 bitbake/lib/bs4/tests/test_docs.py
 delete mode 100644 bitbake/lib/bs4/tests/test_html5lib.py
 delete mode 100644 bitbake/lib/bs4/tests/test_htmlparser.py
 delete mode 100644 bitbake/lib/bs4/tests/test_lxml.py
 delete mode 100644 bitbake/lib/bs4/tests/test_soup.py
 delete mode 100644 bitbake/lib/bs4/tests/test_tree.py
 create mode 100644 bitbake/lib/prserv/tests.py
 create mode 100755 bitbake/lib/toaster/orm/fixtures/check_fixtures.py
 create mode 100644 bitbake/setup-schema/bitbake-setup.schema.json
 create mode 100644 bitbake/setup-schema/layers.schema.json
 create mode 100755 scripts/wic-chroot
 create mode 100644 testsuite/unittests/test_build_uuid.py

-- 
2.56.1

-- 
You received this message because you are subscribed to the Google Groups "isar-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to isar-users+unsubscribe@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/isar-users/20261117144109.2417395-1-clara.kowalsky%40siemens.com.

^ permalink raw reply	[flat|nested] 9+ messages in thread

end of thread, other threads:[~2026-11-18 12:48 UTC | newest]

Thread overview: 9+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2026-11-17 14:41 [PATCH v2 0/6] Update BitBake in Isar 'Clara Kowalsky' via isar-users
2026-11-17 14:41 ` [PATCH v2 1/6] base: replace BitBake's outdated persist_data 'Clara Kowalsky' via isar-users
2026-11-17 14:41 ` [PATCH v2 2/6] isar-events: preserve cleanup for default multiconfig 'Clara Kowalsky' via isar-users
2026-11-17 14:41 ` [PATCH v2 3/6] wic: run the Python driver outside the imaging chroot 'Clara Kowalsky' via isar-users
2026-11-18 12:25   ` 'Moessbauer, Felix' via isar-users
2026-11-18 12:47   ` 'Moessbauer, Felix' via isar-users
2026-11-17 14:41 ` [PATCH v2 4/6] bitbake.conf: explicitly exclude export and func from signatures 'Clara Kowalsky' via isar-users
2026-11-17 14:41 ` [PATCH v2 5/6] meta: add missing whitespace around assignment operators 'Clara Kowalsky' via isar-users
2026-11-17 14:41 ` [PATCH v2 6/6] bitbake: update to branch 2.18, tag yocto-6.0.4 'Clara Kowalsky' via isar-users

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox