From: Henning Schild <henning.schild@siemens.com>
To: Anton Mikanovich <amikan@ilbers.de>
Cc: isar-users@googlegroups.com
Subject: Re: [PATCH v6 00/21] Migrate to Bitbake 2.0
Date: Fri, 16 Dec 2022 15:57:06 +0100 [thread overview]
Message-ID: <20221216155706.6af8a810@md1za8fc.ad001.siemens.net> (raw)
In-Reply-To: <20221213125305.10984-1-amikan@ilbers.de>
Great effort. I gave this a try a while back on a relatively simply
layer, today i gave it a look but not a try.
I had some small remarks but nothing major.
I was never a big fan of the forked bitbake.conf and i saw many commits
touching it. I would suggest to treat it like any other file we have to
fork. Get the original and apply our minimal changes on top, and rebase
when we update the original.
Maybe worth to look at the absolute diff we have before vs the absolute
diff we have with this. To see if we potentially missed out on some
upstream changes to that central config. But maybe that was done
already.
Henning
Am Tue, 13 Dec 2022 15:52:44 +0300
schrieb Anton Mikanovich <amikan@ilbers.de>:
> This patchset moves Isar to use Bitbake 2.0 branch.
>
> scripts/contrib/convert-overrides.py is the script for overrides
> update and it needs some testing on downstream layers. Usage:
> $ ./scripts/contrib/convert-overrides.py meta-customlayer
>
> Changes since v5:
> - Rebase on next
> - Document sstate migration to zstd
>
> Changes since v4:
> - Rebase on next
> - Use Bitbake 2.0.5 / Yocto 4.0.5
> - Fix hash exclude variables
> - Add try/catch into sstate maintenance script
> - Fix overrides conversion script chmod
> - Fix clean task
> - Some commits reorder and rewording
>
> Changes since v3:
>
> - Rebase on next
> - Add network flag for do_containerize
> - Update imagetypes variables in override script
> - Update RECIPE-API-CHANGELOG
>
> Changes since v2:
>
> - Fixed building of stretch targets
>
> Changes since v1:
>
> - Rebased on top of sbuild
> - Resolved 'metadata is not deterministic' issues
> - Update sstate class and maintenance script
> - Update OE classes
> - Adopt CI configuration
>
> Anton Mikanovich (21):
> meta: change deprecated parse calls
> scripts/contrib: Add override conversion script
> scripts/contrib: configure override conversion script
> meta-isar: set default branch names
> meta: remove non recommended syntax
> bitbake: Update to Bitbake 2.0.5
> doc: require zstd tool
> meta: update bitbake variables
> bitbake.conf: align hash vars with openembedded
> meta: mark network and sudo tasks
> meta: update overrides syntax
> sstate: update bbclass
> bitbake.conf: declare default XZ and ZSTD options
> Revert "devshell: Use different termination test to avoid warnings"
> meta: align with OE-core libraries update
> Revert "Revert "devshell: Use different termination test to avoid
> warnings""
> CI: Adopt tests to syntax change
> isar-sstate: adopt sstate maintenance script
> RECIPE-API-CHANGELOG: Add tips after bitbake version update
> Revert "bitbake: Make 3.6.0 the minimum python version"
> Revert "utils/ply: Change md5 usages to work on FIPS enabled hosts"
>
> RECIPE-API-CHANGELOG.md | 22 +
> bitbake/README | 21 +-
> bitbake/bin/bitbake | 4 +-
> bitbake/bin/bitbake-diffsigs | 5 +-
> bitbake/bin/bitbake-getvar | 50 ++
> bitbake/bin/bitbake-hashclient | 2 +
> bitbake/bin/bitbake-hashserv | 2 +
> bitbake/bin/bitbake-layers | 2 +
> bitbake/bin/bitbake-prserv | 8 +-
> bitbake/bin/bitbake-selftest | 3 +
> bitbake/bin/bitbake-server | 3 +-
> bitbake/bin/bitbake-worker | 23 +-
> bitbake/bin/git-make-shallow | 4 +
> bitbake/bin/toaster | 6 +-
> bitbake/bin/toaster-eventreplay | 2 +
> bitbake/conf/bitbake.conf | 6 +-
> bitbake/contrib/hashserv/Dockerfile | 6 +-
> bitbake/contrib/prserv/Dockerfile | 62 ++
> bitbake/contrib/vim/plugin/newbbappend.vim | 2 +-
> bitbake/contrib/vim/syntax/bitbake.vim | 11 +-
> bitbake/doc/Makefile | 2 +-
> bitbake/doc/README | 6 +-
> .../bitbake-user-manual-execution.rst | 112 ++--
> .../bitbake-user-manual-fetching.rst | 229 +++++--
> .../bitbake-user-manual-hello.rst | 60 +-
> .../bitbake-user-manual-intro.rst | 64 +-
> .../bitbake-user-manual-metadata.rst | 493 +++++++--------
> .../bitbake-user-manual-ref-variables.rst | 583
> ++++++++++-------- bitbake/doc/releases.rst |
> 84 ++- bitbake/lib/bb/COW.py | 2 +
> bitbake/lib/bb/__init__.py | 15 +-
> bitbake/lib/bb/asyncrpc/__init__.py | 33 +
> bitbake/lib/bb/asyncrpc/client.py | 178 ++++++
> bitbake/lib/bb/asyncrpc/serv.py | 288 +++++++++
> bitbake/lib/bb/build.py | 104 ++--
> bitbake/lib/bb/cache.py | 35 +-
> bitbake/lib/bb/checksum.py | 22 +-
> bitbake/lib/bb/codeparser.py | 22 +-
> bitbake/lib/bb/command.py | 36 +-
> bitbake/lib/bb/compress/_pipecompress.py | 196 ++++++
> bitbake/lib/bb/compress/lz4.py | 19 +
> bitbake/lib/bb/compress/zstd.py | 30 +
> bitbake/lib/bb/cooker.py | 298 +++++----
> bitbake/lib/bb/cookerdata.py | 47 +-
> bitbake/lib/bb/daemonize.py | 44 +-
> bitbake/lib/bb/data.py | 59 +-
> bitbake/lib/bb/data_smart.py | 213 ++++---
> bitbake/lib/bb/event.py | 16 +-
> bitbake/lib/bb/exceptions.py | 2 +
> bitbake/lib/bb/fetch2/README | 57 ++
> bitbake/lib/bb/fetch2/__init__.py | 138 +++--
> bitbake/lib/bb/fetch2/crate.py | 136 ++++
> bitbake/lib/bb/fetch2/git.py | 54 +-
> bitbake/lib/bb/fetch2/gitsm.py | 25 +-
> bitbake/lib/bb/fetch2/npm.py | 52 +-
> bitbake/lib/bb/fetch2/npmsw.py | 33 +-
> bitbake/lib/bb/fetch2/osc.py | 20 +-
> bitbake/lib/bb/fetch2/s3.py | 41 +-
> bitbake/lib/bb/fetch2/ssh.py | 49 +-
> bitbake/lib/bb/fetch2/svn.py | 10 +-
> bitbake/lib/bb/fetch2/wget.py | 161 +++--
> bitbake/lib/bb/main.py | 9 +-
> bitbake/lib/bb/monitordisk.py | 17 +-
> bitbake/lib/bb/msg.py | 32 +-
> bitbake/lib/bb/parse/__init__.py | 2 +
> bitbake/lib/bb/parse/ast.py | 14 +-
> bitbake/lib/bb/parse/parse_py/BBHandler.py | 7 +-
> bitbake/lib/bb/parse/parse_py/ConfHandler.py | 16 +-
> bitbake/lib/bb/persist_data.py | 54 +-
> bitbake/lib/bb/process.py | 4 +-
> bitbake/lib/bb/progress.py | 9 +-
> bitbake/lib/bb/providers.py | 14 +-
> bitbake/lib/bb/runqueue.py | 284 +++++----
> bitbake/lib/bb/server/process.py | 47 +-
> bitbake/lib/bb/server/xmlrpcserver.py | 1 +
> bitbake/lib/bb/siggen.py | 186 ++++--
> bitbake/lib/bb/taskdata.py | 14 +-
> bitbake/lib/bb/tests/codeparser.py | 28 +-
> bitbake/lib/bb/tests/compression.py | 100 +++
> bitbake/lib/bb/tests/cooker.py | 2 +
> bitbake/lib/bb/tests/data.py | 95 +--
> .../debian/pool/main/m/minicom/index.html | 59 ++
> bitbake/lib/bb/tests/fetch.py | 533 ++++++++++------
> bitbake/lib/bb/tests/parse.py | 43 +-
> .../bb/tests/runqueue-tests/conf/bitbake.conf | 2 +-
> bitbake/lib/bb/tests/runqueue.py | 52 +-
> bitbake/lib/bb/tests/utils.py | 20 +-
> bitbake/lib/bb/tinfoil.py | 12 +-
> bitbake/lib/bb/ui/buildinfohelper.py | 83 +--
> bitbake/lib/bb/ui/knotty.py | 100 +--
> bitbake/lib/bb/ui/taskexp.py | 5 +
> bitbake/lib/bb/ui/uievent.py | 6 +-
> bitbake/lib/bb/ui/uihelper.py | 4 +-
> bitbake/lib/bb/utils.py | 159 ++++-
> bitbake/lib/bblayers/__init__.py | 2 +
> bitbake/lib/bblayers/action.py | 4 +-
> bitbake/lib/bblayers/common.py | 2 +
> bitbake/lib/bblayers/layerindex.py | 18 +-
> bitbake/lib/bblayers/query.py | 10 +-
> bitbake/lib/codegen.py | 6 +
> bitbake/lib/hashserv/__init__.py | 66 +-
> bitbake/lib/hashserv/client.py | 152 +----
> bitbake/lib/hashserv/server.py | 549 ++++++++---------
> bitbake/lib/hashserv/tests.py | 161 ++++-
> bitbake/lib/layerindexlib/__init__.py | 9 +-
> bitbake/lib/layerindexlib/cooker.py | 2 +-
> bitbake/lib/layerindexlib/restapi.py | 4 +-
> bitbake/lib/layerindexlib/tests/restapi.py | 2 +-
> bitbake/lib/prserv/__init__.py | 2 +
> bitbake/lib/prserv/client.py | 50 ++
> bitbake/lib/prserv/db.py | 67 +-
> bitbake/lib/prserv/serv.py | 542 ++++++----------
> bitbake/lib/pyinotify.py | 44 +-
> .../bldcontrol/localhostbecontroller.py | 4 +-
> .../management/commands/runbuilds.py | 83 ++-
> .../migrations/0008_models_bigautofield.py | 48 ++
> bitbake/lib/toaster/manage.py | 2 +
> .../lib/toaster/orm/fixtures/gen_fixtures.py | 445 +++++++++++++
> bitbake/lib/toaster/orm/fixtures/oe-core.xml | 48 +-
> bitbake/lib/toaster/orm/fixtures/poky.xml | 118 ++--
> bitbake/lib/toaster/orm/fixtures/settings.xml | 2 +-
> .../orm/management/commands/lsupdates.py | 14 +-
> .../migrations/0020_models_bigautofield.py | 173 ++++++
> bitbake/lib/toaster/orm/models.py | 5 +-
> .../toaster/toastergui/templates/base.html | 2 +-
> .../toastergui/templates/configvars.html | 2 +-
> .../toaster/toastergui/templates/landing.html | 6 +-
> .../templates/landing_not_managed.html | 34 -
> .../toastergui/templates/layerdetails.html | 2 +-
> .../templates/package_detail_base.html | 2 +-
> .../toaster/toastergui/templates/project.html | 2 +-
> .../templates/project_specific.html | 2 +-
> .../toastergui/templates/projectconf.html | 34 +-
> bitbake/lib/toaster/toastergui/views.py | 22 +-
> .../management/commands/buildimport.py | 2 +-
> bitbake/lib/toaster/toastermain/settings.py | 3 +
> bitbake/toaster-requirements.txt | 2 +-
> doc/user_manual.md | 3 +-
> meta-isar/classes/rpi-sdimg.bbclass | 4 +-
> meta-isar/classes/ubi-ubifs-img.bbclass | 6 +-
> meta-isar/conf/distro/raspios-bullseye.conf | 8 +-
> meta-isar/conf/distro/ubuntu-focal.conf | 4 +-
> meta-isar/conf/local.conf.sample | 8 +-
> meta-isar/conf/machine/de0-nano-soc.conf | 4 +-
> meta-isar/conf/machine/hikey.conf | 2 +-
> meta-isar/conf/machine/phyboard-mira.conf | 2 +-
> meta-isar/conf/machine/qemuamd64.conf | 6 +-
> meta-isar/conf/machine/qemuarm64.conf | 2 +-
> meta-isar/conf/machine/qemuriscv64.conf | 2 +-
> meta-isar/conf/machine/stm32mp15x.conf | 4 +-
> .../conf/multiconfig/qemuamd64-bullseye.conf | 2 +-
> .../conf/multiconfig/qemuarm-bookworm.conf | 2 +-
> meta-isar/recipes-app/cowsay/cowsay_git.bb | 2 +-
> .../recipes-app/hello-isar/hello-isar.bb | 4 +-
> meta-isar/recipes-app/libhello/libhello.bb | 4 +-
> .../bootconfig-rpi/bootconfig-rpi.bb | 6 +-
> .../optee-os/optee-os-stm32mp15x_3.11.0.bb | 2 +-
> .../linux/linux-cip_4.4.166-cip29.bb | 2 +-
> .../linux/linux-mainline_5.4.203.bb | 4 +-
> .../linux/linux-phy_5.10.76-phy4.bb | 2 +-
> meta/classes/base.bbclass | 1 +
> meta/classes/dpkg-base.bbclass | 10 +-
> meta/classes/dpkg-gbp.bbclass | 2 +-
> meta/classes/dpkg-prebuilt.bbclass | 2 +-
> meta/classes/dpkg.bbclass | 2 +-
> meta/classes/image-locales-extension.bbclass | 2 +
> meta/classes/image-tools-extension.bbclass | 1 +
> meta/classes/image.bbclass | 38 +-
> meta/classes/imagetypes.bbclass | 59 +-
> meta/classes/imagetypes_container.bbclass | 5 +-
> meta/classes/imagetypes_vm.bbclass | 10 +-
> meta/classes/imagetypes_wic.bbclass | 5 +-
> meta/classes/rootfs.bbclass | 7 +-
> meta/classes/sdk.bbclass | 30 +-
> meta/classes/sstate.bbclass | 249 ++++----
> meta/conf/bitbake.conf | 69 ++-
> meta/conf/distro/debian-common.conf | 16 +-
> meta/conf/distro/debian-stretch.conf | 4 +-
> meta/lib/oe/gpg_sign.py | 35 +-
> meta/lib/oe/maketype.py | 7 +-
> meta/lib/oe/patch.py | 52 +-
> meta/lib/oe/path.py | 79 +++
> meta/lib/oe/sstatesig.py | 131 ++--
> meta/lib/oe/terminal.py | 33 +-
> meta/lib/oe/utils.py | 67 +-
> meta/recipes-bsp/barebox/barebox.inc | 2 +-
> .../libubootenv/libubootenv_0.3-3.bb | 2 +-
> meta/recipes-bsp/optee-os/optee-os-custom.inc | 2 +-
> .../trusted-firmware-a-custom.inc | 2 +-
> meta/recipes-bsp/u-boot/u-boot-custom.inc | 2 +-
> .../isar-bootstrap/isar-bootstrap.inc | 14 +-
> .../buildchroot/buildchroot-host.bb | 2 +-
> .../buildchroot/buildchroot.inc | 6 +-
> .../sbuild-chroot/sbuild-chroot.inc | 2 +-
> meta/recipes-kernel/kselftest/kselftest.inc | 6 +-
> meta/recipes-kernel/linux-module/module.inc | 2 +-
> meta/recipes-kernel/linux/linux-custom.inc | 12 +-
> scripts/contrib/convert-overrides.py | 145 +++++
> scripts/isar-buildenv-internal | 4 +-
> scripts/isar-sstate | 70 +--
> testsuite/cibuilder.py | 8 +-
> testsuite/citest.py | 2 +-
> 202 files changed, 6993 insertions(+), 3365 deletions(-)
> create mode 100755 bitbake/bin/bitbake-getvar
> create mode 100644 bitbake/contrib/prserv/Dockerfile
> create mode 100644 bitbake/lib/bb/asyncrpc/__init__.py
> create mode 100644 bitbake/lib/bb/asyncrpc/client.py
> create mode 100644 bitbake/lib/bb/asyncrpc/serv.py
> create mode 100644 bitbake/lib/bb/compress/_pipecompress.py
> create mode 100644 bitbake/lib/bb/compress/lz4.py
> create mode 100644 bitbake/lib/bb/compress/zstd.py
> create mode 100644 bitbake/lib/bb/fetch2/README
> create mode 100644 bitbake/lib/bb/fetch2/crate.py
> create mode 100644 bitbake/lib/bb/tests/compression.py
> create mode 100644
> bitbake/lib/bb/tests/fetch-testdata/debian/pool/main/m/minicom/index.html
> create mode 100644 bitbake/lib/prserv/client.py create mode 100644
> bitbake/lib/toaster/bldcontrol/migrations/0008_models_bigautofield.py
> create mode 100755 bitbake/lib/toaster/orm/fixtures/gen_fixtures.py
> create mode 100644
> bitbake/lib/toaster/orm/migrations/0020_models_bigautofield.py delete
> mode 100644
> bitbake/lib/toaster/toastergui/templates/landing_not_managed.html
> create mode 100755 scripts/contrib/convert-overrides.py
>
next prev parent reply other threads:[~2022-12-16 14:57 UTC|newest]
Thread overview: 42+ messages / expand[flat|nested] mbox.gz Atom feed top
2022-12-13 12:52 Anton Mikanovich
2022-12-13 12:52 ` [PATCH v6 01/21] meta: change deprecated parse calls Anton Mikanovich
2022-12-13 12:52 ` [PATCH v6 02/21] scripts/contrib: Add override conversion script Anton Mikanovich
2022-12-13 12:52 ` [PATCH v6 03/21] scripts/contrib: configure " Anton Mikanovich
2022-12-16 14:38 ` Henning Schild
2022-12-16 14:49 ` Anton Mikanovich
2022-12-16 15:00 ` Henning Schild
2022-12-13 12:52 ` [PATCH v6 04/21] meta-isar: set default branch names Anton Mikanovich
2022-12-13 12:52 ` [PATCH v6 05/21] meta: remove non recommended syntax Anton Mikanovich
2022-12-13 12:52 ` [PATCH v6 06/21] bitbake: Update to Bitbake 2.0.5 Anton Mikanovich
2022-12-13 12:52 ` [PATCH v6 07/21] doc: require zstd tool Anton Mikanovich
2022-12-13 12:52 ` [PATCH v6 08/21] meta: update bitbake variables Anton Mikanovich
2022-12-13 12:52 ` [PATCH v6 09/21] bitbake.conf: align hash vars with openembedded Anton Mikanovich
2022-12-13 12:52 ` [PATCH v6 10/21] meta: mark network and sudo tasks Anton Mikanovich
2022-12-16 14:49 ` Henning Schild
2022-12-16 14:52 ` Anton Mikanovich
2022-12-16 15:04 ` Henning Schild
2022-12-16 15:09 ` Schmidt, Adriaan
2022-12-16 15:27 ` Henning Schild
2022-12-13 12:52 ` [PATCH v6 11/21] meta: update overrides syntax Anton Mikanovich
2022-12-13 12:52 ` [PATCH v6 12/21] sstate: update bbclass Anton Mikanovich
2022-12-13 12:52 ` [PATCH v6 13/21] bitbake.conf: declare default XZ and ZSTD options Anton Mikanovich
2022-12-13 12:52 ` [PATCH v6 14/21] Revert "devshell: Use different termination test to avoid warnings" Anton Mikanovich
2022-12-13 12:52 ` [PATCH v6 15/21] meta: align with OE-core libraries update Anton Mikanovich
2022-12-13 12:53 ` [PATCH v6 16/21] Revert "Revert "devshell: Use different termination test to avoid warnings"" Anton Mikanovich
2022-12-13 12:53 ` [PATCH v6 17/21] CI: Adopt tests to syntax change Anton Mikanovich
2022-12-13 12:53 ` [PATCH v6 18/21] isar-sstate: adopt sstate maintenance script Anton Mikanovich
2022-12-13 12:53 ` [PATCH v6 19/21] RECIPE-API-CHANGELOG: Add tips after bitbake version update Anton Mikanovich
2022-12-16 15:18 ` Schmidt, Adriaan
2022-12-13 12:53 ` [PATCH v6 20/21] Revert "bitbake: Make 3.6.0 the minimum python version" Anton Mikanovich
2022-12-13 14:23 ` Schmidt, Adriaan
2022-12-16 14:33 ` Henning Schild
2022-12-16 14:45 ` Anton Mikanovich
2022-12-17 3:55 ` Moessbauer, Felix
2022-12-19 7:37 ` Anton Mikanovich
2022-12-13 12:53 ` [PATCH v6 21/21] Revert "utils/ply: Change md5 usages to work on FIPS enabled hosts" Anton Mikanovich
2022-12-16 14:57 ` Henning Schild [this message]
2022-12-16 15:19 ` [PATCH v6 00/21] Migrate to Bitbake 2.0 Schmidt, Adriaan
2022-12-23 18:10 ` Anton Mikanovich
2022-12-19 7:44 ` Moessbauer, Felix
2022-12-20 6:16 ` Anton Mikanovich
2022-12-20 19:33 ` Roberto A. Foglietta
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20221216155706.6af8a810@md1za8fc.ad001.siemens.net \
--to=henning.schild@siemens.com \
--cc=amikan@ilbers.de \
--cc=isar-users@googlegroups.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox