From: "Schmidt, Adriaan" <adriaan.schmidt@siemens.com>
To: "Schild, Henning" <henning.schild@siemens.com>,
Anton Mikanovich <amikan@ilbers.de>
Cc: "isar-users@googlegroups.com" <isar-users@googlegroups.com>
Subject: RE: [PATCH v6 00/21] Migrate to Bitbake 2.0
Date: Fri, 16 Dec 2022 15:19:41 +0000 [thread overview]
Message-ID: <AS4PR10MB53181DF275F713648E8EAB28EDE69@AS4PR10MB5318.EURPRD10.PROD.OUTLOOK.COM> (raw)
In-Reply-To: <20221216155706.6af8a810@md1za8fc.ad001.siemens.net>
Henning Schild, Freitag, 16. Dezember 2022 15:57:
> Great effort. I gave this a try a while back on a relatively simply
> layer, today i gave it a look but not a try.
I agree! I tried v5 on one of our layers, and it worked great!
Adriaan
> I had some small remarks but nothing major.
>
> I was never a big fan of the forked bitbake.conf and i saw many commits
> touching it. I would suggest to treat it like any other file we have to
> fork. Get the original and apply our minimal changes on top, and rebase
> when we update the original.
>
> Maybe worth to look at the absolute diff we have before vs the absolute
> diff we have with this. To see if we potentially missed out on some
> upstream changes to that central config. But maybe that was done
> already.
>
> Henning
>
> Am Tue, 13 Dec 2022 15:52:44 +0300
> schrieb Anton Mikanovich <amikan@ilbers.de>:
>
> > This patchset moves Isar to use Bitbake 2.0 branch.
> >
> > scripts/contrib/convert-overrides.py is the script for overrides
> > update and it needs some testing on downstream layers. Usage:
> > $ ./scripts/contrib/convert-overrides.py meta-customlayer
> >
> > Changes since v5:
> > - Rebase on next
> > - Document sstate migration to zstd
> >
> > Changes since v4:
> > - Rebase on next
> > - Use Bitbake 2.0.5 / Yocto 4.0.5
> > - Fix hash exclude variables
> > - Add try/catch into sstate maintenance script
> > - Fix overrides conversion script chmod
> > - Fix clean task
> > - Some commits reorder and rewording
> >
> > Changes since v3:
> >
> > - Rebase on next
> > - Add network flag for do_containerize
> > - Update imagetypes variables in override script
> > - Update RECIPE-API-CHANGELOG
> >
> > Changes since v2:
> >
> > - Fixed building of stretch targets
> >
> > Changes since v1:
> >
> > - Rebased on top of sbuild
> > - Resolved 'metadata is not deterministic' issues
> > - Update sstate class and maintenance script
> > - Update OE classes
> > - Adopt CI configuration
> >
> > Anton Mikanovich (21):
> > meta: change deprecated parse calls
> > scripts/contrib: Add override conversion script
> > scripts/contrib: configure override conversion script
> > meta-isar: set default branch names
> > meta: remove non recommended syntax
> > bitbake: Update to Bitbake 2.0.5
> > doc: require zstd tool
> > meta: update bitbake variables
> > bitbake.conf: align hash vars with openembedded
> > meta: mark network and sudo tasks
> > meta: update overrides syntax
> > sstate: update bbclass
> > bitbake.conf: declare default XZ and ZSTD options
> > Revert "devshell: Use different termination test to avoid warnings"
> > meta: align with OE-core libraries update
> > Revert "Revert "devshell: Use different termination test to avoid
> > warnings""
> > CI: Adopt tests to syntax change
> > isar-sstate: adopt sstate maintenance script
> > RECIPE-API-CHANGELOG: Add tips after bitbake version update
> > Revert "bitbake: Make 3.6.0 the minimum python version"
> > Revert "utils/ply: Change md5 usages to work on FIPS enabled hosts"
> >
> > RECIPE-API-CHANGELOG.md | 22 +
> > bitbake/README | 21 +-
> > bitbake/bin/bitbake | 4 +-
> > bitbake/bin/bitbake-diffsigs | 5 +-
> > bitbake/bin/bitbake-getvar | 50 ++
> > bitbake/bin/bitbake-hashclient | 2 +
> > bitbake/bin/bitbake-hashserv | 2 +
> > bitbake/bin/bitbake-layers | 2 +
> > bitbake/bin/bitbake-prserv | 8 +-
> > bitbake/bin/bitbake-selftest | 3 +
> > bitbake/bin/bitbake-server | 3 +-
> > bitbake/bin/bitbake-worker | 23 +-
> > bitbake/bin/git-make-shallow | 4 +
> > bitbake/bin/toaster | 6 +-
> > bitbake/bin/toaster-eventreplay | 2 +
> > bitbake/conf/bitbake.conf | 6 +-
> > bitbake/contrib/hashserv/Dockerfile | 6 +-
> > bitbake/contrib/prserv/Dockerfile | 62 ++
> > bitbake/contrib/vim/plugin/newbbappend.vim | 2 +-
> > bitbake/contrib/vim/syntax/bitbake.vim | 11 +-
> > bitbake/doc/Makefile | 2 +-
> > bitbake/doc/README | 6 +-
> > .../bitbake-user-manual-execution.rst | 112 ++--
> > .../bitbake-user-manual-fetching.rst | 229 +++++--
> > .../bitbake-user-manual-hello.rst | 60 +-
> > .../bitbake-user-manual-intro.rst | 64 +-
> > .../bitbake-user-manual-metadata.rst | 493 +++++++--------
> > .../bitbake-user-manual-ref-variables.rst | 583
> > ++++++++++-------- bitbake/doc/releases.rst |
> > 84 ++- bitbake/lib/bb/COW.py | 2 +
> > bitbake/lib/bb/__init__.py | 15 +-
> > bitbake/lib/bb/asyncrpc/__init__.py | 33 +
> > bitbake/lib/bb/asyncrpc/client.py | 178 ++++++
> > bitbake/lib/bb/asyncrpc/serv.py | 288 +++++++++
> > bitbake/lib/bb/build.py | 104 ++--
> > bitbake/lib/bb/cache.py | 35 +-
> > bitbake/lib/bb/checksum.py | 22 +-
> > bitbake/lib/bb/codeparser.py | 22 +-
> > bitbake/lib/bb/command.py | 36 +-
> > bitbake/lib/bb/compress/_pipecompress.py | 196 ++++++
> > bitbake/lib/bb/compress/lz4.py | 19 +
> > bitbake/lib/bb/compress/zstd.py | 30 +
> > bitbake/lib/bb/cooker.py | 298 +++++----
> > bitbake/lib/bb/cookerdata.py | 47 +-
> > bitbake/lib/bb/daemonize.py | 44 +-
> > bitbake/lib/bb/data.py | 59 +-
> > bitbake/lib/bb/data_smart.py | 213 ++++---
> > bitbake/lib/bb/event.py | 16 +-
> > bitbake/lib/bb/exceptions.py | 2 +
> > bitbake/lib/bb/fetch2/README | 57 ++
> > bitbake/lib/bb/fetch2/__init__.py | 138 +++--
> > bitbake/lib/bb/fetch2/crate.py | 136 ++++
> > bitbake/lib/bb/fetch2/git.py | 54 +-
> > bitbake/lib/bb/fetch2/gitsm.py | 25 +-
> > bitbake/lib/bb/fetch2/npm.py | 52 +-
> > bitbake/lib/bb/fetch2/npmsw.py | 33 +-
> > bitbake/lib/bb/fetch2/osc.py | 20 +-
> > bitbake/lib/bb/fetch2/s3.py | 41 +-
> > bitbake/lib/bb/fetch2/ssh.py | 49 +-
> > bitbake/lib/bb/fetch2/svn.py | 10 +-
> > bitbake/lib/bb/fetch2/wget.py | 161 +++--
> > bitbake/lib/bb/main.py | 9 +-
> > bitbake/lib/bb/monitordisk.py | 17 +-
> > bitbake/lib/bb/msg.py | 32 +-
> > bitbake/lib/bb/parse/__init__.py | 2 +
> > bitbake/lib/bb/parse/ast.py | 14 +-
> > bitbake/lib/bb/parse/parse_py/BBHandler.py | 7 +-
> > bitbake/lib/bb/parse/parse_py/ConfHandler.py | 16 +-
> > bitbake/lib/bb/persist_data.py | 54 +-
> > bitbake/lib/bb/process.py | 4 +-
> > bitbake/lib/bb/progress.py | 9 +-
> > bitbake/lib/bb/providers.py | 14 +-
> > bitbake/lib/bb/runqueue.py | 284 +++++----
> > bitbake/lib/bb/server/process.py | 47 +-
> > bitbake/lib/bb/server/xmlrpcserver.py | 1 +
> > bitbake/lib/bb/siggen.py | 186 ++++--
> > bitbake/lib/bb/taskdata.py | 14 +-
> > bitbake/lib/bb/tests/codeparser.py | 28 +-
> > bitbake/lib/bb/tests/compression.py | 100 +++
> > bitbake/lib/bb/tests/cooker.py | 2 +
> > bitbake/lib/bb/tests/data.py | 95 +--
> > .../debian/pool/main/m/minicom/index.html | 59 ++
> > bitbake/lib/bb/tests/fetch.py | 533 ++++++++++------
> > bitbake/lib/bb/tests/parse.py | 43 +-
> > .../bb/tests/runqueue-tests/conf/bitbake.conf | 2 +-
> > bitbake/lib/bb/tests/runqueue.py | 52 +-
> > bitbake/lib/bb/tests/utils.py | 20 +-
> > bitbake/lib/bb/tinfoil.py | 12 +-
> > bitbake/lib/bb/ui/buildinfohelper.py | 83 +--
> > bitbake/lib/bb/ui/knotty.py | 100 +--
> > bitbake/lib/bb/ui/taskexp.py | 5 +
> > bitbake/lib/bb/ui/uievent.py | 6 +-
> > bitbake/lib/bb/ui/uihelper.py | 4 +-
> > bitbake/lib/bb/utils.py | 159 ++++-
> > bitbake/lib/bblayers/__init__.py | 2 +
> > bitbake/lib/bblayers/action.py | 4 +-
> > bitbake/lib/bblayers/common.py | 2 +
> > bitbake/lib/bblayers/layerindex.py | 18 +-
> > bitbake/lib/bblayers/query.py | 10 +-
> > bitbake/lib/codegen.py | 6 +
> > bitbake/lib/hashserv/__init__.py | 66 +-
> > bitbake/lib/hashserv/client.py | 152 +----
> > bitbake/lib/hashserv/server.py | 549 ++++++++---------
> > bitbake/lib/hashserv/tests.py | 161 ++++-
> > bitbake/lib/layerindexlib/__init__.py | 9 +-
> > bitbake/lib/layerindexlib/cooker.py | 2 +-
> > bitbake/lib/layerindexlib/restapi.py | 4 +-
> > bitbake/lib/layerindexlib/tests/restapi.py | 2 +-
> > bitbake/lib/prserv/__init__.py | 2 +
> > bitbake/lib/prserv/client.py | 50 ++
> > bitbake/lib/prserv/db.py | 67 +-
> > bitbake/lib/prserv/serv.py | 542 ++++++----------
> > bitbake/lib/pyinotify.py | 44 +-
> > .../bldcontrol/localhostbecontroller.py | 4 +-
> > .../management/commands/runbuilds.py | 83 ++-
> > .../migrations/0008_models_bigautofield.py | 48 ++
> > bitbake/lib/toaster/manage.py | 2 +
> > .../lib/toaster/orm/fixtures/gen_fixtures.py | 445 +++++++++++++
> > bitbake/lib/toaster/orm/fixtures/oe-core.xml | 48 +-
> > bitbake/lib/toaster/orm/fixtures/poky.xml | 118 ++--
> > bitbake/lib/toaster/orm/fixtures/settings.xml | 2 +-
> > .../orm/management/commands/lsupdates.py | 14 +-
> > .../migrations/0020_models_bigautofield.py | 173 ++++++
> > bitbake/lib/toaster/orm/models.py | 5 +-
> > .../toaster/toastergui/templates/base.html | 2 +-
> > .../toastergui/templates/configvars.html | 2 +-
> > .../toaster/toastergui/templates/landing.html | 6 +-
> > .../templates/landing_not_managed.html | 34 -
> > .../toastergui/templates/layerdetails.html | 2 +-
> > .../templates/package_detail_base.html | 2 +-
> > .../toaster/toastergui/templates/project.html | 2 +-
> > .../templates/project_specific.html | 2 +-
> > .../toastergui/templates/projectconf.html | 34 +-
> > bitbake/lib/toaster/toastergui/views.py | 22 +-
> > .../management/commands/buildimport.py | 2 +-
> > bitbake/lib/toaster/toastermain/settings.py | 3 +
> > bitbake/toaster-requirements.txt | 2 +-
> > doc/user_manual.md | 3 +-
> > meta-isar/classes/rpi-sdimg.bbclass | 4 +-
> > meta-isar/classes/ubi-ubifs-img.bbclass | 6 +-
> > meta-isar/conf/distro/raspios-bullseye.conf | 8 +-
> > meta-isar/conf/distro/ubuntu-focal.conf | 4 +-
> > meta-isar/conf/local.conf.sample | 8 +-
> > meta-isar/conf/machine/de0-nano-soc.conf | 4 +-
> > meta-isar/conf/machine/hikey.conf | 2 +-
> > meta-isar/conf/machine/phyboard-mira.conf | 2 +-
> > meta-isar/conf/machine/qemuamd64.conf | 6 +-
> > meta-isar/conf/machine/qemuarm64.conf | 2 +-
> > meta-isar/conf/machine/qemuriscv64.conf | 2 +-
> > meta-isar/conf/machine/stm32mp15x.conf | 4 +-
> > .../conf/multiconfig/qemuamd64-bullseye.conf | 2 +-
> > .../conf/multiconfig/qemuarm-bookworm.conf | 2 +-
> > meta-isar/recipes-app/cowsay/cowsay_git.bb | 2 +-
> > .../recipes-app/hello-isar/hello-isar.bb | 4 +-
> > meta-isar/recipes-app/libhello/libhello.bb | 4 +-
> > .../bootconfig-rpi/bootconfig-rpi.bb | 6 +-
> > .../optee-os/optee-os-stm32mp15x_3.11.0.bb | 2 +-
> > .../linux/linux-cip_4.4.166-cip29.bb | 2 +-
> > .../linux/linux-mainline_5.4.203.bb | 4 +-
> > .../linux/linux-phy_5.10.76-phy4.bb | 2 +-
> > meta/classes/base.bbclass | 1 +
> > meta/classes/dpkg-base.bbclass | 10 +-
> > meta/classes/dpkg-gbp.bbclass | 2 +-
> > meta/classes/dpkg-prebuilt.bbclass | 2 +-
> > meta/classes/dpkg.bbclass | 2 +-
> > meta/classes/image-locales-extension.bbclass | 2 +
> > meta/classes/image-tools-extension.bbclass | 1 +
> > meta/classes/image.bbclass | 38 +-
> > meta/classes/imagetypes.bbclass | 59 +-
> > meta/classes/imagetypes_container.bbclass | 5 +-
> > meta/classes/imagetypes_vm.bbclass | 10 +-
> > meta/classes/imagetypes_wic.bbclass | 5 +-
> > meta/classes/rootfs.bbclass | 7 +-
> > meta/classes/sdk.bbclass | 30 +-
> > meta/classes/sstate.bbclass | 249 ++++----
> > meta/conf/bitbake.conf | 69 ++-
> > meta/conf/distro/debian-common.conf | 16 +-
> > meta/conf/distro/debian-stretch.conf | 4 +-
> > meta/lib/oe/gpg_sign.py | 35 +-
> > meta/lib/oe/maketype.py | 7 +-
> > meta/lib/oe/patch.py | 52 +-
> > meta/lib/oe/path.py | 79 +++
> > meta/lib/oe/sstatesig.py | 131 ++--
> > meta/lib/oe/terminal.py | 33 +-
> > meta/lib/oe/utils.py | 67 +-
> > meta/recipes-bsp/barebox/barebox.inc | 2 +-
> > .../libubootenv/libubootenv_0.3-3.bb | 2 +-
> > meta/recipes-bsp/optee-os/optee-os-custom.inc | 2 +-
> > .../trusted-firmware-a-custom.inc | 2 +-
> > meta/recipes-bsp/u-boot/u-boot-custom.inc | 2 +-
> > .../isar-bootstrap/isar-bootstrap.inc | 14 +-
> > .../buildchroot/buildchroot-host.bb | 2 +-
> > .../buildchroot/buildchroot.inc | 6 +-
> > .../sbuild-chroot/sbuild-chroot.inc | 2 +-
> > meta/recipes-kernel/kselftest/kselftest.inc | 6 +-
> > meta/recipes-kernel/linux-module/module.inc | 2 +-
> > meta/recipes-kernel/linux/linux-custom.inc | 12 +-
> > scripts/contrib/convert-overrides.py | 145 +++++
> > scripts/isar-buildenv-internal | 4 +-
> > scripts/isar-sstate | 70 +--
> > testsuite/cibuilder.py | 8 +-
> > testsuite/citest.py | 2 +-
> > 202 files changed, 6993 insertions(+), 3365 deletions(-)
> > create mode 100755 bitbake/bin/bitbake-getvar
> > create mode 100644 bitbake/contrib/prserv/Dockerfile
> > create mode 100644 bitbake/lib/bb/asyncrpc/__init__.py
> > create mode 100644 bitbake/lib/bb/asyncrpc/client.py
> > create mode 100644 bitbake/lib/bb/asyncrpc/serv.py
> > create mode 100644 bitbake/lib/bb/compress/_pipecompress.py
> > create mode 100644 bitbake/lib/bb/compress/lz4.py
> > create mode 100644 bitbake/lib/bb/compress/zstd.py
> > create mode 100644 bitbake/lib/bb/fetch2/README
> > create mode 100644 bitbake/lib/bb/fetch2/crate.py
> > create mode 100644 bitbake/lib/bb/tests/compression.py
> > create mode 100644
> > bitbake/lib/bb/tests/fetch-testdata/debian/pool/main/m/minicom/index.html
> > create mode 100644 bitbake/lib/prserv/client.py create mode 100644
> > bitbake/lib/toaster/bldcontrol/migrations/0008_models_bigautofield.py
> > create mode 100755 bitbake/lib/toaster/orm/fixtures/gen_fixtures.py
> > create mode 100644
> > bitbake/lib/toaster/orm/migrations/0020_models_bigautofield.py delete
> > mode 100644
> > bitbake/lib/toaster/toastergui/templates/landing_not_managed.html
> > create mode 100755 scripts/contrib/convert-overrides.py
> >
>
> --
> You received this message because you are subscribed to the Google Groups
> "isar-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to isar-users+unsubscribe@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/isar-
> users/20221216155706.6af8a810%40md1za8fc.ad001.siemens.net.
next prev parent reply other threads:[~2022-12-16 15:19 UTC|newest]
Thread overview: 42+ messages / expand[flat|nested] mbox.gz Atom feed top
2022-12-13 12:52 Anton Mikanovich
2022-12-13 12:52 ` [PATCH v6 01/21] meta: change deprecated parse calls Anton Mikanovich
2022-12-13 12:52 ` [PATCH v6 02/21] scripts/contrib: Add override conversion script Anton Mikanovich
2022-12-13 12:52 ` [PATCH v6 03/21] scripts/contrib: configure " Anton Mikanovich
2022-12-16 14:38 ` Henning Schild
2022-12-16 14:49 ` Anton Mikanovich
2022-12-16 15:00 ` Henning Schild
2022-12-13 12:52 ` [PATCH v6 04/21] meta-isar: set default branch names Anton Mikanovich
2022-12-13 12:52 ` [PATCH v6 05/21] meta: remove non recommended syntax Anton Mikanovich
2022-12-13 12:52 ` [PATCH v6 06/21] bitbake: Update to Bitbake 2.0.5 Anton Mikanovich
2022-12-13 12:52 ` [PATCH v6 07/21] doc: require zstd tool Anton Mikanovich
2022-12-13 12:52 ` [PATCH v6 08/21] meta: update bitbake variables Anton Mikanovich
2022-12-13 12:52 ` [PATCH v6 09/21] bitbake.conf: align hash vars with openembedded Anton Mikanovich
2022-12-13 12:52 ` [PATCH v6 10/21] meta: mark network and sudo tasks Anton Mikanovich
2022-12-16 14:49 ` Henning Schild
2022-12-16 14:52 ` Anton Mikanovich
2022-12-16 15:04 ` Henning Schild
2022-12-16 15:09 ` Schmidt, Adriaan
2022-12-16 15:27 ` Henning Schild
2022-12-13 12:52 ` [PATCH v6 11/21] meta: update overrides syntax Anton Mikanovich
2022-12-13 12:52 ` [PATCH v6 12/21] sstate: update bbclass Anton Mikanovich
2022-12-13 12:52 ` [PATCH v6 13/21] bitbake.conf: declare default XZ and ZSTD options Anton Mikanovich
2022-12-13 12:52 ` [PATCH v6 14/21] Revert "devshell: Use different termination test to avoid warnings" Anton Mikanovich
2022-12-13 12:52 ` [PATCH v6 15/21] meta: align with OE-core libraries update Anton Mikanovich
2022-12-13 12:53 ` [PATCH v6 16/21] Revert "Revert "devshell: Use different termination test to avoid warnings"" Anton Mikanovich
2022-12-13 12:53 ` [PATCH v6 17/21] CI: Adopt tests to syntax change Anton Mikanovich
2022-12-13 12:53 ` [PATCH v6 18/21] isar-sstate: adopt sstate maintenance script Anton Mikanovich
2022-12-13 12:53 ` [PATCH v6 19/21] RECIPE-API-CHANGELOG: Add tips after bitbake version update Anton Mikanovich
2022-12-16 15:18 ` Schmidt, Adriaan
2022-12-13 12:53 ` [PATCH v6 20/21] Revert "bitbake: Make 3.6.0 the minimum python version" Anton Mikanovich
2022-12-13 14:23 ` Schmidt, Adriaan
2022-12-16 14:33 ` Henning Schild
2022-12-16 14:45 ` Anton Mikanovich
2022-12-17 3:55 ` Moessbauer, Felix
2022-12-19 7:37 ` Anton Mikanovich
2022-12-13 12:53 ` [PATCH v6 21/21] Revert "utils/ply: Change md5 usages to work on FIPS enabled hosts" Anton Mikanovich
2022-12-16 14:57 ` [PATCH v6 00/21] Migrate to Bitbake 2.0 Henning Schild
2022-12-16 15:19 ` Schmidt, Adriaan [this message]
2022-12-23 18:10 ` Anton Mikanovich
2022-12-19 7:44 ` Moessbauer, Felix
2022-12-20 6:16 ` Anton Mikanovich
2022-12-20 19:33 ` Roberto A. Foglietta
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=AS4PR10MB53181DF275F713648E8EAB28EDE69@AS4PR10MB5318.EURPRD10.PROD.OUTLOOK.COM \
--to=adriaan.schmidt@siemens.com \
--cc=amikan@ilbers.de \
--cc=henning.schild@siemens.com \
--cc=isar-users@googlegroups.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox