From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 6543937367387930624 X-Received: by 10.80.204.5 with SMTP id m5mr5201568edi.12.1523629149151; Fri, 13 Apr 2018 07:19:09 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 10.80.192.24 with SMTP id r24ls4421240edb.3.gmail; Fri, 13 Apr 2018 07:19:08 -0700 (PDT) X-Google-Smtp-Source: AIpwx48LYPl7LqIiHog59RBevNEmQrXSApUGvXoFG32Kn2ZafLt/5K2jTIJwXXgY1sFPn4Ms9zta X-Received: by 10.80.165.200 with SMTP id b8mr1030163edc.1.1523629148649; Fri, 13 Apr 2018 07:19:08 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1523629148; cv=none; d=google.com; s=arc-20160816; b=FC13g7wbfIvvfyYWgRZoWTg4Tte19+GKQUHlENOkpZwOPyo5grP49ZrLUOtAip+am+ tD7mmjO+FZ0bZaeGE2RW+/8YjWa4R0eaPWl7l5BpJnWz2VOxt6sztlwcspB549ZcOnxT yN7cypxFq7B56/krss85ChEfHZQ+LVcQJ9Wn5K4WeHE3izuqTuqFeVRr7UgMgT625hVI DygWYWBLDb53R/Lq/96Ou+VWfy7c1UzmTp47LSgHnWmrV5oZw8n55FUCICCjSinkTJfX NK+VLk3YWCfnJWMOVGY8lKOZDEMOvYdh1kuoiKELaNzhBTniO3pe8j2LvzLgutQqHfJI S1sA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=message-id:date:subject:cc:to:from:arc-authentication-results; bh=16VySSwWTlzIJVevkeR00K/lhGcvLO646lUPOIX6jJo=; b=njOlCq0H5KGMu5YlhkgQa+1orTe80xZG/V1xTie2xU3ap3otEUdxNKEUyAQHtSAj50 +LIOsoQ7e6vsOQmJze1XypgtUXtFb8Pe/hy7UjO3WOkR+0asiI5OX4vOvulq6uCdNLJH MUpa2o5Y5r0G4uPbCqSvsIbb5GPZadSuHQaHcD9dVSDMCeDse21/d4tC+iWCJaP+A/h7 Nn89MSf2YQY0t/9e40t855SiT5Y6RhglZgSk89+BMfxsNS5wSWLqG4YAAlSIMHAuB3n3 AjKv+PbmfyfAvR2tcKhoBp8QoMFguwVNWAXSZMqkM8IUcupZbAxjAwUK7G8bTLGflDxP qSHA== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of henning.schild@siemens.com designates 192.35.17.2 as permitted sender) smtp.mailfrom=henning.schild@siemens.com Return-Path: Received: from thoth.sbs.de (thoth.sbs.de. [192.35.17.2]) by gmr-mx.google.com with ESMTPS id z11si115972edh.0.2018.04.13.07.19.08 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 13 Apr 2018 07:19:08 -0700 (PDT) Received-SPF: pass (google.com: domain of henning.schild@siemens.com designates 192.35.17.2 as permitted sender) client-ip=192.35.17.2; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of henning.schild@siemens.com designates 192.35.17.2 as permitted sender) smtp.mailfrom=henning.schild@siemens.com Received: from mail1.siemens.de (mail1.siemens.de [139.23.33.14]) by thoth.sbs.de (8.15.2/8.15.2) with ESMTPS id w3DEJ8BL022137 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Fri, 13 Apr 2018 16:19:08 +0200 Received: from md1pvb1c.ad001.siemens.net (md1pvb1c.ad001.siemens.net [139.25.68.40] (may be forged)) by mail1.siemens.de (8.15.2/8.15.2) with ESMTP id w3DEJ8Vq011006; Fri, 13 Apr 2018 16:19:08 +0200 From: Henning Schild To: isar-users@googlegroups.com Cc: Cedric Hombourger , Andreas Reichel , Henning Schild Subject: [PATCH v2 00/16] wic integration Date: Fri, 13 Apr 2018 16:18:49 +0200 Message-Id: X-Mailer: git-send-email 2.16.1 X-TUID: MdGtjdT+7WPP This series does the follow things: 1. revert all changes that where made to wic so Isar uses an unmodified version of it 2. Introdcue an image-class that will create wic images automatically 3. enable testing that in CI 4. update docs Patches 1 to 7 just deal with getting back to an unmodified version of wic. Patch 11 - the big one - provides the real functionality. I will provide some more information on what is going on here by replying to p11. Major changes to the first series: - rebase on recent Isar - wic is now running in buildchroot, as root - calling wic manually not supported any longer - distros before stretch are not supported either (see p11 discussion for why) - CI can now test wic for the first time Henning Schild (17): Revert "wic: Make the bootimg-efi plugin generate usable images" Revert "wic: Introduce the `WicExecError` exception class" Revert "wic: Work around mcopy error" Revert "wic: Use sudo instead of pseudo" Revert "wic: Remove sysroot support" wic: now truly go for the wic version we claim to have Revert "isar-init-build-env: Add /sbin to PATH" classes: image: introduce size measuring function, for before do_*_image meta/image: Fix broken variables KERNEL_IMAGE and INITRD_IMAGE isar-init-build-env: make ISARROOT available in bitbake images: New class wic-img for wic intregration wic: Add pcibios boot plugins and wks files scripts/start_vm: Enable booting of full disk images multiconfig: Switch qemuamd64-stretch to using wic by default multiconfig: Switch qemui386-stretch to using wic by default docs: Change according to recent patches scripts/vm_smoke_test: double the timeout we wait for qemus doc/technical_overview.md | 7 +- doc/user_manual.md | 31 +-- isar-init-build-env | 5 - meta-isar/conf/multiconfig/qemuamd64-stretch.conf | 8 +- meta-isar/conf/multiconfig/qemui386-stretch.conf | 5 +- .../scripts/lib/wic/canned-wks/common-isar.wks.inc | 3 + .../scripts/lib/wic/canned-wks/directdisk-isar.wks | 7 + .../scripts/lib/wic/canned-wks/sdimage-efi.wks | 2 +- .../lib/wic/plugins/source/bootimg-efi-isar.py | 297 +++++++++++++++++++++ .../lib/wic/plugins/source/bootimg-pcbios-isar.py | 217 +++++++++++++++ meta/classes/ext4-img.bbclass | 7 +- meta/classes/image.bbclass | 39 ++- meta/classes/wic-img.bbclass | 78 ++++++ meta/recipes-devtools/buildchroot/buildchroot.bb | 19 ++ scripts/isar-buildenv-internal | 2 +- scripts/lib/wic/canned-wks/qemux86-directdisk.wks | 2 +- scripts/lib/wic/engine.py | 7 +- scripts/lib/wic/filemap.py | 6 +- scripts/lib/wic/help.py | 2 - scripts/lib/wic/ksparser.py | 4 +- scripts/lib/wic/partition.py | 197 +++++++++----- scripts/lib/wic/pluginbase.py | 11 +- scripts/lib/wic/plugins/imager/direct.py | 66 +++-- scripts/lib/wic/plugins/source/bootimg-efi.py | 78 ++---- .../lib/wic/plugins/source/bootimg-partition.py | 6 +- scripts/lib/wic/plugins/source/bootimg-pcbios.py | 68 ++--- scripts/lib/wic/plugins/source/fsimage.py | 56 ++++ .../lib/wic/plugins/source/isoimage-isohybrid.py | 28 +- scripts/lib/wic/plugins/source/rawcopy.py | 2 +- scripts/lib/wic/plugins/source/rootfs.py | 4 +- scripts/lib/wic/utils/misc.py | 33 +-- scripts/lib/wic/utils/runner.py | 74 ++++- scripts/start_vm | 35 ++- scripts/vm_smoke_test | 2 +- scripts/wic | 27 +- scripts/wic_fakeroot | 37 +++ 36 files changed, 1160 insertions(+), 312 deletions(-) create mode 100644 meta-isar/scripts/lib/wic/canned-wks/common-isar.wks.inc create mode 100644 meta-isar/scripts/lib/wic/canned-wks/directdisk-isar.wks create mode 100644 meta-isar/scripts/lib/wic/plugins/source/bootimg-efi-isar.py create mode 100644 meta-isar/scripts/lib/wic/plugins/source/bootimg-pcbios-isar.py create mode 100644 meta/classes/wic-img.bbclass create mode 100644 scripts/lib/wic/plugins/source/fsimage.py create mode 100755 scripts/wic_fakeroot -- 2.16.1