From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Tue, 03 Mar 2026 11:22:24 +0100 X-Sieve: CMU Sieve 2.4 Received: from mail-wm1-f55.google.com (mail-wm1-f55.google.com [209.85.128.55]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 623AMNds004621 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Tue, 3 Mar 2026 11:22:23 +0100 Received: by mail-wm1-f55.google.com with SMTP id 5b1f17b1804b1-48071615686sf44777535e9.1 for ; Tue, 03 Mar 2026 02:22:23 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1772533338; cv=pass; d=google.com; s=arc-20240605; b=fWIIVevpdVyFBkWN7bib9RckHaa1TsTnc+JRhcWqX5Y4irzf4oA67mthsbX37VnmEB o4MG1EpJgNyl1jztijlCVochbMb/tC8Zjn6kRZD/KB3IXl7E0LZTUI/poztbLQDS7Gkm 0vjdBxSHNtZkMbTsdfQdbfc9+hxzs/H6qHYpWhEBhqnHRdS71Dm2ZAysu0uZq5iKa8d8 nk+zVr6iu2EKyGDimrO+Mwj/mu2T+kLT6zi5lU4aLZo6gXiQBr2UVAWWEmLy+Cg0Vg/c dp+yeoCUx/H3iy2BXSjrjeYhqO0RZIVlbOQrjkx308GJMYeR5n7iAF+gqugsGBv3zv3x a85A== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:in-reply-to:from:content-language :references:to:subject:user-agent:mime-version:date:message-id :sender:dkim-signature; bh=K7JfPKZcVWDFwmcPToMA/p1bP/lBgey7NkOKwhzeLvg=; fh=Uex3XqW9+ulk2X040Cc60Q75Hu6Zvmf2M2h9jpTB/Yw=; b=MuxN/ANr0vTczPqU3T59LMM4D5H5wJ+9OicRquceOLJFj7BC8c0UskJZddScIZOyMb C40dk0hV5ebqwHLeNwZNdTE1zEXSaOdM7h2LNOpbrETmZYMffU179OTSBXE0AkPAaG8M eWM8AS5xE2EXa3BH8G037aJtr4bmFgGQ0u1sK65wPbEcOoZbuqnXCpZNGA+1aNrTfSu5 Crwob8ah1RfYMdYWh0mv0eJRMmTjtkLCjVplJbEJTEJoahxUUgJ/q63bPidDgkgwqIpW fttigeAPstKEApn7tyYKKxyepygrRSWICvKrU18nNfRrwTewbAfhWhCnA2TXhoF9HrlK TEPQ==; darn=ilbers.de ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of wzh@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=wzh@ilbers.de DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1772533338; x=1773138138; darn=ilbers.de; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:x-original-authentication-results :x-original-sender:in-reply-to:from:content-language:references:to :subject:user-agent:mime-version:date:message-id:sender:from:to:cc :subject:date:message-id:reply-to; bh=K7JfPKZcVWDFwmcPToMA/p1bP/lBgey7NkOKwhzeLvg=; b=nmCiLfR9xxSwcteuL9ZtvkH2pBJP093jPC+d4bgQjqU1mH/DmAP3mMLsbaRnXKn/us s9YbONWJdM/AXW4IHQPyvBW+pzQCc7Ztly9ZRpIHxgzhVk0qYvC3bBWCwdrOy0KKRttc OyJ8j24Kxn53OvavZ3m1Rod8YFcD4J4yEi6/t7AbDSFetVEJVUot7oinzH+TS3ahpV5Q dqW+IIG4BYMx0cObUlnQFLdgbVqQwsUBu9ZoHWIfjLRKjPBDLsSPtlm1Uwq+VvuTGJrG I0wBswfEmWMrqHe0NK47rsv66rFnPtoiVi78/oMk9Fehuk1nAPDmqhXn6wt+CBXgImbi XLEg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1772533338; x=1773138138; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence :x-original-authentication-results:x-original-sender:in-reply-to :from:content-language:references:to:subject:user-agent:mime-version :date:message-id:x-beenthere:x-gm-message-state:sender:from:to:cc :subject:date:message-id:reply-to; bh=K7JfPKZcVWDFwmcPToMA/p1bP/lBgey7NkOKwhzeLvg=; b=fFg7L+4045JLBJ9z77ztfans57243mrCovWXgjI5rH4DwIwLMf7s/TN0KJUAoXvGkK RvtW+V2YJXHt7i9+eMx/qK5bMKhyTKlnsi/29cG0Om3GNuwCjPuwf3dby3RRaXHzWlrM Ie9OaVEZsI8nQpkimlJHQNzaEdQjCDhWDCsGyxz2CgICgYR5BDMFneboW6U+7s6IbB9/ 5yHcNtWbtk8X1qIWRGvdzuhLhDcDHLlHPy40sQvA78fhVR+8kP+o6/om2h/qE/GjaEe7 7Ldc9ttGrjIozP8jfyA7U3IxTu5JLHVaFuMDuksAq4yFeU1V5eW8UGUCwEuJdr9fZjkk Px4Q== Sender: isar-users@googlegroups.com X-Forwarded-Encrypted: i=2; AJvYcCWw37/Cvvw9qvxK3d8SQYo8YTTn5saMbLQMXVgFVE1wBc+URitW3+3v1mNxqJFTnLp+4tcB@ilbers.de X-Gm-Message-State: AOJu0YwrnGTUzjAIgJCdBPhQriQbcXKJfjXiJGBcVE0QqpFL5Yezp0nw nUUOKXazl4uSecbQOgLMHD1cQ4YMWWfQUQerDAZaSga+vi0Qhzqljnxe X-Received: by 2002:a05:600c:470a:b0:477:abea:9028 with SMTP id 5b1f17b1804b1-483c9ba68eemr246179035e9.6.1772533337600; Tue, 03 Mar 2026 02:22:17 -0800 (PST) X-BeenThere: isar-users@googlegroups.com; h="AV1CL+Gb1vueGl/h/5Jd+PpKrDb1w/22X3RpwMwxN7oe1AWi7w==" Received: by 2002:a05:600c:35c7:b0:483:7631:bef7 with SMTP id 5b1f17b1804b1-483bf08f927ls48012035e9.2.-pod-prod-08-eu; Tue, 03 Mar 2026 02:22:15 -0800 (PST) X-Forwarded-Encrypted: i=2; AJvYcCUV3f+NT7TzLo6BxPifR0KIjA3vvSDG2MBj2pXO0qzs+CjR/chNHoF8inC3RWe5tGZYVAuOnr053iR/@googlegroups.com X-Received: by 2002:a05:600c:34d0:b0:45d:d97c:236c with SMTP id 5b1f17b1804b1-483c9beac83mr295656325e9.21.1772533335360; Tue, 03 Mar 2026 02:22:15 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1772533335; cv=none; d=google.com; s=arc-20240605; b=BgwXZFvuCSo8KsoMcPQIaXVD+GiMRY+Qzti/B9kWZqiYxA6/oaguIWrZATYlNq7pxx +QfQOyuDRX7LBSjiChKiYVY2/AnRU33tC1tyudiaWpU1ryTAe4KIoo4Tv9sC46F540zl nw/oaS693AnlLWrh3ybX0bKU2yagqiFDMKCiFq2e7OTP9bnRoVv8kmCP2FAJFGK1c+6X CiaR6IghxlzDaksWZpEduqEOub/P7IFno/L7UbGHWNrCtI4VGt2LQ1qcD0lmbB9DS7dh fmY/C8WgcIsrC7WlSlfeTu6jTuAXnxmPtweCIYkNh8Uo0oqcdZIptkPYkjb+6mzwup0N DvPQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=content-transfer-encoding:in-reply-to:from:content-language :references:to:subject:user-agent:mime-version:date:message-id; bh=ccuODDb5/IrCsiWyG8eIEyIa5ZyV8UHm4z4IQ/5tOpQ=; fh=O+ZMFUiiuyZKsfz7Fw8hsdknZlxcSFSsLsCydBEGD0o=; b=JX3oCZJM2bmS8OviKVD5rHJayPzjgMAxDjRrDOCH9uj9GVGvOxm2xZoFpcISrvwb9/ gCXDVPnn9Of4TeLP1+EZKzPqhHIb5idO0j3VoOGqiI3HrNigf/TJS5MQF1zt1AsoV+us aEzlSJK+p5x0/FzJ/EAzA4y4r1rFU1GTNvJHf6EqdzgsOhEUPvjxpkvIUvTjzLZD3j2z sHwm+A6oL/7f6V7zbfIM/D10UUkcRve/VteLnofh7WPJfZv4l9paU4cJ+xr2A0JQOq+i dOR82pL6VvHdzWfAKkA258dLocotKXpxNVnclHXYSSipgTbNYXjsy76/UPyVF2SovSzi WM9Q==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of wzh@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=wzh@ilbers.de Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id 5b1f17b1804b1-4851263d4d2si209565e9.1.2026.03.03.02.22.15 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Tue, 03 Mar 2026 02:22:15 -0800 (PST) Received-SPF: pass (google.com: domain of wzh@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Received: from [192.168.178.116] ([88.130.203.42]) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 623AMEHk004609 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 3 Mar 2026 11:22:14 +0100 Message-ID: <51f19e31-9642-401a-b464-824274221cd8@ilbers.de> Date: Tue, 3 Mar 2026 11:22:14 +0100 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH v7 3/3] meta: Deploy image build artifacts into distro- and image-specific subdirs To: Jan Kiszka , isar-users@googlegroups.com References: <20260226162613.1954014-1-wzh@ilbers.de> <20260226162613.1954014-4-wzh@ilbers.de> Content-Language: en-US From: Zhihang Wei In-Reply-To: Content-Type: text/plain; charset="UTF-8"; format=flowed X-Spam-Status: No, score=-4.6 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_EF,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H2, RCVD_IN_RP_CERTIFIED,RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-Original-Sender: wzh@ilbers.de X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of wzh@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=wzh@ilbers.de Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-TUID: YLVa4RF7L9I9 On 3/2/26 10:45, Jan Kiszka wrote: > On 26.02.26 17:26, Zhihang Wei wrote: >> From: Ilia Skochilov >> >> When building different distros or images for the same machine (e.g. >> phyboard-mira-bullseye and phyboard-mira-bookworm, or isar-image-ci >> and isar-image-base), artifacts with identical names (e.g. DTB files) >> may be deployed to the same location, resulting file conflicts and >> build failures. >> >> Deploy image build artifacts into a subdirectory named >> ${DISTRO}-${IMAGE_PN} to avoid such collisions. >> >> Since the directory now encodes the distro and image name, remove the >> ${DISTRO} and ${IMAGE_PN} prefixes from artifact filenames to >> keep the names short and clear. >> >> Fixes test_dtb_deploy_distros testcase: >> >> ERROR: mc:phyboard-mira-bookworm:isar-image-base-1.0-r0 do_copy_boot_files: The recipe isar-image-base is trying to install files into a shared area when those files already exist. Those files and their manifest location are: >> NOTE: recipe isar-image-base-1.0-r0: task do_copy_boot_files: Failed >> build/tmp/deploy/images/phyboard-mira/imx6q-phytec-mira-rdk-nand.dtb >> (not matched to any task) >> Please verify which recipe should provide the above files. >> >> Signed-off-by: Ilia Skochilov >> Signed-off-by: Uladzimir Bely >> Signed-off-by: Badrikesh Prusty >> Signed-off-by: Anton Mikanovich > Were really all those people involved in developing and signing off this > change? I'll update the list for this specific version of the patch. >> Signed-off-by: Zhihang Wei >> --- >> RECIPE-API-CHANGELOG.md | 63 +++++++++++++++++++ >> .../installer-add-rootfs.bbclass | 9 +-- >> meta/classes-recipe/image.bbclass | 11 ++-- >> .../imagetypes_container.bbclass | 2 +- >> meta/conf/bitbake.conf | 3 +- >> .../plugins/source/isoimage-isohybrid-isar.py | 2 +- >> testsuite/cibase.py | 2 +- >> testsuite/citest.py | 7 ++- >> testsuite/start_vm.py | 2 +- >> 9 files changed, 84 insertions(+), 17 deletions(-) >> >> diff --git a/RECIPE-API-CHANGELOG.md b/RECIPE-API-CHANGELOG.md >> index 0bad8a44..bc7abb37 100644 >> --- a/RECIPE-API-CHANGELOG.md >> +++ b/RECIPE-API-CHANGELOG.md >> @@ -962,3 +962,66 @@ INSTALLER_UNATTENDED_ABORT_ENABLE = "1" >> # Optional: set countdown timeout in seconds (default 5) >> INSTALLER_UNATTENDED_ABORT_TIMEOUT = "5" >> ``` >> + >> +### Change DEPLOY_DIR_IMAGE path and artifacts naming >> + >> +Change DEPLOY_DIR_IMAGE from ${DEPLOY_DIR}/images/${MACHINE} to >> +${DEPLOY_DIR}/images/${MACHINE}/${DISTRO}-${IMAGE_PN}. >> + >> +When building different distros with the same machine the following >> +error occurs: >> + >> +do_copy_boot_files: The recipe isar-image-base is trying to install >> +files into a shared area when those files already exists. It happens >> +when some files have the same names (e.g., dtb files) for different >> +distros. >> + >> +To prevent such collisions, image artifacts are now deployed into a >> +distro- and image-specific subdirectory. >> + >> +Additionally, artifact filenames have been shortened by removing the >> +${DISTRO} and ${IMAGE_PN} prefix, since this information is now >> +encoded in the directory path. >> + >> +Example 1: Build isar-image-base (phyboard-mira, debian-bookworm) >> +Under "build/tmp/deploy/images/": >> +Before: >> +phyboard-mira/imx6q-phytec-mira-rdk-nand.dtb >> +phyboard-mira/isar-image-base-debian-bookworm-phyboard-mira-initrd.img >> +phyboard-mira/isar-image-base-debian-bookworm-phyboard-mira-vmlinuz >> +phyboard-mira/isar-image-base-debian-bookworm-phyboard-mira.dpkg_status >> +phyboard-mira/isar-image-base-debian-bookworm-phyboard-mira.ubi >> + >> +After: >> +phyboard-mira/debian-bookworm-isar-image-base/imx6q-phytec-mira-rdk-nand.dtb >> +phyboard-mira/debian-bookworm-isar-image-base/initrd.img >> +phyboard-mira/debian-bookworm-isar-image-base/vmlinuz >> +phyboard-mira/debian-bookworm-isar-image-base/phyboard-mira.dpkg_status >> +phyboard-mira/debian-bookworm-isar-image-base/phyboard-mira.ubi >> + >> +Example 2: Build isar-image-ci (qemuamd64, debian-bookworm) >> +Under "build/tmp/deploy/images/": >> +Before: >> +qemuamd64/isar-image-ci-debian-bookworm-qemuamd64-initrd.img >> +qemuamd64/isar-image-ci-debian-bookworm-qemuamd64-vmlinuz >> +qemuamd64/isar-image-ci-debian-bookworm-qemuamd64.dpkg_status >> +qemuamd64/isar-image-ci-debian-bookworm-qemuamd64.manifest >> +qemuamd64/isar-image-ci-debian-bookworm-qemuamd64.wic >> +qemuamd64/isar-image-ci-debian-bookworm-qemuamd64.wic.bmap >> +qemuamd64/isar-image-ci-debian-bookworm-qemuamd64.wic.manifest >> + >> +After: >> +qemuamd64/debian-bookworm-isar-image-ci/initrd.img >> +qemuamd64/debian-bookworm-isar-image-ci/vmlinuz >> +qemuamd64/debian-bookworm-isar-image-ci/qemuamd64.dpkg_status >> +qemuamd64/debian-bookworm-isar-image-ci/qemuamd64.manifest >> +qemuamd64/debian-bookworm-isar-image-ci/qemuamd64.wic >> +qemuamd64/debian-bookworm-isar-image-ci/qemuamd64.wic.bmap >> +qemuamd64/debian-bookworm-isar-image-ci/qemuamd64.wic.manifest >> + >> +Artifacts that do not belong to a full image (e.g. isar-image-base, >> +isar-image-ci) remain unchanged. For example, a customized initramfs >> +built independently is not affected. >> + >> +This change affects the location and naming of build artifacts and must >> +be taken into account by downstream users. > The chosen pattern looks reasonable to me. I'm just wondering what OE > does when generating multiple images per target, and why it did not use > something similar. Any ideas? > > Jan I built mc:arm:core-image-minimal and mc:arm:core-image-base in a single command and enforced DTB deployment. These are the artifacts generated by OE under "build/tmp/deploy/images/qemuarm": core-image-base-qemuarm-20260302155417.qemuboot.conf core-image-base-qemuarm-20260302155417.rootfs.ext4 core-image-base-qemuarm-20260302155417.rootfs.manifest core-image-base-qemuarm-20260302155417.rootfs.tar.bz2 core-image-base-qemuarm-20260302155417.testdata.json core-image-base-qemuarm.ext4 -> core-image-base-qemuarm-20260302155417.rootfs.ext4 core-image-base-qemuarm.manifest -> core-image-base-qemuarm-20260302155417.rootfs.manifest core-image-base-qemuarm.qemuboot.conf -> core-image-base-qemuarm-20260302155417.qemuboot.conf core-image-base-qemuarm.tar.bz2 -> core-image-base-qemuarm-20260302155417.rootfs.tar.bz2 core-image-base-qemuarm.testdata.json -> core-image-base-qemuarm-20260302155417.testdata.json core-image-minimal-qemuarm-20260302155417.qemuboot.conf core-image-minimal-qemuarm-20260302155417.rootfs.ext4 core-image-minimal-qemuarm-20260302155417.rootfs.manifest core-image-minimal-qemuarm-20260302155417.rootfs.tar.bz2 core-image-minimal-qemuarm-20260302155417.testdata.json core-image-minimal-qemuarm.ext4 -> core-image-minimal-qemuarm-20260302155417.rootfs.ext4 core-image-minimal-qemuarm.manifest -> core-image-minimal-qemuarm-20260302155417.rootfs.manifest core-image-minimal-qemuarm.qemuboot.conf -> core-image-minimal-qemuarm-20260302155417.qemuboot.conf core-image-minimal-qemuarm.tar.bz2 -> core-image-minimal-qemuarm-20260302155417.rootfs.tar.bz2 core-image-minimal-qemuarm.testdata.json -> core-image-minimal-qemuarm-20260302155417.testdata.json modules--5.15.199+git0+78eca082b6_0ea8d4a7d2-r0-qemuarm-20260302155417.tgz modules-qemuarm.tgz -> modules--5.15.199+git0+78eca082b6_0ea8d4a7d2-r0-qemuarm-20260302155417.tgz versatile-pb--5.15.199+git0+78eca082b6_0ea8d4a7d2-r0-qemuarm-20260302155417.dtb versatile-pb.dtb -> versatile-pb--5.15.199+git0+78eca082b6_0ea8d4a7d2-r0-qemuarm-20260302155417.dtb versatile-pb-qemuarm.dtb -> versatile-pb--5.15.199+git0+78eca082b6_0ea8d4a7d2-r0-qemuarm-20260302155417.dtb zImage -> zImage--5.15.199+git0+78eca082b6_0ea8d4a7d2-r0-qemuarm-20260302155417.bin zImage--5.15.199+git0+78eca082b6_0ea8d4a7d2-r0-qemuarm-20260302155417.bin zImage-qemuarm.bin -> zImage--5.15.199+git0+78eca082b6_0ea8d4a7d2-r0-qemuarm-20260302155417.bin For the same distro but different images, the kernel and DTB are identical, and they were deployed only once. OE names the artifacts with a timestamp and then creates symlinks pointing to them using simpler names. Zhihang -- You received this message because you are subscribed to the Google Groups "isar-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to isar-users+unsubscribe@googlegroups.com. To view this discussion visit https://groups.google.com/d/msgid/isar-users/51f19e31-9642-401a-b464-824274221cd8%40ilbers.de.