From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Tue, 21 Jul 2026 15:56:36 +0200 X-Sieve: CMU Sieve 2.4 Received: from mail-wr1-f58.google.com (mail-wr1-f58.google.com [209.85.221.58]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 66LDuaVN029453 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Tue, 21 Jul 2026 15:56:36 +0200 Received: by mail-wr1-f58.google.com with SMTP id ffacd0b85a97d-47f6e658363sf2315061f8f.3 for ; Tue, 21 Jul 2026 06:56:36 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1784642191; cv=pass; d=google.com; s=arc-20260327; b=XQLXCrilBzydANoTyKErC+421oskZGQxaZnp2060gy9gR/TztRKg7pPJgdbcoLMT4n MooOU6z/V0eSDGcMtFeTKEyuncWQ9AWMQ5fui4wFXb74RyTmltIBTbCaryM8W10m6+qd P5OJSz3GMouZDBawRoDM1x8hmkKAHtmv5Wpr9zOooKQwOdQ0Lj6WwoElit1X7ycc2ozn 7B1RtHvakfJF3C5PO67tbf65XKHSO+QFEsnteVUESnQ2+lRst7rlwjt1vgrAt5kI3fd4 Xj9QBD5xP0GU+Ar/uuepONEC9WWt4DzVt1HU7RYa/BBsVKsA6UeWsmCoIBGweDxleu9S m7Eg== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20260327; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:in-reply-to:from:content-language :references:cc:to:subject:user-agent:mime-version:date:message-id :sender:dkim-signature; bh=az14QIeWVwCp8VNngMgLAZz7xJ+1H2zYhPhUTu5OVPg=; fh=eeMyCtZoU2U8ap8TIA0u7x6aqBD5AldnraO7+XXZQjQ=; b=NVOcTb4oQ3pJL5GyJabvVzt1wxcM5XB+haW/+hmj3UP7WURE4TGNwJq3RqqC24lPCq pVcsOaChB8X/xmwhx2/45TrOAx8NUbKa5+0lDIW9bLGsKLnFFxATRFF16Kt/bwWXZZux pHARthG/Hb0+qVstMw4IwWfI+iltKln4s74QPbtOVS+UgOUaAVPMDqbHVu76HefeiUlO YYtJCRA5KADJZrYP5Xh26oKCcJvv9Zb1xCv0mimAFg8Hb7ahlOfUan1iA6QJblP1XLHF XjW2IaEYRIEAY7AsOw3fcd1W3C0+Tc5NRJtSYuEPPtiy8AROITJJyYaotJYt+KifFGtA 8R4Q==; darn=ilbers.de ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=amikan@ilbers.de DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20251104; t=1784642191; x=1785246991; darn=ilbers.de; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:x-original-authentication-results :x-original-sender:content-type:in-reply-to:from:content-language :references:cc:to:subject:user-agent:mime-version:date:message-id :sender:from:to:cc:subject:date:message-id:reply-to:content-type; bh=az14QIeWVwCp8VNngMgLAZz7xJ+1H2zYhPhUTu5OVPg=; b=XN0rSnmgLqiTrTUzbHdHQqJmNiubbQA8AFJh1J1C8XOKNTdNy/rbUdpGbxxdQ9GUj1 7Jwb0o47DEVjaFkJmVbLBQ19Jw7RPN0UA7LVEoPPNm8FH6nTp+mQ061t0c0EGa36eeOi gpNrcfmnJcta1d9stUOSP4JvysiXn3k50QpuaKf5Kvbgl3A6GxQOrXvmHHGaQEfG3WMK 9NsYSJid07ldq4MLeSswBV6x7+OmpJ1IrA11SG51OhDvuzT76DluptHtTGGP8Hg40Six b39dA9n1yhoapYMfXDFWxmOMzjURZQQy4RcChG3JaHIGToDTnHNVPLKm5IJ9u8UFeM/A F+UQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1784642191; x=1785246991; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence :x-original-authentication-results:x-original-sender:content-type :in-reply-to:from:content-language:references:cc:to:subject :user-agent:mime-version:date:message-id:x-beenthere :x-gm-message-state:sender:from:to:cc:subject:date:message-id :reply-to:content-type; bh=az14QIeWVwCp8VNngMgLAZz7xJ+1H2zYhPhUTu5OVPg=; b=YnNR3SwkBiSdQqIC2bUOi0Ae9vJqsU9q0HIe4u69OYQSdJ/Pu/75tFNJmrUuS3KFFJ GrqO1aB96D+4GXgzhWqLSe8oiwzPhFkWY8xs4MfDdPqUB74mGZDLw/xUtCu785J32bUZ iWPG1p18IMxjYGQyEsuk8KKlrjXEm7kv4i3iV4UWsfO6J0sWSdaW1kZEiYHllgbLx1BL Fh+AaI8ymPB9jbZoNBMn+dkq0/nH2p1qdIzhwU9kxbPXufYIzxzJ8ddY94rAzTtFJeBF Eex8KgxxBOjN+1/vOz0i4WpM6DrKOzqG9DH+Ja/W81RDcMkMtSPpM9YjP2jGDYkPLqMp ZDQw== Sender: isar-users@googlegroups.com X-Forwarded-Encrypted: i=2; AHgh+Rr0ZbLupvvIlxG+zR193Y7sldkZBuU4rCOHqO08tq/oj4q1WfB2ncyhukGOV5bZhhIpUkBd@ilbers.de X-Gm-Message-State: AOJu0YwjJWDb7kTZxyybVZFr+yaQ1rTs/bBEhPWZo+XI6y9aUPlEE0Lq Gxb7PPl5NZrr+ZJV8+C7OLNvJDE5XycQuzEilNLbIUusyepu9biT9Gqv X-Received: by 2002:a5d:5f86:0:b0:47f:80f6:afac with SMTP id ffacd0b85a97d-47f80f6b00dmr3386084f8f.49.1784642190652; Tue, 21 Jul 2026 06:56:30 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com; h="Aa7YSPTNceXw7VMMfr40+7F/EL6o30EiWntYPG3DOsn3fvQtUQ==" Received: by 2002:a05:6000:a90:b0:47f:5c56:4af7 with SMTP id ffacd0b85a97d-47f5c564bcals4423650f8f.2.-pod-prod-06-eu; Tue, 21 Jul 2026 06:56:28 -0700 (PDT) X-Forwarded-Encrypted: i=2; AHgh+Ro4yI5Cbe6+on/hEQemdm8hZXwy7+EXoS3Eb1jEBAipcn6T8QZCM0sYWfv4+0+dFtNZnL3S1s/5EHwb@googlegroups.com X-Received: by 2002:a05:6000:3111:b0:47f:831d:d7f2 with SMTP id ffacd0b85a97d-47f831dd8ecmr1937883f8f.37.1784642187860; Tue, 21 Jul 2026 06:56:27 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1784642187; cv=none; d=google.com; s=arc-20260327; b=nCUKoIIkHpPqKWFse/8e/fo0kXt80PBoXffYxZKr7I8sIBNo4pw68EbTHejAB2pKTq KJ3oVYC6JeOUBGMTGr1tQuolDx0r1E4dCCX0bAbVSPLXqYQDm+ug6Q+9MBWi7OV81nbx 4ADArcEQXiV608rVOaP/gt3Sgdo/eicOsrQFIFTiwkYW8idGoM4K6pHZLkKO9XpDoMlL NkTpXRkQ7SQy6VDjh2hXjy6yJwEDcWLeF2Fv/d0vB2MGXgUl9ryoXOd+aBIhKkEXwqy/ iRcd974E3vtKetvrnpe9C+IAFsAe4esLfxj/Z+pDvEJ+Dnj5Ntx67lBlCNBmn4YMAOMv CcEg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20260327; h=content-transfer-encoding:in-reply-to:from:content-language :references:cc:to:subject:user-agent:mime-version:date:message-id; bh=D0zdT3KfSHZ2BjKWRzXDzSaVzdZtgneIyRyr3YRKlko=; fh=AM6IsWXcplWo8uinpOUVIWI+fGSdBZtkdzDxq4uF13o=; b=V+kwAcJMKf3MKTQRKvUzgXTSt+abkM+FXHQ8dun3aa+QmP201Uyb0KJtA0D23PAure ok7TTicQTaTF+5GKK6XMU9dDvGXJTdxLISDcWgvCvvXvJYdbCq4vZqSu2fSVYVgA/6of LXM1bvqa03t3hif+s0XU+aam11CJjHmk+Ckq52kbZWIGMlMSQHJc4U+O/BFE09W48LaC yWHL9zxQ8AJYSY0INm/WA3lIMikdtqIMwmNFRDNc0hp0xfQTaeywHn+u7l+kKwLKasbB nO1Zzwvw650FSWmyzP215HoQACA1Jy7z4USSv90+/o2M1NIMSGPDjZ/INGFMmG1+YD/s F/dw==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=amikan@ilbers.de Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id ffacd0b85a97d-47f83394b65si14582f8f.6.2026.07.21.06.56.27 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Tue, 21 Jul 2026 06:56:27 -0700 (PDT) Received-SPF: pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Received: from [127.0.0.1] ([88.130.203.42]) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 66LDuQRr029445 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 21 Jul 2026 15:56:26 +0200 Message-ID: <9a53f70e-f23a-4a49-885c-da3177efed11@ilbers.de> Date: Tue, 21 Jul 2026 16:56:26 +0300 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [RFC 1/2] rootfs: download packages with host apt To: Felix Moessbauer , isar-users@googlegroups.com Cc: cedric.hombourger@siemens.com References: <20260720105228.395364-1-felix.moessbauer@siemens.com> Content-Language: en-US, ru-RU From: Anton Mikanovich In-Reply-To: <20260720105228.395364-1-felix.moessbauer@siemens.com> Content-Type: text/plain; charset="UTF-8"; format=flowed X-Spam-Status: No, score=-4.6 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_EF,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H2, RCVD_IN_RP_CERTIFIED,RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-Original-Sender: amikan@ilbers.de X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=amikan@ilbers.de Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-TUID: vf/TTB0YxjbG Hello Felix, 20.07.2026 13:52, 'Felix Moessbauer' via isar-users wrote: > The dependency resolving and download are architecture unspecific, hence > they do not need to be emulated. By not emulating them, we follow the > approach of mmdebstrap and significantly speedup this operation. > > Signed-off-by: Felix Moessbauer > --- > meta/classes-recipe/rootfs.bbclass | 40 ++++++++++++++---------------- > 1 file changed, 19 insertions(+), 21 deletions(-) > > diff --git a/meta/classes-recipe/rootfs.bbclass b/meta/classes-recipe/rootfs.bbclass > index e17f711f..6af29b40 100644 > --- a/meta/classes-recipe/rootfs.bbclass > +++ b/meta/classes-recipe/rootfs.bbclass > @@ -337,10 +337,12 @@ rootfs_install_pkgs_download[progress] = "custom:rootfs_progress.PkgsDownloadPro > rootfs_install_pkgs_download[isar-apt-lock] = "release-after" > rootfs_install_pkgs_download[network] = "${TASK_USE_NETWORK}" > rootfs_install_pkgs_download() { > - # download packages using apt in a non-privileged namespace > - rootfs_cmd --bind "${ROOTFSDIR}/var/cache/apt/archives" /var/cache/apt/archives \ > - ${ROOTFSDIR} \ > - -- /usr/bin/apt-get ${ROOTFS_APT_ARGS} -o Debug::NoLocking=1 --download-only ${ROOTFS_PACKAGES} > + # download packages using the host apt in a non-privileged namespace. > + rootfs_cmd --bind "${ROOTFSDIR}" "${ROOTFSDIR}" \ > + -- /usr/bin/apt-get -o APT::Architecture=${ROOTFS_ARCH} \ > + -o Dir="${ROOTFSDIR}" \ > + ${ROOTFS_APT_ARGS} -o Debug::NoLocking=1 \ > + --download-only ${ROOTFS_PACKAGES} Why do we need rootfs_cmd API usage then? Doesn't it actually still use apt-get from ROOTFSDIR? > } > > ROOTFS_INSTALL_COMMAND_BEFORE_EXPORT ??= "" > @@ -356,23 +358,19 @@ ROOTFS_INSTALL_COMMAND += "rootfs_install_pkgs_isar_download" > rootfs_install_pkgs_isar_download[weight] = "50" > rootfs_install_pkgs_isar_download[isar-apt-lock] = "acquire-before release-after" > rootfs_install_pkgs_isar_download() { > - mkdir -p "${WORKDIR}/dpkg" > - > - # Use our own dpkg lock files rather than those in the rootfs since we are not root > - # (this is safe as there are no concurrent apt/dpkg operations for that rootfs) > - touch "${WORKDIR}/dpkg/lock" "${WORKDIR}/dpkg/lock-frontend" > - > - # Command apt-get install do not cache packages from local repos > - # We can obtain non cached package URIs by recalling install command here > - # No need in export those files to dl_dir, so we can run it right after > - rootfs_cmd --bind "${ROOTFSDIR}/var/cache/apt/archives" /var/cache/apt/archives \ > - --bind "${WORKDIR}/dpkg/lock" /var/lib/dpkg/lock \ > - --bind "${WORKDIR}/dpkg/lock-frontend" /var/lib/dpkg/lock-frontend \ > - --chdir "/var/cache/apt/archives" \ > - ${ROOTFSDIR} \ > - -- /usr/bin/sh -c "apt-get ${ROOTFS_APT_ARGS} --print-uris ${ROOTFS_PACKAGES} | \ > - sed -n \"s|^.*/\\(.*\\)_[^_]*_[^_]*\\.deb'.*|\\1|p\" | \ > - xargs -r apt-get download" > + # apt-get install does not cache packages coming from local repos > + # (isar-apt). Obtain their URIs by recalling the install command and > + # download them using the host apt, same as rootfs_install_pkgs_download. > + # No need to export those files to dl_dir, so we can run it right after. > + rootfs_cmd --bind "${ROOTFSDIR}" "${ROOTFSDIR}" \ > + --chdir "${ROOTFSDIR}/var/cache/apt/archives" \ > + -- /usr/bin/sh -c "apt-get -o APT::Architecture=${ROOTFS_ARCH} \ > + -o \"Dir=${ROOTFSDIR}\" -o Debug::NoLocking=1 \ > + ${ROOTFS_APT_ARGS} --print-uris ${ROOTFS_PACKAGES} | \ > + sed -n \"s|^.*/\\(.*\\)_[^_]*_[^_]*\\.deb'.*|\\1|p\" | \ > + xargs -r apt-get -o APT::Architecture=${ROOTFS_ARCH} \ > + -o \"Dir=${ROOTFSDIR}\" -o Debug::NoLocking=1 \ > + download" Besides of the same question, this task rebuild will probably also helps with ignoring missing deb file arch in the existing implementation, which can possibly fail if we try to build custom package for both host and target architectures. > } > > ROOTFS_INSTALL_COMMAND += "${@ 'rootfs_install_clean_files' if (d.getVar('ROOTFS_CLEAN_FILES') or '').strip() else ''}" -- You received this message because you are subscribed to the Google Groups "isar-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to isar-users+unsubscribe@googlegroups.com. To view this discussion visit https://groups.google.com/d/msgid/isar-users/9a53f70e-f23a-4a49-885c-da3177efed11%40ilbers.de.