From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Mon, 19 May 2025 13:58:23 +0200 X-Sieve: CMU Sieve 2.4 Received: from mail-ed1-f63.google.com (mail-ed1-f63.google.com [209.85.208.63]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 54JBwMpo018142 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Mon, 19 May 2025 13:58:23 +0200 Received: by mail-ed1-f63.google.com with SMTP id 4fb4d7f45d1cf-6019810cd34sf1719393a12.0 for ; Mon, 19 May 2025 04:58:23 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1747655897; cv=pass; d=google.com; s=arc-20240605; b=SsC2ZszQgiyVeelKPVKQnOFwuUsJiHBp7E7auTtTLd4sjbk4jI8v9J8LYvxK6Py6pW tHBtb/2qZ1y/WRLtgxO++0nA7T3gXQnsWlDSaEsLtdAvf6/bZ4TC0H3oSbK33KnzfaKm D1FZIltEQaXvqR1jtZlVZyzfgFCdneBL77ee0+8mmTwXJRaQnjYQ0B2xjVYonG1nalCc tsl/ZEncBheZD1it48T0s8T/3DuxJw5VYZU2sDyqa0J8FB9M7VaJjC+KbZ1cqmZagL3i mbC2q76WlIuMR6FO8gm3tRLwkS3SxDdHSSThk0bmRorstuPH3I4d8yqYf99pft8ox2M4 JuUg== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to:feedback-id:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :dkim-signature; bh=Yf8PsUeaBFA/I140D4g4QDIFxECafAciEj0ApQQFsEU=; fh=rBpfINwecDPtdBYTT4uxPFyqruIq1Zak7VWU7nCnkNk=; b=MdqJAbnr+U7McK6CwSFLX8i9PrrgKO2GyXrHCtiovQGx5dq1aI2ZOdtS2bKt2xh54p RuzitWgQXsub+8USdZ4mQGigWHg2z17svpsBEqUJQTiUOAemGp6br8yhGCFVql7OkxZO nIhB83HwhBOsNseV8NzWzPOUJL6OI+E/etzcnslzKjPSgsVkynCSow5VNzS0gJeLgt4r zSp1Qb7xWNH62JAjhgX/szNv2cCGr9wzuvLjAEfe41XzMsexpYgvIJOrSx7oR84n9Pyk 2EX0t9VzPymohhXfl0PyaQHInvYK9GSMCfX7E1AXalIFQarAvxf0Trojx8n3X4ndu3Iy UODQ==; darn=ilbers.de ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm1 header.b=PhCQ4kVY; spf=pass (google.com: domain of fm-1212295-2025051911581484ad99ed22a832611e-cfne2l@rts-flowmailer.siemens.com designates 185.136.64.228 as permitted sender) smtp.mailfrom=fm-1212295-2025051911581484ad99ed22a832611e-CFNe2l@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1747655897; x=1748260697; darn=ilbers.de; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :mime-version:references:in-reply-to:message-id:date:subject:cc:to :from:from:to:cc:subject:date:message-id:reply-to; bh=Yf8PsUeaBFA/I140D4g4QDIFxECafAciEj0ApQQFsEU=; b=o71T0LDt4xm75jxi/hKE9/ux5/2WOZ5EjzMZo1blH628oW8aDc+HWzKO1NrE9gDi5O RPO1EQn1wh6GNaESE+cqrrLHHsgwpoPX7WrOZFgVPDVMFIWizUtQV3t49Eac26/qK8rv lWa5IjA0Vu8I+1G9hDqBZzWBiyPsB2zN/1YEnE3GMF3BwGjsW6LyuUy3Y+CajZ9iwhiY Tb/OcQrWU7ZaPmfiKrHIB+4eigcW1xpGSuoYN5j664NLYt+kEBFLFDULufoVcAn52xIV mvyJbZTE3Mp/M8c1OZU8nnlOltG5XjWyAPjeL5AyTN0uoYPMofoiUnYWp4LFdB8v3JnW qMCQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1747655897; x=1748260697; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :mime-version:references:in-reply-to:message-id:date:subject:cc:to :from:x-beenthere:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=Yf8PsUeaBFA/I140D4g4QDIFxECafAciEj0ApQQFsEU=; b=QECGQjpO3JztAtAi2mQr0zm9PmnaVuO9CS/2XB+NiySXergcvZG4yN6Ynl2xu1mo43 3Hon6no8oyy0nhG2GaXALXfB2Fr+0D05s6CRSp+9ZgvZqX7y8iojTDADCzNxQqVF4RKA 4sIVlDT3+nAfKJFaqZS906tp0MDhzXqHZLjYU+RjJQpbEF8cXhjXqPN7zOvtK0EfD6R/ k4KHGwRgHhODV+KUfSgQjqZvraxxkQeWNAwvJhSDWJr2k6KX62vHC+Yfu9nrZxzGRLdV 9NuidwzGK6RaXu+uvT/mhIO4K2U3IrFTNq+V8BxN1chVhzvDB4q8Ixr8R6aecL2213P8 31/A== X-Forwarded-Encrypted: i=2; AJvYcCUwCn2TOgZSE81zTn5pW2d4klLsbdS9q0fSq9xbVUESnMmFbKBAzhMPAqUSkY23I+Gah2qG@ilbers.de X-Gm-Message-State: AOJu0YznBSTkrPfoaoRD8H54HC/sl6JgsbZ4trI8dOhptSMsYIa79OkH Nrpl2l6gR6o0cu/TXqd0NVmi5gDDc2mCIbsLc+wBRzWyuK2seRJBEIZ4 X-Google-Smtp-Source: AGHT+IEfMOp091TQ6yCdGbgR1mSnngfichFVHQdbIDNfwLxJBc6J2/kfD/5VDFxNshqmWzpUNYwMwA== X-Received: by 2002:a05:6402:40cc:b0:5f4:d57e:4ab6 with SMTP id 4fb4d7f45d1cf-6011411a954mr8882528a12.24.1747655897309; Mon, 19 May 2025 04:58:17 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com; h=AVT/gBG7kf+mbAz6uJkaImUitv+F7BmfclKZUEF2osPWrLOo2g== Received: by 2002:a05:6402:1ecd:b0:601:a35e:6dd5 with SMTP id 4fb4d7f45d1cf-601a35e7064ls120714a12.0.-pod-prod-05-eu; Mon, 19 May 2025 04:58:14 -0700 (PDT) X-Received: by 2002:a17:906:c14d:b0:ad2:3efc:dd7a with SMTP id a640c23a62f3a-ad536b57a13mr1147253766b.4.1747655894439; Mon, 19 May 2025 04:58:14 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1747655894; cv=none; d=google.com; s=arc-20240605; b=N92k5rzRLHgTt0k1IciBuKgQsWmo+ROD2s94Zc/Sk21NF+iqxVVtmhb7V1hzPECQmk T9/EkD9r5sq6DXhgYLKxqNo4kecpUUqx8mh6rS+lHdrTHueaZciyLZfPK+EL/BclPJA+ nvtOg9mn6BYeW1y2LLoDBXpame/zT8hXuS1wBAWcAefABjFBHQcFKtUivPij7EbBL/LM AIA7iCfQsbftAwv7cUoTJAFl1WdCnq/iTHf+AvDQNTHbNYkKbpPQlgoesPAmQXLcD5uH fRFZhZg4sVNRSKo8X9hnyVA+c44BTcQ4I2z5LEY+R2fTlE4YpJZ8ZQce3Xad9MkRkS3a toeA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=feedback-id:content-transfer-encoding:mime-version:references :in-reply-to:message-id:date:subject:cc:to:from:dkim-signature; bh=yTHyZtp/Gm/LWcW3yXuXiRnaKYLCtILET9xhsLbpom4=; fh=D/q4xMKxZDyLo2GtmwQ/2prSr9aCFD3HVqTCj43epLY=; b=QdtCP1JwFUvitOjgzyLncqWMmjq33OqgANWWacAe9uodZy2k0ikxbdfp5crPmF2JLm gk2lnCqN4aX/y9QJlDZdIv+3CWSAD6jw8texSJo+e5wsCtyDZNBfL0TGyCMY4OscbYbU DzFqgxoFb8zYI93+udLmvv/eHk7TEigkbXzIzcNLAx9F0PN+sHPd6Yf/XFdYY9a0w9pO +3Q42CBu06RPyicsxhkCO1Z/BLuntnam75kMA2iSUEpb9OT2tHBbc5KGam66hf8Yn1jU BniwVYyCyyPCWbg0WhZSowHlMJUUd1nvoVUhpcn1tNkX7WP0LKr/rVqwQSgtGWCDW3jP JFQQ==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm1 header.b=PhCQ4kVY; spf=pass (google.com: domain of fm-1212295-2025051911581484ad99ed22a832611e-cfne2l@rts-flowmailer.siemens.com designates 185.136.64.228 as permitted sender) smtp.mailfrom=fm-1212295-2025051911581484ad99ed22a832611e-CFNe2l@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com Received: from mta-64-228.siemens.flowmailer.net (mta-64-228.siemens.flowmailer.net. [185.136.64.228]) by gmr-mx.google.com with ESMTPS id 4fb4d7f45d1cf-6005ae4a03esi108842a12.3.2025.05.19.04.58.14 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Mon, 19 May 2025 04:58:14 -0700 (PDT) Received-SPF: pass (google.com: domain of fm-1212295-2025051911581484ad99ed22a832611e-cfne2l@rts-flowmailer.siemens.com designates 185.136.64.228 as permitted sender) client-ip=185.136.64.228; Received: by mta-64-228.siemens.flowmailer.net with ESMTPSA id 2025051911581484ad99ed22a832611e for ; Mon, 19 May 2025 13:58:14 +0200 From: "'Cedric Hombourger' via isar-users" To: isar-users@googlegroups.com Cc: felix.moessbauer@siemens.com, Cedric Hombourger Subject: [PATCH 2/4] deb-dl-dir: optimize caching of source packages using apt natively Date: Mon, 19 May 2025 13:57:48 +0200 Message-Id: <20250519115750.3195300-3-cedric.hombourger@siemens.com> In-Reply-To: <20250519115750.3195300-1-cedric.hombourger@siemens.com> References: <20250515150727.1764989-2-cedric.hombourger@siemens.com> <20250519115750.3195300-1-cedric.hombourger@siemens.com> MIME-Version: 1.0 X-Flowmailer-Platform: Siemens Feedback-ID: 519:519-1212295:519-21489:flowmailer X-Original-Sender: cedric.hombourger@siemens.com X-Original-Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm1 header.b=PhCQ4kVY; spf=pass (google.com: domain of fm-1212295-2025051911581484ad99ed22a832611e-cfne2l@rts-flowmailer.siemens.com designates 185.136.64.228 as permitted sender) smtp.mailfrom=fm-1212295-2025051911581484ad99ed22a832611e-CFNe2l@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com X-Original-From: Cedric Hombourger Reply-To: Cedric Hombourger Content-Type: text/plain; charset="UTF-8" Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-Spam-Status: No, score=-4.9 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,MAILING_LIST_MULTI, RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H2,RCVD_IN_RP_CERTIFIED, RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-TUID: PVNp46KJe6Ba source package are downloaded by entering the target rootfs and run apt there. For foreign architectures, this results in apt being executed under QEMU and leads to poor performance. By using the recently introduced rootfs_native_cmd command wrapper, apt will be executed natively against the target rootfs and without elevated privileges. For our test work-load, caching was reduced from more than 10 hours to an hour. Performance is also more consistent as it will no longer depend as to when bitbake kicks caching of source packages for foreign architecture rootfs vs rootfs for the host (in multiconfig builds). Signed-off-by: Cedric Hombourger --- meta/classes/deb-dl-dir.bbclass | 37 ++++++++------------------------- 1 file changed, 9 insertions(+), 28 deletions(-) diff --git a/meta/classes/deb-dl-dir.bbclass b/meta/classes/deb-dl-dir.bbclass index 3f560da4..7026f4f4 100644 --- a/meta/classes/deb-dl-dir.bbclass +++ b/meta/classes/deb-dl-dir.bbclass @@ -5,25 +5,6 @@ inherit repository -debsrc_do_mounts() { - sudo -s <"${DEBSRCDIR}/${rootfs_distro}.lock" - - debsrc_undo_mounts "${rootfs}" } dbg_pkgs_download() { -- 2.39.5 -- You received this message because you are subscribed to the Google Groups "isar-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to isar-users+unsubscribe@googlegroups.com. To view this discussion visit https://groups.google.com/d/msgid/isar-users/20250519115750.3195300-3-cedric.hombourger%40siemens.com.