From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Wed, 25 Jun 2025 21:39:23 +0200 X-Sieve: CMU Sieve 2.4 Received: from mail-oa1-f55.google.com (mail-oa1-f55.google.com [209.85.160.55]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 55PJdBYd007185 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Wed, 25 Jun 2025 21:39:12 +0200 Received: by mail-oa1-f55.google.com with SMTP id 586e51a60fabf-2ea6e3c0530sf48956fac.1 for ; Wed, 25 Jun 2025 12:39:12 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1750880346; cv=pass; d=google.com; s=arc-20240605; b=hoMoQEc9C4TOLbBhcWDvyyUDp09TZCuPSbAOY2s2ywA76KPETRJlT9fRVge9m0ML8o UPy6dMbFhEltdEyqx0O52Fp/pm4XXu7tnytkTD0iveNDX6E+FqmzZ/GRxb9wf8JKFFce zkVZCwpmI/3BRtkfV3KHEW5CtFmIoEB+nLW1petL6gnqWMWoTkwTWFkw9fNkaHEgMMhg cV1AAWpBOeyUZZFq2S9AbgFhePjPWHolLGcHG5mFZJqW9LlTkdawgi7nFniTznCx/fjD 3AtZ71PufaGeiSrXeGhqPxgMvLxCRowMSg0jQDdwrXgGT2PQPgQlT9gGVlbqQFl0ayOw osiA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to:feedback-id:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :dkim-signature; bh=fWEhrPcG9jjLDFgXGjAcw4XIUAV2GeMTzYWUcNStluE=; fh=KgPRqowiz5YIwQy6FEKkraL8unld2bBxZ4ZOhje/4kQ=; b=eYY9JOxcmywKHSpFiH2PvGZIjQftFih8aNP5cu0QgAOMhSHA4waZNyopoFy36bqhVA KxJFTKYkdPSu4HwONdFxhSTF6zvN2Ytrv/CX8u7SHp2xcAn+RA2sNQcQihV2/32gZQKN YkTQspJhVgPh8uDPE3S4IQwbzfeXZMAiAGNYvIATFc/w/0oG8E+b2ErnyXmzsF3AhZUL szq7xthj0IrQMX1eu+Jc8aNFuvITFuWy1bFo7jeUhSk7E1mItHH2wEOonkPloeE1D+oL WLGJ7QS+i8YnaKc6vazch/AR760EZYbJ4rWstX1UkdICVFBlNeCcIKEujSATGDgm8ixV Uewg==; darn=ilbers.de ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm2 header.b=VYmysbnv; spf=pass (google.com: domain of fm-1212295-20250625193904d657f811301bf74e88-rn0ms2@rts-flowmailer.siemens.com designates 185.136.65.228 as permitted sender) smtp.mailfrom=fm-1212295-20250625193904d657f811301bf74e88-rN0Ms2@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1750880346; x=1751485146; darn=ilbers.de; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :mime-version:references:in-reply-to:message-id:date:subject:cc:to :from:from:to:cc:subject:date:message-id:reply-to; bh=fWEhrPcG9jjLDFgXGjAcw4XIUAV2GeMTzYWUcNStluE=; b=GbKaj0Urkxzz+kiuUtvIalOwVggAV1AEhWbIWJ5ZOu+zQm14wg7Y5XIhiN++JYepZx zUiXByGtcump5uL7TxLUz516phkpGlQ+DhAtzkkMXjkX2Kq6+G+sA6RgpXJLxCaqa8y8 VuiAOScCUwA0U0x4RmAjssULzr5BFxL2m7CQu+v4OqMz67vJZFFyLGh8jHCFiGXvZaad bmQNB0V4oW5hnHU0UbYpiz/4anCW1Ic0gBxmNbzIw5vsolZQ0NB5MzmFzoANAh4gHKG1 KMzzznNtLGcnB5vKGTfSHj2OL4m4L8srUeGnVej4r87QWUNcQbDfHZOEUiDN5+hlPIgx nPhQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1750880346; x=1751485146; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :mime-version:references:in-reply-to:message-id:date:subject:cc:to :from:x-beenthere:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=fWEhrPcG9jjLDFgXGjAcw4XIUAV2GeMTzYWUcNStluE=; b=XlTtISqFHro6sNGgqEVf+c8uYRhwpEEBZWBBbdVwgxuf454nj8mip9IR7rM1O09NgD 7+EFZnbZKb53Lgs2oF6v8TlZ0qb3zhZEWacZsNVL97W8/0+85yeYMNxlS9cmmn4tg7B/ vPplvy6o7tXY/NY8K0Knpu9dUv+ZKNBxPpQNQkRVGwyr+Xh3S5VeozU8isp9BW2fma// jN9btMCGv4mM4FxC80Ve1Ya+M8+XXhdH5cbmVSHhr7eLiibOekgbQIhYQWWBpzE3FNUp I3PisPMrpnwLirZSOHvz/3Te40QKmKKodWBvPRpUu3kvASooo0lljHkZxHyglKYWYfzJ TkSA== X-Forwarded-Encrypted: i=2; AJvYcCULD0aoDF5e90Mu3LFoTmwxsUAwqgm7BXgrIyRncPeqb50AmtRjTfHfqG79FcSsho3j9QsB@ilbers.de X-Gm-Message-State: AOJu0YzhNZk7cqJFdpXdGmuC0IphmzVzvnEhzXIcPaq/Bbqr68X3k1xq 9snBCbeOgJMywICyp50rfa+GAYzF/Kycbjh7c6cMOnkehZuIPqMoYdG4 X-Google-Smtp-Source: AGHT+IFin+Qcbl84ySfeOzxQn0/tF1A6CRlikA0tExepOxa+grJ3rT6wmDts83MOuBthbNPoGevi3g== X-Received: by 2002:a05:6820:508e:b0:611:a243:3889 with SMTP id 006d021491bc7-611a2433b41mr525899eaf.1.1750880345947; Wed, 25 Jun 2025 12:39:05 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com; h=AZMbMZd7kzGt0uKb3GTP0r3H8AqGH+NA84tXk9mmX/7AZqUqgw== Received: by 2002:a05:6820:4886:b0:611:7896:5575 with SMTP id 006d021491bc7-611ab014a7cls93641eaf.0.-pod-prod-09-us; Wed, 25 Jun 2025 12:39:05 -0700 (PDT) X-Received: by 2002:a05:6808:4f20:b0:403:3195:58cb with SMTP id 5614622812f47-40b05c15b91mr4031610b6e.28.1750880344907; Wed, 25 Jun 2025 12:39:04 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1750880344; cv=none; d=google.com; s=arc-20240605; b=gr8L0VcjqEXcYulgSmrhI+EdE4nXZcmxZvgVsDBBPr+9nN/QKdAAW6YbamUnXSvRVH ikc9iM3rvihD8J3VR+6WAq3BNZwl2iMogMD4Am1q0jTUFIsGZBeG6RNiBS/7H9lhwZhF JnkvfXihpPymGMQZlJhmc5dhUMl4N3rDElhq8K+K9pRC2wiwZt0s6SoBinFOwuela8VP I3tJrXdDZQ7m37Tti/aHb8NZdEjCwsBKzRjzdl6j3EumqMdP9RvTVWtNQ+tYUthGKhOB n+stLbWNWOL4OiGbuCb4q603kc6f4cD17couODnKbrrr7xBJ3ouzFQbPCBxV+BexPxX4 aHug== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=feedback-id:content-transfer-encoding:mime-version:references :in-reply-to:message-id:date:subject:cc:to:from:dkim-signature; bh=yTHyZtp/Gm/LWcW3yXuXiRnaKYLCtILET9xhsLbpom4=; fh=D/q4xMKxZDyLo2GtmwQ/2prSr9aCFD3HVqTCj43epLY=; b=b1hCdUe4wdGhy5h2zwTCuvNwFA63j93KRIF2ZJciSsUw9OWAOtd8xxXdLc6HC9E5Bl j/MEFt1nQslYGNVQrBYYVMKuWfWuBVEc4QqyQgZv8uOcbTNR1i84ZkMs5SDyKMDeEUAG 2uPdQ2mW48O0O7BGXHgEwrbggpF37z4Obgkrm4VYFPCFzuP7IWTa8eIpMEJzxLH96zxc 1LdHBUJxeOxwRMGaVJJP6USi11W09hjVRUVjthuJ6prH6OYTSkZ64CLewPm6Mlt2MUJj fSc3cUUVdKL7qDTvobkSb5zKFQm/39/dq/mQqlFBFRNi87vPXFi+s+W7ES1jXFbvVqhk bnSg==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm2 header.b=VYmysbnv; spf=pass (google.com: domain of fm-1212295-20250625193904d657f811301bf74e88-rn0ms2@rts-flowmailer.siemens.com designates 185.136.65.228 as permitted sender) smtp.mailfrom=fm-1212295-20250625193904d657f811301bf74e88-rN0Ms2@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com Received: from mta-65-228.siemens.flowmailer.net (mta-65-228.siemens.flowmailer.net. [185.136.65.228]) by gmr-mx.google.com with ESMTPS id 5614622812f47-40ac6d458c8si636949b6e.5.2025.06.25.12.39.04 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 25 Jun 2025 12:39:04 -0700 (PDT) Received-SPF: pass (google.com: domain of fm-1212295-20250625193904d657f811301bf74e88-rn0ms2@rts-flowmailer.siemens.com designates 185.136.65.228 as permitted sender) client-ip=185.136.65.228; Received: by mta-65-228.siemens.flowmailer.net with ESMTPSA id 20250625193904d657f811301bf74e88 for ; Wed, 25 Jun 2025 21:39:04 +0200 From: "'Cedric Hombourger' via isar-users" To: isar-users@googlegroups.com Cc: felix.moessbauer@siemens.com, Cedric Hombourger Subject: [PATCH v3 2/6] deb-dl-dir: optimize caching of source packages using apt natively Date: Thu, 26 Jun 2025 03:37:44 +0800 Message-Id: <20250625193748.2681-3-cedric.hombourger@siemens.com> In-Reply-To: <20250625193748.2681-1-cedric.hombourger@siemens.com> References: <20250625193748.2681-1-cedric.hombourger@siemens.com> MIME-Version: 1.0 X-Flowmailer-Platform: Siemens Feedback-ID: 519:519-1212295:519-21489:flowmailer X-Original-Sender: cedric.hombourger@siemens.com X-Original-Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm2 header.b=VYmysbnv; spf=pass (google.com: domain of fm-1212295-20250625193904d657f811301bf74e88-rn0ms2@rts-flowmailer.siemens.com designates 185.136.65.228 as permitted sender) smtp.mailfrom=fm-1212295-20250625193904d657f811301bf74e88-rN0Ms2@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com X-Original-From: Cedric Hombourger Reply-To: Cedric Hombourger Content-Type: text/plain; charset="UTF-8" Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-Spam-Status: No, score=-4.9 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,MAILING_LIST_MULTI, RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H3,RCVD_IN_MSPIKE_WL, RCVD_IN_RP_CERTIFIED,RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-TUID: XC9ObnTorTkM source package are downloaded by entering the target rootfs and run apt there. For foreign architectures, this results in apt being executed under QEMU and leads to poor performance. By using the recently introduced rootfs_native_cmd command wrapper, apt will be executed natively against the target rootfs and without elevated privileges. For our test work-load, caching was reduced from more than 10 hours to an hour. Performance is also more consistent as it will no longer depend as to when bitbake kicks caching of source packages for foreign architecture rootfs vs rootfs for the host (in multiconfig builds). Signed-off-by: Cedric Hombourger --- meta/classes/deb-dl-dir.bbclass | 37 ++++++++------------------------- 1 file changed, 9 insertions(+), 28 deletions(-) diff --git a/meta/classes/deb-dl-dir.bbclass b/meta/classes/deb-dl-dir.bbclass index 3f560da4..7026f4f4 100644 --- a/meta/classes/deb-dl-dir.bbclass +++ b/meta/classes/deb-dl-dir.bbclass @@ -5,25 +5,6 @@ inherit repository -debsrc_do_mounts() { - sudo -s <"${DEBSRCDIR}/${rootfs_distro}.lock" - - debsrc_undo_mounts "${rootfs}" } dbg_pkgs_download() { -- 2.39.5 -- You received this message because you are subscribed to the Google Groups "isar-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to isar-users+unsubscribe@googlegroups.com. To view this discussion visit https://groups.google.com/d/msgid/isar-users/20250625193748.2681-3-cedric.hombourger%40siemens.com.