From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Thu, 15 May 2025 17:07:43 +0200 X-Sieve: CMU Sieve 2.4 Received: from mail-wm1-f63.google.com (mail-wm1-f63.google.com [209.85.128.63]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 54FF7hX0000749 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Thu, 15 May 2025 17:07:43 +0200 Received: by mail-wm1-f63.google.com with SMTP id 5b1f17b1804b1-442e0e6eb84sf7513795e9.0 for ; Thu, 15 May 2025 08:07:43 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1747321657; cv=pass; d=google.com; s=arc-20240605; b=RKHPYJp1q0mzDZJ6lg+vX8hWaJc95lXQeXgo/nRP/1EgmZrit6IDQLsIkMvB6DLykU 7LjaN9kpXw+Nz99FxgIXTMk/M0Tsd0aoNETFCfv8DvwaykaPa5Ipj4AYy6Lvwi0SbLd4 O8wZ0p2chUxcxkFtmHbyWH1TQfjOmyNMoDWpGP33P98P2p/I+uZ3Azk6JTTOp0tSj6Zu VG67IVQHTGE4wmNkR3JgyPMfYmW9EBQQecnhrpyargiMImSr/s9l/X+3/Wt55Z7++xVN onk/Lal16oVopsoQRJs/+tRJTCxECLCTAW3lFJfKkwIdcqUFNBa+uWq+TkXB5Eku866P co9A== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to:feedback-id:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :dkim-signature; bh=CjnGqXi9QP7V3QR0oaPOuXmCnVVpLexD2QXYFmMm+CE=; fh=oJwMiUJlLAXK6witKwJ9819RwYAF8ULXBe7mxnTihSA=; b=DlOOFJ6p3BR/2QNc0+etzxPrDzs6aaOf7EV8jO8MyjGD2WNSOqhM8UNp8eYtVaYIoa ptYFEGLGfWxxrs5rdPFosWbhaE3Bco4MR17DdBjXwtEuazl1Anp3j+gWVnUSFjnX4Mx0 bv4BO5DC7wqWURx7NQIN+KUSdYRdp6S4dwjcE2LeAITZVnODGu2R8ebE3rTLEwfmYXoY xYh4S3N8RLXNZmngtJkwmksxUma33OWjVY8OSH5b6zgSkMcVNDu5Ozsem4ezj0n3ja0Q y1VZDnQ+KQi+Bu4l0JlJqEE6oSLa4m056xTAOm+D2dPsvoYxEUVu1bm/wXCl2nArrXeE ko2A==; darn=ilbers.de ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm1 header.b=UnrvIuJF; spf=pass (google.com: domain of fm-1212295-20250515150733b2a8ba9c63df5a7e89-0dftzz@rts-flowmailer.siemens.com designates 185.136.65.227 as permitted sender) smtp.mailfrom=fm-1212295-20250515150733b2a8ba9c63df5a7e89-0dfTzz@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1747321657; x=1747926457; darn=ilbers.de; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :mime-version:references:in-reply-to:message-id:date:subject:cc:to :from:from:to:cc:subject:date:message-id:reply-to; bh=CjnGqXi9QP7V3QR0oaPOuXmCnVVpLexD2QXYFmMm+CE=; b=Lfxasg6pNf4mjgceAZB00FRmOasGtf+PRISkg8HLXVg/WQ4zv22/Gx3yUS3ADABCpD 29kACpBagOoG5+yfnabwm/5+HyijbpN87EgyUkfJpwVrw049DN5hniIrlxMxJj3NXm99 LKbFGwjbwKwyoyLDTN1NND+kV/WsoQNoJcCthlUUUrwN0eXVnB9xImL4tL2SOp6qUPed Dn0JEGBil2W+inHLEz6WRgga5nTJ8T1/e0GfLTi56YcPJ1tbhutuZLnqeEB4z8H2gGcI SA0tjzGHih0tE7aL6W6iFPbXOQc1O0A4qNTAq08UvIgcYXUFWRM3e9lkaY1tVuDraIGM zkFQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1747321657; x=1747926457; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :mime-version:references:in-reply-to:message-id:date:subject:cc:to :from:x-beenthere:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=CjnGqXi9QP7V3QR0oaPOuXmCnVVpLexD2QXYFmMm+CE=; b=vYRXiOrXeD7pa7zX5L9/3GF0tf9aN1DUbcw2g1OAOGlykqA67y/27VhTIYUC5KckSK wSIvZ8ufnsNjjaD9nDilSRrBzT6ONlC0Dveq3JtJyVawy/6nEcK2AmJFgSPOII1qHKso 81j1Dc7PriJBNYQxhnqBeDFszv5zUbakGsL3mm1nL0c1V0HHa4dHqlqhdUy/7QaWKSUw p3NiKbXEV11S6rFKoCuTWFS/sElY5QcG9oGF8KBG967jJJmzQajfxwuuwG4Wg8ffFQ41 aSq3SAQ9yiEssNFt4TbHCPMjPEPTo0hZWJ/C4lr0eAev9eT15wvj63NQfs8hWNLQ0TpY 1BRw== X-Forwarded-Encrypted: i=2; AJvYcCXy+RPwPh3AfKSLcDxrEqYdeOCDEBbqsosoMbP3lOppKyWoqJimBd7cfE1FGsy+wrEIUNU1@ilbers.de X-Gm-Message-State: AOJu0YwEpK6drTDwvBZKopkZIwx9O0jsJ+E65GL84IDOyaQoVPtYEJRK QyxI7ARjFIyeX4Ek8Lf4q1cCx7OkyV5UmY1enwcfUwlWdL5umWqY X-Google-Smtp-Source: AGHT+IH4A4ONfjS6YTcxSQIV4n96NOGvvCj1lUTdbLwMU8dMEgwrxK9T1txwcAvuYKoGWPrGifUugg== X-Received: by 2002:a05:600c:46c6:b0:440:6852:5b31 with SMTP id 5b1f17b1804b1-442f20e687bmr77115435e9.10.1747321657168; Thu, 15 May 2025 08:07:37 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com; h=AVT/gBHLqLbBUZgbUDvlrit1MumjCa0BbIadyAX8qRBtsXfC5g== Received: by 2002:a05:600c:1d0a:b0:43c:ef03:56fa with SMTP id 5b1f17b1804b1-442f8789475ls5707745e9.2.-pod-prod-02-eu; Thu, 15 May 2025 08:07:34 -0700 (PDT) X-Received: by 2002:a05:600c:5118:b0:43d:49eb:9675 with SMTP id 5b1f17b1804b1-442fbc322a7mr13708685e9.22.1747321654375; Thu, 15 May 2025 08:07:34 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1747321654; cv=none; d=google.com; s=arc-20240605; b=j26EpcVuBNu31uZYyloS/n/l1K12+SPkhSBSs2c3kgd4Wqy/QfisBpLfiXUCBRUDfw wC5xUZcrI+FTAguCDvSr2GgiKnODy4NxAI1p1bRkpOkJ6qDlWWEZD/FZLUtxCM+3s1rc odgLbIpXyJ98sK+26f/8lNn1q7DHFmLlIyXCelmTR2WebeoYkNY45IL4+MrIXkf87AYH 8VZVj7/+i8npzZ5xzXIUomqArLya0Q4eYGrt46N1Jp1xwi1IIpIsMcQoC9rzoGcgs6yR NNsrDa/sFNnnr9TYTWTQfZheQhjq7bKL0WMCKwqh50EgyctmSdj1xyTXML3YJl1vhHlK vB7w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=feedback-id:content-transfer-encoding:mime-version:references :in-reply-to:message-id:date:subject:cc:to:from:dkim-signature; bh=uzhpT7TF6OMYVNPBZX0mYHcGvGtmz7GPvRN8Pu2CdFw=; fh=D/q4xMKxZDyLo2GtmwQ/2prSr9aCFD3HVqTCj43epLY=; b=hrPilPTA6F+n81sPYb8YdbSfBs8zp8xSONDSyifhh7Riq5UpEObjlZatGN92lTWJyk OwclDPbTtUBSo4SAzzsDWj6WENwPgEOPofjpdppYzEcgQ5PUXJMt/gcSuiyXgDmwzZZo OZpnprQqjMCgbVeZVNvvW3Wms85Wd+Vj0hS8MxapPLdMaAqzPyO6kL8Zl6qui9CZmcgk cT+h8TSFpHcLNJ+vIVzMRsgxVLuAgem05/259IflDe8jxDwCfwE67fcQqfB5s9ukn2Hd s5lJfrlv7oBytgf8PMLFxAlm4UO8WOYZ9lDLfWb5uaEwNvTINuOvb6KD1Povxm/6Bf6e 4eew==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm1 header.b=UnrvIuJF; spf=pass (google.com: domain of fm-1212295-20250515150733b2a8ba9c63df5a7e89-0dftzz@rts-flowmailer.siemens.com designates 185.136.65.227 as permitted sender) smtp.mailfrom=fm-1212295-20250515150733b2a8ba9c63df5a7e89-0dfTzz@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com Received: from mta-65-227.siemens.flowmailer.net (mta-65-227.siemens.flowmailer.net. [185.136.65.227]) by gmr-mx.google.com with ESMTPS id 5b1f17b1804b1-442ebd54ff1si2605795e9.0.2025.05.15.08.07.34 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Thu, 15 May 2025 08:07:34 -0700 (PDT) Received-SPF: pass (google.com: domain of fm-1212295-20250515150733b2a8ba9c63df5a7e89-0dftzz@rts-flowmailer.siemens.com designates 185.136.65.227 as permitted sender) client-ip=185.136.65.227; Received: by mta-65-227.siemens.flowmailer.net with ESMTPSA id 20250515150733b2a8ba9c63df5a7e89 for ; Thu, 15 May 2025 17:07:34 +0200 From: "'Cedric Hombourger' via isar-users" To: isar-users@googlegroups.com Cc: felix.moessbauer@siemens.com, Cedric Hombourger Subject: [RFC PATCH 2/2] deb-dl-dir: optimize caching of source packages using apt natively Date: Thu, 15 May 2025 17:07:27 +0200 Message-Id: <20250515150727.1764989-3-cedric.hombourger@siemens.com> In-Reply-To: <20250515150727.1764989-1-cedric.hombourger@siemens.com> References: <20250515150727.1764989-1-cedric.hombourger@siemens.com> MIME-Version: 1.0 X-Flowmailer-Platform: Siemens Feedback-ID: 519:519-1212295:519-21489:flowmailer X-Original-Sender: cedric.hombourger@siemens.com X-Original-Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm1 header.b=UnrvIuJF; spf=pass (google.com: domain of fm-1212295-20250515150733b2a8ba9c63df5a7e89-0dftzz@rts-flowmailer.siemens.com designates 185.136.65.227 as permitted sender) smtp.mailfrom=fm-1212295-20250515150733b2a8ba9c63df5a7e89-0dfTzz@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com X-Original-From: Cedric Hombourger Reply-To: Cedric Hombourger Content-Type: text/plain; charset="UTF-8" Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-Spam-Status: No, score=-4.9 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,MAILING_LIST_MULTI, RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H2,RCVD_IN_RP_CERTIFIED, RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-TUID: i6yTZD3QfCpz source package are downloaded by entering the target rootfs and run apt there. For foreign architectures, this results in apt being executed under QEMU and leads to poor performance. By using the recently introduced rootfs_native_cmd command wrapper, apt will be executed natively against the target rootfs and without elevated privileges. For our test work-load, caching was reduced from more than 10 hours to an hour. Performance is also more consistent as it will no longer depend as to when bitbake kicks caching of source packages for foreign architecture rootfs vs rootfs for the host (in multiconfig builds). Signed-off-by: Cedric Hombourger --- meta/classes/deb-dl-dir.bbclass | 36 ++++++++------------------------- 1 file changed, 8 insertions(+), 28 deletions(-) diff --git a/meta/classes/deb-dl-dir.bbclass b/meta/classes/deb-dl-dir.bbclass index e75e6be5..a8e8261b 100644 --- a/meta/classes/deb-dl-dir.bbclass +++ b/meta/classes/deb-dl-dir.bbclass @@ -5,25 +5,6 @@ inherit repository -debsrc_do_mounts() { - sudo -s <"${DEBSRCDIR}/${rootfs_distro}.lock" - - debsrc_undo_mounts "${rootfs}" } dbg_pkgs_download() { -- 2.39.5 -- You received this message because you are subscribed to the Google Groups "isar-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to isar-users+unsubscribe@googlegroups.com. To view this discussion visit https://groups.google.com/d/msgid/isar-users/20250515150727.1764989-3-cedric.hombourger%40siemens.com.