From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Thu, 15 May 2025 17:07:44 +0200 X-Sieve: CMU Sieve 2.4 Received: from mail-ed1-f62.google.com (mail-ed1-f62.google.com [209.85.208.62]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 54FF7hUZ000761 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Thu, 15 May 2025 17:07:43 +0200 Received: by mail-ed1-f62.google.com with SMTP id 4fb4d7f45d1cf-5fc013fb4easf1261533a12.0 for ; Thu, 15 May 2025 08:07:43 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1747321658; cv=pass; d=google.com; s=arc-20240605; b=MU+pNUgbajAUZGm7Y2I1il18giQz7l5ayeqT64Cst0ct1nJeMaHoSv22BYiUBcqLZ0 UWXQZa4y51kcM3vPkGfIL5j2qeGwypP3S0v9yZqmyeJYZfkwMvwkFOQXDZadzExiywG3 osUAujt5Pm5p0365HPBcSvWPcEL9+U3uk1/D5JUCZX5bbaswIEsJDXwLFEpqtlulE5nF dhajvgVhD/eIpf0c8Bm1IjqMkuvB47Nw2ejkVlpqeLoGLqBcj7ZPDvDbPUF0G1gykDRH Arw+EnTQm9Q5y2Wt18XE0oo49OumY7et/xVCtQH38G4tz96H1yrmzF3L98jv2pZvQPbK IASA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to:feedback-id:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=1U4Iz2iEVVp/9re7VD6Z4IbXfuxAMHu7P59qkfUUv+Y=; fh=baKVHqmaMQZYpUrh/5cRbWgkFvcuaZOLL7DJ/YugsEw=; b=C9SM8j/Sma5krqBKYehEIdie7AIvQjdJMDCtHnQiby6YKEt6FFp5zH/rnln0Bc5Uzm iC/WHy4H4Ga3GNuT8ewcL8wai2n8k8bwGaTDVlr2FF1Z1TPXAWDksBIVaCl46pRfY62+ tBJRpRcc4HX+A8tz4Pg2H1tcCwnXSmTRprlPoTFyyLbOg1eA/TyS2OP7KOEGIX4cwpcY 1mbB1PonobkoiSEq3I2OsJKuyVkviJrg+PzUOUcun7Wj32Xcm5GJvogsl8SOcyc9aGyl 5tboglPT4lq1WkPDPJraPj0mvdgIPq1g9eo7LBUL6yIzAS3GSll7WQqNPMeG8IkAHJe5 LdHw==; darn=ilbers.de ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm1 header.b=LhDReh7E; spf=pass (google.com: domain of fm-1212295-202505151507330b1f5dc08a0e8843ac-lbrdgt@rts-flowmailer.siemens.com designates 185.136.65.226 as permitted sender) smtp.mailfrom=fm-1212295-202505151507330b1f5dc08a0e8843ac-LBrDGt@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1747321658; x=1747926458; darn=ilbers.de; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :mime-version:message-id:date:subject:cc:to:from:from:to:cc:subject :date:message-id:reply-to; bh=1U4Iz2iEVVp/9re7VD6Z4IbXfuxAMHu7P59qkfUUv+Y=; b=XbxeY/iJg8gUi28MuNmB6JXwQ1LcFJxmUUkwuHgpajImjElkrWTt5sK/vYJmiHmK/w zhrQ5MKcfOEkaxjeEzixbcSNmLRdPK4Bs8RZ3VKHFP0bOHCqTt7kCx5Bpo23Q9s08Z1s z6zmpvk8L1lLbjJ2K2gNj+hoazWrxZQMHlpW5Ub8W+GZvTEXZIcnHNaCk98OvlXTdotL 8ppB4TPfHr9SZUzqkKE6VVOhi+x2pmUQBaXgyXEY9UytW2ARtnkeiGB60fkT+xv6Cdvz X0rTi14Lk5pDdB3FEw421Ji2fKhLd20uCVCbf63jRov7uSFd4Q+VHCQpjGx5+kPUXBwL cusA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1747321658; x=1747926458; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :mime-version:message-id:date:subject:cc:to:from:x-beenthere :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=1U4Iz2iEVVp/9re7VD6Z4IbXfuxAMHu7P59qkfUUv+Y=; b=Z3jpdAT2+2gGLjOnio9q730xkyOTbeq5XccEaa2YNfQMD0aeo0fZ6e854w3i+20e9c mn3/vE8Upb7aylxB6U0PU15Psn9hi0Mu7EpNGRhVQYDQUR09OcEFBF9Jb7qT4FODDfhZ orhMMIgBPLoWx4JkVDiWYUwQGVTpvQe0QpM1WjR5cUgO2Vl+bxpD3R0NuKKQlW24xAts PuJzCsvk5106msb3aCnKQpiOdgQity+kRhjYcvD7SWbRDVTSWyAGDd+qf3IAF2f2PdVr CnV8M4thvaOTfjJ+fCdem8XlJD53zVQ4RSEVIzIb8bVwQVYt2gUurquikiEdhMF7RcEL 5QLw== X-Forwarded-Encrypted: i=2; AJvYcCW4MF9jxoLzh6ZSVnHTuxA689fTTXwF98h0igvgeHZ6KjfqwhmrMzmpzcU0JVfTDWDs+PJN@ilbers.de X-Gm-Message-State: AOJu0YxjcmczmQ6a9Q7ujey0gURGgLnRsz/hy3xtYLwsFA0dkYw11fWU t8Ys7QfcWrpQqoouUXhhfrfrpBtG+K/5ZZ8aMiI9//MIG3NvKJ78 X-Google-Smtp-Source: AGHT+IEp02WR+EzbXBCDD4247L8x06mhATfbKKjYlhtXD2RZyZ9xeLDViiprh9co8oFEab82p0zrxQ== X-Received: by 2002:a05:6402:5107:b0:5fd:1696:3c24 with SMTP id 4fb4d7f45d1cf-5ffd0245994mr2635598a12.16.1747321657295; Thu, 15 May 2025 08:07:37 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com; h=AVT/gBFtDJ5UfjcMvgUN2vR3D+gm3l73X9ff+R294s8Nae2dUA== Received: by 2002:a05:6402:5190:b0:5fc:ae51:ba1 with SMTP id 4fb4d7f45d1cf-5ffc907a536ls91449a12.0.-pod-prod-06-eu; Thu, 15 May 2025 08:07:34 -0700 (PDT) X-Received: by 2002:a05:6402:13c7:b0:5f6:25d6:71e1 with SMTP id 4fb4d7f45d1cf-5ffcf7a8ec9mr2555253a12.0.1747321653913; Thu, 15 May 2025 08:07:33 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1747321653; cv=none; d=google.com; s=arc-20240605; b=D/9gdDFreJ3twDvXWZ7oSLDQip6z1I5SrSH794dPAt+6ciwTcyFTkBQjQSt9XJFOzB bqiI7SL0YMxj9jEdVJtuRBOoiT6ktRb/yjAYCTy9UcYkDqKzRX7SJrTGQCgJANktcSl/ HS5/vHOsdTdN/sBdJMSlexWrgqHV2qbRtdAVJT4mu0e7Hk3kuWvKxhvNj7Hq8hinPWTw nUTUlir0k52MdbmzFFlKNIWjxmD1J//DSUHXy7SxNWMfn0emFNZ+JtvQgi9G1IMDEDmB e9ZcxAibLOeIibAWDt2/fWPFnbgaCovYy/U0aEMO4MLbD0F5GKdPac/OJRRByIfzkhl1 9flg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=feedback-id:content-transfer-encoding:mime-version:message-id:date :subject:cc:to:from:dkim-signature; bh=YPvCNAcL5UTEv7qZSsuJFGIm3K8XRJ7gvxCM0lL045c=; fh=D/q4xMKxZDyLo2GtmwQ/2prSr9aCFD3HVqTCj43epLY=; b=gN3Ug0NqUor7Nw8//72/jmW7FsFWMkBjV6XVbJZZn/83IqlywF0iTdgDRl7+m69HZq hkxAaiKKzP0LJSis+h2Kf51+baSNLM0awYVwUzsYrWyg/GKckoDTwlOZniU8YxNcCgub yMvhssXKUXVfc4PbpTUVzAQkDghmV2c+khtJlB2WparLUvf5TtZer4sBH7udm+cnh8X6 dB4jjwHNhfVWAwCB9qHaii5pVnMDSqjSOSFGthQEwQJvMQm4IfEUG3iWBg/GedMBQFFE y5I3R4Q1md/vcgozDjoS524HGx9Le6SwZzK0Fqt/tjivW9r5uGWommE+v6zYcCvqnfNp bxbQ==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm1 header.b=LhDReh7E; spf=pass (google.com: domain of fm-1212295-202505151507330b1f5dc08a0e8843ac-lbrdgt@rts-flowmailer.siemens.com designates 185.136.65.226 as permitted sender) smtp.mailfrom=fm-1212295-202505151507330b1f5dc08a0e8843ac-LBrDGt@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com Received: from mta-65-226.siemens.flowmailer.net (mta-65-226.siemens.flowmailer.net. [185.136.65.226]) by gmr-mx.google.com with ESMTPS id 4fb4d7f45d1cf-5fc9d6f151fsi419584a12.3.2025.05.15.08.07.33 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Thu, 15 May 2025 08:07:33 -0700 (PDT) Received-SPF: pass (google.com: domain of fm-1212295-202505151507330b1f5dc08a0e8843ac-lbrdgt@rts-flowmailer.siemens.com designates 185.136.65.226 as permitted sender) client-ip=185.136.65.226; Received: by mta-65-226.siemens.flowmailer.net with ESMTPSA id 202505151507330b1f5dc08a0e8843ac for ; Thu, 15 May 2025 17:07:33 +0200 From: "'Cedric Hombourger' via isar-users" To: isar-users@googlegroups.com Cc: felix.moessbauer@siemens.com, Cedric Hombourger Subject: [RFC PATCH 0/2] optimize caching of source packages Date: Thu, 15 May 2025 17:07:25 +0200 Message-Id: <20250515150727.1764989-1-cedric.hombourger@siemens.com> MIME-Version: 1.0 X-Flowmailer-Platform: Siemens Feedback-ID: 519:519-1212295:519-21489:flowmailer X-Original-Sender: cedric.hombourger@siemens.com X-Original-Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm1 header.b=LhDReh7E; spf=pass (google.com: domain of fm-1212295-202505151507330b1f5dc08a0e8843ac-lbrdgt@rts-flowmailer.siemens.com designates 185.136.65.226 as permitted sender) smtp.mailfrom=fm-1212295-202505151507330b1f5dc08a0e8843ac-LBrDGt@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com X-Original-From: Cedric Hombourger Reply-To: Cedric Hombourger Content-Type: text/plain; charset="UTF-8" Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-Spam-Status: No, score=-4.9 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,MAILING_LIST_MULTI, RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H2,RCVD_IN_RP_CERTIFIED, RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-TUID: ulOhqaMoADL5 When building root file-systems for a foreign architecture and needing to cache source packages, apt will be called from within the rootfs and consequently be executed under QEMU: this is terribly slow especially considering that source packages are downloaded one by one. This RFC patch series introduces a wrapper function to run native commands against a rootfs with our special mounts such as /isar-apt. Some basic tests were performed to smoke test this approach and evaluate its performance. It should be noted that the changes introduce a new dependency to bubblewrap. That would need to be documented if moving forward and some alignment with projects such as kas would be required. It is believed that this approach could be implemented in other places and further remove places where we would need elevated privileges. Cedric Hombourger (2): rootfs: introduce wrapper to run native commands against a rootfs deb-dl-dir: optimize caching of source packages using apt natively meta/classes/deb-dl-dir.bbclass | 36 +++++-------------- meta/classes/rootfs.bbclass | 64 +++++++++++++++++++++++++++++++++ 2 files changed, 72 insertions(+), 28 deletions(-) -- 2.39.5 -- You received this message because you are subscribed to the Google Groups "isar-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to isar-users+unsubscribe@googlegroups.com. To view this discussion visit https://groups.google.com/d/msgid/isar-users/20250515150727.1764989-1-cedric.hombourger%40siemens.com.