From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Thu, 10 Apr 2025 07:28:05 +0200 X-Sieve: CMU Sieve 2.4 Received: from mail-ed1-f63.google.com (mail-ed1-f63.google.com [209.85.208.63]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 53A5S49p009424 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Thu, 10 Apr 2025 07:28:04 +0200 Received: by mail-ed1-f63.google.com with SMTP id 4fb4d7f45d1cf-5e5be5ec846sf349338a12.2 for ; Wed, 09 Apr 2025 22:28:04 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1744262879; cv=pass; d=google.com; s=arc-20240605; b=j76P9YND95b21VI6HyURZt2N2dIODhCUOue/zmdwZc0qMA3p4pu6T9TOGGlKwlXUci Cb6AXQq3qHqwb50Lu4Rg3z3phwsgMcWauAdS5Q7yheeOdq+mlHRzIsQmqsNK7+JkIlEZ uxGz+0zLguuY7cn5rb/YwWzYgufMgjpwxJ7PgAJO+Qq3gBOPRGRK7Wi3b41gIOdrbN1y gYo4E5rw+wpJJciWrBSG3ZXGrsVAEAMNdcyMVZ4w6HHW6qTRsz7NCA+eh1kkmXm7UKZH N0Rvtn0nuw0c+oY67ruFGa8mnn0tuaFaSX80JXrZwSshgBMCaK6RWnHyGZ7I9VRmCezG yRIg== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to:feedback-id:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=vCI2/K7hC2YU4neaOFbOz4Crsu8wc6sx4c5XnbyOqE4=; fh=VluIoqbKoGOZdAllhGsvhRYg5OzTrziOIVgvGKirpno=; b=Q71diY69PO+hu/Mz0L2bLm47gIqqqiIxoyEs6V8xXcjFiEgL3cki8dDfjEjWm5smTA HIiaBKDr+ah9Domxigzd8QJM1qk22o7sY6kRkjMXtgKfpki2zqv/pi0k8HrKzlBRlXAY pcjGQtjFj47joY9Tbq+79Qy9FDRgr1wSPrwYiIrYl/sTdx/vwvcSwRVXFaptTbi2uDN/ A053lBOO8GzLEKaVjAuo9WyqnOkEG2q1s4HQC8cBPKwKsqqRfwpy0Lr0gXCswbqwohDa X94VKyRSb7QnwbQkl1hBDGW20qHkebKp8UCdaNnaoxrJXHM5GRRwYUjCxWJCtiTJ4LsI jqZA==; darn=ilbers.de ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm2 header.b=KUOsWkOr; spf=pass (google.com: domain of fm-1321639-202504100527542323b3dd088583a57e-ptwbwf@rts-flowmailer.siemens.com designates 185.136.65.228 as permitted sender) smtp.mailfrom=fm-1321639-202504100527542323b3dd088583a57e-ptwBwf@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1744262879; x=1744867679; darn=ilbers.de; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :mime-version:message-id:date:subject:cc:to:from:from:to:cc:subject :date:message-id:reply-to; bh=vCI2/K7hC2YU4neaOFbOz4Crsu8wc6sx4c5XnbyOqE4=; b=JFCiBDYxB6bMZ+nmcdieQX39LxeOJLxHI8iaN1up2kca9cq8Np9cHEz79cHi908d0B 9ybaindjVc8eDsLmtFKrwo8nytBuhPnsj9E2ub5UVYvLEFCZDh8Qw//H3AXIF3fyMPHm 0fUMD36GcQJCswPmXq5AtHy9noQQPImiCtjpvWVG8YwpJjr4hcS2MtLwBrdmzUang7JM H6J+/lMQ0P9vA1Pcr0gIpnaHP7ZLdsZcDKCmXOF9fykACJbMw2VGlT4SOO6eZtJvpLOB HcuLZC+FYJ+hPlo56gcZ50qpovEeiBQTkfIUQvTgioIa4jF2kTipZ2whsCYhsS5FHJGU BpaA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1744262879; x=1744867679; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :mime-version:message-id:date:subject:cc:to:from:x-beenthere :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=vCI2/K7hC2YU4neaOFbOz4Crsu8wc6sx4c5XnbyOqE4=; b=crx4X5GFj9ottptnEWaxIXP4VKiOV5+NcHrOAt6Zi2v6WasapdRNeE1rtgF8vhmCJO 7UmWke2r3M5s+smQdAAuasiEvxrIJRyOfUapD9GeFIMhScwN5ZCRBxKW6ZIxEd1CXcII Gaux16pJPVSiHo141MS82yWd9z0Pr65XNU3HjAAsaS0H/2jR2IRpQqeHwH/2DgDrUeFM WyiJLij1+QYRBtLTKKer7hGShDOU6VY0YisYb7mto5IpvvLeNW6MkBpaF2YR4D6vMvXv 3kwfvg4DxvcHjJ20z3vfo0f//9ol7k64iSS43U5tjydPNmMGqWfq3DHXEvg15pSYMOX0 HntQ== X-Forwarded-Encrypted: i=2; AJvYcCVx5t380LFozJkJPOGIhseH3j/8Sx06MG+WGnCISDortz59TnRJRlW1jDpqXgSPYi++N3KC@ilbers.de X-Gm-Message-State: AOJu0Yxd+CeFjKbRmFnVW/nzS9alMpv/ZxMuga3uXFrODV9Q3otcs4LG 1xSpJQXZjmY9gff7KY/rXaeog4aBG3IAC4BAHcsdxOJ/gtN6u6Xd X-Google-Smtp-Source: AGHT+IFNxGeyS/e9G7vu54oLE+LRxx/BWTRGl7NAxHDYgttUtlGMCfcpfrwSJObJF5tQWV1ridf/zw== X-Received: by 2002:a05:6402:538e:b0:5e8:bf8b:4396 with SMTP id 4fb4d7f45d1cf-5f32c455309mr827869a12.13.1744262877441; Wed, 09 Apr 2025 22:27:57 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com; h=ARLLPAJIKYYk5+12MbzAtUty0SoYK2GDeDX2IpmIBaTQP26q+g== Received: by 2002:a50:ab14:0:b0:5dc:d1a6:1880 with SMTP id 4fb4d7f45d1cf-5f32765091als404159a12.2.-pod-prod-07-eu; Wed, 09 Apr 2025 22:27:55 -0700 (PDT) X-Received: by 2002:a05:6402:274c:b0:5e0:9252:3550 with SMTP id 4fb4d7f45d1cf-5f32c42e29fmr679851a12.2.1744262874755; Wed, 09 Apr 2025 22:27:54 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1744262874; cv=none; d=google.com; s=arc-20240605; b=QCrs56ZJ4cwcmtELc8+yK04zvaLLdbtKQiu+NGeRPhynyUA1b7qqqFzl20qUdeTMga xmF13KkG/fVIJjlgljbA450aoKoeLLv/dlVlvjHUVQkzQkqJsXOBOeJjc1dO6664hj/D BOoKVDi4VujIm/nJYqXK5Gevq27CzJF4tKf7yYnXvR2euQVzpPfI6tblBYxVNG9NoX2W 3dCP7+4MqC9ZLsjyUxybZOkO469YRctTvKvegnrSFplsiFG/GWQPWKGxES+GbgkgcA60 4fOdDnxcK1fCmmDrIfDgVsF3Q18JOIG1jM1LqszB+CzPO+gigVj1+knQT3Vj/1Nrckjb 2BRA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=feedback-id:content-transfer-encoding:mime-version:message-id:date :subject:cc:to:from:dkim-signature; bh=q3TRnSCSkHR99cAJJqo7aslJVrSyDRWLO6fHP/sZWbw=; fh=ihiGjvo7NUvpz5Iu2nNH4iKRnWbkT1eQ96FbYrmsmqY=; b=gsAyCG0kQJn9rDS/wur7+3gLxSF5bL3xIWGlrGciRmdsGrwBVcp5wuAlV43wkeAW9I a8db+lOOX00aeo6JhYzM1G1sWU5nN0iTAeisJQ6cilIq8JdkBCzjE6Zz6dom3AZUVOPF lwGat81MyIdjSY/D6MgqYbPihVNCM3iPTLgl5PoHoj1l8wPbwy2+AMHzmWBS5WrZ8lLQ TG6n1jnERC0nxPx4GOSHhnfrt1UJwmXNhDZs39eG93x4SukQUZJl9x6kn0DY32oJUGET QrGPKVZn+MosUfsyLU57H2vpdevByuY0/pbdTK3upkIv1uAPdHRwHderzECjcoTznlzM ouzg==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm2 header.b=KUOsWkOr; spf=pass (google.com: domain of fm-1321639-202504100527542323b3dd088583a57e-ptwbwf@rts-flowmailer.siemens.com designates 185.136.65.228 as permitted sender) smtp.mailfrom=fm-1321639-202504100527542323b3dd088583a57e-ptwBwf@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com Received: from mta-65-228.siemens.flowmailer.net (mta-65-228.siemens.flowmailer.net. [185.136.65.228]) by gmr-mx.google.com with ESMTPS id 4fb4d7f45d1cf-5f2fbbac511si82322a12.1.2025.04.09.22.27.54 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 09 Apr 2025 22:27:54 -0700 (PDT) Received-SPF: pass (google.com: domain of fm-1321639-202504100527542323b3dd088583a57e-ptwbwf@rts-flowmailer.siemens.com designates 185.136.65.228 as permitted sender) client-ip=185.136.65.228; Received: by mta-65-228.siemens.flowmailer.net with ESMTPSA id 202504100527542323b3dd088583a57e for ; Thu, 10 Apr 2025 07:27:54 +0200 From: "'Felix Moessbauer' via isar-users" To: isar-users@googlegroups.com Cc: adriaan.schmidt@siemens.com, cedric.hombourger@siemens.com, Felix Moessbauer Subject: [PATCH 0/2] Significantly speedup image generation Date: Thu, 10 Apr 2025 07:27:49 +0200 Message-Id: <20250410052751.3835154-1-felix.moessbauer@siemens.com> MIME-Version: 1.0 X-Flowmailer-Platform: Siemens Feedback-ID: 519:519-1321639:519-21489:flowmailer X-Original-Sender: felix.moessbauer@siemens.com X-Original-Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm2 header.b=KUOsWkOr; spf=pass (google.com: domain of fm-1321639-202504100527542323b3dd088583a57e-ptwbwf@rts-flowmailer.siemens.com designates 185.136.65.228 as permitted sender) smtp.mailfrom=fm-1321639-202504100527542323b3dd088583a57e-ptwBwf@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com X-Original-From: Felix Moessbauer Reply-To: Felix Moessbauer Content-Type: text/plain; charset="UTF-8" Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-Spam-Status: No, score=-4.9 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,MAILING_LIST_MULTI, RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H2,RCVD_IN_RP_CERTIFIED, RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-TUID: G9PZk1Id5tDr Especially on non native machines, the image generation can take a long time. This is due to the fact that the initrd is generated during the rootfs installation. By that, also the initrd is generated multiple times, despite only one final version is needed. In case of a out-of-rootfs initrd, it is built 5 times (2x in rootfs, 2x in initramfs +1x manually in initramfs). We optimize this by manually controlling when the initrd is built instead of relying on the triggers from the initramfs-tools. As initramfs-tools does not provide a conf.d style mechanism to completely disable the generation, we now install this package during bootstrap and then stub the update-initramfs calls during rootfs installation. In rootfs_postprocess, we restore the original update-initramfs calls and build the initrd manually. Changes since RFC v3: - Use path-injection during do_packages_install to replace the update-initramfs script - No need to add packages to bootstrap - The initrd stub is deployed and removed in do_rootfs_install. By that, the clean rootfs is deployed into the sstate cache Changes since RFC v2: - Complete re-design of approach to better integrate with sstate cache - Unify logic in rootfs.bblcass and initramfs.bbclass Best regards, Felix Felix Moessbauer (2): delay creation of initrd until end of rootfs install report approximate progress during initrd generation meta/classes/image.bbclass | 17 ++--- meta/classes/initramfs.bbclass | 39 +--------- meta/classes/rootfs.bbclass | 72 ++++++++++++++++++- meta/lib/rootfs_progress.py | 33 +++++++-- .../sbuild-chroot/sbuild-chroot.inc | 1 + 5 files changed, 106 insertions(+), 56 deletions(-) -- 2.39.5 -- You received this message because you are subscribed to the Google Groups "isar-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to isar-users+unsubscribe@googlegroups.com. To view this discussion visit https://groups.google.com/d/msgid/isar-users/20250410052751.3835154-1-felix.moessbauer%40siemens.com.