From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Wed, 09 Apr 2025 13:29:16 +0200 X-Sieve: CMU Sieve 2.4 Received: from mail-wr1-f64.google.com (mail-wr1-f64.google.com [209.85.221.64]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 539BTFtA005632 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Wed, 9 Apr 2025 13:29:15 +0200 Received: by mail-wr1-f64.google.com with SMTP id ffacd0b85a97d-39123912ff0sf2864055f8f.2 for ; Wed, 09 Apr 2025 04:29:15 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1744198150; cv=pass; d=google.com; s=arc-20240605; b=Dfo4TgQQ7CTldCK4tVGzBu22tZQiPwM02mT0iqKiKKdT5dEEHj1nV9bnzySR33sdAD FBEBDvpE/FopAi8uWY5VEnTVbtyLiP+/rHdNtg/tmXMUWXelM4wPjULe3KmYcGoQ8qVN 2jE67OpYsKENByPi7IMS39kGT/xXFf7U99M37c9qIT20xjrCTzloa1PPp8+MQlsoVvHG cKfTTjNRPloaZKOTobqFK3Fah8W+rRGjF68ejt7V3OCTcN6KO+UAhW0oxNQ4QnNXt1M5 +61wLB60S3x9dc/3iOj0QDcu/q4D3Kf5To9x04aRsiyNi0Ol8UHgc4z3wcJ01lnytt80 DGfw== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to:feedback-id:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=Hm6NwLhF1LCwp0q5LEQfojXI9ObDSBbDvnCrt6U0r9E=; fh=vIbbFFNXnEBwt3pKcULEA6eEZInQv93EAVUzhOYBJnM=; b=kPBlD5c8o7IPJ7SMCimskKf43Ie+6vhWcZEJVtlWFi5r1kCh8lLDvcFXd1enx5lyaE 5I07x7JP9DuDcG2WOw4/l26rLFSA4xiOaswqSLe63E5+Gyk3kU4ctiisupiSNJQvDvfj tigmU9lnH583YY/OWYzVdShvpjif82ROKSVfY2Dy8cYjCB5l8gf9lQ6qCyDHH2Ui6pqV mNJWtFe6DKaKJJXpKbBBwbrP1+MZR7+geH5jVrJSttxuL9zfcpIfB8R79Y9o5zkrg8Lk tcNbj/ZOsYndmC9Tn/sSJo4T8OrjiRY5ScMGO7+3LDdSSgCsXZf3MYzd5AyQ9HzQgQml erNg==; darn=ilbers.de ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm2 header.b=eVUTQegA; spf=pass (google.com: domain of fm-1321639-20250409112906b43cc2050ee5f34560-h5uyw3@rts-flowmailer.siemens.com designates 185.136.64.226 as permitted sender) smtp.mailfrom=fm-1321639-20250409112906b43cc2050ee5f34560-h5uYW3@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1744198150; x=1744802950; darn=ilbers.de; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :mime-version:message-id:date:subject:cc:to:from:from:to:cc:subject :date:message-id:reply-to; bh=Hm6NwLhF1LCwp0q5LEQfojXI9ObDSBbDvnCrt6U0r9E=; b=tP23s/mHLwOUNi35PQn1BMXJKIpXUIcwPonctRdqs2SKZa96TwlPUIuEuXiOpFmwds kI8jcsryzKs56vgrV4mDyVSUeD2UDYM+hfH2ox+9nBLe6lyNbKMhv3sF7be2+guH94aB MlPGeTmsmqkH+tTVX3Q60TdxASEY9xrFU8wE8gENyf9Fa5PA3Py01uowEFUh6k70+4yM C3OqHfjo/qieagNGPgkLdQ5LI/wM/aSNhoORHsXuipnuljlvZ7nq2Daaa9mLa0UpkTnV ZWfY4wRX1vfhAnaZlHrHpnpjFIOv9VZ5IaWYdJQax/UXAwfyDDdXWUT3GtMYPu5BP735 xdJg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1744198150; x=1744802950; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :mime-version:message-id:date:subject:cc:to:from:x-beenthere :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=Hm6NwLhF1LCwp0q5LEQfojXI9ObDSBbDvnCrt6U0r9E=; b=Bn8h/mzjRyhQ+2EkAYc3qpgeWCimulABTzBNbVfYUGuzSZh9bxRwAN5Bp+r68Ke19+ fMzN5RVygZa93DgpYlw9Vd40Gg3S5jq8L43ci2Cjx5z5gxy1qodIpWRA29hKFLTk0In6 Pc88QX4u0rBHqCDIbgiA7cHsqBeO1QST531f9PpI+7uCBpyJiWYojT9+kyLBbQyVBCh/ g9SD2FHAZfHqm2Px+OeFgGNjtyZq1aamdmDNCpuiGJw/WwU6vPH0XwD5UAxjWcjuifw4 JJslMDAOCRqP9C+EfakD6yhITQLUPYCWk3cNwcRTeL7MD8nFydfMnUxseMu4rfIMqE6c RwHw== X-Forwarded-Encrypted: i=2; AJvYcCUNg6V5Zxx9zA0P2nCGzorM4mbJVutkrorDNxUmv+KEUiNdBoV4VJWj3wZsogsa1a7alzKc@ilbers.de X-Gm-Message-State: AOJu0YwWcS7cc55xyFQ1SV+RC69JC7Rxg7yBPHO0haZYuBhws3xs+OQJ CeQfudrD6oEhK9EeY+ZaXn0oe2Gfok2uCf9og2bOfqvtuAi3zoVk X-Google-Smtp-Source: AGHT+IEO96p/VbUlfdDRTb/Qjx3xUBQ969YuNg7C+rj3db28NE4PPWhweJAaX2ZnsUhMfqQaEf6edA== X-Received: by 2002:a05:6000:4009:b0:391:3cb7:d441 with SMTP id ffacd0b85a97d-39d87ab6642mr1847870f8f.25.1744198149571; Wed, 09 Apr 2025 04:29:09 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com; h=ARLLPAJIhWR9X0O1kUWIl4Lx6pNBQVz9l9lV4zveOU4fAF0e8w== Received: by 2002:a7b:cc94:0:b0:43c:f19c:87b2 with SMTP id 5b1f17b1804b1-43f29d7be5als491745e9.0.-pod-prod-08-eu; Wed, 09 Apr 2025 04:29:07 -0700 (PDT) X-Received: by 2002:a05:6000:1886:b0:391:2ab1:d4c2 with SMTP id ffacd0b85a97d-39d87cd34a4mr2005458f8f.37.1744198146627; Wed, 09 Apr 2025 04:29:06 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1744198146; cv=none; d=google.com; s=arc-20240605; b=C/UAg5Ez4e0St/zR+IRc+ccz4HPKEJc7LKP+ZIY9mQeUlTIxpXIE68oOctBTQUkdBS K2nrfJowNjqcjg20Dpq/wwlwDqStCxusF2CUAsW1JCmcAKIPnf23h7tibkXNweJgywOp wAas0QF1NQFWH790s5gUgQhe8BQTaEFK/sdMBphYUImL8iy6FtNZWCZkghWVuxQi8oSo aj877XLvwbBud6tkXs+4O0ZfD1vJ+ORcHdn2pFQyOxZtYvTvfkF444OZVasduyrhz9P0 HnaMQetyYZLnmJ6I9iwimNB1TLALpWuTxuouNm5rzCBKiAfgGVu78QWT6+XufXgptKwz 45Cw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=feedback-id:content-transfer-encoding:mime-version:message-id:date :subject:cc:to:from:dkim-signature; bh=NRczMLqcb4/Q4vsL329mNu8QY4s06visqyHqgEno4no=; fh=ihiGjvo7NUvpz5Iu2nNH4iKRnWbkT1eQ96FbYrmsmqY=; b=B4mRPBaaKafSQsX/Ilr5EZuiRNX97sKAYw0Vk9iytjVTV+Pko60PBC746Aot7+wPTP jTtDiPDB+7TKLB/dHRElRCEtw8/J0pCcNLANms2n35KTa6C5DGpPxj1Wi9XQUuHfCy7H fsh8EhENq4G5mJS42RGKAj77XTqaWZ98JX6uO1mcveJ130P0jspPs/C72keb/kOCiQkF qGqbCu6ly3dDFSQoeT3OTqLEteXbAwfIUGhB4NRwCgNjAEk45hR7UyfKtIhEZaARdSJI VXNFzoEgJqeiK2zrtjV7mdQYqk/2hXNMZ3YHDaQboCWNh9XTWYNaGC7ScxwaoE09PLd4 +hEw==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm2 header.b=eVUTQegA; spf=pass (google.com: domain of fm-1321639-20250409112906b43cc2050ee5f34560-h5uyw3@rts-flowmailer.siemens.com designates 185.136.64.226 as permitted sender) smtp.mailfrom=fm-1321639-20250409112906b43cc2050ee5f34560-h5uYW3@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com Received: from mta-64-226.siemens.flowmailer.net (mta-64-226.siemens.flowmailer.net. [185.136.64.226]) by gmr-mx.google.com with ESMTPS id 5b1f17b1804b1-43f233b7d71si209695e9.2.2025.04.09.04.29.06 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 09 Apr 2025 04:29:06 -0700 (PDT) Received-SPF: pass (google.com: domain of fm-1321639-20250409112906b43cc2050ee5f34560-h5uyw3@rts-flowmailer.siemens.com designates 185.136.64.226 as permitted sender) client-ip=185.136.64.226; Received: by mta-64-226.siemens.flowmailer.net with ESMTPSA id 20250409112906b43cc2050ee5f34560 for ; Wed, 09 Apr 2025 13:29:06 +0200 From: "'Felix Moessbauer' via isar-users" To: isar-users@googlegroups.com Cc: adriaan.schmidt@siemens.com, cedric.hombourger@siemens.com, Felix Moessbauer Subject: [RFC v3 0/2] Significantly speedup image generation Date: Wed, 9 Apr 2025 13:28:45 +0200 Message-Id: <20250409112847.3395116-1-felix.moessbauer@siemens.com> MIME-Version: 1.0 X-Flowmailer-Platform: Siemens Feedback-ID: 519:519-1321639:519-21489:flowmailer X-Original-Sender: felix.moessbauer@siemens.com X-Original-Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm2 header.b=eVUTQegA; spf=pass (google.com: domain of fm-1321639-20250409112906b43cc2050ee5f34560-h5uyw3@rts-flowmailer.siemens.com designates 185.136.64.226 as permitted sender) smtp.mailfrom=fm-1321639-20250409112906b43cc2050ee5f34560-h5uYW3@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com X-Original-From: Felix Moessbauer Reply-To: Felix Moessbauer Content-Type: text/plain; charset="UTF-8" Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-Spam-Status: No, score=-4.9 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,MAILING_LIST_MULTI, RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H2,RCVD_IN_RP_CERTIFIED, RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-TUID: TXf5PDxYlVKo Especially on non native machines, the image generation can take a long time. This is due to the fact that the initrd is generated during the rootfs installation. By that, also the initrd is generated multiple times, despite only one final version is needed. In case of a out-of-rootfs initrd, it is built 5 times (2x in rootfs, 2x in initramfs +1x manually in initramfs). We optimize this by manually controlling when the initrd is built instead of relying on the triggers from the initramfs-tools. As initramfs-tools does not provide a conf.d style mechanism to completely disable the generation, we now install this package during bootstrap and then stub the update-initramfs calls during rootfs installation. In rootfs_postprocess, we restore the original update-initramfs calls and build the initrd manually. Changes since v2: - Complete re-design of approach to better integrate with sstate cache - Unify logic in rootfs.bblcass and initramfs.bbclass Best regards, Felix Felix Moessbauer (2): delay creation of initrd until end of rootfs install report approximate progress during initrd generation meta/classes/image.bbclass | 17 ++--- meta/classes/initramfs.bbclass | 39 +---------- meta/classes/rootfs.bbclass | 70 +++++++++++++++++++ meta/lib/rootfs_progress.py | 33 +++++++-- .../isar-bootstrap/isar-bootstrap.inc | 2 + .../isar-mmdebstrap/isar-mmdebstrap.inc | 2 + .../sbuild-chroot/sbuild-chroot.inc | 1 + 7 files changed, 109 insertions(+), 55 deletions(-) -- 2.39.5 -- You received this message because you are subscribed to the Google Groups "isar-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to isar-users+unsubscribe@googlegroups.com. To view this discussion visit https://groups.google.com/d/msgid/isar-users/20250409112847.3395116-1-felix.moessbauer%40siemens.com.