From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Thu, 10 Apr 2025 07:28:07 +0200 X-Sieve: CMU Sieve 2.4 Received: from mail-lj1-f192.google.com (mail-lj1-f192.google.com [209.85.208.192]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 53A5S68e009436 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Thu, 10 Apr 2025 07:28:06 +0200 Received: by mail-lj1-f192.google.com with SMTP id 38308e7fff4ca-30bff0c526csf1899951fa.0 for ; Wed, 09 Apr 2025 22:28:06 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1744262880; cv=pass; d=google.com; s=arc-20240605; b=CGwkfSY9/yJvhWUz7a4VZkSQ/yqNmRtewJwyy6ukIeHvvn779NomzpyG+HmP57RTax ZnOM5EI4piD0i8CY/+9loTKhsWj22iLa7LRtJLnmtb5VKG78Zyg3bzaacSY2HNQXaCQT S38+/0EiBdzRQ/TFtmBxpzYLriMmOXSBJ0jxh1WFCoIx6SQfS0BEJSBcwd0EJ/3tWto6 DT98almpLSFFtG3L8uA04/sL2+RIx5hymPBXaH4m0d3ZyHwKZE81SJCF/10fC/rD48Yd GeSDkalimFHU6QQeYeuDsGS4hGlnGJXRs8nlhnkURMtxkeOLaKWK7fd/76wW7jjgbNa9 dLUQ== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to:feedback-id:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :dkim-signature; bh=Yjze8Ey4+iuacgtl1qMzGaY89CgGrwtbQ+cN5nC57KE=; fh=N+pdcqhKLdSCIFbPXjpvL2XJ1xg2OpuFzGXxf7JYC6s=; b=gQUA9PFvgrsc+PrSQgfsdK0a0rBKQ5wsuy7tTg/5K0pzDijG1nAlH+45aZmKyb7lwJ gvqfY3IRpbUkiJAHUMvklZJ373+Rl5bXoZ9UD2YlBL7nSiDZgC8AUqQMLYPuzYW3gA5H aBmJwoygV5L0zPZHIILyyq0NP+vEfIWpOV9Z/Wixo5pimp3MF9MS/3EIqZKKTU1sn5FZ jneqF/C6DcABrMynJjqzbGx1u/NIayb1SowdJKiWImO3FBgjqWMPeJfrSa/TYINHmbcF weXTwpfi9eafaqcQahzj7/uP7DeEcbzpIFwI8jE3m8Ya13dr99Gvo7LV5nI06hAxGR/x cw+g==; darn=ilbers.de ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm2 header.b="PvwXQJp/"; spf=pass (google.com: domain of fm-1321639-20250410052754604757b2cd5f10d5f3-oa_ab3@rts-flowmailer.siemens.com designates 185.136.64.228 as permitted sender) smtp.mailfrom=fm-1321639-20250410052754604757b2cd5f10d5f3-oA_Ab3@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1744262880; x=1744867680; darn=ilbers.de; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :mime-version:references:in-reply-to:message-id:date:subject:cc:to :from:from:to:cc:subject:date:message-id:reply-to; bh=Yjze8Ey4+iuacgtl1qMzGaY89CgGrwtbQ+cN5nC57KE=; b=UEd8KSksCN+a3FkvTv2IU7uTV8h1NNB8J/BIrmjMIQhcS0ZtiFXmpcGJngyv9/du3i lIJQ8okEGehCJkpSXtgSzhIl5W03QIJAPV+EIehtJrPobfba31g7IxAm89dJwyTZHlJk KYSWP4JCytm9VF314Cv99F5z6ZpT3rOUsna4n/9qGhFIqTGfXkjdchRkoyk4cL7ACNVn 3uu/Ve6BUC6KpKZKpqfasfdno1toC+K9YNLCiB1ybhnL+Ix7nG1nx5VbvDsVt5/wwBGC F1zdaBDZogc9+7UKG2PuaDPnKP6y8p60GE/Xg7VOX2govFhL8tRctbYLjObjg93mW+BR KmXg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1744262880; x=1744867680; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :mime-version:references:in-reply-to:message-id:date:subject:cc:to :from:x-beenthere:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=Yjze8Ey4+iuacgtl1qMzGaY89CgGrwtbQ+cN5nC57KE=; b=TiXZSu98gwmMJXLtIWg0DrtXJuff1ijCw3jJkDkVnYfSYN7EqNSc8CpC+hnOd3QuVb y88LrKPSoHosbGoSdV8uahavSj9LyT6U77Qp1cliwwsHNjVtdHTX8FYRY3PN17wUxYFR KPTBojY3F8imiFQ0kB4gOd3bVCWITikmPROAvUAZtCp+jpwIiiiCr6P0NQ71apHz9wm3 kf2JQnWCi1pxf1hdQvO3trIyl28RtKvu2ojcdKYFCLUWPC9n3jJSto/ti6NYwK1MjdSW wow37wqD2OdoaSEi1Wb63P8tNVo8yy+Vx7YtOUygCxHU7dhTQNDhxbxrxLhyFR6hzMIW 74ow== X-Forwarded-Encrypted: i=2; AJvYcCXmxjie8QRShh0BfjAnnP5F0tXXLtX3Lx8w7AwvJwyYykfCojGUyJ5uaYfqfxgd8xNinFvn@ilbers.de X-Gm-Message-State: AOJu0YwpgUJ1PdBjP1DZkz3+RqDN756KCMa1hYO00ojZYBLGkNo5wW9d 5Lw7SGYTNnPGxdRc85Hv2eGiq78K5xA5VS8jselK/feAMPouk50q X-Google-Smtp-Source: AGHT+IHEZl82F6/RTr322WlCl7B6RzPYHkt3Twxhs80NRnb38xXL4feDefQ3YU/Alw3fnN++Sm10Gg== X-Received: by 2002:a05:651c:3225:b0:30c:cb7:560b with SMTP id 38308e7fff4ca-3103eacd376mr2302681fa.12.1744262879101; Wed, 09 Apr 2025 22:27:59 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com; h=ARLLPALsmKNfi2A+Z8ikcWhc1qDSjvt1csVazeuAwl87MWERQA== Received: by 2002:a2e:ab0b:0:b0:30b:f139:c898 with SMTP id 38308e7fff4ca-30f4c933a96ls1496911fa.1.-pod-prod-09-eu; Wed, 09 Apr 2025 22:27:56 -0700 (PDT) X-Received: by 2002:a05:651c:88f:b0:30b:efa5:69a8 with SMTP id 38308e7fff4ca-3103ed5bf1fmr3431291fa.36.1744262875699; Wed, 09 Apr 2025 22:27:55 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1744262875; cv=none; d=google.com; s=arc-20240605; b=W1w5e7bK7s5B46F5Nqk9K9RR9CpKUFVehV/knv5SjH+7ZALRja8letwc5XRc4U8aCM /nM636/qQZZimp21qPQqG0F37W88NpNQr0t7nhPzunVtvqUCifEjC/CJHSXVYBZeapbw mxggKmDLdrrE0/y0KkosbtaFQfUVAcGCMG/Smm9yipk4P+dxaES/lFnvoOZ9gtoHnAwd FC7WGVti7MBtqssVqCsD2BORMg+kQNJsX1sVwI4o2JEIKfJcxvMJ/iPm9bKjxWlO9D3D DSC73Mun8ih4+VAloGCWS1dQyhQ9d7DutENYj5uhLrFN6DgJYd58lDRwZr3Dpvkiua1N YgQQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=feedback-id:content-transfer-encoding:mime-version:references :in-reply-to:message-id:date:subject:cc:to:from:dkim-signature; bh=Y6NiNo5UkALfqncbE+8v4VXL6SbBRP9VTaPjaXZwJkE=; fh=ihiGjvo7NUvpz5Iu2nNH4iKRnWbkT1eQ96FbYrmsmqY=; b=OnHUf/cwJwcAkfdqIUCop0MxerS+IcmITl+d4UwtOS1CaCP8y+6K6cAlpFiyymm/zc ltIMe4c75I2tOhgVi+oqP1jSB5st7LmQs7vGoCL0UJ0BXugZ03Og9FhrM4jNIVgHvskh qlgh4vYUsFPKCL6rf/8283ADb64aI6O9i//ScP1u3tDHK5PeGVLUywpFVKdakHy+26wi RJmrHQOdbn2ZuM8vQmqs1wK3c0FeeFD0f9Nc6yG01CmnQWtc22dYEv3E0EAlQcueBtig qyCtu9z0qIVZJcyZ/CLD5wjO1CxRZpbtJ5qUoWHbkm0o1glwnCBBNo5b53Ns7BVd9Z2f H0Qw==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm2 header.b="PvwXQJp/"; spf=pass (google.com: domain of fm-1321639-20250410052754604757b2cd5f10d5f3-oa_ab3@rts-flowmailer.siemens.com designates 185.136.64.228 as permitted sender) smtp.mailfrom=fm-1321639-20250410052754604757b2cd5f10d5f3-oA_Ab3@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com Received: from mta-64-228.siemens.flowmailer.net (mta-64-228.siemens.flowmailer.net. [185.136.64.228]) by gmr-mx.google.com with ESMTPS id 38308e7fff4ca-30f465d6583si471661fa.6.2025.04.09.22.27.55 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 09 Apr 2025 22:27:55 -0700 (PDT) Received-SPF: pass (google.com: domain of fm-1321639-20250410052754604757b2cd5f10d5f3-oa_ab3@rts-flowmailer.siemens.com designates 185.136.64.228 as permitted sender) client-ip=185.136.64.228; Received: by mta-64-228.siemens.flowmailer.net with ESMTPSA id 20250410052754604757b2cd5f10d5f3 for ; Thu, 10 Apr 2025 07:27:54 +0200 From: "'Felix Moessbauer' via isar-users" To: isar-users@googlegroups.com Cc: adriaan.schmidt@siemens.com, cedric.hombourger@siemens.com, Felix Moessbauer Subject: [PATCH 2/2] report approximate progress during initrd generation Date: Thu, 10 Apr 2025 07:27:51 +0200 Message-Id: <20250410052751.3835154-3-felix.moessbauer@siemens.com> In-Reply-To: <20250410052751.3835154-1-felix.moessbauer@siemens.com> References: <20250410052751.3835154-1-felix.moessbauer@siemens.com> MIME-Version: 1.0 X-Flowmailer-Platform: Siemens Feedback-ID: 519:519-1321639:519-21489:flowmailer X-Original-Sender: felix.moessbauer@siemens.com X-Original-Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm2 header.b="PvwXQJp/"; spf=pass (google.com: domain of fm-1321639-20250410052754604757b2cd5f10d5f3-oa_ab3@rts-flowmailer.siemens.com designates 185.136.64.228 as permitted sender) smtp.mailfrom=fm-1321639-20250410052754604757b2cd5f10d5f3-oA_Ab3@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com X-Original-From: Felix Moessbauer Reply-To: Felix Moessbauer Content-Type: text/plain; charset="UTF-8" Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-Spam-Status: No, score=-4.9 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,MAILING_LIST_MULTI, RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H2,RCVD_IN_RP_CERTIFIED, RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-TUID: MBHM4CznGYNw On non native architectures, the initrd generation has to be emulated. In combination with kernels that provide many modules (like the distro kernels), this leads to long initrd build times. To give a rough estimation of the duration, we add progress reporting to that step. As we always build the initrd with MODULES=most, we know from experiments, that ~50% of the kernel modules of the rootfs are included in the initrd. We use that number as a guesstimate, as we don't have precise numbers when starting the task. Signed-off-by: Felix Moessbauer --- meta/classes/rootfs.bbclass | 6 ++++++ meta/lib/rootfs_progress.py | 33 ++++++++++++++++++++++++++++----- 2 files changed, 34 insertions(+), 5 deletions(-) diff --git a/meta/classes/rootfs.bbclass b/meta/classes/rootfs.bbclass index d49cd1ef..e0aa7377 100644 --- a/meta/classes/rootfs.bbclass +++ b/meta/classes/rootfs.bbclass @@ -454,6 +454,10 @@ do_generate_initramfs[sstate-outputdirs] = "${DEPLOY_DIR_IMAGE}" python do_generate_initramfs() { bb.build.exec_func('rootfs_do_mounts', d) bb.build.exec_func('rootfs_do_qemu', d) + + progress_reporter = bb.progress.ProgressHandler(d) + d.rootfs_progress = progress_reporter + try: bb.build.exec_func('rootfs_generate_initramfs', d) finally: @@ -468,7 +472,9 @@ rootfs_generate_initramfs[progress] = "custom:rootfs_progress.InitrdProgressHand rootfs_generate_initramfs() { if [ -n "$(sudo find '${ROOTFSDIR}/boot' -type f -name 'vmlinu[xz]*')" ]; then sudo -E chroot "${ROOTFSDIR}" sh -c '\ + mods_total="$(find /usr/lib/modules -type f -name '*.ko*' | wc -l)"; \ export kernel_version=$(basename /boot/vmlinu[xz]* | cut -d'-' -f2-); \ + echo "Total number of modules: $mods_total"; \ echo "Generating initrd"; \ update-initramfs -u -v -k "$kernel_version";' if [ -n "${INITRD_DEPLOY_FILE}" ]; then diff --git a/meta/lib/rootfs_progress.py b/meta/lib/rootfs_progress.py index f808852f..1cc70c87 100644 --- a/meta/lib/rootfs_progress.py +++ b/meta/lib/rootfs_progress.py @@ -28,14 +28,16 @@ class PkgsProgressHandler(bb.progress.ProgressHandler): self._linebuffer = self._linebuffer[breakpos:] if self._stage == 'prepare': - match = re.search( - r'^([0-9]+) upgraded, ([0-9]+) newly installed', line) - if match: - self._num_pkgs = int(match.group(1)) + int(match.group(2)) - self._stage = 'post-prepare' + self.process_total(line) else: self.process_line(line) + def process_total(self, line): + m = re.search(r'^([0-9]+) upgraded, ([0-9]+) newly installed', line) + if m: + self._num_pkgs = int(m.group(1)) + int(m.group(2)) + self._stage = 'post-prepare' + def process_line(self, line): return @@ -65,3 +67,24 @@ class PkgsInstallProgressHandler(PkgsProgressHandler): progress = 99 * (self._pkg + self._pkg_set_up) / (self._num_pkgs * 2) self._progress.update(progress) + + +class InitrdProgressHandler(PkgsProgressHandler): + def __init__(self, d, outfile, otherargs=None): + super().__init__(d, outfile) + + def process_total(self, line): + m = re.search(r'^Total number of modules: ([0-9]+)', line) + if m: + # in MODULES=most mode, we install ~half of all modules + self._num_pkgs = int(m.group(1)) // 2 + self._stage = 'post-prepare' + + def process_line(self, line): + if line.startswith('Adding module'): + self._pkg += 1 + elif line.startswith('(excluding'): + self._pkg += len(line.split(' ')) - 1 + else: + return + self._progress.update(99 * self._pkg / self._num_pkgs) -- 2.39.5 -- You received this message because you are subscribed to the Google Groups "isar-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to isar-users+unsubscribe@googlegroups.com. To view this discussion visit https://groups.google.com/d/msgid/isar-users/20250410052751.3835154-3-felix.moessbauer%40siemens.com.