From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Wed, 23 Apr 2025 14:44:16 +0200 X-Sieve: CMU Sieve 2.4 Received: from mail-ed1-f56.google.com (mail-ed1-f56.google.com [209.85.208.56]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 53NCiF6U011670 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Wed, 23 Apr 2025 14:44:15 +0200 Received: by mail-ed1-f56.google.com with SMTP id 4fb4d7f45d1cf-5f62fb80999sf5369556a12.3 for ; Wed, 23 Apr 2025 05:44:15 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1745412250; cv=pass; d=google.com; s=arc-20240605; b=LR+Pw59oAahCS+wyz+/1oZgJEcHL8b+v3k7ZUV/Quw0yEd4U0j5Duw+fWBb96m+DmY A+75+eySV3D3v+rERbLApYWopeXZa8B8bRLnTtDrod4sXKHADtTH2cemodvOvi8qHONp B4almZOBDhdNMyeU8qvOeTzqqjhrIVuWfJVcpzv/gb97YhtsoxnEJ2SU3yck7pMYOPqI DAcn4mGiTAU8GE5cq44nB/KGURdKg1rEQ1MIEnZKTINPp8Gh/DbJwJYi7wwUq3fK3Z2U QWJG3qQOE1h3FoUQqO4W1UrihDltv3FENqGpD+gxp79qV7CS9mZFK2+sfE7oNam4xvXi PyLQ== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to:feedback-id:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :dkim-signature; bh=t5edAy4yFNmFWmYFwaBG027bNLZyJJwgqu307084pZA=; fh=GD1y9kLESFv8XYMbNwhM8+DZk/7eHyB7bjp4FVCkWdo=; b=OWwEuIMuvcZgAdKY7o2SNZCje+H3975pFmD+jhYF2ht9T5hJTgxbHECOEgYfcvU6fd QqiDJ50a8FmKWIhKwuP67SGCZGL4nEy6R80OBfrL3RndjEVR3G248my3P/PER34kqDea TtR2DnjIrSVmQAPoDVOWLMktk+o1WUuX3WtJX3rRHkom9hVGn9zqe+OgiKuSSK2R8k1H +jjWAzWkAKzSmvALPuYDOqBG5Mu0bhW9IMYkj0Jnze7KLuA/fCGH5gBM5sW3SWGbMbxU iL6oLK7zQ3JrnmT8z1+dDAYoBV906Zs+Gb1tVX00rxMW7Dvk6KdV/HpA0rgLRAUpCIJl Dehw==; darn=ilbers.de ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm2 header.b=eD0nlK9V; spf=pass (google.com: domain of fm-1321639-202504231244058ce314500f709e708a-gfsaf1@rts-flowmailer.siemens.com designates 185.136.64.227 as permitted sender) smtp.mailfrom=fm-1321639-202504231244058ce314500f709e708a-gFSaF1@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1745412250; x=1746017050; darn=ilbers.de; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :mime-version:references:in-reply-to:message-id:date:subject:cc:to :from:from:to:cc:subject:date:message-id:reply-to; bh=t5edAy4yFNmFWmYFwaBG027bNLZyJJwgqu307084pZA=; b=PTu1JKDQYoLg0/IaQ0jpUcqBeYfpuPEQ5e8LbNBebwDPiow3rjSX7fzbandD99zIwA GzB1/o/0AhIpnUMLiYhf7EkQor5d13ozD8fjXThMjKO8UfCUaRlPmYoKOSjsqbvYhsjp Cb3r9yy1E0ekxqA1cW56aNcJuujFddnLZ6/vVX7VCYEE8Jd2+jtHg/orUwzVeZhEl8Ea KOz8FNpaoCOfMKUucZmEBqOLhN1ZSdwkGcv2Ruv53i/ee6V1mudKe/KtmHMiiNreqToG jJ57Y+SITiQIXzmwqmrBLRvoJOpXDbmhpeplpkLepGqB5xe7Io+5Lp1rTeNYfsJ2WCtj F0yg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1745412250; x=1746017050; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :mime-version:references:in-reply-to:message-id:date:subject:cc:to :from:x-beenthere:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=t5edAy4yFNmFWmYFwaBG027bNLZyJJwgqu307084pZA=; b=CWigUhFewYYGJszhcqJNTByVtsn7vzi2chY2dEOkSNZQQdN7ZlFNtHM264UPnRGJ7Y vBniouF5xfFxm100Mt/02xETNke6xpVXCFfkV2BVLChzIbNdMX+Kw+35pth0dKZLQSEU n3WBJh8Vw/w8baN3UjXjW/SE7w9V1B2iTOdrDBtuv/I2kdVvrOVv/XRskf6RzX2pdi5D LC54IP+6/8uO8YihR1nQRUP53jbXFJWM9ZU02kTEcakQZ/knGzXCLU1X3FoHfkFUscky zIA5rR2zHRq32WrOVTgME27zJSWhMaH2NrfJbIPaUD1+ZvoZtU+hIzz5Mx8s83RreI3D vtog== X-Forwarded-Encrypted: i=2; AJvYcCUbInzso5131ZbiEb5AmFXJwOAVQ9AKvoEO42cQe+r0tpOyX/tcUAHtBZdIPSEXTNFI+qrB@ilbers.de X-Gm-Message-State: AOJu0YyaA64rmSeCLSfNLhutMZzrV3BlzMJ7I9759rb7+Tx1IWo2gTCb beUKV1casOoYxiBBnWupCkz8U4kdi2NAaQOOkMK520tfBpjb7tGU X-Google-Smtp-Source: AGHT+IHmeTwPZGFJ/XNzktWfeIRkacI2ximTZ5vrPj6c0RhnXxBmk9jG0eTVDFmjUrI1QTV/RGPz3g== X-Received: by 2002:a05:6402:40cf:b0:5f4:cad5:360f with SMTP id 4fb4d7f45d1cf-5f6285d430dmr17237115a12.28.1745412249182; Wed, 23 Apr 2025 05:44:09 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com; h=ARLLPAJpA9k1rbqEsu4U4D0G70TdW9s6LQUg3giemLOna2LIrg== Received: by 2002:a05:6402:42c8:b0:5dc:cf28:2128 with SMTP id 4fb4d7f45d1cf-5f6b4f88bfals169167a12.0.-pod-prod-03-eu; Wed, 23 Apr 2025 05:44:06 -0700 (PDT) X-Received: by 2002:a05:6402:13ce:b0:5e6:de5:312f with SMTP id 4fb4d7f45d1cf-5f6285a89e4mr16260393a12.23.1745412246288; Wed, 23 Apr 2025 05:44:06 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1745412246; cv=none; d=google.com; s=arc-20240605; b=RzdkKRzckGuiKJOEQ2Zf490SpwD7ui3VkcB69bQp20tC4oJsvUg3aKwwRKowQCQViS xZP717rF1tg6+tRrYLKiN3Jo9JGeLO48s9orcqIOU+yr3rf7/nuVWK9BMmH3KSHqs08t YxbKwf3VAmCDxu2no1FFkKpfcCikuMW/r3WXd76VyW+NRH7JzfGLCCzuSwQzZFMQe8zH GSsZ3NDI7CDeKhql0rOoDlQPbZ5+tiEbC5/lSNUXl/3fdrCbT/zSf4EUdz3YHD7vfydx 0vQi6SUUioxvmadwPudUeLX5fEV+o+B9mufH1ai+z/jmXhtkzIIsNKOgIAJAov2BxYTH dOXQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=feedback-id:content-transfer-encoding:mime-version:references :in-reply-to:message-id:date:subject:cc:to:from:dkim-signature; bh=vVVAObvm+npG1BgVLJffsHmP8s57zQVpO2J5vj9c9pw=; fh=ihiGjvo7NUvpz5Iu2nNH4iKRnWbkT1eQ96FbYrmsmqY=; b=KeH5ITjqIFgbDeo2i9qRNZ9VNURK4a3PScpnWL4eAdshAuGKsc61SDOrE9glGfJWSG PMen7bwFf7euAWJRoccZPzyfq+P6L+eQdLlOmFVHjFo8JwaQ7B8MYuVNgg7IDbeuGa+o Z/te29R90CowqBdGuchXgJbVuHgHN8+thHtFxKmPPh8UB1d2c/9cTc2R8S8CDuDHzKx1 GopVKR2MfoG2PZD6/sDBXbTTESPTCQuW6Z7qtYM+A2d3XdJuJ8HoMzIju+vWfkQKMMR5 qcoOKjU5TgcQzNrSnpYoCEtBiyY3x2QQCL9HLTQvCbv5dxaGUdKGnS6jvTev8A0zopFq 7/qQ==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm2 header.b=eD0nlK9V; spf=pass (google.com: domain of fm-1321639-202504231244058ce314500f709e708a-gfsaf1@rts-flowmailer.siemens.com designates 185.136.64.227 as permitted sender) smtp.mailfrom=fm-1321639-202504231244058ce314500f709e708a-gFSaF1@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com Received: from mta-64-227.siemens.flowmailer.net (mta-64-227.siemens.flowmailer.net. [185.136.64.227]) by gmr-mx.google.com with ESMTPS id 4fb4d7f45d1cf-5f6258343edsi427225a12.4.2025.04.23.05.44.06 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 23 Apr 2025 05:44:06 -0700 (PDT) Received-SPF: pass (google.com: domain of fm-1321639-202504231244058ce314500f709e708a-gfsaf1@rts-flowmailer.siemens.com designates 185.136.64.227 as permitted sender) client-ip=185.136.64.227; Received: by mta-64-227.siemens.flowmailer.net with ESMTPSA id 202504231244058ce314500f709e708a for ; Wed, 23 Apr 2025 14:44:06 +0200 From: "'Felix Moessbauer' via isar-users" To: isar-users@googlegroups.com Cc: adriaan.schmidt@siemens.com, cedric.hombourger@siemens.com, Felix Moessbauer Subject: [PATCH v2 2/2] report approximate progress during initrd generation Date: Wed, 23 Apr 2025 14:43:59 +0200 Message-Id: <20250423124359.1081781-3-felix.moessbauer@siemens.com> In-Reply-To: <20250423124359.1081781-1-felix.moessbauer@siemens.com> References: <20250423124359.1081781-1-felix.moessbauer@siemens.com> MIME-Version: 1.0 X-Flowmailer-Platform: Siemens Feedback-ID: 519:519-1321639:519-21489:flowmailer X-Original-Sender: felix.moessbauer@siemens.com X-Original-Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm2 header.b=eD0nlK9V; spf=pass (google.com: domain of fm-1321639-202504231244058ce314500f709e708a-gfsaf1@rts-flowmailer.siemens.com designates 185.136.64.227 as permitted sender) smtp.mailfrom=fm-1321639-202504231244058ce314500f709e708a-gFSaF1@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com X-Original-From: Felix Moessbauer Reply-To: Felix Moessbauer Content-Type: text/plain; charset="UTF-8" Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-Spam-Status: No, score=-4.9 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,MAILING_LIST_MULTI, RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H2,RCVD_IN_RP_CERTIFIED, RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-TUID: OcofPO/GKUu5 On non native architectures, the initrd generation has to be emulated. In combination with kernels that provide many modules (like the distro kernels), this leads to long initrd build times. To give a rough estimation of the duration, we add progress reporting to that step. As we always build the initrd with MODULES=most, we know from experiments, that ~50% of the kernel modules of the rootfs are included in the initrd. We use that number as a guesstimate, as we don't have precise numbers when starting the task. Signed-off-by: Felix Moessbauer --- meta/classes/rootfs.bbclass | 6 ++++++ meta/lib/rootfs_progress.py | 33 ++++++++++++++++++++++++++++----- 2 files changed, 34 insertions(+), 5 deletions(-) diff --git a/meta/classes/rootfs.bbclass b/meta/classes/rootfs.bbclass index fd6bb24a..ab30ab91 100644 --- a/meta/classes/rootfs.bbclass +++ b/meta/classes/rootfs.bbclass @@ -454,6 +454,10 @@ do_generate_initramfs[sstate-outputdirs] = "${DEPLOY_DIR_IMAGE}" python do_generate_initramfs() { bb.build.exec_func('rootfs_do_mounts', d) bb.build.exec_func('rootfs_do_qemu', d) + + progress_reporter = bb.progress.ProgressHandler(d) + d.rootfs_progress = progress_reporter + try: bb.build.exec_func('rootfs_generate_initramfs', d) finally: @@ -468,7 +472,9 @@ rootfs_generate_initramfs[progress] = "custom:rootfs_progress.InitrdProgressHand rootfs_generate_initramfs() { if [ -n "$(sudo find '${ROOTFSDIR}/boot' -type f -name 'vmlinu[xz]*')" ]; then sudo -E chroot "${ROOTFSDIR}" sh -c '\ + mods_total="$(find /usr/lib/modules -type f -name '*.ko*' | wc -l)"; \ export kernel_version=$(basename /boot/vmlinu[xz]-* | cut -d'-' -f2-); \ + echo "Total number of modules: $mods_total"; \ echo "Generating initrd for kernel version: $kernel_version"; \ update-initramfs -u -v -k "$kernel_version";' if [ -n "${INITRD_DEPLOY_FILE}" ]; then diff --git a/meta/lib/rootfs_progress.py b/meta/lib/rootfs_progress.py index f808852f..1cc70c87 100644 --- a/meta/lib/rootfs_progress.py +++ b/meta/lib/rootfs_progress.py @@ -28,14 +28,16 @@ class PkgsProgressHandler(bb.progress.ProgressHandler): self._linebuffer = self._linebuffer[breakpos:] if self._stage == 'prepare': - match = re.search( - r'^([0-9]+) upgraded, ([0-9]+) newly installed', line) - if match: - self._num_pkgs = int(match.group(1)) + int(match.group(2)) - self._stage = 'post-prepare' + self.process_total(line) else: self.process_line(line) + def process_total(self, line): + m = re.search(r'^([0-9]+) upgraded, ([0-9]+) newly installed', line) + if m: + self._num_pkgs = int(m.group(1)) + int(m.group(2)) + self._stage = 'post-prepare' + def process_line(self, line): return @@ -65,3 +67,24 @@ class PkgsInstallProgressHandler(PkgsProgressHandler): progress = 99 * (self._pkg + self._pkg_set_up) / (self._num_pkgs * 2) self._progress.update(progress) + + +class InitrdProgressHandler(PkgsProgressHandler): + def __init__(self, d, outfile, otherargs=None): + super().__init__(d, outfile) + + def process_total(self, line): + m = re.search(r'^Total number of modules: ([0-9]+)', line) + if m: + # in MODULES=most mode, we install ~half of all modules + self._num_pkgs = int(m.group(1)) // 2 + self._stage = 'post-prepare' + + def process_line(self, line): + if line.startswith('Adding module'): + self._pkg += 1 + elif line.startswith('(excluding'): + self._pkg += len(line.split(' ')) - 1 + else: + return + self._progress.update(99 * self._pkg / self._num_pkgs) -- 2.39.5 -- You received this message because you are subscribed to the Google Groups "isar-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to isar-users+unsubscribe@googlegroups.com. To view this discussion visit https://groups.google.com/d/msgid/isar-users/20250423124359.1081781-3-felix.moessbauer%40siemens.com.