From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Thu, 06 Nov 2025 11:10:33 +0100 X-Sieve: CMU Sieve 2.4 Received: from mail-lf1-f60.google.com (mail-lf1-f60.google.com [209.85.167.60]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 5A6AAWFY025507 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Thu, 6 Nov 2025 11:10:33 +0100 Received: by mail-lf1-f60.google.com with SMTP id 2adb3069b0e04-59449c01c3esf105743e87.3 for ; Thu, 06 Nov 2025 02:10:33 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1762423827; cv=pass; d=google.com; s=arc-20240605; b=IP48rMypbDSkRa+P3xPOpptp8QOr1pWI3+4IjZ7AHCZpjJdCEy1PYNf4oN7Ku2AQgf 7Twm8DNxDjPI0gHfiygiICS/mHPYYRqDTYeqAmtDBjSFuXJkLxwZu2wNXzqu3/ztFgUj ZT68K0MMZlt9XXr2x3WubGF2S7RKsPDghj33rqOkAEYDQV7ToeQ+kJiK+siQEquAaDuw 2oNQC1bNyGcg0Zt32U5nlJGudlD1Ev3LcHp9NZ8/FAqQ4B4tFwZtUgrFh7WE8MwBF1Uj QTsMb2rVILI80LFCJ5G84pn70WLIT3UKUtzsNYPsxqm8pvpgB2ZNrpkiLNJUAv048a4z 6x5A== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:content-transfer-encoding :in-reply-to:content-language:references:to:subject:from:user-agent :mime-version:date:message-id:sender:dkim-signature; bh=/7z/LKjFfs9o/aSbAghlGex9AsJ8kCojvXEcmrduKS4=; fh=hdltgCuUHMuG8FEVKN4zdtEtTSsb/s2oZ6o1bAFm5TE=; b=YQCbPujXj+9blu1mmliAOrLgvp1kx1VPLlFXjkQcmh8WsuxlJPJK7MwduB9oX9G5Fx +Vly8LM+N0tj3VrJ3dYX/m1M+7AsfRiObuO3afm70CZthlrTt54Qt/j6OSvzDFapYK32 MaC08KxZAFJLOBuszZPd16bm1eqZqHU8aCRk84O78l+Sa2WIWCtndYtou2CbeUMmrCMP /Mm6IWRd3sIKp0SByhwPlIaNVqQ7c5tJcGNagvnwIKiVCzNVNap9/NNndw4moosuhvnB KkJX8nxsnVWexov+wP23ywFhJsGUrGqra7SD/TVixIKOOd8f8ZmQWvluhueTh8ud+qV/ DOZg==; darn=ilbers.de ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of wzh@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=wzh@ilbers.de DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1762423827; x=1763028627; darn=ilbers.de; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:x-original-authentication-results :x-original-sender:content-transfer-encoding:in-reply-to :content-language:references:to:subject:from:user-agent:mime-version :date:message-id:sender:from:to:cc:subject:date:message-id:reply-to; bh=/7z/LKjFfs9o/aSbAghlGex9AsJ8kCojvXEcmrduKS4=; b=vBYuF07hw5Cys9FD1f5VSFrvWuAp51QgJ7Uzz5Zq0PoUsDtPGOAR9Qd1725lUaOhbT o9K/AUUscn0tcnI7JtyGVyClKAbJvDC+DCPWTLkOW2W80OfvHGgVmCgP4ksf3MoyNVxZ nUeMJR9Wuh99YiGTQCInbgDfNVai4vVmeBAxqfKFIXKVh1NZaVWa1Jhn4Mu8oTMwXJxy Eap/WeGmg9+7JdH5st7Qc6c2A7zqi9VFI9jYPUaZr0lQ28YIdQ35B0Uw5VQjFap4UmQ1 ztLqhScuXnw2CLgIG9hkO3uCTUFhrmdD35UKX+i/if8TfMmQFSKa+N3KLK57QR+oLZ3h +9Zg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1762423827; x=1763028627; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence :x-original-authentication-results:x-original-sender :content-transfer-encoding:in-reply-to:content-language:references :to:subject:from:user-agent:mime-version:date:message-id:x-beenthere :x-gm-message-state:sender:from:to:cc:subject:date:message-id :reply-to; bh=/7z/LKjFfs9o/aSbAghlGex9AsJ8kCojvXEcmrduKS4=; b=w9wRu3vBLYXpTwF/H+5Pi3bwmzMu6WXmVB+ZTG8dp4M/W4LDt50OWUkW8Di85v41vx YE3DSktm5PYs2YIDHjCmKSBR97+1jYjXaPZYzfTC9norxyVAIxh/72rey5z+L9VYu+dv zrjfHnZYNGZqEj5odfWhT5XYRLLY4BhHHScBUHqg9bPpClhy1SbIz93me2K6NCHbZL3X ICVPPzMMD7Iso6v0HDmtTQBkjmW21JnEgCmQuq/Iakq6V4v86DcropsnuRsjKWFHQlA9 bE9X1meQYO0fHxY8RVHevb4/ROxznThziYAI2jFiVaM2bqQUPzHjOyyGOXiO1O8uoG8d Sajg== Sender: isar-users@googlegroups.com X-Forwarded-Encrypted: i=2; AJvYcCWQwWIDgCbZsKxQC/Kfh6icR9sMMl0TjslmO03Dus2FxXegVY9EBzMAO2OdF8p5vdOR5w8d@ilbers.de X-Gm-Message-State: AOJu0Yy2wKgLZd4zyk44oV0s8sX7FX8/KxGNQpvhzS0DyRSRcuPbpYL+ vHjk2NikoZdJJzU9dO3OD8AvQmvE+izDxtF9DHGMqMvTnVpwMn8E1tyh X-Google-Smtp-Source: AGHT+IHT1h9PkdRKlkTvEmyx84n1xdRmrlAojdL1H0KnPL3TkdY69iAnnWK6SXhPCcvMz1lNj6b8Ug== X-Received: by 2002:a05:651c:41d4:b0:378:f0d6:8fb1 with SMTP id 38308e7fff4ca-37a514a5d23mr9194191fa.5.1762423827017; Thu, 06 Nov 2025 02:10:27 -0800 (PST) X-BeenThere: isar-users@googlegroups.com; h="Ae8XA+aX4KnKBuXox0qff8NyWV4vVeLaXH64G3NpNdtSY7K9dg==" Received: by 2002:a05:651c:438e:20b0:37a:2bed:b406 with SMTP id 38308e7fff4ca-37a5ddd82b5ls979611fa.2.-pod-prod-04-eu; Thu, 06 Nov 2025 02:10:23 -0800 (PST) X-Forwarded-Encrypted: i=2; AJvYcCX5qDYeR+p5QZW1RgjOKcKCueb/50guyiVSv7C/XZh4lj95Z/QozML5keC/SXgeAVyFBEEc45hLIZ3v@googlegroups.com X-Received: by 2002:a05:651c:31dc:b0:37a:5bc6:ab9f with SMTP id 38308e7fff4ca-37a5bc6b58dmr12143181fa.26.1762423823115; Thu, 06 Nov 2025 02:10:23 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1762423823; cv=none; d=google.com; s=arc-20240605; b=cW8ZHVEaqXg9utOmACCYPKcHFFN7sLmpGyFJKvcFxAAshAdiEn7GkhWMG6TyCLyGvP fBLCw1gUkBukzFJVtthHG/QjwdAyjsWEkDXnV2TappAdS3yks+u1B2bwgW/k6hYH5aL4 XLKeflWQE0clPcpZCzu/RuTjtlOqiVBVg2AVGCc29lTySl6riWIPV1hAy53ZVDvobL3B U9Dwi26JUY65Z4LVGQ68D0vUfbJP1S6nfEE48lWiVukLHB2i/d4lfGvad0wJYK1BJ61O 4CyMlqmpxzGux0nwM47Xn2GA+O9v6HmG6QJsmT5i7HGrzGVAzSpVfg1W7AY4Bg+RelPZ igKQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=content-transfer-encoding:in-reply-to:content-language:references :to:subject:from:user-agent:mime-version:date:message-id; bh=eYjZiQ944HpeT3qv8ODy53Z+F4S/ulgIRa3KoEAfNOw=; fh=5NSxVC+mApFXoXLSOq5LsifR6fZRAAkhAp5yZbt2WhY=; b=ZQ6S+SOpzp4Y+rBSI8mzBQXxQu6AAM+qmFZNiRbPLYxZ30zQvVpPl2M3a31G8kCyiY uFiUAJZjgub5blUF0OZ6eILSI8qi52MtuV7LIBZq7JQ71llGYBuPeqLWi+vwchx17c+4 VXOhmMqQCN7FEZHz6kp6P5CZg9/44oFHW3j+h8/Lmsl3D4B5uwB6WJvoXgnZbUOO3Va6 86E3NWL26ZzOrFxR7fwIu7xrFDfoSmOujbRSPspZ59ojowce0u2MwI/anxEh5PTCG2ua jPFNvxEJgrfyorTyjVNS7kdVcDRiZWN7GwivkXxQn1XVRaVDJoTbO0rpYwEvYIJNDknO Z8Hg==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of wzh@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=wzh@ilbers.de Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id 38308e7fff4ca-37a5f10daf9si332211fa.8.2025.11.06.02.10.22 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Thu, 06 Nov 2025 02:10:23 -0800 (PST) Received-SPF: pass (google.com: domain of wzh@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Received: from [192.168.178.117] ([88.130.203.42]) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 5A6AALGd025501 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 6 Nov 2025 11:10:21 +0100 Message-ID: Date: Thu, 6 Nov 2025 11:10:21 +0100 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird From: Zhihang Wei Subject: Re: Reminder: hotfix fast path needed To: "MOESSBAUER, Felix" , "isar-users@googlegroups.com" , "Kiszka, Jan" References: <3c21e4e1-ad2b-4510-8cf2-ba616fc166dc@siemens.com> Content-Language: en-US In-Reply-To: Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: quoted-printable X-Spam-Status: No, score=-4.6 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_EF,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H2, RCVD_IN_RP_CERTIFIED,RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-Original-Sender: wzh@ilbers.de X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of wzh@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=wzh@ilbers.de Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-TUID: b0WPtclN13MB On 10/24/25 13:23, 'MOESSBAUER, Felix' via isar-users wrote: > On Thu, 2025-10-23 at 11:05 +0000, 'MOESSBAUER, Felix' via isar-users > wrote: >> On Thu, 2025-10-23 at 12:42 +0200, Baurzhan Ismagulov wrote: >>> Hello Jan, >>> >>> On 2025-10-23 07:52, Jan Kiszka wrote: >>>> Patches that carry "Fixes:" tag and address build breakages should be = on >>>> a fast path for QA and merge. I'm pointing colleagues to [1] and [2] >>>> almost on a daily basis, but those are just two recent examples. >>>> >>>> [1]https://patchwork.isar-build.org/project/isar/patch/20251017085344.= 2647058-1-felix.moessbauer@siemens.com/ >>>> [2]https://patchwork.isar-build.org/project/isar/patch/0f16240d-aca7-4= f03-b0f7-1567c5b4c26f@siemens.com/ >>> I acknowledge the desire to have fast path for "Fixes:" and build break= ages. >>> We've merged #2. The full results for #1 will be available tomorrow. Th= ere is a >>> number of failures due to e.g. external networking issues; we'll be sha= ring >>> patches for those. >> That's one of the core problems: The test suite itself is too unstable >> and also way too complicated to be executed on each addition (actually >> tests should be executed on a per-commit level, not per patch-series >> level). >> >>> I think introducing fast path for certain changes is the easiest part o= f the >>> equation. >>> >> That's at least something which can be implemented process-wise without >> a major refactoring of the testsuite. > I again tried really hard to work with the testsuite, but this beast > has a will of its own... > > I tried executing the tests with sstate cache enabled (via the > undocumented -p sstate=3D1 option), only to find out that my > tests=C2=A0sporadically fail due to bitbake server errors (do I have to r= un > with --max-parallel-task=3D1?). Yes, "-max-parallel-task=3D1" is needed in this case.=20 "citest.py:CrossTest" is a test suite that contains multiple test cases. Running multiple test cases a= t the same time could cause failures when dependencies exist. An example to run a single test case could be: $ avocado run citest.py:CrossTest.test_cross_rpi Another issue is that running a command like: $ avocado run citest.py:CrossTest.test_cross will make avocado run all test cases whose names start with "test_cross" simultaneously. This is actually a feature of avocado. To avoid this, a=20 $ sign is needed at the end of the command: $ avocado run citest.py:CrossTest.test_cross$ I'll specify the exact command that avoids these issues when reporting CI failures. > Once done that, the CI failed because of > missing disk space (in which mountpoint?) I still have plenty of space > in the build dir. Docker does create files under /var/lib/docker, I notice it could take 10+G= B when a lot of targets are being built at the same time. > ./kas/kas-container shell kas/isar.yaml --command \ > "rm -rf /work/build/conf && /work/scripts/ci_setup.sh" > cd /work/testsuite > avocado run citest.py:CrossTest -p sstate=3D1 > > For me as a developer, the testsuite is currently not usable. I'm > willing to add tests again, once the infrastructure is ready for that. > But this requires upfront redesign. > > Felix I=E2=80=99m aware that some tests take a long time to run. For example, "citest.py:NoCrossTest.test_nocross$" includes 30 targets and can take 3=20 hours on our CI server. When a failure occurs in these tests, I'll identify the exact target that caused the failure and provide the steps to build only th= e necessary target =E2=80=94 for example, by sharing a diff file for citest.p= y that temporarily disable unrelated targets. I hope this approach will make it easier for developers to reproduce CI failures with avocado. Best, Zhihang --=20 You received this message because you are subscribed to the Google Groups "= isar-users" group. To unsubscribe from this group and stop receiving emails from it, send an e= mail to isar-users+unsubscribe@googlegroups.com. To view this discussion visit https://groups.google.com/d/msgid/isar-users/= c3db73d0-5753-41cd-a300-21bec09a0c96%40ilbers.de.