From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7186996775974076416 X-Received: by 2002:a05:6512:39c7:b0:4cc:7876:9f35 with SMTP id k7-20020a05651239c700b004cc78769f35mr1355662lfu.125.1673630049876; Fri, 13 Jan 2023 09:14:09 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:6512:3681:b0:4d1:8575:2d31 with SMTP id d1-20020a056512368100b004d185752d31ls1461489lfs.0.-pod-prod-gmail; Fri, 13 Jan 2023 09:14:08 -0800 (PST) X-Google-Smtp-Source: AMrXdXsiaTKY0DpZJf3gp9QtG8uJ6abc60eMQs8VaibomqXa0t5tDuTo6J7mtvus2hj9MMlxomlD X-Received: by 2002:a05:6512:b28:b0:4ca:f42f:c6a4 with SMTP id w40-20020a0565120b2800b004caf42fc6a4mr24575327lfu.36.1673630048664; Fri, 13 Jan 2023 09:14:08 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1673630048; cv=pass; d=google.com; s=arc-20160816; b=tDyQgim62BI7YLEjIIcBafApGu4wy/z6QLQjKC4Zh/4mVrkciDtGkSnxugyU4dPCJv RkSC5F6GBWXVJBg4BBuCd/+/iHhoPjFwteiUzK2PJ4aq4EgCGLEYLXml/9qZMDS8gJ58 f9Ae8yuXzhdP962acThLidLKE814jsPUHefHDRJvr/bG4Tz75KVu1hPy86x9FV+ivrAG p7BNHV1PHxfYizf9yI1C3eZJzI/BwQDG03Boa+ElJC9cVmhpI+0D/tHs6bKTbOp+9thf tW4bPemBNAM+HqUoa0lTnOhhygNaWmkCoA3NfLH2s5AYmc2jK9eK//bZw4HKqpEXisv1 SBGQ== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:content-transfer-encoding:references:in-reply-to :message-id:subject:cc:to:from:date:dkim-signature; bh=FkAnkkSS3j6csnosUfRxcpdvsKuZqHA+ms1Levs87Vg=; b=o3/iHuoTwl1gVp17Nwp2kMaaYRTYP1DwjHaLpZdXTHvZMdGhO6hBU2rj/UYT2QZY6I Cij3oTg1Y+ubCj5zMSJS0VCMo+GWv2yHhK7HjQ4Xuya+dwJlVTKQgLCSjmhW6fqSQOzc 8fyRimhtIsbn1om5ox4Lo3BgPTtflcx/fOXdkoHlf8646bUEb85W4Wsu7po7D+JXBHaE xCRn3d6Kmur3E2ay+ye4FfY/fUcTsqsSuDoTZ89jpamqZhe31vKU/je3WlQHJejj2DaN 6V/aB9+y4CqR8d0HXLNJn5e2n8bh7xqsXj2TtpfabB6u1do6CjCdnvtDtXr4d6yhXQtD e+Rw== ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b="d9/L9o3C"; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of henning.schild@siemens.com designates 40.107.20.51 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Return-Path: Received: from EUR05-DB8-obe.outbound.protection.outlook.com (mail-db8eur05on2051.outbound.protection.outlook.com. [40.107.20.51]) by gmr-mx.google.com with ESMTPS id o16-20020ac24e90000000b004a222ff195esi962141lfr.11.2023.01.13.09.14.08 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Fri, 13 Jan 2023 09:14:08 -0800 (PST) Received-SPF: pass (google.com: domain of henning.schild@siemens.com designates 40.107.20.51 as permitted sender) client-ip=40.107.20.51; Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b="d9/L9o3C"; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of henning.schild@siemens.com designates 40.107.20.51 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=CeR+OwEQVsiseeHxt0M0X0VSNMIUseHjzBGrE+Nmz+J05eEK6ka8q/38PAa2cSuKY7ttP2R71Ysx9jR3pd8BnBDFF290kga6Yw+baufb2pJo2S8SRoPJDzUKy9ZHnaJ7VKcj4kqu1An1YpX95gvUfly5hZHXhyOr5r1skiY1vmg/rTyFjx226h3d0NNKY5fzIk+HPWIOXLx0t6xPnNuD9EspsT7/sLITDEHioQa0MhrvGCt/+dHxdOmCRgBwHAVdrPMljBAbdIXeorXj62gn6mPev2S6eH6OAabvV14EFLBFwRRzKib6+QzKcWFm+uJ6G0a+4dWNvCcvDUAkhuDP+g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=FkAnkkSS3j6csnosUfRxcpdvsKuZqHA+ms1Levs87Vg=; b=a4LgkdABZUf4nvyFt7OSTSwQB+tIpDYyAFSK8wG+QYEFUtkM9hCAV34JTeA/4qMhjEYS2PA1zEqniChqm6bfjwGaLSiFFTy1v6QLtstiCyAF/p5h94i6YctBu4WdTJDwkCPzy41dEZ0cc+ImDiUlIm0HK/iUn0YDL2yDKnWDxRd/F66vJxDrp4kiKnRKE6kJ1JfJ3Dr6Snh4HiaU7pPhqaPZerwBiwrt+v3/PRxnUZNH8RakEa0EFquIYopXtVsy5B7xLuqiC2IORMrJn5OY1CUAnhArE7w4TV1JLpyGmbowrhahv67cl5/WmG1fVqpopBHzzNae54HSx8Y0RtEckg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=siemens.com; dmarc=pass action=none header.from=siemens.com; dkim=pass header.d=siemens.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=siemens.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=FkAnkkSS3j6csnosUfRxcpdvsKuZqHA+ms1Levs87Vg=; b=d9/L9o3CZO0hRM2jHPglJD76KYWoiROVgHvMuLdUQbT8wTrogNht9B1W1F47tDJPh0djzVUIxbjfqHXxDu018gwGrVQiqz0ngpsDOgIQb9Vzxg52gC6xyoGbWOb9AWmhS41b1HIQ+3SKnNVTeCHnI70Z3spYlgHKNK0n8SlPbb2HJwHAWxCQs0JcDwxsXkNXyD/gQhxK+L5T+O0FbzrEi9KQl10ukGM5Ug3wZq33dbRQgyKTPmNJGbhR85ADlQST8wlwpfy85dKszcvFfLQoVcvqYt218p9bt2hFkkJka+1IQXjvEPOHncMrJnlMsHVFGW2AqrkfaV6dKyAPv3bgMA== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=siemens.com; Received: from PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:102:269::8) by AS2PR10MB6542.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:55d::7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6002.12; Fri, 13 Jan 2023 17:14:07 +0000 Received: from PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM ([fe80::bdf0:fdeb:f955:bc79]) by PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM ([fe80::bdf0:fdeb:f955:bc79%4]) with mapi id 15.20.6002.012; Fri, 13 Jan 2023 17:14:07 +0000 Date: Fri, 13 Jan 2023 18:14:01 +0100 From: Henning Schild To: Baurzhan Ismagulov Cc: isar-users@googlegroups.com, "Moessbauer, Felix" Subject: Re: [PATCH 0/8] CI rework of gitlab fast job Message-ID: <20230113181401.3b8e5807@md1za8fc.ad001.siemens.net> In-Reply-To: References: <20230110121748.14917-1-henning.schild@siemens.com> <20230112161250.78000195@md1za8fc.ad001.siemens.net> <20230113004315.65f968dc@md1za8fc.ad001.siemens.net> X-Mailer: Claws Mail 4.1.0 (GTK 3.24.35; x86_64-pc-linux-gnu) Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-ClientProxiedBy: FR3P281CA0011.DEUP281.PROD.OUTLOOK.COM (2603:10a6:d10:1d::17) To PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:102:269::8) Return-Path: henning.schild@siemens.com MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: PA4PR10MB5780:EE_|AS2PR10MB6542:EE_ X-MS-Office365-Filtering-Correlation-Id: b7f5c3ca-6e19-4f41-bf9a-08daf58993fd X-LD-Processed: 38ae3bcd-9579-4fd4-adda-b42e1495d55a,ExtAddr X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: EV6o4CD5jaAy9Ve4XGiWM2IC9kt/VruCRd43nPPtDZlHUdzPZoZQE9nePnB0T+Kb7JDIobGrvU6GWNeXmVpT6DvZoswASRd/WL/TEHnuiGqIUFQYcX4gEF9+5O4WywnKA0ww7SwpePrHe9o7R8/ZQlXvPROTN/XLT0ZuN4PKoaMvKFV3OBf1GCaHSBCiwVWPVdJZSXubF1cWmOAO54wKjDmaUJNMYXlTypGMeLg+nbkm2uUTqYIV+ew1sv8BAn3JraY+fhnJLdVctyIodvoWVMVzuFFrLHUlR1ahwbi/UFknquudaFyzfu5E9I96YDrE7jNo0VqvZLTXQPa6mRdiY8t2+smzIoNRAOypdfNyDalMyAsqea8vTejqY0bSJ92BjO4ox3hIFtGYf5nMMIy1QBIPc2w07bzWPqwiN4glXQ0ZLh1IRnlQ6YGip97jj0SF8gREzFCqFVZLP5Yc+RhEpsFrjrqstVaRb2xgODhhbQ5Vijs8GDJ1RQP5lK0wY3CC16YSrJ91POVB6+z6BR9/dLV6cWLbqQ3LgdteB1s+jmptVC1pDzgUVpUoG/Llh7boD9E0vAvsOrGAAOkMwYioiGRJiL63wOGHrdwjvWpiu9v759H+xsPCJYQYV94WSmtK7JAf9wUuu+EXhLvzbdBZMA== X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230022)(4636009)(396003)(39860400002)(346002)(366004)(376002)(136003)(451199015)(8936002)(5660300002)(83380400001)(41300700001)(86362001)(38100700002)(2906002)(44832011)(82960400001)(9686003)(478600001)(186003)(6512007)(6506007)(6486002)(66476007)(8676002)(6916009)(4326008)(66946007)(66556008)(316002)(1076003)(107886003)(6666004);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?AOnhx68TEgE6Xgkw8+Qv1VpxdKxkY/8phLq1IhT7tPm3jLOeluOPvaj3YT+x?= =?us-ascii?Q?ck5ebOWjKOjH5VtVObDLWvGsTOM0Rgbii5RvhW5xg9SmGZtZWHZLAtp7NXr6?= =?us-ascii?Q?qG5cYJphz3qiP+qoEke4Uqj6BF+TbskX7u0aSr2VW5UyjVNKDL8jWDjv91nP?= =?us-ascii?Q?6+AL2bCcjAO/aufWzrGRzumo+V2J9TJypivTsZFV2oiPtgrxjnxlGYkmMPg7?= =?us-ascii?Q?8yw1IDhBCVW2amzPuk1F7Nt40VjlvCS+ijdXSVspq5CfmWEjoTb6ULUN2Bn4?= =?us-ascii?Q?GWf29HEeuUDReYc76uzqGALubPUcvPeVX7aQYUkSxJO47eFylbAo0DZ8LdAV?= =?us-ascii?Q?Vn5kv2hCOCm/6M7LIB1io/XXBxRk4FbWRlIvfkjMemljXQtPOVjPKlqab7iA?= =?us-ascii?Q?TTe3udwtLrMYs6M/2Vp2v52C7zwScwRjMv2yWxIdoXIuIBOnJxYTbXbdTX3O?= =?us-ascii?Q?6LP1dzSREXKqPj35PFR0H4iPCX0RUbWxNqoXppKvck81Yr/uuPDzYjF7Cezk?= =?us-ascii?Q?NdEcqc/Xn855nYO7UEBkuOygt+Vw3e7i5d1Guvkz3PqMd4sZP/9zdL+/zFjo?= =?us-ascii?Q?BkqiOwvHAhpYrzf+DzoQMUDHe7TRWXJ+XbVEW2RAzCtQ6gZoJ8lkwc22DJy5?= =?us-ascii?Q?yFErL6kqBf/vbnHj8fWpHEaSHtzy9Bwocv0fd7JH/m1H6BSg/TYKTiZTSDPK?= =?us-ascii?Q?7sjZL211bcF1zFJlW1nOkGYLey8z80ZXDxYuZ4FfvqCwu7YuC2L33+zzxUJx?= =?us-ascii?Q?KBn+XS8HjlQ55Gv6E0XoTrN5SDxOTflWF2CRAtznoqNzUC+03BPEsgxwt/94?= =?us-ascii?Q?1GeDGIJKxZHxzjLV8KoLtnHxiC6OO1l7CErxo9D/gBVi1oOchP+bMD/WJxHv?= =?us-ascii?Q?+QIgYdi/aB1At6dgsL57VryYyefJ/WwaYc8hS9ADQP+0Df18XkyU7ck62bqL?= =?us-ascii?Q?/ySV+cLvW66GAFhW7RUfb4WLXjHB1CesyxsQ4M1nEkQ/fnWa5GQM8J06iXHh?= =?us-ascii?Q?8KXI72JXKIkhgpKQZdhf4GsGCKot+Lv5TyYx5/IuZ6c0vC6yurbYgDyG8v8D?= =?us-ascii?Q?StRyTk4H+2MQ38X0FntE1LiiScOi9XtdYxIE4EYn2wDwereiyF2O+DAu62uQ?= =?us-ascii?Q?htLmy74glmctM/30nqc2x6nriVp3mavofRrvq/Sh5JJd7j4WDahfs/0h1ych?= =?us-ascii?Q?OHZoFDvD5+EcY/IGWiHTcg42NnyMRMnfZmmyRTIsnfrxnjWVcM0I8JWeTO0B?= =?us-ascii?Q?fguky+DiVOcPbwYAgQk5ZgiVAuiKBWAqv2cM/huBc/yut73oB8ZApv8AMLXz?= =?us-ascii?Q?kZPfAoSTc98gJwxK80aOYYVy4Q9xUm1/EuGzbV1gM5AMuh1rIpSFoRhyrvVz?= =?us-ascii?Q?2KXB9Y5fb/bitZwd5wdPhBf7cK/6uNkAthZ2Qx3qCppdt6gI329KSfiVvBHo?= =?us-ascii?Q?nyBmQfWF9GCDWXCtaVxCNLD4c2ZtR8G+9v/9U/GXjqSO3i2qeF/wxGyJMhLQ?= =?us-ascii?Q?V3gUoid1Np/RZ+lybSCDsOj8WS50axcqDXE2M4wEhI1lh70eW8aHGc5ELjKz?= =?us-ascii?Q?Jn4wqVW+BucmiRdVQ0CiMFAqeZjJ4ZhiVdTdn9V6nK1gxF2kYYD5aTSviRYT?= =?us-ascii?Q?1hzpd1reE3EtA0OneH9qXAPjfSpu+fBVv60v8v3mNKnt+UnrEgtopLaeNDv3?= =?us-ascii?Q?kCVxnw=3D=3D?= X-OriginatorOrg: siemens.com X-MS-Exchange-CrossTenant-Network-Message-Id: b7f5c3ca-6e19-4f41-bf9a-08daf58993fd X-MS-Exchange-CrossTenant-AuthSource: PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 13 Jan 2023 17:14:07.0738 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 38ae3bcd-9579-4fd4-adda-b42e1495d55a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: qInxHa1eA1dkEICkvjbh57uVUCuM4hpOQF0JQFkR6Juy4Sy+Hd6oJVepqdd+r/T9S7GAOFqk/l5FMGcbVYOsXNHCqYW8T8Y8hgxwH03WIU0= X-MS-Exchange-Transport-CrossTenantHeadersStamped: AS2PR10MB6542 X-TUID: QS/9JJ0yI2wX Am Fri, 13 Jan 2023 14:14:58 +0100 schrieb Baurzhan Ismagulov : > On Fri, Jan 13, 2023 at 12:43:15AM +0100, Henning Schild wrote: > > At the end of the day i want any variant of the testsuite to run on > > any setup just like it does on ilbers jenkins. > > > > That should be based on the kas containers for anyone not using your > > jenkins. > > > > With that any contributor would be able to run it manually or in > > their CI. > > > > We currently can not run "full" in gitlab CI because it takes too > > much time and our gitlab runners would take such jobs for at most > > 12h. But that is a value i could adjust if we find that it really > > needs to take that long. I hope we can get much faster and still > > have the same coverage. > > Thanks for the summary, that's fully in line with our last off-list > discussion: > > * The preferred downstream testsuite is "dev" (runs for ~ 2 h IIRC). > > * The testsuite runs manually on the host or in kas. > > * The testsuite runs automatically in GitLab, Jenkins or Azure using > kas. > > * Separate testcases for every arch / distro combo. One can run the > complete testsuite or individual testcases. > > * The maintainer CI provides test status and build control on a > publicly accessible, easily scalable infrastructure. > > * The CI setup is easily clonable for the downstreams. > > * Downstreams can run Isar testsuites and / or their own testsuites. > > > So, I propose that we update and apply the "dev" testsuite series, > then apply yours with the following changes: > > 1. Use "dev" in "[PATCH 3/8] CI: install qemu-system when qemu > testing is requested". > > 2. Patches 4-8 "testsuite: Remove X test from "fast" set" will be > unnecessary (we'd take this into account during the "dev" series > update -- those testcases are not part of the "dev" v1 anyway). > > For the final review of the use cases I'll wait for Anton. Let us see how we merge all that. I never looked at that dev series and think we should not add a third pipeline. Too many switches and variations just mean that we will need testing for the tests and nobody will know which to run when. I did not try but i bet if "fast" would simply use Sstate caches it would run in less than 30min for small changes. And we would naturally test Sstate and actually become much better on "partial rebuild". So in my book "dev" is "fast" or even "full" with warm caches. Henning > > With kind regards, > Baurzhan