From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7186996775974076416 X-Received: by 2002:a02:a604:0:b0:39e:9f5e:cc59 with SMTP id c4-20020a02a604000000b0039e9f5ecc59mr1486574jam.238.1673615702487; Fri, 13 Jan 2023 05:15:02 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a5e:c24b:0:b0:6df:2c73:e7dc with SMTP id w11-20020a5ec24b000000b006df2c73e7dcls958933iop.1.-pod-prod-gmail; Fri, 13 Jan 2023 05:15:02 -0800 (PST) X-Google-Smtp-Source: AMrXdXugxCWZjVGJB1lkTWXPKTiNjxpnhCh1sBt332oLbCtdTVNcTOo3f0n+8sFgtkPOgltWP3o+ X-Received: by 2002:a5d:8f86:0:b0:6e2:db1a:6c36 with SMTP id l6-20020a5d8f86000000b006e2db1a6c36mr49464055iol.11.1673615701962; Fri, 13 Jan 2023 05:15:01 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1673615701; cv=none; d=google.com; s=arc-20160816; b=uFhat7qcqGDWl91NhZZLcucoHhDtEwt07T9opm9mWuoFi7SCcpujJ8ojRmKmH8kuAn yvx8qQIPnuRBFvsivoqh3ZfJW+EmsItBlGSxTDaOqcBx60iC53D7sr3T0rAiB5gValnq bScFnqbNA8f9SlXVnA8ybsztIWTcp06+W8UqW9q4wBRJZy07oUCzhofHDMj4mbpTv5BH WSrqk0kwrOGBBWHVAy2naGGz1OGFPYYtDCtKPiQ/fmhWGuNON9P3xqFXLSHAncWp/8et REaBGNcsDr8aVVoh8Iyjwq05dfV/ReWC9nUV1UIVYy+f8MWdjOo6ow8CUmsNVlgn3CTU 2lrA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=in-reply-to:content-disposition:mime-version:references :mail-followup-to:message-id:subject:cc:to:from:date; bh=U/TEiQrz4o2pPgl7WWJ7KuRa3c+QEK6SotPRotHLJ8Q=; b=f6wlXOqRoTUwu4eBbMAzUSGb6KZ9zApKTLp8yWTCzOp8s5fd47aGHWmK8bI5SQ2dHN NuZxzj84pUmeTbVLX0lNN9SYXCJgERMaD3hc+5XHyRjMbqT9ZwQvLGck05+FtIrIHIw4 fTTi3bz1VHLPjVVVkWY9D6U+vSEs6aSL/tKJQmU8UXs61VoISeG7r76ffodtqOocxApZ BwBp8gC+phJ14sZq+6j290tN8SxzWQydlgDc7a8T6xbOewUotpYQ0NGjYDZj8OZUJLjA QTzfvcCT6frx/9zNr+PkN/medgKkfMuCRAYAC2AbfeAj/TWn9MO/mC5sS6HUgtB8iQ2H LPhA== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=neutral (google.com: 85.214.156.166 is neither permitted nor denied by best guess record for domain of ibr@radix50.net) smtp.mailfrom=ibr@radix50.net Return-Path: Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id 3-20020a05660220c300b007045222d9f2si957363ioz.0.2023.01.13.05.15.01 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Fri, 13 Jan 2023 05:15:01 -0800 (PST) Received-SPF: neutral (google.com: 85.214.156.166 is neither permitted nor denied by best guess record for domain of ibr@radix50.net) client-ip=85.214.156.166; Authentication-Results: gmr-mx.google.com; spf=neutral (google.com: 85.214.156.166 is neither permitted nor denied by best guess record for domain of ibr@radix50.net) smtp.mailfrom=ibr@radix50.net Received: from ilbers.de (host-80-81-17-52.static.customer.m-online.net [80.81.17.52]) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 30DDEwhh029161 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Fri, 13 Jan 2023 14:14:59 +0100 Date: Fri, 13 Jan 2023 14:14:58 +0100 From: Baurzhan Ismagulov To: isar-users@googlegroups.com Cc: "Schild, Henning" , "Moessbauer, Felix" Subject: Re: [PATCH 0/8] CI rework of gitlab fast job Message-ID: Mail-Followup-To: isar-users@googlegroups.com, "Schild, Henning" , "Moessbauer, Felix" References: <20230110121748.14917-1-henning.schild@siemens.com> <20230112161250.78000195@md1za8fc.ad001.siemens.net> <20230113004315.65f968dc@md1za8fc.ad001.siemens.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20230113004315.65f968dc@md1za8fc.ad001.siemens.net> X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-TUID: NnrJwfdOyMdk On Fri, Jan 13, 2023 at 12:43:15AM +0100, Henning Schild wrote: > At the end of the day i want any variant of the testsuite to run on any > setup just like it does on ilbers jenkins. > > That should be based on the kas containers for anyone not using your > jenkins. > > With that any contributor would be able to run it manually or in their > CI. > > We currently can not run "full" in gitlab CI because it takes too much > time and our gitlab runners would take such jobs for at most 12h. But > that is a value i could adjust if we find that it really needs to take > that long. I hope we can get much faster and still have the same > coverage. Thanks for the summary, that's fully in line with our last off-list discussion: * The preferred downstream testsuite is "dev" (runs for ~ 2 h IIRC). * The testsuite runs manually on the host or in kas. * The testsuite runs automatically in GitLab, Jenkins or Azure using kas. * Separate testcases for every arch / distro combo. One can run the complete testsuite or individual testcases. * The maintainer CI provides test status and build control on a publicly accessible, easily scalable infrastructure. * The CI setup is easily clonable for the downstreams. * Downstreams can run Isar testsuites and / or their own testsuites. So, I propose that we update and apply the "dev" testsuite series, then apply yours with the following changes: 1. Use "dev" in "[PATCH 3/8] CI: install qemu-system when qemu testing is requested". 2. Patches 4-8 "testsuite: Remove X test from "fast" set" will be unnecessary (we'd take this into account during the "dev" series update -- those testcases are not part of the "dev" v1 anyway). For the final review of the use cases I'll wait for Anton. With kind regards, Baurzhan