From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 6927246286546534400 X-Received: by 2002:ac2:4154:: with SMTP id c20mr1269583lfi.145.1613124085737; Fri, 12 Feb 2021 02:01:25 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:ac2:518c:: with SMTP id u12ls118174lfi.2.gmail; Fri, 12 Feb 2021 02:01:24 -0800 (PST) X-Google-Smtp-Source: ABdhPJwtiG6ZH/3CTgEjPVPdH4CbkmFwhqhB1xQETyCC2+7UEoGeZRPQ9qYUuVA4EYPC0OkQ5lSI X-Received: by 2002:a19:f813:: with SMTP id a19mr1225107lff.272.1613124084636; Fri, 12 Feb 2021 02:01:24 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1613124084; cv=none; d=google.com; s=arc-20160816; b=cr9fWha9rDKLwQeREjvEDqwTKs9aU31h1Ng0Op+KEwB6ibBISZM8Ufv/qrMWInlCb8 NZkyAX6w7phND8NN4qoVf2nC948MhNoKCkHDHZsckLvalHUphVxzYzrYgnnrtvtVgFAx +SwXBxws/xpMWdJwH64NkT+XZL/dxW1aNrPb+ujC+A1mtjEJy7UNFBXie8VpmwlUOT+O zWio5NdaECtNEmdCAH2ZgJBdCG0vFI4jUw4Uac4yiN39V+JuZlmIRWECxoF/pQ0thqta R3hHMlflukhLlCERuwpIbLPxzzNN/MZv6xRwHBnFA82Q1oN1+K/qpPSTk8D2uajCfA9b Ar6g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=user-agent:in-reply-to:content-disposition:mime-version:references :mail-followup-to:message-id:subject:to:from:date; bh=3+jksG847xsAB58Pzg/eO1yRmMgNWrCTdAKNywirrwQ=; b=pHgkFb4PPSzRA4hlSLx1qtRsl1+FNgOvojFuVC6cgb8vKZauayy7fSPKxjDxiJJai1 z3Mk1JTtoV5g7uU2S+G+kV9YuC9D9ZC5ZkSmC3ElYdLe1sZUhXjiYYceDwgzzJbaveD8 ODh8ouVuFpXO0fFOhj8E6Dvef7fGAuWJBkA/CuRhbFtVbrDjPq2fzSW2O60DrY2j9Uoz J5wb8g/mlVN+Y++ATdEKwPpnnlqhSJsWOR9rQtIls7wHVcKu/4hHp7GbIxHpwUr5SJJS 3c8OrAd8bCDMfsdEHqB5/XlXyxWTcUSef7q0xhpay+AKKEZil9r7X+imcKdKBVLciShY vbcg== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=neutral (google.com: 85.214.156.166 is neither permitted nor denied by best guess record for domain of ibr@radix50.net) smtp.mailfrom=ibr@radix50.net Return-Path: Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id l22si281448ljh.4.2021.02.12.02.01.24 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Fri, 12 Feb 2021 02:01:24 -0800 (PST) Received-SPF: neutral (google.com: 85.214.156.166 is neither permitted nor denied by best guess record for domain of ibr@radix50.net) client-ip=85.214.156.166; Authentication-Results: gmr-mx.google.com; spf=neutral (google.com: 85.214.156.166 is neither permitted nor denied by best guess record for domain of ibr@radix50.net) smtp.mailfrom=ibr@radix50.net Received: from yssyq.m.ilbers.de (host-80-81-17-52.static.customer.m-online.net [80.81.17.52]) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8) with ESMTPSA id 11CA1Lmr021501 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Fri, 12 Feb 2021 11:01:23 +0100 Date: Fri, 12 Feb 2021 11:01:21 +0100 From: Baurzhan Ismagulov To: isar-users Subject: Re: FYI: Feasibility of CI on github Message-ID: <20210212100121.GE20742@yssyq.m.ilbers.de> Mail-Followup-To: isar-users References: <20f63dff-b266-24b9-4356-341d99782420@siemens.com> <20210212101647.69e6b7cd@md1za8fc.ad001.siemens.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20210212101647.69e6b7cd@md1za8fc.ad001.siemens.net> User-Agent: Mutt/1.10.1 (2018-07-13) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-TUID: nESCl6rY95Uf On Fri, Feb 12, 2021 at 10:16:47AM +0100, Henning Schild wrote: > that is very good news. And the current CI is a total mess anyways. All > in one 6h job. Maybe someone will find the time to improve this with > something like bats or pytest. And rip out that Avocado stuff ... does > anyone even use this? We have the current testsuite in Avocado, will send patches. The long run time is the reason why we use our own servers for CI; currently, we get it built in 4.5 h. This could be improved to some extent through parallelizing the test cases, but CPU and storage utilization is about 100%, so that would require several nodes. Also, looking at the task timing diagram, it seems that dpkg-buildpackage is completely serialized; maybe we could improve here, too. We did look around before introducing Avocado. Pytest is fine for module tests, but Avocado has more infrastructure for black box and target tests that we need. We haven't looked at bats, but I'd like stay away from shell in favor of Python. What I don't understand is, after we have individual test cases, how does that help us with the long run time? Would you schedule every test case in different steps? With kind regards, Baurzhan.