From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7350330382288420864 X-Received: by 2002:a19:6403:0:b0:513:ec2a:8fd1 with SMTP id y3-20020a196403000000b00513ec2a8fd1mr6027700lfb.47.1711382153601; Mon, 25 Mar 2024 08:55:53 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:ac2:520c:0:b0:513:e91f:da6f with SMTP id a12-20020ac2520c000000b00513e91fda6fls230802lfl.1.-pod-prod-07-eu; Mon, 25 Mar 2024 08:55:51 -0700 (PDT) X-Google-Smtp-Source: AGHT+IFbw5MGivyN/VTQT4dvKXYW2bpes0toLAMj+0kQ3KMncWrsygVVx5/xVN8hm0Epy7LDP6PK X-Received: by 2002:a19:5e19:0:b0:513:d5ea:1d21 with SMTP id s25-20020a195e19000000b00513d5ea1d21mr5213584lfb.69.1711382151376; Mon, 25 Mar 2024 08:55:51 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1711382151; cv=none; d=google.com; s=arc-20160816; b=RDRoJPy+BC5nDnPxRLFdv9fDGgpSLaETT/oJlOtwN+MpekV9A7oTpY9T/CP75GcTE0 +XpFYTAbSAEe1srCOA80UZUZZ+4PVf1hjeCOKhgLEp9KvtxRsFfwW800ZyFvHeL8FNVo xoYnWNvunu+pGjVmJTYKIbAToCPtxUtceuTOQgz0Cm+LSEjztzqOZPdSVa4LqLNwmMcF 1L20NontEYlOweXFVLOgnjzPWkJpSLW8t6+t+znQeYkrTyBTVFbf6FIDPOOo+dmhNoYL H/kWVfxrXEY7VeIvFhsr+j7pP7+1cTm7JhMS9pAyGWCwI+nghfqbsXjrKNIHVex3uwHL dQAQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from; bh=gsd1523YQ0x8mbAH1iX2Wy70ZvZyxZe/U5/sZrXKrq8=; fh=/h9QQkzJ8EboVkWg45aWwpaUro6WMavIVd2OhN45RtE=; b=o7k57yAJciOG6+cxVUETwqhBHhh9MVuUhF+z+qvUenGE6N7Kvd3/5wqFCXj0+Ypt6S 5EiA4rtaDa6IhYi297Y6MsFK7PRMaPDO1WIqcz837/BSUPmXqI0LW93KDX03635EF929 udU6GzmVXRw0uJn3BvYOrD7F9FmG/8QIiIeUrehUcR7up2iTqlakHyzdbw/0bBDd8xBA 8/f0ja5yeUJV4u8UmxUIXa/cIHiEiOPy77PWPTKSavdJm2xaDsAmTY4sDjHnkhKgy0bi FX2u1wrkxMKz13a9RFXKXpdXD2RtVwlmevWuD2lhOwCoO+ItDMr/o9JAgo6e9/sCFoqq YmbQ==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=amikan@ilbers.de Return-Path: Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id v14-20020a170906380e00b00a46acd22106si229717ejc.0.2024.03.25.08.55.51 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Mon, 25 Mar 2024 08:55:51 -0700 (PDT) Received-SPF: pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=amikan@ilbers.de Received: from user-B660.promwad.corp ([159.148.83.123]) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 42PFtnL9011703 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 25 Mar 2024 16:55:50 +0100 From: Anton Mikanovich To: isar-users@googlegroups.com Cc: Anton Mikanovich Subject: [PATCH 00/23] Additional CI improvements Date: Mon, 25 Mar 2024 17:55:17 +0200 Message-Id: <20240325155540.4162990-1-amikan@ilbers.de> X-Mailer: git-send-email 2.34.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-TUID: VxwzXg62afg/ This patchset accumulates testsuite fixes and improvements in the following main ways: - Migration of full testsuite to cross building - Target lists update - Speedup overall CI execution - Improve testsuite naming - Make output log lines shorter - Improve startvm errors handling - Increase startvm test coverage - Add an ability to check all the possible targets - Improve Avocado tags usage - Code cleanup The main change here is a new Standard testsuite to be placed between fast and old full testsuites. Anton Mikanovich (23): CI: Introduce Standard CI for cross building CI: Rename cross to fast CI: Rename nocross to full CI: Remove test keyword from class names CI: Rename base test cases CI: Remove cleanup before nocross build CI: Update default target to bookworm CI: Remove duplicated targets CI: Run startvm for all qemu targets CI: Fix errors reporting during startvm CI: Remove logging hack for job.log CI: Do not lost errors on failed processes CI: Remove container package list hack from testsuite CI: Minimize debsrc_cache checking CI: Minimize kselftest checking CI: Do not include testsuites into each other CI: Mark some single testcases with tags CI: Execute startvm testcases after building CI: Fix missing endline in generated config CI: Remove absolute path to citest.py CI: Create avocado.conf inside build_dir CI: Set also cache dir for Avocado CI: Add make world test case .gitignore | 2 +- meta-isar/conf/local.conf.sample | 4 + meta-test/conf/local.conf.sample | 3 + scripts/ci_build.sh | 24 +- testsuite/cibuilder.py | 86 +++-- testsuite/citest.py | 608 ++++++++++++++++++++++++------- testsuite/data/targets.yml | 118 ++++++ testsuite/utils/targets_gen.py | 27 ++ 8 files changed, 692 insertions(+), 180 deletions(-) create mode 100644 testsuite/data/targets.yml create mode 100755 testsuite/utils/targets_gen.py -- 2.34.1