From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Wed, 27 May 2026 10:40:53 +0200 X-Sieve: CMU Sieve 2.4 Received: from mail-lf1-f55.google.com (mail-lf1-f55.google.com [209.85.167.55]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 64R8erPa030051 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Wed, 27 May 2026 10:40:53 +0200 Received: by mail-lf1-f55.google.com with SMTP id 2adb3069b0e04-5a886a993fesf9190837e87.1 for ; Wed, 27 May 2026 01:40:53 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1779871247; cv=pass; d=google.com; s=arc-20240605; b=hhWoN3fES0W8iF2DFojMs4KsXIn1v96mVviNREP9CPbvVD2Naj/aqXXtXkdgHDpyhK pSsFnxD9S+Sac1uduVDMInpa5w27ThOuF/ai7RcEhzuQQQCP2x6uQSC/u6Kyv6OoYAcT F0MXwA0o+OC+FXazw0Vv0gpuO7RJ1wK9ef/ycrcngIhdDcWVFqmfpoPdWJEYa/RkZyIg 1lvvgRJ+HyKfZ4cc4/xDksenRLV2SSZaArNc5SprwiyC3SNtMaprY5CDrKEojz5qsUtd sZdqGfncSNdocu/+cIG8/ki4xiFNHgbbjtRnFC0g59SH7Gy6Hir/z6Mt6UkG9JA3MvTX bLSw== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:in-reply-to:from:content-language :references:cc:to:subject:user-agent:mime-version:date:message-id :sender:dkim-signature; bh=kV9dAfXp+3VrxZMw0WBIUcxIg5ZyBpLZETNokNGZ0JM=; fh=PnZqDHOHZbqYi8zUccK0P/5jC7+/oRiwr37eD02GWr0=; b=BqXwcvmq5yBP+qSrKNy3G9Dc4IJzUhoXm5WeH3rTB23Eb9pIqc1Dh22ixNXwRoYd65 w6UrDfgyGaY8aKmXIzM4unt7YAg79IODd9iaX/71NZjpfDflEcnfuFu/qs/aOQV2dTp2 8qXlP5wdYMI5o7L2mRrLDa5Jx6oKlRIjhkUVBslpnab9h0wLuS4dXNB9aBgpkjuXTYRy 5RqdnK2nWZmPbHek4Ui/R1k8gWBs68MDyp2CCrf2mC73XHogUudARUeOttgNpH0dip9H PHHnZ3qxA8SbERCLF60CF/3b/R32kASWXf9KJwryekeUcWrDLKeXccvt17ptsX3FXL0s TSIA==; darn=ilbers.de ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of wzh@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=wzh@ilbers.de DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20251104; t=1779871247; x=1780476047; darn=ilbers.de; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:x-original-authentication-results :x-original-sender:in-reply-to:from:content-language:references:cc :to:subject:user-agent:mime-version:date:message-id:sender:from:to :cc:subject:date:message-id:reply-to; bh=kV9dAfXp+3VrxZMw0WBIUcxIg5ZyBpLZETNokNGZ0JM=; b=vmXFx6aBZOQJ+XsLsj0lDbdTvoz3zRcdmv9yGTIDCrsp/K1znAoWD6teJ4Gy4ucSRA Kr4zqRpsEM/eXkm6y623lCvu71HDIye9ZXfgpHHpLpofUtZbHcAMOJTO7PLiMrE+rBNp a7b1bpzIi/djhiNZQQy1T0I2yMfyTu3wK1xOD4UTJWwxAS0OnlP0Z424ECwpLiZIp219 hPoJk6an3c+Ik6VQFNeYCD5UJcSUPrbC8Y1qdsqPix6MVKlHnWj0OJDpZ86V2g1v3eB0 vBPZ5SidsswljyF3CHvXS1VoQTn14dfdzEoAznnefgsfQqOj8ue6G7JRTFTa+Qk2Rfly SJ5Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1779871247; x=1780476047; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence :x-original-authentication-results:x-original-sender:in-reply-to :from:content-language:references:cc:to:subject:user-agent :mime-version:date:message-id:x-beenthere:x-gm-message-state:sender :from:to:cc:subject:date:message-id:reply-to; bh=kV9dAfXp+3VrxZMw0WBIUcxIg5ZyBpLZETNokNGZ0JM=; b=lIKNigLvCqDarLg5bJ6xRh0gT0xxtay9n3M5o/6bNTJon+fTEvkar2AdubcRw1sDcN KtPMZr2ggmlTn7qx0LlQ4UMclM8r7Q1Fpf0vZmn2x+ET+Aaq+YbND9GiNq0xM/glaPXb uDQJOjO3smz0QlbjNlXmUEKWUbzCW4+JlCM8LR59i+A3stTm2yk80z1mTmZ3R7Ijko+K IEdC8My0zcSahvkcA0flSj2S1jjGM+F1jKG1IKFbt4/r67LFpL9t8QqgaoSwubvjReOk HZ9BAWnpTJdIuWNooHxwOfuZ4UevG8ZU5YT+PUD2EHvhSxHe3KNOVzfwcVPdyUZtcJiD 0LWA== Sender: isar-users@googlegroups.com X-Forwarded-Encrypted: i=2; AFNElJ96ojDykk8ye2byA7w/OjYSaJMZhCqEOrQkpiW0TquXY2gX8X1M8D92yv8oHiCxnf0j8J1Q@ilbers.de X-Gm-Message-State: AOJu0YwfPd7nQdxcIXZjBAs0bLhJk3wiIoOVsD5APLR6KIRWAxTjCXX+ EVVkj9Az1kQBvHd/iFTwmoCNEg5YogZQ704PAT4jV86uQ1rpPkeqacOL X-Received: by 2002:ac2:59d1:0:b0:5a8:a558:63b3 with SMTP id 2adb3069b0e04-5aa323b22c7mr4132066e87.30.1779871247283; Wed, 27 May 2026 01:40:47 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com; h="AUV6zMPrMl4O3rdrphyDJ8e0It7R9nwGGuFlzoOaISeU63xmrw==" Received: by 2002:a05:6512:3452:b0:5a8:6e89:d4cd with SMTP id 2adb3069b0e04-5a91e5d9c7cls4009358e87.1.-pod-prod-03-eu; Wed, 27 May 2026 01:40:44 -0700 (PDT) X-Forwarded-Encrypted: i=2; AFNElJ+Qcl5NbFk0tOvs+FdXhvBfPM+oacJAbayIUJvOh8jOTi+NCvSBriooZBZNeVos7Z0zOBJv9WYec+Ow@googlegroups.com X-Received: by 2002:a05:6512:1452:10b0:5aa:105e:b95e with SMTP id 2adb3069b0e04-5aa32379d7bmr4576257e87.16.1779871244071; Wed, 27 May 2026 01:40:44 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1779871244; cv=none; d=google.com; s=arc-20240605; b=NzsANuParx2d02BrHXwBwUZJrwPo9/QcZ+zI463Ho0iLrqrU9Ks5HUWhG+PbNCBuSg DOEvfxMJEIbQeenaiyB874ojYtY1ch3DpKqwyLQMHBfO3zsG6nHKhSINTujURxOPQD8H ou0B1NWP4qDfXbbya+TwqrgHR6FgQGXMBKw0eiZ2P6sL9C8R+QHmndPooORJen/R80ss qBdCnL2HgLBpdwG0gyILxH/xBpV8a9ZJprm8Ir6HulzcVfDyaZmYbKxDg5AG9RGI62Qi Q64KX63qstLUZ0aGQbWANvo0ye2nQ66rc31uaFek/UbfDfhZswgWCP/hpVz4rBxnfTKV j6PQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=content-transfer-encoding:in-reply-to:from:content-language :references:cc:to:subject:user-agent:mime-version:date:message-id; bh=IAiLKw4SPw3sCqIafUwzRjSNYT182jnVa6TjpTlrHl4=; fh=8XA1Ja/VUWd1Y9aplZoB+WHnxwIfztNWNhNOqtywICg=; b=MEMETyffogJBPEt04SPAFj+Feo2wNHsI0/KQKk31Z1CBaJpyStSqNeiwMoxTyACNTa 1xZKnnKbWl0thDXlgH6s3LZNVbALQ0VZp3EJeU8K7M1sVXXqosQvfgGIaEIlRFluUEQU pzewCe7leD4+yAZB0xYpPZENFp7LKp+2T5ZEzVKoOh/Gk0ARsAa1EsUZjLOXKNZxWG1w VwCnG+r+7u4cy0jcY0FDRA7XH/mBU8WkVdg3C7xUAsjrTIH4JyCeG5cxnB9GJGd7H961 AMdC4JL2L9o/YZ1NsMiC7idcMlteXcOMJWNlc2ACmqUyrENCdLCP+YFBhFqWrctHFsDf xo2w==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of wzh@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=wzh@ilbers.de Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id 2adb3069b0e04-5aa46365f68si88179e87.5.2026.05.27.01.40.43 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Wed, 27 May 2026 01:40:43 -0700 (PDT) Received-SPF: pass (google.com: domain of wzh@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Received: from [192.168.178.148] ([88.130.203.42]) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 64R8egKp030035 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 27 May 2026 10:40:43 +0200 Message-ID: <1817d36a-75b4-4369-b9a0-128bfba6a656@ilbers.de> Date: Wed, 27 May 2026 10:40:42 +0200 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH 0/9] Improve testsuite executability, basic GitHub CI To: Jan Kiszka , isar-users Cc: Felix Moessbauer , Cedric Hombourger References: Content-Language: en-US From: Zhihang Wei In-Reply-To: Content-Type: text/plain; charset="UTF-8"; format=flowed X-Spam-Status: No, score=-4.6 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_EF,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H2, RCVD_IN_RP_CERTIFIED,RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-Original-Sender: wzh@ilbers.de X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of wzh@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=wzh@ilbers.de Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-TUID: taJH65eGnEIz p1-p8 were applied to next. In p7, "scripts/run-tests -T dev" was changed to "scripts/run-tests -t dev". Thanks. Zhihang On 3/23/26 09:30, 'Jan Kiszka' via isar-users wrote: > There were several proposals for wrapping the testsuite execution into > some container. There is even docker-isar already, though this one was > not yet used for a wrapper. > > This new approach enhances the existing container to "test-container", a > kas-based environment that contains all required testsuite dependencies > and can run them both as CI base container as well as via a script that > is kas-container-like (actually using it). So, all the setup steps are > history now, just call > > scripts/run-tests.sh -t dev > > to execute the minimal testsuite locally. Or just run > > scripts/run-tests.sh testsuite/citest.py:test_dev_apps > > to execute a specific test (avocado command line interface). > > Along that, kas is updated consistently to 5.2, using the trixie > container now. The testsuite loses some obsolete KFAIL tags. And, > finally, some basic CI step is added as GitHub action. > > The latter can be considered an RFC for now. It's unclear how far we can > go on public CI by parallelizing some of the test sets. Avocado lacks > support for test dependencies [1], thus this would require additional > maintenance and may still run into the limitations of public GitHub > runners. > > A full run of this series can be found at [2]. This also allows to try > out the container before it was built officially, just set this prior to > calling run-tests.sh: > > CONTAINER_BASENAME=ghcr.io/siemens/isar > > Jan > > [1] https://github.com/avocado-framework/avocado/issues/6131#issuecomment-2694016818 > [2] https://github.com/siemens/isar/actions/runs/23426024062 > > Jan Kiszka (9): > Update kas-container to 5.2 > testsuite: Provide a new kas-based test container and wrapper script > testsuite: Install avocado-framework-plugin-varianter-yaml-to-mux in > test-container > testsuite: Add squid to test-container > ci: Add github workflow for building and deploying test-container > ci: Switch gitlab-ci to new test-container > CONTRIBUTING: Switch to new run-tests.sh > testsuite: Drop KFAIL from trixie tests > ci: Add github test job to github workflow > > .github/workflows/main.yml | 101 ++++++++++++++++++ > .gitlab-ci.yml | 22 ++-- > CONTRIBUTING.md | 72 +++---------- > kas/kas-container | 6 +- > scripts/ci_setup.sh | 32 ------ > scripts/run-tests.sh | 18 ++++ > testsuite/citest.py | 15 +-- > testsuite/dockerdata/Dockerfile | 19 +++- > testsuite/dockerdata/README.md | 20 ---- > testsuite/dockerdata/build.sh | 14 +++ > .../dockerdata/test-container-entrypoint | 99 +++++++++++++++++ > testsuite/dockerdata/version | 1 + > 12 files changed, 280 insertions(+), 139 deletions(-) > create mode 100644 .github/workflows/main.yml > delete mode 100755 scripts/ci_setup.sh > create mode 100755 scripts/run-tests.sh > delete mode 100644 testsuite/dockerdata/README.md > create mode 100755 testsuite/dockerdata/build.sh > create mode 100755 testsuite/dockerdata/test-container-entrypoint > create mode 100644 testsuite/dockerdata/version > -- You received this message because you are subscribed to the Google Groups "isar-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to isar-users+unsubscribe@googlegroups.com. To view this discussion visit https://groups.google.com/d/msgid/isar-users/1817d36a-75b4-4369-b9a0-128bfba6a656%40ilbers.de.