From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7192322883099557888 X-Received: by 2002:a05:600c:1d96:b0:3d3:5249:d42a with SMTP id p22-20020a05600c1d9600b003d35249d42amr2608420wms.153.1674635515644; Wed, 25 Jan 2023 00:31:55 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:adf:cd91:0:b0:2bf:adc3:9107 with SMTP id q17-20020adfcd91000000b002bfadc39107ls367947wrj.0.-pod-prod-gmail; Wed, 25 Jan 2023 00:31:54 -0800 (PST) X-Google-Smtp-Source: AMrXdXuBdyU11UW2LvSvO/e3pEFZFVS/jqAi9cfL+47h/YYOigHoa9KKZlTIgC+byuCY4xmUP2sJ X-Received: by 2002:a5d:58e8:0:b0:2be:b07:d411 with SMTP id f8-20020a5d58e8000000b002be0b07d411mr26061451wrd.3.1674635514607; Wed, 25 Jan 2023 00:31:54 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1674635514; cv=pass; d=google.com; s=arc-20160816; b=QBEX50ke/3u8z8ySQorXgqs5GPdderTcYJdjNsbET7pe3sELtq5za66q3Tpntj0yTg 5bFWU1zN1l5RRSXcL+natQyebCnvp5XqYqgMGg058huutInWd4rnqdBeIpGW94c11ax8 zuUHWknTMXDhug5bKYNWf0YuekakYSOYKzHgOrhIYRPYTlJ0eJ7I+gZYQJdxuA5IZmzJ ApUTB+wUNTwuCvovrMI1HkBe6lUwQb39Tmq/HCffigZkvbLT5anoOdZaxbv40ZOxgZ0r fwiV7uV8A/pPIuBcY2a3AiT6OyS+r2LTg7GEsXFcUiETv51p4kl8+tzylR0MGH056hly q1Ug== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:content-transfer-encoding:references:in-reply-to :message-id:subject:cc:to:from:date:dkim-signature; bh=odXAU3p1gt1m/iLM53sMkzpgfnropwmFxNX/3RP6rRc=; b=oa2asNioGlXf+2j1G9t6yt0WLnDhj+H/FkGvTq7xenCuqWD5klLcmYjjD0F9ftqqwY CL8kf9pvH6nU5G4jr6OS2LU4li7HGbXE2mZHI/McI3dqAj8GjYVjVB2/N42jSMJkJb3G Cx8h6lmSwbQIjrsAjno9kgV7EdMT1l61R2SY9e97hzLTX+u8YI2aCsfIsNrXbAMRLctd noBplqOI2F5V+0Mxi8kYBVvicKMGoHYZPEH1CLFxiayYLlcMy8ucSfIbVEEQhWGCj/we bmzmHkoboS+SG/yoP+xFwvgJVu9XJ9leyhd/WYH3Tx5TlSf8BN5J/Mdz9oLJgANFu7MT cnLQ== ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=U6Z9zfJv; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of henning.schild@siemens.com designates 40.107.6.47 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Return-Path: Received: from EUR04-DB3-obe.outbound.protection.outlook.com (mail-db3eur04on2047.outbound.protection.outlook.com. [40.107.6.47]) by gmr-mx.google.com with ESMTPS id ba25-20020a0560001c1900b002be1052742esi205628wrb.4.2023.01.25.00.31.54 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 25 Jan 2023 00:31:54 -0800 (PST) Received-SPF: pass (google.com: domain of henning.schild@siemens.com designates 40.107.6.47 as permitted sender) client-ip=40.107.6.47; Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=U6Z9zfJv; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of henning.schild@siemens.com designates 40.107.6.47 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=RxqHfavX1E/mPyoQqi1C8jIxPi0aJ3eGp1BlF5/UlSua1XD88yz3c9f4kb7XCH8b0xo5IpFNUcVpfooXEqA5YncmBdNiNgSevgZExhVtKyWxwYhcPfDRkkksAjc1yLCcFKUIyXOvZl/6Wqc+oKoWVHqQs0hcxAJoCzNEoOF+GjpCUSPocio4XV8LGZZqbeRnHMCGhwLeq1Z3EUTej5Cn2TtcKdsVwBuZCZw4+OCdhp6D/kc0IEfJL67mN8rv9cgXSJyJarcYKmRpyqvscqt9A79/OoCwBLLj3JPqnScNICjvZP2WVIdRLaYy465UbAsfKNQDvaugitCDNpcVtwBDCA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=odXAU3p1gt1m/iLM53sMkzpgfnropwmFxNX/3RP6rRc=; b=nWCh6pBMdiquMnrTEZkF3xixqmJclwepzsaYxEMwLnmRRWKEb0wefEQ+utZ2yqkEpuPlLIZLpTE/i88ReJ6U4mlr6po1Zm5bljYV5Po+N3CHCX4O49NI3DFUBx1EHqrTiis9KRsVcliGACorEOZBV7R72fZg0tudaM6FdWWT0JTOMatBIIXInMasXBXrppUImGMqDzL9FviOIhrianE1Om6a1By0b2XC55TkKqoo0aI1eBa7WutzcCcEd80H7qWhzfi+QlgW9lbAHD8pWtaFIgip7KpRwa13Qn1wwYNK4J7Kkf/81n32iwzXs1hM9rvSALLjGoST7Dc7UWc2pYzbig== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=siemens.com; dmarc=pass action=none header.from=siemens.com; dkim=pass header.d=siemens.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=siemens.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=odXAU3p1gt1m/iLM53sMkzpgfnropwmFxNX/3RP6rRc=; b=U6Z9zfJvDtilyVSdrD26QAXBLlCOYpPlc/+N/G4s0OO+3GqQyLVGrMxtv2LSdmSfoDabhSvvsF+8UKF86cQV2Jdf2hvbPDt+otDmahKiLUmbCtwvfCcpPhDWO8mUJgrxtLJtapCH8lJEVjlDx0yAT5ZCxSw55kx1gZzgJ3l4sEpsfydssIZ6FW7kZZORcCJu83oyCIWtPl5nD9HQ7+MyXt/h/ZOPHpvEqkbOuQZTOfaAsqkiDbJm1k8D1gFlLpHXbXjI7civA2n8g/3trMNZSmgDM60uvLbOmqKr/NWOKz2D2NwP1p7M+8gMg+Rd1xu8FPiLqwM/T4qfjCbB0DP4oA== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=siemens.com; Received: from PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:102:269::8) by AS8PR10MB6673.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:565::11) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6002.33; Wed, 25 Jan 2023 08:31:53 +0000 Received: from PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM ([fe80::bdf0:fdeb:f955:bc79]) by PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM ([fe80::bdf0:fdeb:f955:bc79%4]) with mapi id 15.20.6002.033; Wed, 25 Jan 2023 08:31:53 +0000 Date: Wed, 25 Jan 2023 09:31:47 +0100 From: Henning Schild To: Anton Mikanovich Cc: isar-users@googlegroups.com Subject: Re: [PATCH v2 14/15] CI: Update testsuite documentation Message-ID: <20230125093147.37009115@md1za8fc.ad001.siemens.net> In-Reply-To: <20230124204558.31025-15-amikan@ilbers.de> References: <20230124204558.31025-1-amikan@ilbers.de> <20230124204558.31025-15-amikan@ilbers.de> X-Mailer: Claws Mail 4.1.0 (GTK 3.24.35; x86_64-pc-linux-gnu) Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-ClientProxiedBy: VI1P18901CA0011.EURP189.PROD.OUTLOOK.COM (2603:10a6:801::21) To PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:102:269::8) Return-Path: henning.schild@siemens.com MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: PA4PR10MB5780:EE_|AS8PR10MB6673:EE_ X-MS-Office365-Filtering-Correlation-Id: 220871bf-f541-4540-4fb3-08dafeae9cab X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: tpiot6HFWhSwbl6kDBBMMh2NhcyJTKLZTW54nNyrckUQ+ix0MUsseQ6kCMwsD9eASSA/dle0FQUroCWLk4cr5nL55HLdLJYBJkyN+fKyAJteFAw5WAiiNN2roDQG8fkHSRUUaykeGUuQSxFDH84ca/tmNDrWHYdGwmzdDwJu5iniWBkEgcu+/G2fdqnm8R7+gHnLx2hqU8AkaFAmvdg9bhMyraWs4l+uoPMfbMX/XhJ4NBFXY4BQFc3x2VTSW8s0pmsGCfFqcK9pVJkcpQ0ZeHXHpwFAxk0kM0kZRrI1wodKQOxYZjsYQxhkHgOySbm76duiwdnmwHKMv45NW4rI34O3sqikip48/Ig9eRUDa7Wt1WJGV4HWTCwQJq4u2fBY/iMsGcI4VO4lTLZIvk3V1f1t8JBPiu8/oAIiKU+IuQXev/Xe0d3JsRGLG36LHQaHkoKK+gK8X8W9tr5YN7fTAsXj26NJDdGpm4X+dOsJN+FeGua1SUNLCH8A8jAs//4I72C8CXJeCYIQXv4bKrFfloj/1dhHLoNhmH3xiGplxsHeSdrESTIG1HoexmTtis3Uv+gUtcw3FsxbREzLmbLDmtizJHxCIIote+oBqzFj+KriRBiy5xrD5cad6GB3GTR9SBYXKmP0NvgLt3qY5f44n6QEY3MF9JcT9jLongcJUUo= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230025)(4636009)(376002)(39860400002)(136003)(346002)(366004)(396003)(451199018)(38100700002)(83380400001)(6916009)(66556008)(478600001)(8676002)(186003)(66476007)(9686003)(6486002)(1076003)(66946007)(966005)(2906002)(86362001)(41300700001)(82960400001)(5660300002)(316002)(6506007)(6666004)(6512007)(44832011)(4326008)(8936002);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?pbc8TviJGEajzSDdsLLidTKbCE4AWRVvthlOjAJ/O3wca7y5CCMvEqJtvIGp?= =?us-ascii?Q?NopGWk0YRTKtro211fuj6iBmj72tITilNDTGBTSfv45971tZ1jfyoaTkRCYR?= =?us-ascii?Q?we64iRUFVrJlIOrIETmDdgd9rI17q0jM9vrnQvFayI10bSVL/77csr93N9YL?= =?us-ascii?Q?rGwZk57YKhOzN4FrbEjcdOF/aPmh0CGlyWP+i6z5F7S2Lm8/2AF9CGtPxkLf?= =?us-ascii?Q?EqLxuG/DAnn+oa+iBnFbXF2YnHTTUE9L6plbTOqK9u3/16FcWhRecp2Frk1n?= =?us-ascii?Q?TRmRNkv8acKWH8ZDRaSJkAP5lg6GnUXnC0dMgw66cgvHKAizw2Q9ts5ZEwHg?= =?us-ascii?Q?Di4/1i63pir4A/KIDnBFPu7mppbmNh29folmL7z87RTO41/LoFr/P5noMoqe?= =?us-ascii?Q?04zk0KCQm5Yy73SAipm0xKojRG01Q65OIC6B64Ed6A13BJn+rDLTindAUu5c?= =?us-ascii?Q?VQoBJmjrzDRfBJKGdqB66QSNIVKCST0oHyyTvg/9+CwAirb2MgsRZcbYe+ga?= =?us-ascii?Q?YObwPzuZNyNsgcfsTpxra1zuUdgCRrkBdkh9c6tQ6xxnzF+r33LqPyhU9SRu?= =?us-ascii?Q?+wHQ/c9hZFerlC6XGNAV7KeA8QuWSr086AvspvGaGSJYI6MzjkQtcj5nMooc?= =?us-ascii?Q?dKV1wKrcgHIjnOexSudt+tkStdwE1pRhjUndeXdTpYs6ApWygm78qz/ixZA8?= =?us-ascii?Q?W9vEe8fSErB6c1PfBpza5bqyQYwaOFIFt6G8U4/uY/8jTfuEBLuBsVX5gjQc?= =?us-ascii?Q?AYRJRFc9Lhol+Ggybf88UDR9kSU4Lk5Dt6bClXCVI2g3tZ5v0E3ruLhPIE0R?= =?us-ascii?Q?zatvFY6/dEqKjVum996h2RWvDtU4D6idaJYw5vSES0zxbwf8gJW3rsQl2snK?= =?us-ascii?Q?vrBraVPBleU3gzJtW9+Horev6rQYs8G39pplZHvwqtMV0YBkCIesCr5Foahf?= =?us-ascii?Q?Z++8dKqgSgWKVsy1hluDtz0ENJF5yxVOlAOLsj4YVmQN1jGvC0YBr7D2i/M7?= =?us-ascii?Q?mdcdWrdSajJ40RHFCesHI8BulJoGxNHYl2uRkvqBtVbyfSGLSuFSZV4wYME3?= =?us-ascii?Q?E7L/h2eGe92MTiib8p0NijPClcyQDpFUnT2hHHDIaRlFFRQp4p8vPKuYaJje?= =?us-ascii?Q?2vLhS7gFEmYi+o5lLEhDI7Tc19IvxOKbokYtDmS+3U1H6BI9XMyLI3BV3Uv+?= =?us-ascii?Q?2qBtqfX8X2zsqJkegHPKziSsrOWysulhv7T4sIzbpgHQK2GkL6Y/5ViBcG1/?= =?us-ascii?Q?fo/cNGbsUCCz1NmNg/pCXGAK1xpjk1qUsnCnuypLh5H27QGlY7QPi8ex3f75?= =?us-ascii?Q?+lWWnNMeiWMkpx8qa2tjuEbYkHBlBLvfislvBkNUAweD9dfdUZ00JCvma73F?= =?us-ascii?Q?3TbOigQhlrXOLVPu+u7vQCyN5LorZ+LJncpkx8pivTdGSfDZ8Nqs2gqItqxm?= =?us-ascii?Q?qBrMn69qNPNrvWH8igu+cR3bQB2fB7pJ3XqkwkcU/j3yt1jmjpwIwGhDjJbc?= =?us-ascii?Q?0cM9twPpQnT9Zsr4ZIYdI1tsCFhpLzKx597NOYWof6wrSMH8fbRllhWvM7YR?= =?us-ascii?Q?cStpvOba19Mi+z4jBhdUDZeeww3tO5321IsSDzAtB9n7S/xgYM1RvaUiW4mN?= =?us-ascii?Q?EbHEwRp/uFSbnWTW/uMBFXM0yfWnSLf3y9gf4oKHcYUVv/ACT3pM7+aiDfKW?= =?us-ascii?Q?ThXvaQ=3D=3D?= X-OriginatorOrg: siemens.com X-MS-Exchange-CrossTenant-Network-Message-Id: 220871bf-f541-4540-4fb3-08dafeae9cab X-MS-Exchange-CrossTenant-AuthSource: PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 25 Jan 2023 08:31:53.5708 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 38ae3bcd-9579-4fd4-adda-b42e1495d55a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: iWmUhVi/wePEcssj56jh0J7LHgwDLARifbTTBE/O/96PZPf3jEzihBQ1Al+Cl6W2+l+fEo5fTvu1OY17H7IQdbsjnCCse0ODdVeACMxw0/o= X-MS-Exchange-Transport-CrossTenantHeadersStamped: AS8PR10MB6673 X-TUID: hHIXS+6ODVKE Am Tue, 24 Jan 2023 22:45:57 +0200 schrieb Anton Mikanovich : > Signed-off-by: Anton Mikanovich > --- > testsuite/README.md | 20 ++++++++++++++------ > 1 file changed, 14 insertions(+), 6 deletions(-) > > diff --git a/testsuite/README.md b/testsuite/README.md > index b83a8f9..90ba5c3 100644 > --- a/testsuite/README.md > +++ b/testsuite/README.md > @@ -4,34 +4,42 @@ The framework could be installed by using standard > HOWTO: > https://github.com/avocado-framework/avocado#installing-with-standard-python-tools > > -## For Debian (tested on Debian 10.x) > +## For Debian (tested on Debian 11.x) > > - $ sudo dpkg -i avocado_91.0_all.deb > +``` > +$ pip install avocado-framework==99.0 > +``` maybe suggest venv, pip is evil and if people do that on productive machines they might get into real trouble at some point Henning > > # Run test > > +## Quick developers test > + > +``` > +$ avocado run ../testsuite/citest.py -t dev > --nrunner-max-parallel-tasks=1 +``` > + > ## Fast build test > > ``` > -$ avocado run build_test.py -t fast -p quiet=1 -p cross=1 > +$ avocado run ../testsuite/citest.py -t fast > --nrunner-max-parallel-tasks=1 -p quiet=1 ``` > > ## Full build test > > ``` > -$ avocado run build_test.py -t full -p quiet=1 > +$ avocado run ../testsuite/citest.py -t full > --nrunner-max-parallel-tasks=1 -p quiet=1 ``` > > ## Fast boot test > > ``` > -$ avocado run vm_boot_test.py -t fast -p build_dir="$BUILDDIR" -p > time_to_wait=300 +$ avocado run ../testsuite/citest.py -t > startvm,fast -p time_to_wait=300 ``` > > ## Full boot test > > ``` > -$ avocado run vm_boot_test.py -t full -p build_dir="$BUILDDIR" -p > time_to_wait=300 +$ avocado run ../testsuite/citest.py -t > startvm,full -p time_to_wait=300 ``` > > # Other