From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7008446828784910336 X-Received: by 2002:a2e:9018:: with SMTP id h24mr4914729ljg.477.1634809722023; Thu, 21 Oct 2021 02:48:42 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:6512:e85:: with SMTP id bi5ls314708lfb.2.gmail; Thu, 21 Oct 2021 02:48:41 -0700 (PDT) X-Google-Smtp-Source: ABdhPJxZlvtvvpoe43iBM4oICwkSJNtWV4OJZKyI7cnNlMcS7ak9Q1jaYsNPYKScml6HTO9Y+0n5 X-Received: by 2002:a19:48d1:: with SMTP id v200mr4602789lfa.47.1634809721023; Thu, 21 Oct 2021 02:48:41 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1634809721; cv=none; d=google.com; s=arc-20160816; b=DkmCkbf3zP25fYZVQrGLquuW4hxxau5abmG+vda89oEX310sVTcEZyYEvFaFnRocQ+ S0bcMC/V4Wv/ehyeoYSZ32T0yIFjNHAx3MFjwhZq7qBkhmEvaz2lpChq6a0fUcQD2Itt iule+D0FReA2WGq2F0Ubzb4K6iFH+WMAPoZQv1JrVGU8rsrBFv2BiKm/fO3hvD2eDTUD 56bbEbGRM/s6X/HGpS/XbW717aZD6PNSGoy0/gzKYHqGGx/lI/R9r571sp0rUcBSAnlv /ZCFpdFYCCXUAA6nzx8q/DvvOuLbUArk1lChQGyb7u+3T3y6x1AQurlx7rWLMt3laf+j 8xug== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=user-agent:in-reply-to:content-disposition:mime-version:references :mail-followup-to:message-id:subject:to:from:date; bh=Z7KvghPeN5cnWpTu/ElRrtG8OFVUwawoIUsBbipNPp8=; b=BVbO0imr+U4ty5qllB0fHXc4dooosfoC/m7a+653NMLIhKMxyDkK+IPbwUY5A7Ekwa 8+/27JVWq8lATLDExWaxxidrW8LY8bkTXudQMGyb8Xv03BDxSjz0TviJV8BxS012uHcX ShWWmYyJK5wKBjZn3XJY+r1w2fy0vUqISOF9jXD2Q3gMWv39g4vxxNKqdjMpidqNyYyI Q94V/o7v61xrkhT+SYGPScTvc0gwENe3IYmykT+5sIj7gq1oeJRfMjzAgwO2ngOaotCG w7acLKCGdcNxEGq64Zg52z2jgMtgd+b2xO0YOTmwVAgacrc7wiBnhiMjGyaqgEw4//D3 2WXg== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=neutral (google.com: 85.214.156.166 is neither permitted nor denied by best guess record for domain of ibr@radix50.net) smtp.mailfrom=ibr@radix50.net Return-Path: Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id s16si342939lfp.6.2021.10.21.02.48.40 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Thu, 21 Oct 2021 02:48:40 -0700 (PDT) Received-SPF: neutral (google.com: 85.214.156.166 is neither permitted nor denied by best guess record for domain of ibr@radix50.net) client-ip=85.214.156.166; Authentication-Results: gmr-mx.google.com; spf=neutral (google.com: 85.214.156.166 is neither permitted nor denied by best guess record for domain of ibr@radix50.net) smtp.mailfrom=ibr@radix50.net Received: from yssyq.m.ilbers.de (host-80-81-17-52.static.customer.m-online.net [80.81.17.52]) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8) with ESMTPSA id 19L9ma2m018837 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Thu, 21 Oct 2021 11:48:38 +0200 Date: Thu, 21 Oct 2021 11:48:36 +0200 From: Baurzhan Ismagulov To: isar-users@googlegroups.com Subject: Re: [PATCH v14 00/16] Update Avocado testsuite Message-ID: <20211021094836.GG27644@yssyq.m.ilbers.de> Mail-Followup-To: isar-users@googlegroups.com References: <1633020341-26062-1-git-send-email-anton.mikanovich@promwad.com> <98b328db-e1ef-0a2a-8ddd-7fe8f9c341ab@siemens.com> <20211014102538.GA27644@yssyq.m.ilbers.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.10.1 (2018-07-13) X-TUID: nKhnWrtjMgqf On Thu, Oct 14, 2021 at 05:51:22PM +0200, Jan Kiszka wrote: > > In a nutshell, the execution environment can have the control how the necessary > > tools are provided (Debian packages or pip), just as it is today with the other > > packages required by Isar. > > You broke gitlab-ci, please fix. This can only reasonably be done in > Isar, not outside (avokado is not build dependency, this is not part of > kas-isar). We can do this to unblock the situation. However, I think that drawing the line between build dependency and test tooling is a disservice for kas users. One of the goals for migrating to a test framework is to split the previously monolithic testsuite into individual testcases and the ability to run them manually. People like kas because it hides the environment preparation issues while also providing the necessary customization options. If a user spawns a kas shell to make his changes, he could use e.g. avocado run testsuite/build_test/build_test.py -t sdk to test only the area he is interested in. The same for debugging failing CI cases without having to run the full testsuite, which meanwhile takes several hours. That is why I think providing the test tooling in the default image is actually a good thing for the developers. With kind regards, Baurzhan.