From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7024137565936549888 X-Received: by 2002:a05:651c:b07:: with SMTP id b7mr5603922ljr.166.1635435295519; Thu, 28 Oct 2021 08:34:55 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a19:c74d:: with SMTP id x74ls2546010lff.3.gmail; Thu, 28 Oct 2021 08:34:54 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwhNgdt1E+gp/aY1vfXNQqhj5orwQbjbRYSGf4XukjXTQtQqzYd3kY7cShMdMmy1G2ek6Pm X-Received: by 2002:a05:6512:750:: with SMTP id c16mr5058421lfs.571.1635435294061; Thu, 28 Oct 2021 08:34:54 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1635435294; cv=none; d=google.com; s=arc-20160816; b=VDsNCao3J7hBc+XpH385g4X6YGRmtDovm0KoIXLH8NnyUhs0oNT6DPreP+TH6Krf7k TrAmj3blFzwlgFZh7kjAHQxKnw8K0wuH9W8bRIbLY2RZCkipdBm0zEK9mEZ+iyrhnywK W6VOEySIi21xYTqixFvf/R5FTcXRd51E8jXETr11EWUMo2jjBLBSy5M4K6/qoTuenc07 lZSH3NaXiI+iatx/w1UHhvklLJ6GZrptTblkW0cTsbxJl7uoWMs48+UMJC7xaYPnrXOT AE7mzzGW8kQFE1bKd8iTFNXh4Aifp73rMxkcY+PxuIafCYYGiJF3WTaH9qwv+ZEFuK0D h0Iw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:content-language:in-reply-to:mime-version :user-agent:date:message-id:from:references:to:subject; bh=IeuhFoEKX98uXXlCQjac8U2TmHAh3uoaDc6yrOG3QRg=; b=Ai9BJtNyo8uYad/HtVk9eLbgaLUMc7NI3BtCq2OqshE3Q6JiyPG32A2whtQO3yG2GZ y13H+o6y1UBwuRMdqxPBchBbHVvMWwED95OS5zK47Cmdfy/8NJTKfEAra40BLGWs0Rzu 956jzSQvWJWqLZ+oeTc+c7Vl/uiqCCHtJAiEioy3x8dsvziiMNavI9Eo6tOpL97ewJBj rXf3zpAOe05xgbWYp8yM/xwstxGs7r3Z01NxoHskF46xKUwuSmyb0FfFovj08/72MyMG BGXJH7rN1H3FRj0DiopqjtRsAysjo8ZVDh0Fg0Xdxv0LorQY4NEZTMhwqcQNjMSorM1p 2zpg== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of jan.kiszka@siemens.com designates 194.138.37.40 as permitted sender) smtp.mailfrom=jan.kiszka@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Return-Path: Received: from gecko.sbs.de (gecko.sbs.de. [194.138.37.40]) by gmr-mx.google.com with ESMTPS id t142si168999lff.11.2021.10.28.08.34.53 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Thu, 28 Oct 2021 08:34:54 -0700 (PDT) Received-SPF: pass (google.com: domain of jan.kiszka@siemens.com designates 194.138.37.40 as permitted sender) client-ip=194.138.37.40; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of jan.kiszka@siemens.com designates 194.138.37.40 as permitted sender) smtp.mailfrom=jan.kiszka@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Received: from mail2.sbs.de (mail2.sbs.de [192.129.41.66]) by gecko.sbs.de (8.15.2/8.15.2) with ESMTPS id 19SFYrnV009334 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Thu, 28 Oct 2021 17:34:53 +0200 Received: from [139.22.40.62] ([139.22.40.62]) by mail2.sbs.de (8.15.2/8.15.2) with ESMTP id 19SFYqJY027663; Thu, 28 Oct 2021 17:34:52 +0200 Subject: Re: [PATCH] CI: Add sstate-cache testcase To: Anton Mikanovich , isar-users@googlegroups.com, "Schmidt, Adriaan" References: <20211028152056.244471-1-amikan@ilbers.de> From: Jan Kiszka Message-ID: Date: Thu, 28 Oct 2021 17:34:52 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 MIME-Version: 1.0 In-Reply-To: <20211028152056.244471-1-amikan@ilbers.de> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-TUID: XHXSb5ClWIgP On 28.10.21 17:20, Anton Mikanovich wrote: > Test rebuild time improve after cleanup to be sure sstate-cache works. > > Signed-off-by: Anton Mikanovich > --- > testsuite/build_test/build_test.py | 40 ++++++++++++++++++++++++++++-- > 1 file changed, 38 insertions(+), 2 deletions(-) > > diff --git a/testsuite/build_test/build_test.py b/testsuite/build_test/build_test.py > index d39c10c0..244f6fc0 100644 > --- a/testsuite/build_test/build_test.py > +++ b/testsuite/build_test/build_test.py > @@ -1,9 +1,9 @@ > #!/usr/bin/env python3 > > -import os > +import os, time > > from avocado import skipUnless > -from avocado.utils import path > +from avocado.utils import path, process > from cibase import CIBaseTest > > UMOCI_AVAILABLE = True > @@ -206,3 +206,39 @@ class ContainerSdkTest(CIBaseTest): > targets = ['mc:container-amd64-stretch:isar-image-base'] > > self.perform_container_test(targets, 'do_populate_sdk') > + > +class SstateTest(CIBaseTest): > + > + """ > + Test rebuild speed improve with sstate-cache > + > + :avocado: tags=sstate > + """ > + def test_sstate_rebuild(self): > + speedup_k = 2.0 > + > + targets = [ > + 'mc:qemuamd64-bullseye:isar-image-base' > + ] > + > + # Cleanup everything before build > + build_dir = self.params.get('build_dir', > + default=os.path.dirname(__file__) + '/../../build') > + process.run('rm -rf ' + build_dir + '/sstate-cache', sudo=True) > + self.deletetmp(build_dir) > + > + start = time.time() > + self.perform_build_test(targets, 1, None) > + first_time = time.time() - start > + self.log.info('Non-cached build:' + str(round(first_time, 2))) > + > + # Cleanup everything but cache files > + self.deletetmp(build_dir) > + > + start = time.time() > + self.perform_build_test(targets, 1, None) > + second_time = time.time() - start > + self.log.info('Cached build:' + str(round(second_time, 2))) > + > + if first_time / second_time < speedup_k: > + self.fail('No speedup after rebuild with sstate-cache') > Is there no better way than measuring time to test if sstate was in place? Maybe some hit/miss statistics? Jan -- Siemens AG, T RDA IOT Corporate Competence Center Embedded Linux