From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7024137565936549888 X-Received: by 2002:a17:906:d0c9:: with SMTP id bq9mr7138917ejb.410.1635441791248; Thu, 28 Oct 2021 10:23:11 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a17:906:5941:: with SMTP id g1ls1966548ejr.10.gmail; Thu, 28 Oct 2021 10:23:10 -0700 (PDT) X-Google-Smtp-Source: ABdhPJww1zU68G+Keqjii+L768XLbUS7ARVWdI5xYFDQb+MXZY0PRFEgcZOmelBFnctmiZJm2Q5v X-Received: by 2002:a17:907:9806:: with SMTP id ji6mr7028787ejc.464.1635441790354; Thu, 28 Oct 2021 10:23:10 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1635441790; cv=none; d=google.com; s=arc-20160816; b=DwYJhcS37OVkKEpg/eJxf8yyiSsv7S0NR8x+G0ZIvR9VHkwOF+Cf++se8WVTMsZ/qi ZL9czg/aLPw+ZqLaBJdGJ522T6jshdpfvf/6qb/GuBCAJDXVuu/mnekSKs8jFv3igBnA r7MzJk5uYhdNaSKNNQzg0g/yBj6Xs80IXH7P4gmmdZ78rsvjN6USZ/qXWROOCaMiTc92 Lfa6m/fCl1AIC7Z1KHZ/Wa3yeZqIhODmMz/mET3fsqU7lvb/8Eqifz3aMMb0DHLqeZQI +M682CZl+LeJES56SGts6naxLVcJZp1zH0YMl6qslvK2B9eTf2mNmuq8CxcqHvAi13KO 7M3g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-language:content-transfer-encoding:in-reply-to:mime-version :user-agent:date:message-id:from:references:to:subject; bh=wYPq/HQaTp/hDwr+w+6OJJh6jvKA7LGLn7Kl4Nd346g=; b=yKRhup9uZbL2BJPwEQYT5eC7ppJXYfLeFxj1tZltpQuOKdOgkDsxQ0lXrvQM1Qnu+4 dlSiyswOHQ/53nYh0l8uRFzn6e14ATJGni24XSNgTDPGYxQy6npUbrOkZaEnnC35AmK2 Bo2y63AVMVGwMiugJ4BeDnMvVOxPcTM65evYoG1jpDlSQyBgw29xq8YSFMO6GW1Hje8a UnLe1go/ZjHf+pwRDLBWCyOFRBlHmNU5l5eJBMX+fVeeUruuakjaO1A3da14nc/jWHz5 r7oSYbopaKeJOWmdP5eyDXQNFXGZPYe+N1fYzZ828azDlxFGOs7Ui2ceqmMOTpFTy4T7 tdng== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=amikan@ilbers.de Return-Path: Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id bi21si257852edb.0.2021.10.28.10.23.10 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Thu, 28 Oct 2021 10:23:10 -0700 (PDT) Received-SPF: pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=amikan@ilbers.de Received: from [192.168.67.164] (mm-42-79-214-37.mgts.dynamic.pppoe.byfly.by [37.214.79.42] (may be forged)) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8) with ESMTPSA id 19SHN4nh018467 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 28 Oct 2021 19:23:07 +0200 Subject: Re: [PATCH] CI: Add sstate-cache testcase To: Jan Kiszka , isar-users@googlegroups.com, "Schmidt, Adriaan" References: <20211028152056.244471-1-amikan@ilbers.de> From: Anton Mikanovich Message-ID: <1822c3ac-88d1-32cc-8886-c83d4746fe3a@ilbers.de> Date: Thu, 28 Oct 2021 20:22:58 +0300 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-TUID: ThB+acjJ4ZN3 28.10.2021 18:34, Jan Kiszka wrote: > On 28.10.21 17:20, Anton Mikanovich wrote: >> Test rebuild time improve after cleanup to be sure sstate-cache works. >> >> Signed-off-by: Anton Mikanovich >> --- >> testsuite/build_test/build_test.py | 40 ++++++++++++++++++++++++++++-- >> 1 file changed, 38 insertions(+), 2 deletions(-) >> >> diff --git a/testsuite/build_test/build_test.py b/testsuite/build_test/build_test.py >> index d39c10c0..244f6fc0 100644 >> --- a/testsuite/build_test/build_test.py >> +++ b/testsuite/build_test/build_test.py >> @@ -1,9 +1,9 @@ >> #!/usr/bin/env python3 >> >> -import os >> +import os, time >> >> from avocado import skipUnless >> -from avocado.utils import path >> +from avocado.utils import path, process >> from cibase import CIBaseTest >> >> UMOCI_AVAILABLE = True >> @@ -206,3 +206,39 @@ class ContainerSdkTest(CIBaseTest): >> targets = ['mc:container-amd64-stretch:isar-image-base'] >> >> self.perform_container_test(targets, 'do_populate_sdk') >> + >> +class SstateTest(CIBaseTest): >> + >> + """ >> + Test rebuild speed improve with sstate-cache >> + >> + :avocado: tags=sstate >> + """ >> + def test_sstate_rebuild(self): >> + speedup_k = 2.0 >> + >> + targets = [ >> + 'mc:qemuamd64-bullseye:isar-image-base' >> + ] >> + >> + # Cleanup everything before build >> + build_dir = self.params.get('build_dir', >> + default=os.path.dirname(__file__) + '/../../build') >> + process.run('rm -rf ' + build_dir + '/sstate-cache', sudo=True) >> + self.deletetmp(build_dir) >> + >> + start = time.time() >> + self.perform_build_test(targets, 1, None) >> + first_time = time.time() - start >> + self.log.info('Non-cached build:' + str(round(first_time, 2))) >> + >> + # Cleanup everything but cache files >> + self.deletetmp(build_dir) >> + >> + start = time.time() >> + self.perform_build_test(targets, 1, None) >> + second_time = time.time() - start >> + self.log.info('Cached build:' + str(round(second_time, 2))) >> + >> + if first_time / second_time < speedup_k: >> + self.fail('No speedup after rebuild with sstate-cache') >> > Is there no better way than measuring time to test if sstate was in > place? Maybe some hit/miss statistics? > > Jan > I've tried to find some Avocado API to access final testcase statistics from within other testcase but didn't find so far. Any advice is welcome. -- Anton Mikanovich Promwad Ltd. External service provider of ilbers GmbH Maria-Merian-Str. 8 85521 Ottobrunn, Germany +49 (89) 122 67 24-0 Commercial register Munich, HRB 214197 General Manager: Baurzhan Ismagulov