From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7182122219497062400 X-Received: by 2002:a05:6e02:5ac:b0:303:1ebe:9c4c with SMTP id k12-20020a056e0205ac00b003031ebe9c4cmr2805690ils.301.1672388878668; Fri, 30 Dec 2022 00:27:58 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a92:c5b1:0:b0:30c:2132:4ba with SMTP id r17-20020a92c5b1000000b0030c213204bals1372086ilt.1.-pod-prod-gmail; Fri, 30 Dec 2022 00:27:58 -0800 (PST) X-Google-Smtp-Source: AMrXdXteVbt9HSBUlQECbyCa0UOs1ufDD2roOB9HPiHaa04EQU6lb318nQWK29i8Vb92puJh8IB2 X-Received: by 2002:a92:d382:0:b0:30b:c7fa:7492 with SMTP id o2-20020a92d382000000b0030bc7fa7492mr22002969ilo.12.1672388878140; Fri, 30 Dec 2022 00:27:58 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1672388878; cv=none; d=google.com; s=arc-20160816; b=SQAG/8BPrYw9zAGrHc0eYuH3jwBsRVsQIEkGUr04DT6GomeDD0L8/GWgBb1CwKcl7N 6bezBwAdUUdvaP48wLZCO2K2qezDhk3tPAZOEbjjgQrwbq6ismUHL4/erZrd2Zw9/toc u3gOOtpkH+ZvspnBmYFdsBTU5byfgkGIePrmofz+NVn0AwbnT4CBtbpKBaYH4qcrojZK 0s9IVAyQUmqR1505E2MnrBX0vTytgn9PNsJb/FAK+N7hOJ+dp/++J5A3wRODFaK3QgfN Au776DJqfcOtRiKceeHietRqxVjFXtWWoZLMucKFi6xUunqwmkk6ETUCo2MLXOU8Qnj+ Np5w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:dkim-signature; bh=ABt8MXMbHDgJaoeDgA2KdzEIkpj3zxv7kw7DosOIew4=; b=CJMb4JkBAZlbKeBwp7cL4WMBxrQ4uWs8BqOXB7W+nI7RfFy6aAjOfRw8WDUOVyP0KY SaTlxubfBoRZcuq07sEDWactd4cp8qAdidWHUAY3tJKw9VTiZQcjlq8W8wPl8h1qikAP 4y1qw+EzRGYHpiO8T0L25Imksqz+0YdpeGQ9XnFca8Py6aMkxgP9ywfRCw8I6rV6rJ7f 96luvUoZF2Br+/NGsReapwLxbMXh+GW+qFt1Cwtm3Z7bi2dwV6qROGZOFgGTswYfDf1j aayul7J4clSdVQog6Ywa84Qua9Mv5kLIalrds9tQrKlLOX3xC8wEHG1giOEAwEHPsvBO lQpw== ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b=DqIrs7Ih; spf=pass (google.com: domain of roberto.foglietta@gmail.com designates 2607:f8b0:4864:20::735 as permitted sender) smtp.mailfrom=roberto.foglietta@gmail.com; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from mail-qk1-x735.google.com (mail-qk1-x735.google.com. [2607:f8b0:4864:20::735]) by gmr-mx.google.com with ESMTPS id t8-20020a02cca8000000b0038a5b827993si1500275jap.2.2022.12.30.00.27.58 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 30 Dec 2022 00:27:58 -0800 (PST) Received-SPF: pass (google.com: domain of roberto.foglietta@gmail.com designates 2607:f8b0:4864:20::735 as permitted sender) client-ip=2607:f8b0:4864:20::735; Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b=DqIrs7Ih; spf=pass (google.com: domain of roberto.foglietta@gmail.com designates 2607:f8b0:4864:20::735 as permitted sender) smtp.mailfrom=roberto.foglietta@gmail.com; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: by mail-qk1-x735.google.com with SMTP id o14so10037466qkk.5 for ; Fri, 30 Dec 2022 00:27:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=ABt8MXMbHDgJaoeDgA2KdzEIkpj3zxv7kw7DosOIew4=; b=DqIrs7Ih5l+uZwJqtH/m1rmrwXlzBg+JTYkdjM1iYS8n88JPQGeoLhF87jvPzN4Fid e6h/SXtUj7G1TXL1lknIst3TAmLxz6AlIV6t2HO8S2ThX69JYh/bIdHPqCDpC1NmtdDM d3U5l3/fkt+GB/GljNYXyxvM3kFKEOLGc0aNZmEkggAUbbQJ1yIaOKoTqWKAvHZL6OFR qGzmE9yEpYt1IlAXHfZ0A6liK4cQrbTKIaptN/TeeNG8wUHT2KtCuZSJW1OTduJ7vinm nlgFRf8ftdFkOYG6FEvkOKDpqz3fE6CxwCevDpPSD7rcKZaTUqlRp4BEB6zddxnmLbRj 2Ggg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=ABt8MXMbHDgJaoeDgA2KdzEIkpj3zxv7kw7DosOIew4=; b=lksSaOtmszI/EWaUSlWn3xJe90RrYfLtGbW2DTtHMSsv6l89qU15aDcMHy5Mv31USq vZ6SPe2Luq2KtZUXxaUTMLBoDxQzLVc2NibvrLZws6zC9MxFpid70qPYAyysnWPgIumf jXVhDk+ALrg/yfT3Cj75vtnjgIvQRLVDXb7iNFgMz5lzMizCog/+jrnDTXHQei5bAycu RosMQeIg7sKonzYk5t774hFt9OClkk1M3z3TISKytehI9+00nxmxfWbJoL+dciJPrO2B jDslzFx0iFAFMwIdyOTbmTCKigZkytwl7v1100CC+KTcNxsEwwRtMoFXiNvTaoThI5BB Y9Kw== X-Gm-Message-State: AFqh2krOj3FDoDCidw1oaN/fH31w7ZkgPdxELrRGTzJrCLoNeWcr+Jhz Jr6/wIfF5Q4SQLJQD10y3Bj9b03nX1CgKCZIvg== X-Received: by 2002:ae9:ed86:0:b0:702:4c8f:8316 with SMTP id c128-20020ae9ed86000000b007024c8f8316mr1013704qkg.533.1672388877485; Fri, 30 Dec 2022 00:27:57 -0800 (PST) MIME-Version: 1.0 References: <371e4d826cca6aaba11a4222fef547b134ed6ce7.camel@siemens.com> <38d18c245baa4f685642eafa9a52ab9b9ae9001c.camel@siemens.com> <4769513.OV4Wx5bFTl@hp> <95542c23ea3bd00e31898fc1080854c58e41a8b2.camel@siemens.com> In-Reply-To: <95542c23ea3bd00e31898fc1080854c58e41a8b2.camel@siemens.com> From: "Roberto A. Foglietta" Date: Fri, 30 Dec 2022 09:27:19 +0100 Message-ID: Subject: Re: Better way to handle apt cache needed To: "Moessbauer, Felix" Cc: "ubely@ilbers.de" , "isar-users@googlegroups.com" , "Bezdeka, Florian" , "ibr@radix50.net" , "Schild, Henning" Content-Type: text/plain; charset="UTF-8" X-TUID: DkrMPC/snd5g On Fri, 30 Dec 2022 at 07:05, Moessbauer, Felix wrote: > > On Fri, 2022-12-30 at 00:15 +0100, Roberto A. Foglietta wrote: > > Hi all, > > > > I did some changes to reduce disk usage and to speed up the building. > > The results are quite impressing so, before everything else I am > > going > > to show you the numbers: > > > > results before and after the changes > > > > 43954 Mb (max) | 8657 Mb (max) > > 26548 Mb (rest) | 4118 Mb (rest) > > 3741 Mb (deb) | 3741 Mb (deb) > > 820 Mb (wic) | 820 Mb (wic) > > 11789 Mb (cache) | 579 Mb (cache) > > time: 8m33s | time: 4m34s > > > > The changes has been committed on the default branch (evo) on my ISAR > > fork > > > > https://github.com/robang74/isar > > > > * 9fd5282 - changes for a faster build using less disk space, p.1 > > Hi Roberto, > > I tested your patches. In general, the implemented pattern looks good > and also result in significantly shorter build times on virtual file > systems. > > But I discovered some issues on partial rebuilds. Example: > | ln: will not overwrite just-created '/build/tmp/deploy/buildchroot- > target/debian-bullseye-amd64/var/cache/apt/archives/libnet-ssleay- > perl_1.88-3+b1_arm64.deb' with '/build/downloads/deb/debian- > bullseye/libnet-ssleay-perl_1.88-3+b1_arm64.deb' > > This happens in the do_install_npm in the npm class of meta-iot2050 > [1]. > It could also be an issue with an older sstate cache artifact, or > related to the specific implementation in the NPM class. > Needs further investigation. > > [1] > https://github.com/siemens/meta-iot2050/blob/master/classes/npm.bbclass#L105 Hi Felix, try als with the 2nd part which do not force overwriting of exporting packages 281bcdd - changes for a faster build using less disk space, p.2 I got this error in building the iot2050 project as proposed in README.md: ./kas-container build kas-iot2050-example.yml:kas/opt/sdk.yml ERROR: python-absl-0.15.0-2-r0 do_fetch: Fetcher failure: Recipe uses a floating tag/branch without a fixed SRCREV yet doesn't call bb.fetch2.get_srcrev() (use SRCPV in PV for OE). ERROR: Logfile of failure stored in: /build/tmp/work/iot2050-debian-arm64/python-absl/0.15.0-2-r0/temp/log.do_fetch.746 ERROR: Task (/build/../work/meta-coral/recipes-python/python-absl/python-absl_0.15.0-2.bb:do_fetch) failed with exit code '1' The only change that I make, is to use my ISAR and obviously I converted the syntax to the new bitbake 2.0 Best regards, R-