From mboxrd@z Thu Jan  1 00:00:00 1970
X-GM-THRID: 7182122219497062400
X-Received: by 2002:a05:6214:3a07:b0:4bb:ce03:5714 with SMTP id nw7-20020a0562143a0700b004bbce035714mr1428653qvb.30.1672219325571;
        Wed, 28 Dec 2022 01:22:05 -0800 (PST)
X-BeenThere: isar-users@googlegroups.com
Received: by 2002:ac8:58c1:0:b0:397:ab6a:3f0 with SMTP id u1-20020ac858c1000000b00397ab6a03f0ls10998305qta.0.-pod-prod-gmail;
 Wed, 28 Dec 2022 01:22:05 -0800 (PST)
X-Google-Smtp-Source: AMrXdXuZGmfeOMx011yuyvmZKA6tC2x8jqztbLHQB3v/MFVNlcPI3l+PVUOH4RvSoqEOEIOthiyL
X-Received: by 2002:ac8:6e87:0:b0:3a8:11f3:b81c with SMTP id c7-20020ac86e87000000b003a811f3b81cmr31726669qtv.53.1672219325026;
        Wed, 28 Dec 2022 01:22:05 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; t=1672219325; cv=none;
        d=google.com; s=arc-20160816;
        b=NmGERVLJDCGxVgZfZyfcpoo4tWOn8fotkeALns8blWk9nbktmFl/j1Pnqro3j7jtxH
         i0gRQNhuY1r2lwiW89HwsYdfb5kYcJaU2ELutzHaryMLUNTt9qzIU6st0gXL60rOcl0Y
         cnFaQVUWWMEjDApNMnMRZR39/qt7qTuS5qrBIjy+d4RzNtQdYPV70/ski34JrG5x0XcP
         I15AuOBfyTSPG7qLmjFUuBxzs47JQc6Cl5Ic12Anj47EgmHMnRleiN9P9k7qqDgx+r6z
         XBtBm0ugoYj82QvVXY0ffUDjY3sw9pH5I6LmDTjFhZEcTQwkzhyiAHDIWDuKt6jnB6NS
         JDUQ==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816;
        h=in-reply-to:content-disposition:mime-version:references
         :mail-followup-to:message-id:subject:cc:to:from:date;
        bh=X+/oNUUA7mOlEMsNifTcMM8VTsEJSZoICekg0VFf3cw=;
        b=ObdH/wy5JKo90rUUctZv2OIGjynwBdTdX7U4KgzbxpczrAA+4JgYhPln3C04YLoAgK
         dt8S8APMLaIunMLxDKAE0RRLiBaAwwUjIP8UA9bX76XaAwEC9G33N7Luw5DCcq72DMKs
         7nGVbMXh3fobT2DlVsmAHOObVz2fNzg7mA1x9W3d4SmRP427L82HRVM47Ih5F6IRawwL
         2SW3h/rO8lmNeNur5sgasYHweb0z7JWklMW2dFQ9R6aTtbSWquSlbz2HtjvMZjmwsD8u
         iWnmvMSb75WNwgGPncTcHfcch3XeAeV1Ro1CMWMDIsh+IC5KTCyiA0dpGzrL1P0B5dV7
         7vBg==
ARC-Authentication-Results: i=1; gmr-mx.google.com;
       spf=neutral (google.com: 85.214.156.166 is neither permitted nor denied by best guess record for domain of ibr@radix50.net) smtp.mailfrom=ibr@radix50.net
Return-Path: <ibr@radix50.net>
Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166])
        by gmr-mx.google.com with ESMTPS id i11-20020a05620a144b00b006fe3de3ed80si939826qkl.4.2022.12.28.01.22.04
        for <isar-users@googlegroups.com>
        (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256);
        Wed, 28 Dec 2022 01:22:04 -0800 (PST)
Received-SPF: neutral (google.com: 85.214.156.166 is neither permitted nor denied by best guess record for domain of ibr@radix50.net) client-ip=85.214.156.166;
Authentication-Results: gmr-mx.google.com;
       spf=neutral (google.com: 85.214.156.166 is neither permitted nor denied by best guess record for domain of ibr@radix50.net) smtp.mailfrom=ibr@radix50.net
Received: from ilbers.de (dslb-084-058-239-201.084.058.pools.vodafone-ip.de [84.58.239.201])
	(authenticated bits=0)
	by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 2BS9M15f003587
	(version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT);
	Wed, 28 Dec 2022 10:22:02 +0100
Date: Wed, 28 Dec 2022 10:21:56 +0100
From: Baurzhan Ismagulov <ibr@radix50.net>
To: "Moessbauer, Felix" <felix.moessbauer@siemens.com>
Cc: "isar-users@googlegroups.com" <isar-users@googlegroups.com>,
        "Schild, Henning" <henning.schild@siemens.com>
Subject: Re: Better way to handle apt cache needed
Message-ID: <Y6wKtPgPRoR+1FNX@ilbers.de>
Mail-Followup-To: "Moessbauer, Felix" <felix.moessbauer@siemens.com>,
	"isar-users@googlegroups.com" <isar-users@googlegroups.com>,
	"Schild, Henning" <henning.schild@siemens.com>
References: <371e4d826cca6aaba11a4222fef547b134ed6ce7.camel@siemens.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <371e4d826cca6aaba11a4222fef547b134ed6ce7.camel@siemens.com>
X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED
	autolearn=unavailable autolearn_force=no version=3.4.2
X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de
X-TUID: ica36NYO6eaX

On Wed, Dec 28, 2022 at 09:02:13AM +0000, Moessbauer, Felix wrote:
> The root cause for that behavior is the apt cache
> (deb_dl_dir_(import|export)), that copies all previously downloaded apt
> packages into the WORKDIR of each (bitbake) package.
> Given, that a common apt-cache is around 2GB and 8 tasks are run in
> parallel, this gives already 16GB for the tasks, and 7 * 2GB for the
> buildchroots (host and target), in total ~30GB.

Thanks Felix for the report. IIRC, it was previously mounted and was supposed
to be converted to per-package hardlinks to parallelize sbuild instances and
ease debugging (by knowing later which exact snapshot was fed to a specific
build). We use small (1- / 2-TB) SSDs as job storage and a huge increase would
have been noticeable... We'll check.

With kind regards,
Baurzhan