From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7184619192186830848 X-Received: by 2002:a05:6902:b14:b0:6fc:c88a:1c6d with SMTP id ch20-20020a0569020b1400b006fcc88a1c6dmr5314869ybb.486.1672831045990; Wed, 04 Jan 2023 03:17:25 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:690c:607:b0:462:6db8:ed52 with SMTP id bq7-20020a05690c060700b004626db8ed52ls16826258ywb.1.-pod-prod-gmail; Wed, 04 Jan 2023 03:17:25 -0800 (PST) X-Google-Smtp-Source: AMrXdXsvrNky1bx5Q4EyTRejkFLzKNi4hYofGtNdARWalqoF2ThHU/OrMbD/f+w+0IE2ecvDH72v X-Received: by 2002:a05:6102:150d:b0:3c7:cf4e:a62a with SMTP id f13-20020a056102150d00b003c7cf4ea62amr16990673vsv.32.1672830943578; Wed, 04 Jan 2023 03:15:43 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1672830943; cv=none; d=google.com; s=arc-20160816; b=PH74KC6InlQ59+6w4tSZEqHEHE4d5WCDMcCNIXUD1GRD55IWZ7wErVLaHYdXG15ZwF eKIkrOZtg7+1lDtt5UNUf9JqELgmdIjmthrAjd6CsF68E/WORuYBZNvBle1ZDCYsHoqL Zk0ycqUwxSoRmU7cmmk8TljMmwQZHx3eRESTXhdr6xBR+zuMAnu4PnRUMx7rxC3FMQFN 6oND1tOvgdIJlWVyM9OKWwAIi90vGmPnsK1HKPU1qiphGYvvc8zLzq70UrkaAtVVBphe XvoSO9AjiH8+Akv2U+n/HTyx5Z8At5SFbnZxATRnwgsU2wdzFvXgiMu976gYzRAdIc5A t0jg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:dkim-signature; bh=Xj/Bhs0AxoLEGJoec19ltQ+6TiQch/L3h3anIZGmPjM=; b=biBjKNWrf3BauAfA2T0HhvIMh945VSXVlRok6TgkkIY/v4ukWgvRka9DQk5ZZvWaVJ FPL47lo/zI6NMInNt9Pvut9XYRpjglL2GjmDMcQ6gZH0pm2uWpP51hCmGVecz5IM4Xy0 zrno8suFWoUv5fzyttGhq6FvvBZGZ5l4GnJQt9Ey7O+JWgWS49Oz+COioRFZ/7Ly50NI o0x6jOO8MEW/ViRWTuQbDrS6sVA6KUQfL7Bgf/xiHN4zTl0lYkWDcRJTwHBLgAot9diw 9CPBQB95m5d75CkXiCK9z18ckJB7jily40zzk55ycbAnpMFcU9L6q/io6UUd6oVAsQfL glRg== ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b="EurmGZ/p"; spf=pass (google.com: domain of roberto.foglietta@gmail.com designates 2607:f8b0:4864:20::82c as permitted sender) smtp.mailfrom=roberto.foglietta@gmail.com; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from mail-qt1-x82c.google.com (mail-qt1-x82c.google.com. [2607:f8b0:4864:20::82c]) by gmr-mx.google.com with ESMTPS id ay22-20020a056130031600b00495a8105fc7si7968459uab.2.2023.01.04.03.15.43 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 04 Jan 2023 03:15:43 -0800 (PST) Received-SPF: pass (google.com: domain of roberto.foglietta@gmail.com designates 2607:f8b0:4864:20::82c as permitted sender) client-ip=2607:f8b0:4864:20::82c; Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b="EurmGZ/p"; spf=pass (google.com: domain of roberto.foglietta@gmail.com designates 2607:f8b0:4864:20::82c as permitted sender) smtp.mailfrom=roberto.foglietta@gmail.com; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: by mail-qt1-x82c.google.com with SMTP id j16so26924176qtv.4 for ; Wed, 04 Jan 2023 03:15:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=Xj/Bhs0AxoLEGJoec19ltQ+6TiQch/L3h3anIZGmPjM=; b=EurmGZ/pie1LR/plkBlKDj3Dbiw4+k+37I3PQ8w/P5WSzBrrNPc/2wI/WFO/q5y723 SDDochuk3j7byeFWvU1wXifqpDZDmTHlsrjeV0cDLcwBRbCiwfr/7ZrDKN80RALlO0qa /tZ9mKIGhueWONIRRpQid3m+THm7Qq+TOc91j//v7RKLcQZwJ+hVpqSVOg6YcMuYV3gi BfmIvRyCLM4K2x6qARxLt3wNDuDqxZXgdy0OkCd1KFVhY4ETrkusaZSAp8PIVKJVzXnd SXT0MJ//0dvUIqzu0wX+H8slwh4Vm9ca/MCmFb+dhSUhYsJ6m94xPq1Dr7DwLNeFK1DC L6wg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=Xj/Bhs0AxoLEGJoec19ltQ+6TiQch/L3h3anIZGmPjM=; b=5zre43YQCrjGbzmfgfXmIAyGVbR/cdask7VVo9qstsWwZIdID+Zyx+c71h1w+46vO2 bI6mFblaaPQtJtmdAeNLk3rPz8+LoLxcsNx8UHFfClufoYbT+8U60Je9eldcHeP+K2K5 oOki8r9bRfkBpFU34s3FgkrKRZkAxwoMS95zBeScvNoaARGOWbHF7owD2HotefkdSSh4 Vv6dJUne27vMKV2ouuj9GCGex4gKReEXpQTCO7mTIWqHjwBXLnhmfpzi2UQDwIuwKEkV F8FJPVeVrkuXlhUxcc9xqJByKf+5kxpKnH2HnosxV3ppNuXvAS+KEtlT3YBi1fiex0er Inbg== X-Gm-Message-State: AFqh2krcQx1Cz3L5zpmAsxnMIQRDNcuwBgQJV21CNXVeJOZ8T61Ip5ie t2xlVs71pUfpRVKPuxFi27lhhZj21FTuv3jklg== X-Received: by 2002:a05:622a:601f:b0:3a7:f283:43cc with SMTP id he31-20020a05622a601f00b003a7f28343ccmr2081829qtb.467.1672830943173; Wed, 04 Jan 2023 03:15:43 -0800 (PST) MIME-Version: 1.0 References: <20230104023128.374390-1-felix.moessbauer@siemens.com> In-Reply-To: From: "Roberto A. Foglietta" Date: Wed, 4 Jan 2023 12:15:06 +0100 Message-ID: Subject: Re: [PATCH 1/1] Reduce disk usage during build by avoiding copies of apt cache To: "Bezdeka, Florian" Cc: "Schmidt, Adriaan" , "ubely@ilbers.de" , "isar-users@googlegroups.com" , "Kiszka, Jan" , "MOESSBAUER, FELIX JONATHAN" , "Schild, Henning" Content-Type: text/plain; charset="UTF-8" X-TUID: YoRNdH9JGTon On Wed, 4 Jan 2023 at 12:00, Bezdeka, Florian wrote: > > On Wed, 2023-01-04 at 11:26 +0100, Roberto A. Foglietta wrote: > > On Wed, 4 Jan 2023 at 07:10, Schmidt, Adriaan > > wrote: > > > > > > @@ -308,7 +307,8 @@ rootfs_install_sstate_prepare() { > > > > # so we use some mount magic to prevent that > > > > mkdir -p ${WORKDIR}/mnt/rootfs > > > > sudo mount --bind ${WORKDIR}/rootfs ${WORKDIR}/mnt/rootfs -o ro > > > > - sudo tar -C ${WORKDIR}/mnt -cpSf rootfs.tar --one-file-system rootfs > > > > + lopts="--one-file-system --exclude-caches --exclude=var/cache/apt/archives" > > > > > > (several locations): > > > With the creation of CACHEDIR.TAG, and --exclude-caches, isn't the --exclude= > > > of that same path redundant? > > > > Hi Adriaan, > > > > if you look at this, everything has been achieved using exclude option > > > > sudo tar --one-file-system --exclude="var/log/*" \ > > --exclude="var/cache/*" --exclude="var/backups/*" \ > > --exclude="var/tmp/*" --exclude="var/crash/*" \ > > --exclude="var/spool/*" --exclude="var/lib/apt/*" \ > > --exclude-caches --exclude-backups -C ${WORKDIR}/mnt \ > > -cpSf rootfs.tar rootfs > > > > however exclude backups and caches are still in place because the user > > might define further ignoring locations using different ways. > > > > P.S.: I have updated and rebased the cherry picking on my 'next' > > branch and it works pretty well despite is just a subset of all the > > patches I am experimenting. > > Roberto, > > nice to see you working on that, but: if you want us to look at > something (especially on code/patches) please send them - with the > right version tag - to the list. We can't go and check your repo every > time and follow all the activity (especially rebasing) that is going on > there. > > Someone already mentioned that: We need to look at patches that are > based on current Isar next branch. Everything else is basically > unusable for us. > Hi Florian, I am not going to push my will over you. I like that you will find your own independent solution whatever the time it takes. After all, my actual contribution is just for free aka I am just a hobbyist. The 1st rule of a hobbyist is: if it works on my PC then, it works for all my world! Sometimes also referred to as Robinson Crusoe 1st rule. LOL Just for sake of completeness: the basic-os was built in 8m33s, in the current 'next' branch it takes 3m6s. It was requiring 43GB of disk space but now less than 4GB. The complete build was taking 20m13s but now is around 12m, sometimes above and sometimes below. It was using 53GB of disk but now it is just 29GB and I am still working on it to improve it. Useless is such a big word, after all... ROTFL Best regards, R-