From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7182796543154454528 X-Received: by 2002:a05:6808:13cf:b0:377:fae6:6cdb with SMTP id d15-20020a05680813cf00b00377fae66cdbmr622165oiw.206.1675088255852; Mon, 30 Jan 2023 06:17:35 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:6830:d0a:b0:66c:7df0:d6be with SMTP id bu10-20020a0568300d0a00b0066c7df0d6bels1804503otb.8.-pod-prod-gmail; Mon, 30 Jan 2023 06:17:35 -0800 (PST) X-Google-Smtp-Source: AK7set9uVV3OKa4hBjfBY2wNrez+D8n4SLFYZQHuLWKpkWokXAIX/AQJfBPnr5YTOt77+FHU28D9 X-Received: by 2002:a9d:1b0:0:b0:688:4899:4a23 with SMTP id e45-20020a9d01b0000000b0068848994a23mr4463526ote.11.1675088255335; Mon, 30 Jan 2023 06:17:35 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1675088255; cv=none; d=google.com; s=arc-20160816; b=ENFoZ6vJ9/DlkaI1DZByzbL+w4fHQyQmuk4gxzzU4eibYqjNIwXWZ45iRr+j2zISfn T6UwdQvRdhmzUHJ2u+OTwzQ/Uo4DBHSZFWq9SXzZEfr/4I/WBB9IpTRNpRfpDK/rqDaC PPXcv7OdkNO8LDhEHcWsjYnawEb6UHFvvLNg2GNljXo4mgYHGB2tjmAbTjlfk+vkP1IU BKG1OPn87ahlBWTdlkYEgro7RO8bUbw/MLzBLcyqsnG13Q4HSM85zr6/tT26HwzlVqdV BAA+y5XMTwFIHHvLrUghOEZ+oGDlRWKyMTYtDJmw1kbgOJv1J961ut7leKHt3m2I7tx4 AiWQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:dkim-signature; bh=m3LFptk4EgbBJC8OQk93MHDqMhLAONcjO6tJhJsUuYw=; b=hvoV/kpGlpy/J6lSEBbZxR1FhXEFRxHSK4R+8+wWt8Q87/iX1v6nd4AY0se7BiPyg/ h+NCxkf+CY9h9MGMlaB0oLR2UQepNBijMRQ1ECfVRZAqKmIgr5uSVt7fL6/JdkWehtLE 8Xzn5gRNKtVEEQ+Mjpj57k5QOadKhsPwLJG9+n7g8vUSb/y6OQkjllAtPEWP5P/xNsKo cAYVYoG05dICryEV1a+vuNypXZK9ooJvzjHswk73IiqKN7lI9TT3YQtXpArBEg41M1V9 fG02H1ONH9SyLXbHuBGMurcMtp2gBGVyJLhgDe+EPm3ZnxLVfb5xJmR6iNoGi803qbbl VRjg== ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b=mncGmFfh; spf=pass (google.com: domain of roberto.foglietta@gmail.com designates 2607:f8b0:4864:20::831 as permitted sender) smtp.mailfrom=roberto.foglietta@gmail.com; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from mail-qt1-x831.google.com (mail-qt1-x831.google.com. [2607:f8b0:4864:20::831]) by gmr-mx.google.com with ESMTPS id cc9-20020a05683061c900b00686e40e1e0esi1459939otb.1.2023.01.30.06.17.35 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 30 Jan 2023 06:17:35 -0800 (PST) Received-SPF: pass (google.com: domain of roberto.foglietta@gmail.com designates 2607:f8b0:4864:20::831 as permitted sender) client-ip=2607:f8b0:4864:20::831; Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b=mncGmFfh; spf=pass (google.com: domain of roberto.foglietta@gmail.com designates 2607:f8b0:4864:20::831 as permitted sender) smtp.mailfrom=roberto.foglietta@gmail.com; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: by mail-qt1-x831.google.com with SMTP id bb40so2592830qtb.2 for ; Mon, 30 Jan 2023 06:17:35 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=m3LFptk4EgbBJC8OQk93MHDqMhLAONcjO6tJhJsUuYw=; b=mncGmFfhMrrq7BsQe0ho+1FLs5YSBLB3QM0kLt85x4PKGagsJsAfrKuFSWbI265GDZ D76yt8M/mvGq45cjgQMw7u7ss89BaixXYChpTevvtJn61u635mWUzfwYiBfc36MB64yf VU0CX7eoh91Oj3aUCLSnh4Bt6W0AcOLR+YfGT7tQI4zj6bvB7dKXK7G+CKzHLNyN11Vm HNyubEu38sC4kyUHlyVp9LXZ1jYThCp2995T2aYGBaI43AJM4T/dNngGgCFSZ4L0WIlS uKEWT1YKhlQMB2E3BDuD15wHtDA4ah3GfoTkb39/M7RymAFedBYyH5Hth7L68uIciYA2 Y7lg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=m3LFptk4EgbBJC8OQk93MHDqMhLAONcjO6tJhJsUuYw=; b=QQk7UEt3kN0g7v5ppvIrvxd0Cqn8A7G+JUnPRc/F2Ta8soThFZTA3LBDlDLq9U/qhw tWuxz9wPfv/dQQVn6fNlg0+ol71oQ/Rd07MOquILauRs33ZF8T9ghDRk1aJSdOawl8hk +OXjnk3lK4ErUHj7tqIjq/R0lMJ70+pPNlwB+oNVGUNcCZ/HIcQe3O+FrV0+LqjD+bRY p6eh9b/XRhUF89iO1HQzny8pPse4dEeZcgfWrVO9hJLBzLhDId1IMz6ALDeCLa+wMAUq lrhbMrb2LljgnvLgxZYzGC9AVtwE7yBNZNH/U2ELaNcQFHKfyWY1vhsc20W0QZJK6Xif B9+A== X-Gm-Message-State: AO0yUKXqFMjV/OvdqcLiT6FWaetdjwPv6CHUOXeIgITvsr2X/VsOxhEt UfoTTpIQAsfgPuakehRKSsLT0qHm7foJET7pAw== X-Received: by 2002:a05:622a:60f:b0:3b8:2edf:bac1 with SMTP id z15-20020a05622a060f00b003b82edfbac1mr547208qta.328.1675088254782; Mon, 30 Jan 2023 06:17:34 -0800 (PST) MIME-Version: 1.0 References: <20230120073106.5453-1-ubely@ilbers.de> In-Reply-To: From: "Roberto A. Foglietta" Date: Mon, 30 Jan 2023 15:16:57 +0100 Message-ID: Subject: Re: [PATCH v3 0/5] Improving apt cache To: "Moessbauer, Felix" Cc: "ubely@ilbers.de" , "isar-users@googlegroups.com" , "Kiszka, Jan" , "Schild, Henning" Content-Type: text/plain; charset="UTF-8" X-TUID: snmBH1WQpLhq On Mon, 30 Jan 2023 at 09:45, Moessbauer, Felix wrote: > > On Fri, 2023-01-20 at 08:31 +0100, Uladzimir Bely wrote: > > Currently, apt cache (e.g. `var/cache/apt/archives`) import and > > export > > functions are not optimal. Multiple files are copied from global > > DL_DIR to package WORKDIR, increasing disk IO and space needed. > > > > Also, various chroots (bootstrap, buildchroot, sbuild chroot) include > > their apt caches to sstate cache files. > > > > This patchset switches to hardlinks instead of copies and removes apt > > cache from bootstrapped images ans sstate caches. > > I just saw that this pattern does NOT work in case the cache is on a > different filesystem. This unfortunately is the case for all CI systems > with locally mounted caches, as well as for kas-container builds with > DL_DIR outside the KAS_WORK_DIR. > > In short: This breaks a LOT of use-cases. > I'm really sorry that we only found that by know. > But we definitely need a different solution. > > Example output: > 2023-01-30 08:38:51 - INFO - | ln: failed to create hard link > '/builds/iiot-edge-device/foo/meta-iot2050-pg2- > foo/build/tmp/work/debian-bullseye-amd64/isar-bootstrap-target/1.0- > r0/rootfs/var/cache/apt/archives/gcc-arm-linux-gnueabihf_4%3a10.2.1- > 1_arm64.deb' => '/local-cache/meta-iot2050-pg2- > foo/downloads/deb/debian-bullseye/gcc-arm-linux-gnueabihf_4%3a10.2.1- > 1_arm64.deb': Invalid cross-device link > One more thing: as shown to Uladzimir, as long as the source of two different mount points (not filesystems) exists on the same filesystem, then lp -P complains but for some reason it works. I do not grant that it works in any case but it works enough for which a 2>/dev/null makes the building complete and no one notices. So, if it does not build, that's an issue. If it completes the build despite the stderr messages, we are lucky. However, if confirmed - this weird behaviour - is out of the standard, so being lucky is not enough in the long run. Best regards, R-