From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 6771003123014041600 X-Received: by 2002:a05:6402:513:: with SMTP id m19mr3859619edv.387.1580226216085; Tue, 28 Jan 2020 07:43:36 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a17:906:8597:: with SMTP id v23ls4927100ejx.6.gmail; Tue, 28 Jan 2020 07:43:35 -0800 (PST) X-Google-Smtp-Source: APXvYqxaAnYvIEZxcd4mSv8dNkkcKnObiwUeeh75RupYz0S+kkWdoOPLRlKRzL2d0TBxHnaAdZcI X-Received: by 2002:a17:907:104e:: with SMTP id oy14mr3727108ejb.82.1580226215328; Tue, 28 Jan 2020 07:43:35 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1580226215; cv=none; d=google.com; s=arc-20160816; b=q2rJ6DLxG1BBC5ti/FRbEbGZ+SxieHfTbqVHb8+TwY1YAvn8fVMbosnWn64Zx9KjhA 1/voBE0aQfpZ4hqfWHjD+uT7Wv9CDXN192VvqLtVg1jzgufsdIbZPTIAkGfJA4ejLuDI Rtdd7IKxeuzYS0SY7yI/Oeza7PAode8ohVbMrWswcZsSCQiqtRyG39EfzPMjIIC9JTPC NyCpE22rol0HfoMprImxugMI1zfsWaxnHdnHapC//10k8AXedOVcucSLIwbO+gsEv7w1 lHOtvlOtz/vbXuGSbS0bYAbx7p6TskbdqszXgTodc958cv5ZFd6803x81YUfftR1Vd9D EjlQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=references:in-reply-to:message-id:date:subject:cc:to:from :dkim-signature; bh=4S+BBtqtxpUrUiXcVsIDojLMQlGbFAj28IKyu2m3e/Q=; b=QGai9JfWgtGoAdJSBrWD5nEpTOu1GT4gCRPVOQrBqv0rCC/GxL95mHUQqWe2FtsghD V8de3cIhFmUL+3xIJsVlwb0wGuf13YpcFGMEvpEneOckf+y926x0E7unrXS3iQbwmgUc MKolJsN2TmgCizAEdBQT8Kv5Y6HUMH8XpskDxNWSTMtswk0Eix5BtAgUCdAeidKyW2X5 yYratmr4qvMO+nyA7EaMl48zqZPt2WRgbUG3memmsm+MapTINjmzZDvNNE2aMq7TuHxS 6IAL/+7yxGBm1eOiG6I+c46apfTLQKobWRCuMGiKk8xo1u56Ne2In6Y+YH4ETgV2kBYr uJaw== ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=Uu5CiFWm; spf=pass (google.com: domain of vijaikumar.kanagarajan@gmail.com designates 2a00:1450:4864:20::442 as permitted sender) smtp.mailfrom=vijaikumar.kanagarajan@gmail.com; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from mail-wr1-x442.google.com (mail-wr1-x442.google.com. [2a00:1450:4864:20::442]) by gmr-mx.google.com with ESMTPS id cc24si726228edb.5.2020.01.28.07.43.35 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Tue, 28 Jan 2020 07:43:35 -0800 (PST) Received-SPF: pass (google.com: domain of vijaikumar.kanagarajan@gmail.com designates 2a00:1450:4864:20::442 as permitted sender) client-ip=2a00:1450:4864:20::442; Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=Uu5CiFWm; spf=pass (google.com: domain of vijaikumar.kanagarajan@gmail.com designates 2a00:1450:4864:20::442 as permitted sender) smtp.mailfrom=vijaikumar.kanagarajan@gmail.com; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: by mail-wr1-x442.google.com with SMTP id q10so16552645wrm.11 for ; Tue, 28 Jan 2020 07:43:35 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references; bh=4S+BBtqtxpUrUiXcVsIDojLMQlGbFAj28IKyu2m3e/Q=; b=Uu5CiFWmqVd/rxGhjJkiEtS5CAUjpAvY61y3O4inKmktYiEAF3uDrrmr06SRjpNOUN OpNvkf3v2rfIt4mBmXnmweWHYEPYpT0UgpdfgNwOWgbNfK8+s5KySlOy3+OdZmNwJfc3 hM3WoHSmE60VY/4zmUQQYn10ZNw/mK2TExHV27ohlRx3so87qIKFQ01sLDfd7dMkr6hI LnUbZMvLuBmfIVH/KfgM5gqlNxgi+zNE0XBHtjMUhQymoZQMES05FSsBNFnXzHqnIrjX 8jUL/pquikHHWAb4o92lLZwrwGZ31VPMFTQ9KJ+ziODeeZl2u/D6sEe8s8GxLAOxwl0z rYuw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references; bh=4S+BBtqtxpUrUiXcVsIDojLMQlGbFAj28IKyu2m3e/Q=; b=VAdZ+T8ThTNh7CxSuBQXH5LIQqu0XD2UmAYfYdHyrZXAcm7xKXliuMzTrk5pHFWLIS HHBKapnS+rDJmTWc68SzgxR7aZWcyFNiX/ReI4sUNt/Pr1MrZ3qCG4jOwQMZhQWY1HzS cwGU7HYCJvoq9eqNhcvPWX1+dNazY6lWF37tRX0rF2Ldj4GFgkeYNZapKVTpSz5FwmTM YoCdTBJGEiu0lrL/CUtTfSCJyv0lMV6oW5MppeP0R3kzxlkK0tnOEvQAdBDl8uKAflGM eoZZb3JcuCqJFyiUEOJO+2iX4GiC1htjqdmpN6yYQ25uGyOEB17KeYCM+vdbJvY/sJOB IVsw== X-Gm-Message-State: APjAAAUbZxkn6x8l4bf1GD9os4zwNP59NN4AlYYoe5cF7Z+Zr32nheEQ h1M1Xr+8NeQF2XTaeoFIB9xQxGvjnH4= X-Received: by 2002:adf:8150:: with SMTP id 74mr30104374wrm.114.1580226214880; Tue, 28 Jan 2020 07:43:34 -0800 (PST) Return-Path: Received: from oxygen.mgc.mentorg.com (nat-sch.mentorg.com. [139.181.36.34]) by smtp.gmail.com with ESMTPSA id u8sm3601200wmm.15.2020.01.28.07.43.33 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 28 Jan 2020 07:43:34 -0800 (PST) From: Vijai Kumar K To: isar-users@googlegroups.com Cc: Henning Schild Subject: [PATCH v3 25/26] meta: deb-dl-dir: only export newly downloaded files Date: Tue, 28 Jan 2020 21:12:12 +0530 Message-Id: <20200128154213.22353-26-vijaikumar.kanagarajan@gmail.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20200128154213.22353-1-vijaikumar.kanagarajan@gmail.com> References: <20200128154312.337e61f6@md1za8fc.ad001.siemens.net> <20200128154213.22353-1-vijaikumar.kanagarajan@gmail.com> X-TUID: I9gBearloynV From: Henning Schild Remember the time we imported the previously downloaded files, and only copy out new ones when exporting again. That saved pointless copies and time. Signed-off-by: Henning Schild --- meta/classes/deb-dl-dir.bbclass | 13 ++++++++++--- 1 file changed, 10 insertions(+), 3 deletions(-) diff --git a/meta/classes/deb-dl-dir.bbclass b/meta/classes/deb-dl-dir.bbclass index f969960..e65fc51 100644 --- a/meta/classes/deb-dl-dir.bbclass +++ b/meta/classes/deb-dl-dir.bbclass @@ -8,24 +8,31 @@ inherit repository deb_dl_dir_import() { export pc="${DEBDIR}/${DISTRO}/" export rootfs="${1}" + rm -f "${T}"/deb_dl_dir_import.stamp + touch "${T}"/deb_dl_dir_import.stamp [ ! -d "${pc}" ] && return 0 + [ ! -d "${rootfs}"/var/cache/apt/archives/ ] && return 0 flock -s "${pc}".lock -c ' \ sudo find "${pc}" -type f -iname '*\.deb' -exec \ - cp -f --no-preserve=owner -t "${rootfs}"/var/cache/apt/archives/ '{}' + + cp -n --no-preserve=owner -t "${rootfs}"/var/cache/apt/archives/ '{}' + ' } deb_dl_dir_export() { export pc="${DEBDIR}/${DISTRO}/" export rootfs="${1}" + export T mkdir -p "${pc}" flock "${pc}".lock -c ' \ - find "${rootfs}"/var/cache/apt/archives/ -type f -iname '*\.deb' |\ + find "${rootfs}"/var/cache/apt/archives/ \ + -cnewer "${T}"/deb_dl_dir_import.stamp \ + -type f -iname '*\.deb' |\ while read p; do repo_contains_package "${REPO_ISAR_DIR}"/"${DISTRO}" "${p}" && \ continue - sudo cp -f "${p}" "${pc}" + sudo cp -n "${p}" "${pc}" done sudo chown -R $(id -u):$(id -g) "${pc}" ' + rm -f "${T}"/deb_dl_dir_import.stamp } -- 2.17.1