From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 6788114222392803328 X-Received: by 2002:a05:6402:13c6:: with SMTP id a6mr11985560edx.339.1584779522457; Sat, 21 Mar 2020 01:32:02 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a50:8ad5:: with SMTP id k21ls4919374edk.0.gmail; Sat, 21 Mar 2020 01:32:02 -0700 (PDT) X-Google-Smtp-Source: ADFU+vunm3wBWps/csKFc9oYH9pbmoU1wLBzBuCWVW/LGPFE9/IowaV6/ygO2PGtKRupdnS5xWOr X-Received: by 2002:a50:e68e:: with SMTP id z14mr12191339edm.307.1584779522027; Sat, 21 Mar 2020 01:32:02 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1584779522; cv=none; d=google.com; s=arc-20160816; b=Af2Exy4croJiOB4snvlVOUzz8FgB60H6r3mUi+53EzaH59dQ4pY7WSRgsNpIwEH1XD x6y31007jd48JqIZOu3WETKea9EWiLARiNFUkAFXOaFggLi5LmFUQ+cPXqWvpZXtBVVf tp/paZQBM93aGWic0I/VjByGM5cWkVwbIdXqJxhs/ufwD8lQnSYlNJB6XS/g+TUj6Fq7 60VAEdBnLyeze5yG6yMKso+6u/c4a79HheSNnJmtlXFRzIjDWmwQixo4/HfoYX/CPgv3 dzeWyf2eY0zX0sMfwChu8mmsYmLHALNlmXTeTFMbK6cjEPihJpsdcCaHBHpsZgftWuT7 Ocow== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from; bh=WOndSrYbb+Mf07Z2tkS9w8/fSBYcqzAbofaxjG8K+QA=; b=riRZ8uUcaGeQEXHeUepb+wLVNgfIa3GZ/XHmhuMfB7q+SfCuKFSUzGM7wlZIpJx7dM lXfKN+Tngx8I7qnz78NW/DXVjf1yfnNU4yD6TTe/5Ge9cD0N4xnm3IhXWCdM6ORPy1dR g2ne4v6RUqlsmSzu8XMnQCih2AwMPSECJeOuzdnqSjIpsCR20l2Tx4uuYtSTd/RVki0g NjfHJMRzH7+hH8+AbTUvaZ6NO9zxZgKRln6cu5GNH8IGpD6xM2LNVh21iEdN6kCLMOHo q1LC379mgAp94tb5nkDxOkas3usfb7nzNgklRcC3tbBplpPKoumh8ENlyOM9dIPEh4tj 3qYQ== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of henning.schild@siemens.com designates 192.35.17.14 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Return-Path: Received: from david.siemens.de (david.siemens.de. [192.35.17.14]) by gmr-mx.google.com with ESMTPS id e19si424057edr.3.2020.03.21.01.32.01 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 21 Mar 2020 01:32:02 -0700 (PDT) Received-SPF: pass (google.com: domain of henning.schild@siemens.com designates 192.35.17.14 as permitted sender) client-ip=192.35.17.14; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of henning.schild@siemens.com designates 192.35.17.14 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Received: from mail2.sbs.de (mail2.sbs.de [192.129.41.66]) by david.siemens.de (8.15.2/8.15.2) with ESMTPS id 02L8W1lj026308 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Sat, 21 Mar 2020 09:32:01 +0100 Received: from localhost.localdomain ([139.22.32.253]) by mail2.sbs.de (8.15.2/8.15.2) with ESMTP id 02L8VuGN021533; Sat, 21 Mar 2020 09:32:00 +0100 From: Henning Schild To: isar-users@googlegroups.com Cc: Vijai Kumar K , Baurzhan Ismagulov , Jan Kiszka , Henning Schild Subject: [PATCHv7 09/29] meta: create DL_DIR support for all apt-get downloaded .debs Date: Sat, 21 Mar 2020 09:31:28 +0100 Message-Id: <20200321083148.26160-10-henning.schild@siemens.com> X-Mailer: git-send-email 2.24.1 In-Reply-To: <20200321083148.26160-1-henning.schild@siemens.com> References: <20200321083148.26160-1-henning.schild@siemens.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-TUID: j7LWccZb1hsl From: Henning Schild Hook in between the "apt-get --download-only"s and the "apt-get"s and copy out all the debs for later. Signed-off-by: Henning Schild --- meta/classes/deb-dl-dir.bbclass | 15 +++++++++++++++ meta/classes/dpkg-base.bbclass | 1 + meta/classes/dpkg-gbp.bbclass | 1 + meta/classes/dpkg.bbclass | 1 + meta/classes/image-locales-extension.bbclass | 2 +- meta/classes/image-tools-extension.bbclass | 1 + meta/classes/rootfs.bbclass | 14 +++++++++++--- meta/conf/bitbake.conf | 1 + 8 files changed, 32 insertions(+), 4 deletions(-) create mode 100644 meta/classes/deb-dl-dir.bbclass diff --git a/meta/classes/deb-dl-dir.bbclass b/meta/classes/deb-dl-dir.bbclass new file mode 100644 index 00000000..066ce1a3 --- /dev/null +++ b/meta/classes/deb-dl-dir.bbclass @@ -0,0 +1,15 @@ +# This software is a part of ISAR. +# Copyright (C) 2020 Siemens AG +# +# SPDX-License-Identifier: MIT + +deb_dl_dir_export() { + export pc="${DEBDIR}/${DISTRO}" + export rootfs="${1}" + mkdir -p "${pc}" + flock "${pc}".lock -c ' \ + sudo find "${rootfs}"/var/cache/apt/archives/ -type f -iname '*\.deb' \ + -exec cp -f '{}' "${pc}" \; + sudo chown -R $(id -u):$(id -g) "${pc}" + ' +} diff --git a/meta/classes/dpkg-base.bbclass b/meta/classes/dpkg-base.bbclass index 5dd334d0..9aa2d546 100644 --- a/meta/classes/dpkg-base.bbclass +++ b/meta/classes/dpkg-base.bbclass @@ -8,6 +8,7 @@ inherit buildchroot inherit debianize inherit terminal inherit repository +inherit deb-dl-dir DEPENDS ?= "" diff --git a/meta/classes/dpkg-gbp.bbclass b/meta/classes/dpkg-gbp.bbclass index 2afe9db4..7e908eba 100644 --- a/meta/classes/dpkg-gbp.bbclass +++ b/meta/classes/dpkg-gbp.bbclass @@ -15,6 +15,7 @@ do_install_builddeps_append() { sudo -E chroot ${BUILDCHROOT_DIR} \ apt-get install -y -o Debug::pkgProblemResolver=yes \ --no-install-recommends --download-only ${GBP_DEPENDS} + deb_dl_dir_export "${BUILDCHROOT_DIR}" sudo -E chroot ${BUILDCHROOT_DIR} \ apt-get install -y -o Debug::pkgProblemResolver=yes \ --no-install-recommends ${GBP_DEPENDS} diff --git a/meta/classes/dpkg.bbclass b/meta/classes/dpkg.bbclass index b26c6456..7e2c86d6 100644 --- a/meta/classes/dpkg.bbclass +++ b/meta/classes/dpkg.bbclass @@ -9,6 +9,7 @@ do_install_builddeps() { E="${@ isar_export_proxies(d)}" sudo -E chroot ${BUILDCHROOT_DIR} /isar/deps.sh \ ${PP}/${PPS} ${DISTRO_ARCH} --download-only + deb_dl_dir_export "${BUILDCHROOT_DIR}" sudo -E chroot ${BUILDCHROOT_DIR} /isar/deps.sh \ ${PP}/${PPS} ${DISTRO_ARCH} dpkg_undo_mounts diff --git a/meta/classes/image-locales-extension.bbclass b/meta/classes/image-locales-extension.bbclass index 3c0758ff..0f0d0ca4 100644 --- a/meta/classes/image-locales-extension.bbclass +++ b/meta/classes/image-locales-extension.bbclass @@ -25,7 +25,7 @@ def get_nopurge(d): j.split()[0].split(".")[0], j.split()[0])))) -ROOTFS_INSTALL_COMMAND_BEFORE_CLEAN += "image_install_localepurge_download" +ROOTFS_INSTALL_COMMAND_BEFORE_EXPORT += "image_install_localepurge_download" image_install_localepurge_download[weight] = "40" image_install_localepurge_download() { sudo -E chroot '${ROOTFSDIR}' \ diff --git a/meta/classes/image-tools-extension.bbclass b/meta/classes/image-tools-extension.bbclass index b8531cb4..ec67d940 100644 --- a/meta/classes/image-tools-extension.bbclass +++ b/meta/classes/image-tools-extension.bbclass @@ -34,6 +34,7 @@ do_install_imager_deps() { --allow-unauthenticated --allow-downgrades --download-only install \ ${IMAGER_INSTALL}' + deb_dl_dir_export ${BUILDCHROOT_DIR} sudo -E chroot ${BUILDCHROOT_DIR} sh -c ' \ apt-get -o Debug::pkgProblemResolver=yes --no-install-recommends -y \ --allow-unauthenticated --allow-downgrades install \ diff --git a/meta/classes/rootfs.bbclass b/meta/classes/rootfs.bbclass index 64eaef70..706b43a7 100644 --- a/meta/classes/rootfs.bbclass +++ b/meta/classes/rootfs.bbclass @@ -1,5 +1,7 @@ # This software is a part of ISAR. -# Copyright (c) Siemens AG, 2019 +# Copyright (c) Siemens AG, 2020 + +inherit deb-dl-dir ROOTFS_ARCH ?= "${DISTRO_ARCH}" ROOTFS_DISTRO ?= "${DISTRO}" @@ -119,8 +121,14 @@ rootfs_install_pkgs_download() { /usr/bin/apt-get ${ROOTFS_APT_ARGS} --download-only ${ROOTFS_PACKAGES} } -ROOTFS_INSTALL_COMMAND_BEFORE_CLEAN ??= "" -ROOTFS_INSTALL_COMMAND += "${ROOTFS_INSTALL_COMMAND_BEFORE_CLEAN}" +ROOTFS_INSTALL_COMMAND_BEFORE_EXPORT ??= "" +ROOTFS_INSTALL_COMMAND += "${ROOTFS_INSTALL_COMMAND_BEFORE_EXPORT}" + +ROOTFS_INSTALL_COMMAND += "rootfs_export_package_cache" +rootfs_export_package_cache[weight] = "5" +rootfs_export_package_cache() { + deb_dl_dir_export ${ROOTFSDIR} +} ROOTFS_INSTALL_COMMAND += "${@ 'rootfs_install_clean_files' if (d.getVar('ROOTFS_CLEAN_FILES') or '').strip() else ''}" rootfs_install_clean_files[weight] = "2" diff --git a/meta/conf/bitbake.conf b/meta/conf/bitbake.conf index 6b05e91b..b7c0a8f5 100644 --- a/meta/conf/bitbake.conf +++ b/meta/conf/bitbake.conf @@ -26,6 +26,7 @@ DEPLOY_DIR = "${TMPDIR}/deploy" FILE_DIRNAME = "${@os.path.dirname(d.getVar('FILE', False))}" FILESEXTRAPATHS ?= "__default:" GITDIR = "${DL_DIR}/git" +DEBDIR = "${DL_DIR}/deb" DEBSRCDIR = "${DL_DIR}/deb-src" P = "${PN}-${PV}" PF = "${PN}-${PV}-${PR}" -- 2.24.1