public inbox for isar-users@googlegroups.com
 help / color / mirror / Atom feed
From: Jan Kiszka <jan.kiszka@siemens.com>
To: "[ext] Henning Schild" <henning.schild@siemens.com>,
	isar-users@googlegroups.com, "Su,
	Bao Cheng (RC-CN DI FA R&D SW)" <baocheng.su@siemens.com>
Cc: Vijai Kumar K <vijaikumar.kanagarajan@gmail.com>
Subject: Re: [PATCHv4 22/26] meta: deb-dl-dir: do not cache debs from isar-apt
Date: Mon, 3 Feb 2020 18:20:11 +0100	[thread overview]
Message-ID: <16977d1f-fb4d-481b-9c55-53ed064df333@siemens.com> (raw)
In-Reply-To: <20200131143000.14873-23-henning.schild@siemens.com>

On 31.01.20 15:29, [ext] Henning Schild wrote:
> From: Henning Schild <henning.schild@siemens.com>
> 
> Packages from isar-apt are not downloaded from the outside and should
> not be cached.
> 
> Signed-off-by: Henning Schild <henning.schild@siemens.com>
> ---
>   meta/classes/deb-dl-dir.bbclass | 14 ++++++++++----
>   1 file changed, 10 insertions(+), 4 deletions(-)
> 
> diff --git a/meta/classes/deb-dl-dir.bbclass b/meta/classes/deb-dl-dir.bbclass
> index ab4b1f09..f9699603 100644
> --- a/meta/classes/deb-dl-dir.bbclass
> +++ b/meta/classes/deb-dl-dir.bbclass
> @@ -3,8 +3,10 @@
>   #
>   # SPDX-License-Identifier: MIT
>   
> +inherit repository
> +
>   deb_dl_dir_import() {
> -    export pc="${DEBDIR}/${DISTRO}"
> +    export pc="${DEBDIR}/${DISTRO}/"
>       export rootfs="${1}"
>       [ ! -d "${pc}" ] && return 0
>       flock -s "${pc}".lock -c ' \
> @@ -14,12 +16,16 @@ deb_dl_dir_import() {
>   }
>   
>   deb_dl_dir_export() {
> -    export pc="${DEBDIR}/${DISTRO}"
> +    export pc="${DEBDIR}/${DISTRO}/"
>       export rootfs="${1}"
>       mkdir -p "${pc}"
>       flock "${pc}".lock -c ' \
> -        sudo find "${rootfs}"/var/cache/apt/archives/ -type f -iname '*\.deb' \
> -            -exec cp -f '{}' "${pc}" \;
> +        find "${rootfs}"/var/cache/apt/archives/ -type f -iname '*\.deb' |\
> +        while read p; do
> +             repo_contains_package "${REPO_ISAR_DIR}"/"${DISTRO}" "${p}" && \

repo_contains_package may not be found inside the flock shell context, 
as Bao Cheng noticed out. He suggests the pattern

(flock 8
  ...
) 8>${LOCKFILE}

Bao Check, maybe you can describe how you noticed.

Jan

> +                 continue
> +             sudo cp -f "${p}" "${pc}"
> +        done
>           sudo chown -R $(id -u):$(id -g) "${pc}"
>       '
>   }
> 

-- 
Siemens AG, Corporate Technology, CT RDA IOT SES-DE
Corporate Competence Center Embedded Linux

  reply	other threads:[~2020-02-03 17:20 UTC|newest]

Thread overview: 45+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2020-01-31 14:29 [PATCHv4 00/26] base-apt-rework Henning Schild
2020-01-31 14:29 ` [PATCHv4 01/26] repository: new class to deal with repos Henning Schild
2020-01-31 14:29 ` [PATCHv4 02/26] dpkg-base: add download caching of apt:// downloads Henning Schild
2020-01-31 14:29 ` [PATCHv4 03/26] meta: dpkg-base: convert "exit" into "return 0" Henning Schild
2020-01-31 14:29 ` [PATCHv4 04/26] base-apt: change the sources.list to also offer deb-src Henning Schild
2020-01-31 14:29 ` [PATCHv4 05/26] base-apt: add deb-src packages as well Henning Schild
2020-01-31 14:29 ` [PATCHv4 06/26] base-apt: do not skip gpg check when it is signed Henning Schild
2020-01-31 14:29 ` [PATCHv4 07/26] ci: conf: add "hello" to the sample config and every build Henning Schild
2020-01-31 14:29 ` [PATCHv4 08/26] meta: split all apt-get invocations into download and execution Henning Schild
2020-01-31 14:29 ` [PATCHv4 09/26] meta: create DL_DIR support for all apt-get downloaded .debs Henning Schild
2020-01-31 14:29 ` [PATCHv4 10/26] meta: import DL_DIR debs before apt-get download steps Henning Schild
2020-01-31 14:29 ` [PATCHv4 11/26] meta: include DL_DIR deb import/export into bootstrap Henning Schild
2020-01-31 14:29 ` [PATCHv4 12/26] base-apt: populate from DEBDIR as well Henning Schild
2020-01-31 14:29 ` [PATCHv4 13/26] base-apt: drop the "apt_cache" feature Henning Schild
2020-01-31 14:29 ` [PATCHv4 14/26] base-apt: do not copy debs directly out of rootfss anymore Henning Schild
2020-01-31 14:29 ` [PATCHv4 15/26] base-apt: rework base-apt population Henning Schild
2020-01-31 14:29 ` [PATCHv4 16/26] base-apt: move class "base-apt-helper" into only user Henning Schild
2020-01-31 14:29 ` [PATCHv4 17/26] CI: include "isar-disable-apt-cache" into all CI images Henning Schild
2020-01-31 14:29 ` [PATCHv4 18/26] CI: include "cowsay" into default build to test dpkg-gbp Henning Schild
2020-01-31 14:29 ` [PATCHv4 19/26] CI: set BB_NO_NETWORK for cached rebuild Henning Schild
2020-01-31 14:29 ` [PATCHv4 20/26] meta: repository: implement repo_contains_package and use it in base_apt Henning Schild
2020-01-31 14:29 ` [PATCHv4 21/26] meta: repository: simplify the matching of packages Henning Schild
2020-01-31 14:29 ` [PATCHv4 22/26] meta: deb-dl-dir: do not cache debs from isar-apt Henning Schild
2020-02-03 17:20   ` Jan Kiszka [this message]
2020-02-03 18:27     ` Henning Schild
2020-02-03 18:59       ` Henning Schild
2020-02-04  2:11         ` Su, Bao Cheng
2020-02-04  5:10           ` Su, Bao Cheng
2020-02-04  5:14             ` Jan Kiszka
2020-02-04  5:31               ` Su, Bao Cheng
2020-02-04 16:26               ` Henning Schild
2020-02-04  9:33             ` Henning Schild
2020-02-05 12:11             ` Henning Schild
2020-02-05 14:21               ` Su, Bao Cheng
2020-01-31 14:29 ` [PATCHv4 23/26] base-apt: pull base-apt population to the front of the build chain Henning Schild
2020-01-31 14:29 ` [PATCHv4 24/26] meta: base-apt: remove isar-apt check from population Henning Schild
2020-01-31 14:29 ` [PATCHv4 25/26] meta: deb-dl-dir: only export newly downloaded files Henning Schild
2020-01-31 14:30 ` [PATCHv4 26/26] CI: test a custom kernel build in the base-apt offline rebuild Henning Schild
2020-01-31 14:30 ` [PATCHv4 00/26] base-apt-rework Henning Schild
2020-03-04 23:25 ` Baurzhan Ismagulov
2020-03-04 23:28   ` [PATCH v5 01/26] repository: new class to deal with repos Baurzhan Ismagulov
2020-03-10 13:14     ` Henning Schild
2020-03-10 14:13       ` Baurzhan Ismagulov
2020-03-04 23:28   ` [PATCH v5 08/26] meta: split all apt-get invocations into download and execution Baurzhan Ismagulov
2020-03-10 13:01   ` [PATCHv4 00/26] base-apt-rework Henning Schild

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=16977d1f-fb4d-481b-9c55-53ed064df333@siemens.com \
    --to=jan.kiszka@siemens.com \
    --cc=baocheng.su@siemens.com \
    --cc=henning.schild@siemens.com \
    --cc=isar-users@googlegroups.com \
    --cc=vijaikumar.kanagarajan@gmail.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox