From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 6788114222392803328 X-Received: by 2002:a2e:93c5:: with SMTP id p5mr7785355ljh.192.1584780098527; Sat, 21 Mar 2020 01:41:38 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a2e:8541:: with SMTP id u1ls1856716ljj.10.gmail; Sat, 21 Mar 2020 01:41:38 -0700 (PDT) X-Google-Smtp-Source: ADFU+vu1TA55ELNp2BMDGCxjO2y4OShKGP8vWgQAxDmvpbfDnzgTlumJKO52Brp39RD3yDJqL/bf X-Received: by 2002:a05:651c:2007:: with SMTP id s7mr8082632ljo.214.1584780098053; Sat, 21 Mar 2020 01:41:38 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1584780098; cv=none; d=google.com; s=arc-20160816; b=yZeNaSq69Iu5QvJ7Y0nVflwc9PaEUyuz3W8DBtTmN6TK6suduW6YhP+++y5NXw7/EL q2s0jz8MXBZa9yyL6+PkRBd4+/BDKXqf2hWtqb1Ytr+CgrnOv6BGz8oyoMyLMZE0cl83 RBK2YqBw6OPUDFrAC+ah4zmnNDHLCJJZKPedGXXqeeFKT0RpvtMh7AObvuVc+Xq66VVN AGGag4GQQvCkA5S3vycMt14B18svPruCp34tH/8OMGdhgauJYmcqMBdxA0MBDl7BlB/g 0K9tq5wJYo/GEOXvmqChLSa0ngD+Yu2AdxUZjmqH+t3ogBO7z8HnT98yMvwiUed3qtic 4pMA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date; bh=Mv7QXpHk/4EvzdN6jwb7h0nbARcNEIS0svKXIFZpXOI=; b=e3+MMg0RQfFbKfmkFnd+OkRcYfsJRP+IFtdmY2/pq9985bqST58pErnB2clcsIF8Yj yjfARvhYzv/EZtghsnVKBJUnsHGfwO1M8ZxaVYZBZCZnV7arhVeXhbUjEBEqX5zI0XxN Kj01y4wlZfTf6KXnCvh6hNCSsCfRc1eFN+qoo8TvLSiuxF4WHuwfpKx4T/htacxuswGh HsTVedsrQEaIQ8VkXZ6/C5lMcmkFrGyuwgjZqNem0nFR/AfJmj/bs1CqfyT2rTZPeS0k 7Pv0usVfg/uYvUMPXJi9ehf0dhZGebpbYfHUEN1wMxC2NbyP4XX9DUcwEUYoZvCF8qsK I0pQ== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of henning.schild@siemens.com designates 194.138.37.39 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Return-Path: Received: from lizzard.sbs.de (lizzard.sbs.de. [194.138.37.39]) by gmr-mx.google.com with ESMTPS id s17si611800ljm.5.2020.03.21.01.41.37 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 21 Mar 2020 01:41:38 -0700 (PDT) Received-SPF: pass (google.com: domain of henning.schild@siemens.com designates 194.138.37.39 as permitted sender) client-ip=194.138.37.39; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of henning.schild@siemens.com designates 194.138.37.39 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Received: from mail1.sbs.de (mail1.sbs.de [192.129.41.35]) by lizzard.sbs.de (8.15.2/8.15.2) with ESMTPS id 02L8fb9M011043 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Sat, 21 Mar 2020 09:41:37 +0100 Received: from md1za8fc.ad001.siemens.net ([139.22.32.253]) by mail1.sbs.de (8.15.2/8.15.2) with ESMTP id 02L8fawd016160; Sat, 21 Mar 2020 09:41:36 +0100 Date: Sat, 21 Mar 2020 09:41:30 +0100 From: Henning Schild To: Cc: Vijai Kumar K , Baurzhan Ismagulov , Jan Kiszka Subject: Re: [PATCHv7 00/29] base-apt-rework Message-ID: <20200321094130.34372969@md1za8fc.ad001.siemens.net> In-Reply-To: <20200321083148.26160-1-henning.schild@siemens.com> References: <20200321083148.26160-1-henning.schild@siemens.com> X-Mailer: Claws Mail 3.17.4 (GTK+ 2.24.32; x86_64-pc-linux-gnu) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-TUID: fMbkM+jRPx16 Also available here https://github.com/henning-schild-work/isar/tree/henning/staging4 Henning On Sat, 21 Mar 2020 09:31:19 +0100 Henning Schild wrote: > From: Henning Schild > > changes since v5: > > - took whitespace and RECIPE-API-CHANGELOG modifications from Baurzhan > - fixed p25 to use another mechanism to speed up exports > - fixed p11 to actually not re-fetch on bootstrap, saves time and > bandwidth > - calling it v7 because some patches appeared as v6 on the list > > changes since v4: > > - add missing - in p8 download-only arg matching, found by Baurzhan > - adding patch 27 and 28 to deal with shell code reuse issues pointed > out by Su, Bao Cheng ... "command not found" > - bump copyright headers from 2019 to 2020 > - adding p29, RECIPE-API-CHANGELOG > > p8 and p1 appeared on the list as v5, but not from me, the p8 thing is > in here the p1 change will probably be added by Baurzhan on a merge, > not calling this v6 because of that repost > > changes since v2: > > Rebased/merged onto current next and added p26. The custom kernel > caching that was missing in v2 is not required on next anymore. > > This one was sent as v3 by Vijai Kumar K > . That just contained a fix in case > the patches would not be rebased, can be ignored. > > Henning Schild (29): > repository: new class to deal with repos > dpkg-base: add download caching of apt:// downloads > meta: dpkg-base: convert "exit" into "return 0" > base-apt: change the sources.list to also offer deb-src > base-apt: add deb-src packages as well > base-apt: do not skip gpg check when it is signed > ci: conf: add "hello" to the sample config and every build > meta: split all apt-get invocations into download and execution > meta: create DL_DIR support for all apt-get downloaded .debs > meta: import DL_DIR debs before apt-get download steps > meta: include DL_DIR deb import/export into bootstrap > base-apt: populate from DEBDIR as well > base-apt: drop the "apt_cache" feature > base-apt: do not copy debs directly out of rootfss anymore > base-apt: rework base-apt population > base-apt: move class "base-apt-helper" into only user > CI: include "isar-disable-apt-cache" into all CI images > CI: include "cowsay" into default build to test dpkg-gbp > CI: set BB_NO_NETWORK for cached rebuild > meta: repository: implement repo_contains_package and use it in > base_apt > meta: repository: simplify the matching of packages > meta: deb-dl-dir: do not cache debs from isar-apt > base-apt: pull base-apt population to the front of the build chain > meta: base-apt: remove isar-apt check from population > meta: deb-dl-dir: only export newly downloaded files > CI: test a custom kernel build in the base-apt offline rebuild > meta/deb-dl-dir: make subshell verbose and fail on error > meta: deb-dl-dir: fix "command not found" error when excluding pkgs > RECIPE-API-CHANGELOG: add a few bits on the base-apt caching changes > > RECIPE-API-CHANGELOG.md | 7 ++ > doc/user_manual.md | 9 +- > meta-isar/conf/local.conf.sample | 10 +- > meta/classes/base-apt-helper.bbclass | 57 ---------- > meta/classes/deb-dl-dir.bbclass | 45 ++++++++ > meta/classes/dpkg-base.bbclass | 47 ++++---- > meta/classes/dpkg-gbp.bbclass | 5 + > meta/classes/dpkg.bbclass | 7 +- > meta/classes/image-cache-extension.bbclass | 36 ------- > meta/classes/image-locales-extension.bbclass | 2 +- > meta/classes/image-tools-extension.bbclass | 7 ++ > meta/classes/image.bbclass | 3 +- > meta/classes/repository.bbclass | 100 > ++++++++++++++++++ meta/classes/rootfs.bbclass | > 32 +++--- meta/conf/bitbake.conf | 6 +- > .../isar-bootstrap/files/base-apt-sources | 1 - > .../isar-bootstrap/isar-bootstrap.inc | 31 +++--- > meta/recipes-devtools/base-apt/base-apt.bb | 92 ++++++++++------ > .../base-apt/files/distributions.in | 3 - > .../buildchroot/files/deps.sh | 37 ++++--- > .../isar-apt/files/distributions.in | 3 - > meta/recipes-devtools/isar-apt/isar-apt.bb | 26 ++--- > scripts/ci_build.sh | 15 ++- > 23 files changed, 342 insertions(+), 239 deletions(-) > delete mode 100644 meta/classes/base-apt-helper.bbclass > create mode 100644 meta/classes/deb-dl-dir.bbclass > delete mode 100644 meta/classes/image-cache-extension.bbclass > create mode 100644 meta/classes/repository.bbclass > delete mode 100644 > meta/recipes-core/isar-bootstrap/files/base-apt-sources delete mode > 100644 meta/recipes-devtools/base-apt/files/distributions.in delete > mode 100644 meta/recipes-devtools/isar-apt/files/distributions.in >