From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 6788114222392803328 X-Received: by 2002:a05:651c:313:: with SMTP id a19mr149255ljp.173.1583877401059; Tue, 10 Mar 2020 14:56:41 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:6512:686:: with SMTP id t6ls2033460lfe.3.gmail; Tue, 10 Mar 2020 14:56:40 -0700 (PDT) X-Google-Smtp-Source: ADFU+vtm5l1/iR4WSTUWnKEDLisuF+7/yV7H5rR0u8T97c5aPcOltt9gx/p6zNzFa+Ldbe8zsNxP X-Received: by 2002:a19:a415:: with SMTP id q21mr111123lfc.21.1583877400338; Tue, 10 Mar 2020 14:56:40 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1583877400; cv=none; d=google.com; s=arc-20160816; b=JA6lezYhOVh3I+as5ffajER6wwXT8oPUBcM8fr5TGZPSqtSxsnHMCD9REO4PPqWF5M gaciAJ7onw2JtkZgtpMfOqF3feciFyNW1cweS+BXb0VXhBbhtwIw2JMTOfPNBmVzJIZj ucRZwcz2ciiKBhy7tSb+3dUP/cimgK2BDQlclBPfoFw+LWSBLTR+mQ6ujJ2b0so7HY+U bHPwMO6pKG8+7zZxyxBX6IdnSl62ja06vCNPPJ4RBp30FBHwVXwzYGHJhbb89oAOrjQm fvoglfwub0trTgxiumCA3GLeRJaLh+n0FIXICEcO26bAokRYHr+MPWfKB9kvL3zmnrBN d54A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from; bh=XadWK/qBd3mNaokIheaaQ6aSVNhhYL2DcfzuL/A27Xs=; b=CAHH06ZKj7EQCU8f6Ggh414cGp2+LDddfqwQlL/9xK8kW/ZN8g5DAsmyUH9jFbwXPB Cdsg0zep8h6TBcxddGYhSe3D/JqN4h1etcKQj/0yDTrCXL9eeeOP8+nelJwiUJix6ZtA iFMPWYY5wtzIgCalPUnS9vE6pbkCL5bHGi+Ml10GDB2ZX2TeuMqytY19RBLPEU3MKVjM a3hSp9JQqh5/o6Pg8IN+iVAewXnZoZJTZrzhAx6b6mj0J4wOGX3A9/jNychCtMyJ0nLc sHfAAkkZDZaaUKoGHC+csNvjHDPPB+TC2TzloxH/xMhuE7DhTN4xR+QJyifoHAwFa0Cf VUMg== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of henning.schild@siemens.com designates 194.138.37.40 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Return-Path: Received: from gecko.sbs.de (gecko.sbs.de. [194.138.37.40]) by gmr-mx.google.com with ESMTPS id j11si4870lfe.4.2020.03.10.14.56.40 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 10 Mar 2020 14:56:40 -0700 (PDT) Received-SPF: pass (google.com: domain of henning.schild@siemens.com designates 194.138.37.40 as permitted sender) client-ip=194.138.37.40; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of henning.schild@siemens.com designates 194.138.37.40 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Received: from mail2.sbs.de (mail2.sbs.de [192.129.41.66]) by gecko.sbs.de (8.15.2/8.15.2) with ESMTPS id 02ALucDs027783 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Tue, 10 Mar 2020 22:56:38 +0100 Received: from localhost.localdomain ([139.22.36.172]) by mail2.sbs.de (8.15.2/8.15.2) with ESMTP id 02ALub5i026985; Tue, 10 Mar 2020 22:56:38 +0100 From: Henning Schild To: isar-users@googlegroups.com Cc: Vijai Kumar K , Baurzhan Ismagulov , Jan Kiszka , Henning Schild Subject: [PATCHv5 00/29] base-apt-rework Date: Tue, 10 Mar 2020 22:56:02 +0100 Message-Id: <20200310215631.24859-1-henning.schild@siemens.com> X-Mailer: git-send-email 2.24.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-TUID: jc8Du6N703uG From: Henning Schild changes since v4: - add missing - in p8 download-only arg matching, found by Baurzhan - adding patch 27 and 28 to deal with shell code reuse issues pointed out by Su, Bao Cheng ... "command not found" - bump copyright headers from 2019 to 2020 - adding p29, RECIPE-API-CHANGELOG p8 and p1 appeared on the list as v5, but not from me, the p8 thing is in here the p1 change will probably be added by Baurzhan on a merge, not calling this v6 because of that repost changes since v2: Rebased/merged onto current next and added p26. The custom kernel caching that was missing in v2 is not required on next anymore. This one was sent as v3 by Vijai Kumar K . That just contained a fix in case the patches would not be rebased, can be ignored. Henning Schild (29): repository: new class to deal with repos dpkg-base: add download caching of apt:// downloads meta: dpkg-base: convert "exit" into "return 0" base-apt: change the sources.list to also offer deb-src base-apt: add deb-src packages as well base-apt: do not skip gpg check when it is signed ci: conf: add "hello" to the sample config and every build meta: split all apt-get invocations into download and execution meta: create DL_DIR support for all apt-get downloaded .debs meta: import DL_DIR debs before apt-get download steps meta: include DL_DIR deb import/export into bootstrap base-apt: populate from DEBDIR as well base-apt: drop the "apt_cache" feature base-apt: do not copy debs directly out of rootfss anymore base-apt: rework base-apt population base-apt: move class "base-apt-helper" into only user CI: include "isar-disable-apt-cache" into all CI images CI: include "cowsay" into default build to test dpkg-gbp CI: set BB_NO_NETWORK for cached rebuild meta: repository: implement repo_contains_package and use it in base_apt meta: repository: simplify the matching of packages meta: deb-dl-dir: do not cache debs from isar-apt base-apt: pull base-apt population to the front of the build chain meta: base-apt: remove isar-apt check from population meta: deb-dl-dir: only export newly downloaded files CI: test a custom kernel build in the base-apt offline rebuild meta/deb-dl-dir: make subshell verbose and fail on error meta: deb-dl-dir: fix "command not found" error when excluding pkgs RECIPE-API-CHANGELOG: add a few bits on the base-apt caching changes RECIPE-API-CHANGELOG.md | 5 + doc/user_manual.md | 9 +- meta-isar/conf/local.conf.sample | 10 +- meta/classes/base-apt-helper.bbclass | 57 ---------- meta/classes/deb-dl-dir.bbclass | 44 ++++++++ meta/classes/dpkg-base.bbclass | 47 ++++---- meta/classes/dpkg-gbp.bbclass | 5 + meta/classes/dpkg.bbclass | 7 +- meta/classes/image-cache-extension.bbclass | 36 ------- meta/classes/image-locales-extension.bbclass | 2 +- meta/classes/image-tools-extension.bbclass | 7 ++ meta/classes/image.bbclass | 3 +- meta/classes/repository.bbclass | 100 ++++++++++++++++++ meta/classes/rootfs.bbclass | 32 +++--- meta/conf/bitbake.conf | 6 +- .../isar-bootstrap/files/base-apt-sources | 1 - .../isar-bootstrap/isar-bootstrap.inc | 21 ++-- meta/recipes-devtools/base-apt/base-apt.bb | 92 ++++++++++------ .../base-apt/files/distributions.in | 3 - .../buildchroot/files/deps.sh | 37 ++++--- .../isar-apt/files/distributions.in | 3 - meta/recipes-devtools/isar-apt/isar-apt.bb | 26 ++--- scripts/ci_build.sh | 15 ++- 23 files changed, 334 insertions(+), 234 deletions(-) delete mode 100644 meta/classes/base-apt-helper.bbclass create mode 100644 meta/classes/deb-dl-dir.bbclass delete mode 100644 meta/classes/image-cache-extension.bbclass create mode 100644 meta/classes/repository.bbclass delete mode 100644 meta/recipes-core/isar-bootstrap/files/base-apt-sources delete mode 100644 meta/recipes-devtools/base-apt/files/distributions.in delete mode 100644 meta/recipes-devtools/isar-apt/files/distributions.in -- 2.24.1