From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 6771003121820762112 X-Received: by 2002:a1c:1b41:: with SMTP id b62mr8569207wmb.53.1576747291199; Thu, 19 Dec 2019 01:21:31 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a5d:6912:: with SMTP id t18ls1389044wru.7.gmail; Thu, 19 Dec 2019 01:21:30 -0800 (PST) X-Google-Smtp-Source: APXvYqyG+73eq+ONdo5iGHlrLyhot0zXVmTfHuxJZK34sxdCtkPUqgEGrO0GGmbCbW8wKVodNDlK X-Received: by 2002:adf:f5cf:: with SMTP id k15mr8470759wrp.182.1576747290545; Thu, 19 Dec 2019 01:21:30 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1576747290; cv=none; d=google.com; s=arc-20160816; b=zWTP/jOzlPyDaX/zptYuueLvRmHvHjESdJ7OS45Jzykq9ERJx0Tb2F3pgry+gbSvl7 8vLDkvlgRP6/nFtklLhUBWh+8lYVUuHkM4ZbjponpSHDYjD7sNc4fWac6NR12qIe5XxL YGr2uNLbTU2Q8D1VCD9wzv0cPitEMBF1GeqZqtn8DmXmL3myYLcNEvuA/yBVaPCfW9o8 OsB/uvaNeNQzVhbLxP36L2W0LmG0596R6fSdXbXRspWsZ2MydjJ4OPavlnaRmOK9rRom rmC3Plz0A2sYzvOew6KaF6F+y55ecrv665vm1VmVqWksMkVbbzoqnbevMb/Qaw7Tf+H1 O7Jw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date; bh=Mv1Y/0uBJPhO487EoxQxmaMkV/MAJ7tHTq9QpubQoJ0=; b=ClnLgILlFtfd2Gjt0aTxs3wn/+FXS8eiaoUK/pLd7aA0NxVsPJBASUhv5EpmQhVrMv uCUqtJdfUtLCX3o4SJWPu4wH/UNHNPqpZtCgfLrsOcpw5Jzo7qbo69nHgjpdhBD/QZ9J Pyjk6Usb1n2+RPgabwno66fCwLhAKpj7do4u6+7L7x9Fne3bUHyJG4gdG2ECcqmX428K e2ZkkiiqFRYwWjX/IixUxcg/HMa3kuSoJrKFGUChPnqQzPKIPzX8vEZXhkJdU+YKISCp 5apCjHgUQkFJmGg/hpEVRTygR3AQ6ZRwmorPegCIogNLTGtaKf7BvRAEEa3lQ9kQzAZE j7VA== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of henning.schild@siemens.com designates 192.35.17.28 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Return-Path: Received: from goliath.siemens.de (goliath.siemens.de. [192.35.17.28]) by gmr-mx.google.com with ESMTPS id y185si175602wmd.2.2019.12.19.01.21.30 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 19 Dec 2019 01:21:30 -0800 (PST) Received-SPF: pass (google.com: domain of henning.schild@siemens.com designates 192.35.17.28 as permitted sender) client-ip=192.35.17.28; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of henning.schild@siemens.com designates 192.35.17.28 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Received: from mail2.sbs.de (mail2.sbs.de [192.129.41.66]) by goliath.siemens.de (8.15.2/8.15.2) with ESMTPS id xBJ9LT8m021508 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Thu, 19 Dec 2019 10:21:29 +0100 Received: from md1za8fc.ad001.siemens.net ([139.25.69.125]) by mail2.sbs.de (8.15.2/8.15.2) with ESMTP id xBJ9LT0A032170; Thu, 19 Dec 2019 10:21:29 +0100 Date: Thu, 19 Dec 2019 10:21:29 +0100 From: Henning Schild To: Cc: Jan Kiszka , Baurzhan Ismagulov , Subject: Re: [PATCHv2 00/25] base-apt-rework Message-ID: <20191219102129.7f9a6392@md1za8fc.ad001.siemens.net> In-Reply-To: <20191216115011.17664-1-henning.schild@siemens.com> References: <20191216115011.17664-1-henning.schild@siemens.com> X-Mailer: Claws Mail 3.17.4 (GTK+ 2.24.32; x86_64-pc-linux-gnu) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-TUID: ch9kIJW4uVgK https://github.com/henning-schild-work/isar/tree/henning/staging4 On Mon, 16 Dec 2019 12:49:46 +0100 Henning Schild wrote: > From: Henning Schild > > That one had to wait for some time. I finally managed to have a look > at it again and came up with a v2. Sorry that one is really big and a > lot of things happened since v1. > > The most significant change to last time it p23, which switches the > way the offline cache works. Unfortunately this is turned out pretty > big, splitting it into readably and working chunks was not reasonable. > > Everything up to p19 was already sent once, at least roughly ... > > I hope a v3 will come faster and we will have better tracking of > changes between 2 and 3. > > changes since v1: > > - pull the base-apt building to the front of the build chain > - performance optimze all that copying > - add import/export of bootstrap step > - rebased on current next > - exclude isar-apt in deb_dl_dir_export > - use find exec + for deb_dl_dir_import > - fixed "==" operator in deps.sh in p8 > - fixed typo in p2 message > - fixed variable scope to local in repository functions > > > Henning Schild (25): > repository: new class to deal with repos > dpkg-base: add download caching of apt:// downloads > meta: dpkg-base: convert "exit" into "return 0" > base-apt: change the sources.list to also offer deb-src > base-apt: add deb-src packages as well > base-apt: do not skip gpg check when it is signed > ci: conf: add "hello" to the sample config and every build > meta: split all apt-get invocations into download and execution > meta: create DL_DIR support for all apt-get downloaded .debs > meta: import DL_DIR debs before apt-get download steps > meta: include DL_DIR deb import/export into bootstrap > base-apt: populate from DEBDIR as well > base-apt: drop the "apt_cache" feature > base-apt: do not copy debs directly out of rootfss anymore > base-apt: rework base-apt population > base-apt: move class "base-apt-helper" into only user > CI: include "isar-disable-apt-cache" into all CI images > CI: include "cowsay" into default build to test dpkg-gbp > CI: set BB_NO_NETWORK for cached rebuild > meta: repository: implement repo_contains_package and use it in > base_apt > meta: repository: simplify the matching of packages > meta: deb-dl-dir: do not cache debs from isar-apt > base-apt: pull base-apt population to the front of the build chain > meta: base-apt: remove isar-apt check from population > meta: deb-dl-dir: only export newly downloaded files > > doc/user_manual.md | 9 +- > meta-isar/conf/local.conf.sample | 10 +- > meta/classes/base-apt-helper.bbclass | 57 ---------- > meta/classes/deb-dl-dir.bbclass | 38 +++++++ > meta/classes/dpkg-base.bbclass | 47 ++++---- > meta/classes/dpkg-gbp.bbclass | 5 + > meta/classes/dpkg.bbclass | 7 +- > meta/classes/image-cache-extension.bbclass | 36 ------- > meta/classes/image-locales-extension.bbclass | 2 +- > meta/classes/image-tools-extension.bbclass | 7 ++ > meta/classes/image.bbclass | 3 +- > meta/classes/repository.bbclass | 100 > ++++++++++++++++++ meta/classes/rootfs.bbclass | > 30 +++--- meta/conf/bitbake.conf | 6 +- > .../isar-bootstrap/files/base-apt-sources | 1 - > .../isar-bootstrap/isar-bootstrap.inc | 21 ++-- > meta/recipes-devtools/base-apt/base-apt.bb | 92 ++++++++++------ > .../base-apt/files/distributions.in | 3 - > .../buildchroot/files/deps.sh | 37 ++++--- > .../isar-apt/files/distributions.in | 3 - > meta/recipes-devtools/isar-apt/isar-apt.bb | 26 ++--- > scripts/ci_build.sh | 13 ++- > 22 files changed, 321 insertions(+), 232 deletions(-) > delete mode 100644 meta/classes/base-apt-helper.bbclass > create mode 100644 meta/classes/deb-dl-dir.bbclass > delete mode 100644 meta/classes/image-cache-extension.bbclass > create mode 100644 meta/classes/repository.bbclass > delete mode 100644 > meta/recipes-core/isar-bootstrap/files/base-apt-sources delete mode > 100644 meta/recipes-devtools/base-apt/files/distributions.in delete > mode 100644 meta/recipes-devtools/isar-apt/files/distributions.in >