From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7014023532628672512 X-Received: by 2002:ac2:424d:: with SMTP id m13mr2049571lfl.413.1633423004666; Tue, 05 Oct 2021 01:36:44 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a2e:5d3:: with SMTP id 202ls3630128ljf.4.gmail; Tue, 05 Oct 2021 01:36:43 -0700 (PDT) X-Google-Smtp-Source: ABdhPJxJInUQYNq+2kZWBRfSnF5JaLb7v7/CWT+AkllgrZ4x2ZnOxA+PkCcy2mpnZArrLWXpt7c8 X-Received: by 2002:a2e:91d4:: with SMTP id u20mr20762798ljg.81.1633423003619; Tue, 05 Oct 2021 01:36:43 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1633423003; cv=none; d=google.com; s=arc-20160816; b=SxYuse544huflGwaQA0Nu3a/ss29AkxHCWFKV8n9HDb3lNkBMdNHNMj8nxscmn6I9y 2VyXReBAn4xhvVLxDOcBDSEubbPxRtB5uadP3IunCGxY2SeseMKu0lKEHFBQqrnVCxwd RMDBD3oDlHIl3CVydN3SDzkDGhElXR7pyr5wV9dtm3hyrDMmhbVFFR8w/u9DkV5oMOvo XM1fLdkgWfL0z3lsMkWLlC3wtEtLQCB3elY2XWPFn31LhgI4KZ9obHFP3uY86x2nFEmQ kc9KGB3XuHq4j5zkrSbS21kPoPv4Ejmr5ip6iQQJic+zfekDsgomKR1NVYzIUd6w+HpE 74Ww== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date; bh=GKcD036iN8qHx7xQyk/Z6q5XUGuyu9HuX0J2EZ1Yij0=; b=QYuzGUUwocV3oScHy1OoLx++52Qkc9O/Ix7+Gc48f8b2vfhVjx2ObS+T+mYCl3JyIL S/VIu0i3C1EcvqqjwighaVDfAF38t9uM4Pr55/TjPQ6KuGCbjxtupR4zP3ePsZKdcLId Ko0t964LrQjzAIcx9u+KNTWuLYyTET1tTQohvv7HTiCOHaoUcFE8/MR0fho1zXQXXG9t bFqEDc9SdhMV6SIZ4C3GzmHAC+V/2o/6IPmVldnkLb3CwaDO63zPmJs6gtxHqPHRxWeG +ZW0Q6sPFHwlmEvaf8PAxPG4/+o1bw3cdfDLaIcLCxnMJQNS2lj/Nzvjfs4aTKlFeywB 76nQ== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of henning.schild@siemens.com designates 192.35.17.2 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Return-Path: Received: from thoth.sbs.de (thoth.sbs.de. [192.35.17.2]) by gmr-mx.google.com with ESMTPS id z1si17806lfu.5.2021.10.05.01.36.43 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 05 Oct 2021 01:36:43 -0700 (PDT) Received-SPF: pass (google.com: domain of henning.schild@siemens.com designates 192.35.17.2 as permitted sender) client-ip=192.35.17.2; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of henning.schild@siemens.com designates 192.35.17.2 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Received: from mail2.sbs.de (mail2.sbs.de [192.129.41.66]) by thoth.sbs.de (8.15.2/8.15.2) with ESMTPS id 1958agNW009655 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Tue, 5 Oct 2021 10:36:42 +0200 Received: from md1za8fc.ad001.siemens.net ([139.25.0.59]) by mail2.sbs.de (8.15.2/8.15.2) with ESMTP id 1958agnJ022815; Tue, 5 Oct 2021 10:36:42 +0200 Date: Tue, 5 Oct 2021 10:36:42 +0200 From: Henning Schild To: Uladzimir Bely Cc: isar-users@googlegroups.com Subject: Re: [PATCH v2 0/1] Improving base-apt usage Message-ID: <20211005103642.2d3bf31f@md1za8fc.ad001.siemens.net> In-Reply-To: <20211001091329.12979-1-ubely@ilbers.de> References: <20211001091329.12979-1-ubely@ilbers.de> X-Mailer: Claws Mail 3.18.0 (GTK+ 2.24.33; x86_64-pc-linux-gnu) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-TUID: qiCbkxe8rke2 Am Fri, 1 Oct 2021 11:13:28 +0200 schrieb Uladzimir Bely : > Changes since v1: > - rebased on latest next > - updated patchset description > > Currently, base-apt is used in the following way: > * At first build every deb file that took part in installing is > cached in directory $DL_DIR/deb/. Debootstrap is done from remote > source. > * At second build, `base-apt` repo is created from previously > downloaded debs (if ISAR_USE_CACHED_BASE_REPO is set). Debootstrap > and installing packages later is done from this local repo > > The idea of this patchset is to precreate `base-apt` at first build > and use it later for all steps. So, no second build will be required. > > Currently, only debootstrap part is supported, all build-deps are > still installed as before. I do not get where the improvement is. A second offline run is _always_ useful to verify the cache is complete and can be used for a rebuild. If one just wants that cache ... one would only run that base-apt task in the second run. So a fast path without real build is supported. We could even run that base-apt task at the end of the first run ... it used to be an optional task at the end before i moved it to the front. Since your code is not "complete" and just taking care of part of the problem (which to me is not even clear) ... i am against merging that. There is debugging leftofters in the code, but i did not look too deep yet. And it seems like a lot of host leakage is coming into play with the use of the python libs. That weird difference between ubuntu/raspbian and debian is one example. So now one can not run isar on ubuntu anymore ... (not sure if it worked before ... but would be nice if it could). Henning > In future, there are plans to switch from debootstrap to mmdebstrap > that is able to work without sudo and uses more clean > (apt/python-apt) approach in comparison with debootstrap. > > Uladzimir Bely (1): > [meta] Use cached base-apt repo to debootstrap > > meta-isar/conf/distro/ubuntu-focal.conf | 4 + > meta-isar/conf/distro/ubuntu.public.key | 53 +++++ > .../isar-bootstrap/isar-bootstrap.inc | 35 ++- > scripts/debrepo.py | 216 > ++++++++++++++++++ 4 files changed, 307 insertions(+), 1 deletion(-) > create mode 100644 meta-isar/conf/distro/ubuntu.public.key > create mode 100644 scripts/debrepo.py >