From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 6554347564595937280 X-Received: by 2002:a1c:3f83:: with SMTP id m125-v6mr1082151wma.18.1526306438124; Mon, 14 May 2018 07:00:38 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a1c:5411:: with SMTP id i17-v6ls1571571wmb.8.canary-gmail; Mon, 14 May 2018 07:00:37 -0700 (PDT) X-Google-Smtp-Source: AB8JxZqNNmESnzrKmgXzXh8ORNbgXbTMuaylOwjnt5LoyUIjcD5NmIjlouLaXv4ToFrgwvwXAvI/ X-Received: by 2002:a1c:741a:: with SMTP id p26-v6mr1218506wmc.15.1526306437610; Mon, 14 May 2018 07:00:37 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1526306437; cv=none; d=google.com; s=arc-20160816; b=J4KVpG0jQGRgfw7odOU3pe5qBF5bIR3tqSpFv1fREkDvaAlIWjYG50JBDSQlj/APGa uKMIcD2bevyZaOBAa24JZt0SlWP1/OaQKFwOxG1Iiz7Yftf3YYeZczAHapaeMhZESL/5 slKon1t7FmxOrAfcKRlGPKFWwfrOZPUBtgeO6fYIK4rjEp7VBy9fM/lY1HTCIBudeDwT Csb+oJe9Q2ymuepezo6Ga6XWzrS9IxjycOvAHYkeZwkxNe+m+BKmrMFD17n9TFout21H B0y0NA5oHwiVPPSnflJLH9tRS6N6nD2rrT7AQDGr5lSczZpKL0JI+bqjKaCyMaL/tVfs iyFg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:content-language:in-reply-to:mime-version :user-agent:date:message-id:from:references:to:subject :arc-authentication-results; bh=ogr/tA3icQQwVHpKywZuwr7YSFqHfV3tB8AYFXCXNFk=; b=fcxMtWUJ7G794GhXeSrFe7umSPu/0Y94Ycqjfi7HG+NuwzowDwIoqdYSsfnmQp9VZA Iia26m0cmYs4Ga5J0PqD+oH2Exit1fVEkKdbtPSCAlZgwCI+SmJXx6IaFcC6YJsiyB1l IZ/kgo4s73/WZjH+FjmzhvoddwwJ6iWk8rvIseVw3MkY17bC7XW+iRLSWNkySoTWWugO RN/z2xIpw3KppaqlBp1eWaa7FUfE7Eay1BI7yBd0VEW80pU/uv1/Hbou3MvUu356Ukm0 hggJC7lzUAIlBy9qBfH42f6ojDTf1fcJ6tzNjG0SN98Yu69B2rG7p0OlWhaRl3HatzB3 5Dvg== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: best guess record for domain of asmirnov@ilbers.de designates 85.214.62.211 as permitted sender) smtp.mailfrom=asmirnov@ilbers.de Return-Path: Received: from aqmola.ilbers.de (aqmola.ilbers.de. [85.214.62.211]) by gmr-mx.google.com with ESMTPS id g12-v6si315623wrm.4.2018.05.14.07.00.37 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 14 May 2018 07:00:37 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of asmirnov@ilbers.de designates 85.214.62.211 as permitted sender) client-ip=85.214.62.211; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: best guess record for domain of asmirnov@ilbers.de designates 85.214.62.211 as permitted sender) smtp.mailfrom=asmirnov@ilbers.de Received: from [10.0.2.15] ([188.227.110.165]) (authenticated bits=0) by aqmola.ilbers.de (8.14.4/8.14.4/Debian-4+deb7u1) with ESMTP id w4EE0YDf011789 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT) for ; Mon, 14 May 2018 16:00:36 +0200 Subject: Re: [PATCH v3] debootstrap: Add fallback apt cache support To: isar-users@googlegroups.com References: <20180514135816.6914-1-asmirnov@ilbers.de> From: Alexander Smirnov Message-ID: <200df34d-4c03-b4ba-a17f-02de9b036001@ilbers.de> Date: Mon, 14 May 2018 17:00:29 +0300 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.4.0 MIME-Version: 1.0 In-Reply-To: <20180514135816.6914-1-asmirnov@ilbers.de> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-TUID: c6Sp8UBRZ70B On 05/14/2018 04:58 PM, Alexander Smirnov wrote: > Add apt config file to switch caching mechanism from MMap to array-based. > This needed to provide possibility to build fresh Isar suites on old hosts. > For example, building Isar stretch on jessie host fails with the following > error: > > Hit:1 http://security.debian.org stretch/updates InRelease > Ign:2 http://ftp.de.debian.org/debian stretch InRelease > Hit:3 http://ftp.de.debian.org/debian stretch-updates InRelease > Hit:4 http://ftp.de.debian.org/debian stretch Release > E: Dynamic MMap ran out of room. Please increase the size of APT::Cache-Start. Current value: 25165824. (man 5 apt.conf) > qemu: uncaught target signal 11 (Segmentation fault) - core dumped > Segmentation fault > > Now Isar performs the following: > 1. Checking if user attempts to build stretch on old kernels > 2. Temporarly installing this apt config file. > 3. Removing this file after image rootfs creation > > So this file will not go to target rootfs. > > Signed-off-by: Alexander Smirnov > --- > meta-isar/recipes-core/images/isar-image-base.bb | 1 + > .../isar-bootstrap/files/isar-apt-fallback.conf | 4 ++++ > meta/recipes-core/isar-bootstrap/isar-bootstrap.bb | 15 ++++++++++++++- > 3 files changed, 19 insertions(+), 1 deletion(-) > create mode 100644 meta/recipes-core/isar-bootstrap/files/isar-apt-fallback.conf > > diff --git a/meta-isar/recipes-core/images/isar-image-base.bb b/meta-isar/recipes-core/images/isar-image-base.bb > index 04c92ab..5ad6df3 100644 > --- a/meta-isar/recipes-core/images/isar-image-base.bb > +++ b/meta-isar/recipes-core/images/isar-image-base.bb > @@ -45,4 +45,5 @@ do_rootfs() { > sudo rmdir ${IMAGE_ROOTFS}/isar-apt > sudo umount -l ${IMAGE_ROOTFS}/dev > sudo umount -l ${IMAGE_ROOTFS}/proc > + sudo rm -f "${IMAGE_ROOTFS}/etc/apt/apt.conf.d/55isar-fallback.conf" > } > diff --git a/meta/recipes-core/isar-bootstrap/files/isar-apt-fallback.conf b/meta/recipes-core/isar-bootstrap/files/isar-apt-fallback.conf > new file mode 100644 > index 0000000..12ddbea > --- /dev/null > +++ b/meta/recipes-core/isar-bootstrap/files/isar-apt-fallback.conf > @@ -0,0 +1,4 @@ > +# Switch apt caching mechanism from mmap to array-based. > +# This helps to build fresh Isar suites on old hosts. > + > +APT::Cache-Fallback "1"; > diff --git a/meta/recipes-core/isar-bootstrap/isar-bootstrap.bb b/meta/recipes-core/isar-bootstrap/isar-bootstrap.bb > index 97b6640..c9a3d98 100644 > --- a/meta/recipes-core/isar-bootstrap/isar-bootstrap.bb > +++ b/meta/recipes-core/isar-bootstrap/isar-bootstrap.bb > @@ -10,7 +10,9 @@ Description = "Minimal debian root file system" > LICENSE = "gpl-2.0" > LIC_FILES_CHKSUM = "file://${LAYERDIR_isar}/licenses/COPYING.GPLv2;md5=751419260aa954499f7abaabaa882bbe" > FILESPATH_prepend := "${THISDIR}/files:" > -SRC_URI = "file://isar-apt.conf" > +SRC_URI = " \ > + file://isar-apt.conf \ > + file://isar-apt-fallback.conf" > PV = "1.0" > > WORKDIR = "${TMPDIR}/work/${DISTRO}-${DISTRO_ARCH}/${PN}" > @@ -189,6 +191,11 @@ do_bootstrap() { > } > addtask bootstrap before do_build after do_generate_keyring > > +def get_host_release(): > + import platform > + rel = platform.release() > + return rel > + > do_apt_config_install[stamp-extra-info] = "${DISTRO}-${DISTRO_ARCH}" > do_apt_config_install() { > sudo mkdir -p "${ROOTFSDIR}/etc/apt/preferences.d" > @@ -201,6 +208,12 @@ do_apt_config_install() { > sudo mkdir -p "${ROOTFSDIR}/etc/apt/apt.conf.d" > sudo install -v -m644 "${WORKDIR}/isar-apt.conf" \ > "${ROOTFSDIR}/etc/apt/apt.conf.d/50isar.conf" > + > + if [ "${@get_distro_suite(d)}" = "stretch" ] && [ "${@get_host_release().split('.')[0]}" -lt "4" ]; then > + sudo install -v -m644 "${WORKDIR}/isar-apt-fallback.conf" \ > + "${ROOTFSDIR}/etc/apt/apt.conf.d/55isar-fallback.conf" > + fi > + This trailing line will be fixed before applying, sorry. Alex > } > addtask apt_config_install before do_build after do_bootstrap do_apt_config_prepare > >