From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 6607733288662466560 X-Received: by 2002:ac2:41da:: with SMTP id d26-v6mr846858lfi.13.1539800110612; Wed, 17 Oct 2018 11:15:10 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a2e:9204:: with SMTP id k4-v6ls1465056ljg.31.gmail; Wed, 17 Oct 2018 11:15:10 -0700 (PDT) X-Google-Smtp-Source: ACcGV63u7dG2zMzxI+hZZzsB0oecshfGs+WnAbOa8D5nQxqfiO1l5lg9HzUNQlLlUQb1CDE5+kwF X-Received: by 2002:a2e:218:: with SMTP id 24-v6mr838529ljc.31.1539800110089; Wed, 17 Oct 2018 11:15:10 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1539800110; cv=none; d=google.com; s=arc-20160816; b=AXCYBsFkSMc4HUBnQiD1KdfwWaXlavEiWCRRyZIryXPSTOhIHKEjO8Q55cSfD+YjxL HYG9Iz5JnVIuYW2N5VRcwL1tO/k5JwM3yhXnncog4sZ7fEaBqWR6go3kmrNPQrJWDDsF FV8MsLfCHvMXUj6DAKy4pvIFonoUGDvDxTGD7fTkyf7ZQXT+GqGNi7zcdYJVyIiqvnF2 rErzm8cCiEHXxXPWG1PwZNJCTv3TLbbfFWgIqdObArG0C5h1t91mc0fbhQm1pMUor920 kyqnAP8KzItRgND948q2Yz6nqjD7/ldSWKsM+sV+j4g3yQcvSqJMR4rG26gqntn7lc/w 5nCg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:content-language:in-reply-to:mime-version :user-agent:date:message-id:organization:from:references:to:subject; bh=a6B+bRLEIROSvnlhsXrIVEhQtbIS34zGrJbH3dh7Dyg=; b=rtsMFSlVVG1ZnvaABoTZaXZMneXUQ+KIF/tfGyaq/Qj53xAIO0FGixB/86Apzq4NTX vi8AEJ9p6H2HTzvMm55k8JX0P/0sdBvxhr2HhMZB0HGqw1IMBVHP/6Tya6K/1Lii2KTZ tu7AG9QIeZbV2S8eJuGTNWrwtVtdepwe6FTA4A29OuLnEJeW86eGvkRHm3hn3y96ba5t ZrHdPcEFS/MnzytxZGVWuJOlEtvzLkMVRRZ/H8QTzL+Qul5d1HnANomjoaJVwSUn2wVK OMa1ttwFbA64DqkcCDvgG6GLYrha/6xTvTOwhe4Nr1ULZko9OAo7O4whX46GX7rAhmpi wyEA== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: best guess record for domain of mosipov@ilbers.de designates 85.214.62.211 as permitted sender) smtp.mailfrom=mosipov@ilbers.de Return-Path: Received: from aqmola.ilbers.de (aqmola.ilbers.de. [85.214.62.211]) by gmr-mx.google.com with ESMTPS id y66-v6si497132lje.0.2018.10.17.11.15.09 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 17 Oct 2018 11:15:09 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of mosipov@ilbers.de designates 85.214.62.211 as permitted sender) client-ip=85.214.62.211; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: best guess record for domain of mosipov@ilbers.de designates 85.214.62.211 as permitted sender) smtp.mailfrom=mosipov@ilbers.de Received: from [192.168.50.180] (nat-ppp-217.71.235.199-satnet-spb.ru [217.71.235.199] (may be forged)) (authenticated bits=0) by aqmola.ilbers.de (8.14.4/8.14.4/Debian-4+deb7u1) with ESMTP id w9HIF709002427 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NOT); Wed, 17 Oct 2018 20:15:08 +0200 Subject: Re: [PATCH v2 00/10] Introduce local apt repo to cache upstream debian packages for offline usage To: Jan Kiszka , isar-users@googlegroups.com References: <20181011165305.1622-1-mosipov@ilbers.de> <598de977-de7e-0a48-6c8d-36761711a738@siemens.com> From: "Maxim Yu. Osipov" Organization: ilbers GmbH Message-ID: <2c35941c-a17c-9fa7-e286-01e4fe786051@ilbers.de> Date: Wed, 17 Oct 2018 21:15:01 +0300 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.0 MIME-Version: 1.0 In-Reply-To: <598de977-de7e-0a48-6c8d-36761711a738@siemens.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-TUID: X/07NSY1LcNJ On 10/17/18 8:11 PM, Jan Kiszka wrote: > On 11.10.18 18:52, Maxim Yu. Osipov wrote: >> Hello everybody, >> >> This series contains fixes/improvements suggested by Claudius Heine >> during v1 series review. >> >> Changes to v2: >> - Fixes/improvements found in base-apt-helper class >> - Unifies path names to local repositories >> >> 1) Introduces dedicated local apt (base-apt) repo for upstream Debian packages >> >> 2) Caches in base-apt repo upstream Debian packages during image generation. >> >> 3) After this step, image can be built offline using only base-apt repo. >> >> Usage instructions can be found in the last patch. >> >> TODO: >> Sign the repo with gpg >> >> Kind regards, >> Maxim. >> >> Alexander Smirnov (8): >> base-apt: Add helper class >> base-apt: Introduce base implementation >> isar-boot-strap: Add option to keep cache >> image: Add cache_base_repo task >> isar-bootstrap: Make possible to reuse the cache >> buildchroot: Make it buildable from base-apt >> workaround: Use --allow-unauthenticated working with base-apt >> local.conf: Add option to use cached base repository >> >> Maxim Yu. Osipov (2): >> meta: Unify path names to local repositories >> doc: Creation of local apt repo caching upstream Debian packages >> >> doc/user_manual.md | 39 ++++++++++++++++ >> meta-isar/conf/layer.conf | 10 ++-- >> meta-isar/conf/local.conf.sample | 4 ++ >> meta-isar/recipes-core/images/isar-image-base.bb | 3 +- >> meta/classes/base-apt-helper.bbclass | 54 ++++++++++++++++++++++ >> meta/classes/buildchroot.bbclass | 2 +- >> meta/classes/dpkg-base.bbclass | 10 ++-- >> meta/classes/dpkg.bbclass | 2 +- >> meta/classes/image.bbclass | 25 +++++++++- >> meta/classes/isar-bootstrap-helper.bbclass | 17 +++++-- >> .../isar-bootstrap/files/base-apt-sources | 1 + >> .../recipes-core/isar-bootstrap/isar-bootstrap.inc | 32 +++++++++---- >> meta/recipes-devtools/base-apt/base-apt.bb | 31 +++++++++++++ >> .../base-apt/files/distributions.in | 3 ++ >> meta/recipes-devtools/buildchroot/files/deps.sh | 2 +- >> meta/recipes-devtools/isar-apt/isar-apt.bb | 8 ++-- >> meta/recipes-kernel/linux/linux-custom.inc | 2 +- >> 17 files changed, 213 insertions(+), 32 deletions(-) >> create mode 100644 meta/classes/base-apt-helper.bbclass >> create mode 100644 meta/recipes-core/isar-bootstrap/files/base-apt-sources >> create mode 100644 meta/recipes-devtools/base-apt/base-apt.bb >> create mode 100644 meta/recipes-devtools/base-apt/files/distributions.in >> > > Could it be we have some regression here? After updating to current > next, a build without the cache enabled fails during do_rootfs with > > | (Reading database ... 9600 files and directories currently installed.) > | Removing isar-cfg-localepurge (1.0+isar) ... > | find: '/build/tmp/work/debian-stretch-armhf/isar-image-base/rootfs/var/cache/apt/archives/partial': Permission denied > | chown: invalid user: '/build/tmp/work/debian-stretch-armhf/isar-image-base/apt_cache/adduser_3.115_all.deb' > | WARNING: exit code 1 from a shell command. > | ERROR: Function failed: do_rootfs (log file is located at /build/tmp/work/debian-stretch-armhf/isar-image-base/temp/log.do_rootfs.5627) > > I do not have the time to bisect, will just jump back for now. Hmmm... Of course, I've run CI build before applying to the 'next' (see http://isar-build.org:8080/job/isar_mosipov_next/61). I'll check if your problem is reproduced when build is not started from the scratch. Regards, Maxim. -- Maxim Osipov ilbers GmbH Maria-Merian-Str. 8 85521 Ottobrunn Germany +49 (151) 6517 6917 mosipov@ilbers.de http://ilbers.de/ Commercial register Munich, HRB 214197 General Manager: Baurzhan Ismagulov