From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 6607733288662466560 X-Received: by 2002:a17:906:645:: with SMTP id t5-v6mr709715ejb.3.1540288579947; Tue, 23 Oct 2018 02:56:19 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a17:906:3641:: with SMTP id r1-v6ls655778ejb.11.gmail; Tue, 23 Oct 2018 02:56:19 -0700 (PDT) X-Google-Smtp-Source: ACcGV62ZrAz7pSMldAfIwmN5WzauQ5gLc7HofaEAMGYg30WsJmDvmmUGn2ViIFetCJZk7vy7oVje X-Received: by 2002:a17:906:2cd4:: with SMTP id r20-v6mr8675365ejr.5.1540288579479; Tue, 23 Oct 2018 02:56:19 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1540288579; cv=none; d=google.com; s=arc-20160816; b=0ZNRH6cGtJJEQP/hv76qoLIYaOWZ5DXeeD5Xpr/d+pAd4Khp9D6DYQ4Sv49SWtXkji V1F03LtZsy32ZN6eYfZNdsjUEHYB8GSP5Vhs4qJl88Q+5PQ5V7AKLx0WiMcrjeHNXhHJ 84UXTKiHNIpJgL+MndD1o2LlwB6/c2zZvF2NCDvda2AU7seplbAeUFE6LPkF+CIM+ogk 4cbjWMsid+mlXXetlWwfOBpCHwO08G/iXkwgGGm51EfufKrL3DPUvL+sS5m3Wl0QmcU1 Jz9GKisdMeeLLD2NvMjcFaMOGy0TiEyyhFyoYZa/ERTry/mOidYKp7mrR/Pa2nk+Wq7r fwTQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:content-language:in-reply-to:mime-version :user-agent:date:message-id:organization:references:to:from:subject; bh=s9OFjabl+Z0m5hm9z2kOtfwz3ZH8cFEAvz4TzFd9Rn4=; b=onT81H9Q9m1dUOW+oPE586q0KqcZiput3no+CVJLagbs9Brshk6m0BcFYPy+MbnTqk sktHhHTZ+wycUf9j5sxrNKo6g51M/GhFIqV47Dv0YH2nT9koI0N6xXVXZ8dPMDKZnP1k 3KE4KSGxQJnPWeEwmFLRBNN98vUiO95dKN+DtCLoX02h1qVXcaK44ZOzGApVwZA6dg8f AWD0PFVmctZbWfTgXuNxvYf/ZkYzGObmsyWcfnTKb1N8NP1P8EFTK72FQ6N6dWs96wwS CrO+3Zd6knAPcAf+DYeyqTrhuzmGpyrQZW6HX4ozYGTUPHh5G6Gc2hwsHnVB9cqKI+2P go7w== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: best guess record for domain of mosipov@ilbers.de designates 85.214.62.211 as permitted sender) smtp.mailfrom=mosipov@ilbers.de Return-Path: Received: from aqmola.ilbers.de (aqmola.ilbers.de. [85.214.62.211]) by gmr-mx.google.com with ESMTPS id y16-v6si49397eds.0.2018.10.23.02.56.19 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 23 Oct 2018 02:56:19 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of mosipov@ilbers.de designates 85.214.62.211 as permitted sender) client-ip=85.214.62.211; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: best guess record for domain of mosipov@ilbers.de designates 85.214.62.211 as permitted sender) smtp.mailfrom=mosipov@ilbers.de Received: from [192.168.50.180] (nat-ppp-217.71.235.199-satnet-spb.ru [217.71.235.199] (may be forged)) (authenticated bits=0) by aqmola.ilbers.de (8.14.4/8.14.4/Debian-4+deb7u1) with ESMTP id w9N9uGEI023209 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NOT); Tue, 23 Oct 2018 11:56:17 +0200 Subject: Re: [PATCH v2 00/10] Introduce local apt repo to cache upstream debian packages for offline usage From: "Maxim Yu. Osipov" To: Jan Kiszka , isar-users@googlegroups.com References: <20181011165305.1622-1-mosipov@ilbers.de> <598de977-de7e-0a48-6c8d-36761711a738@siemens.com> <2c35941c-a17c-9fa7-e286-01e4fe786051@ilbers.de> Organization: ilbers GmbH Message-ID: <02e2e7d3-e470-03fd-32b1-9fb9fa716bde@ilbers.de> Date: Tue, 23 Oct 2018 12:56:11 +0300 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.0 MIME-Version: 1.0 In-Reply-To: <2c35941c-a17c-9fa7-e286-01e4fe786051@ilbers.de> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-TUID: P2x/VUhQtAyq Hi Jan, On 10/17/18 9:15 PM, Maxim Yu. Osipov wrote: > On 10/17/18 8:11 PM, Jan Kiszka wrote: >> On 11.10.18 18:52, Maxim Yu. Osipov wrote: >>> Hello everybody, >>> >>> This series contains fixes/improvements suggested by Claudius Heine >>> during v1 series review. >>> >>> Changes to v2: >>>    - Fixes/improvements found in base-apt-helper class >>>    - Unifies path names to local repositories >>> >>> 1) Introduces dedicated local apt (base-apt) repo for upstream Debian >>> packages >>> >>> 2) Caches in base-apt repo upstream Debian packages during image >>> generation. >>> >>> 3) After this step, image can be built offline using only base-apt repo. >>> >>> Usage instructions can be found in the last patch. >>> >>> TODO: >>> Sign the repo with gpg >>> >>> Kind regards, >>> Maxim. >>> >>> Alexander Smirnov (8): >>>     base-apt: Add helper class >>>     base-apt: Introduce base implementation >>>     isar-boot-strap: Add option to keep cache >>>     image: Add cache_base_repo task >>>     isar-bootstrap: Make possible to reuse the cache >>>     buildchroot: Make it buildable from base-apt >>>     workaround: Use --allow-unauthenticated working with base-apt >>>     local.conf: Add option to use cached base repository >>> >>> Maxim Yu. Osipov (2): >>>     meta: Unify path names to local repositories >>>     doc: Creation of local apt repo caching upstream Debian packages >>> >>>    doc/user_manual.md                                 | 39 >>> ++++++++++++++++ >>>    meta-isar/conf/layer.conf                          | 10 ++-- >>>    meta-isar/conf/local.conf.sample                   |  4 ++ >>>    meta-isar/recipes-core/images/isar-image-base.bb   |  3 +- >>>    meta/classes/base-apt-helper.bbclass               | 54 >>> ++++++++++++++++++++++ >>>    meta/classes/buildchroot.bbclass                   |  2 +- >>>    meta/classes/dpkg-base.bbclass                     | 10 ++-- >>>    meta/classes/dpkg.bbclass                          |  2 +- >>>    meta/classes/image.bbclass                         | 25 +++++++++- >>>    meta/classes/isar-bootstrap-helper.bbclass         | 17 +++++-- >>>    .../isar-bootstrap/files/base-apt-sources          |  1 + >>>    .../recipes-core/isar-bootstrap/isar-bootstrap.inc | 32 +++++++++---- >>>    meta/recipes-devtools/base-apt/base-apt.bb         | 31 +++++++++++++ >>>    .../base-apt/files/distributions.in                |  3 ++ >>>    meta/recipes-devtools/buildchroot/files/deps.sh    |  2 +- >>>    meta/recipes-devtools/isar-apt/isar-apt.bb         |  8 ++-- >>>    meta/recipes-kernel/linux/linux-custom.inc         |  2 +- >>>    17 files changed, 213 insertions(+), 32 deletions(-) >>>    create mode 100644 meta/classes/base-apt-helper.bbclass >>>    create mode 100644 >>> meta/recipes-core/isar-bootstrap/files/base-apt-sources >>>    create mode 100644 meta/recipes-devtools/base-apt/base-apt.bb >>>    create mode 100644 >>> meta/recipes-devtools/base-apt/files/distributions.in >>> >> >> Could it be we have some regression here? After updating to current >> next, a build without the cache enabled fails during do_rootfs with >> >> | (Reading database ... 9600 files and directories currently installed.) >> | Removing isar-cfg-localepurge (1.0+isar) ... >> | find: >> '/build/tmp/work/debian-stretch-armhf/isar-image-base/rootfs/var/cache/apt/archives/partial': >> Permission denied >> | chown: invalid user: >> '/build/tmp/work/debian-stretch-armhf/isar-image-base/apt_cache/adduser_3.115_all.deb' >> >> | WARNING: exit code 1 from a shell command. >> | ERROR: Function failed: do_rootfs (log file is located at >> /build/tmp/work/debian-stretch-armhf/isar-image-base/temp/log.do_rootfs.5627) >> >> >> I do not have the time to bisect, will just jump back for now. > > Hmmm... Of course, I've run CI build before applying to the 'next' > (see http://isar-build.org:8080/job/isar_mosipov_next/61). > > I'll check if your problem is reproduced when build is not started from > the scratch. I've built (cross compiled from the scratch) the multiconfig:qemuarm-stretch:isar-image-base, after that I've checkouted 'next' branch and ran again 'bitbake multiconfig:qemuarm-stretch:isar-image-base' in the same build directory. Build was OK. Did you have another test case? Kind regards, Maxim. -- Maxim Osipov ilbers GmbH Maria-Merian-Str. 8 85521 Ottobrunn Germany +49 (151) 6517 6917 mosipov@ilbers.de http://ilbers.de/ Commercial register Munich, HRB 214197 General Manager: Baurzhan Ismagulov