Re: [PATCH v2 00/10] Introduce local apt repo to cache upstream debian packages for offline usage

["Maxim Yu. Osipov" <mosipov@ilbers.de>]

On 10/17/18 8:11 PM, Jan Kiszka wrote:
> On 11.10.18 18:52, Maxim Yu. Osipov wrote:
>> Hello everybody,
>>
>> This series contains fixes/improvements suggested by Claudius Heine
>> during v1 series review.
>>
>> Changes to v2:
>>    - Fixes/improvements found in base-apt-helper class
>>    - Unifies path names to local repositories
>>
>> 1) Introduces dedicated local apt (base-apt) repo for upstream Debian packages
>>
>> 2) Caches in base-apt repo upstream Debian packages during image generation.
>>
>> 3) After this step, image can be built offline using only base-apt repo.
>>
>> Usage instructions can be found in the last patch.
>>
>> TODO:
>> Sign the repo with gpg
>>
>> Kind regards,
>> Maxim.
>>
>> Alexander Smirnov (8):
>>     base-apt: Add helper class
>>     base-apt: Introduce base implementation
>>     isar-boot-strap: Add option to keep cache
>>     image: Add cache_base_repo task
>>     isar-bootstrap: Make possible to reuse the cache
>>     buildchroot: Make it buildable from base-apt
>>     workaround: Use --allow-unauthenticated working with base-apt
>>     local.conf: Add option to use cached base repository
>>
>> Maxim Yu. Osipov (2):
>>     meta: Unify path names to local repositories
>>     doc: Creation of local apt repo caching upstream Debian packages
>>
>>    doc/user_manual.md                                 | 39 ++++++++++++++++
>>    meta-isar/conf/layer.conf                          | 10 ++--
>>    meta-isar/conf/local.conf.sample                   |  4 ++
>>    meta-isar/recipes-core/images/isar-image-base.bb   |  3 +-
>>    meta/classes/base-apt-helper.bbclass               | 54 ++++++++++++++++++++++
>>    meta/classes/buildchroot.bbclass                   |  2 +-
>>    meta/classes/dpkg-base.bbclass                     | 10 ++--
>>    meta/classes/dpkg.bbclass                          |  2 +-
>>    meta/classes/image.bbclass                         | 25 +++++++++-
>>    meta/classes/isar-bootstrap-helper.bbclass         | 17 +++++--
>>    .../isar-bootstrap/files/base-apt-sources          |  1 +
>>    .../recipes-core/isar-bootstrap/isar-bootstrap.inc | 32 +++++++++----
>>    meta/recipes-devtools/base-apt/base-apt.bb         | 31 +++++++++++++
>>    .../base-apt/files/distributions.in                |  3 ++
>>    meta/recipes-devtools/buildchroot/files/deps.sh    |  2 +-
>>    meta/recipes-devtools/isar-apt/isar-apt.bb         |  8 ++--
>>    meta/recipes-kernel/linux/linux-custom.inc         |  2 +-
>>    17 files changed, 213 insertions(+), 32 deletions(-)
>>    create mode 100644 meta/classes/base-apt-helper.bbclass
>>    create mode 100644 meta/recipes-core/isar-bootstrap/files/base-apt-sources
>>    create mode 100644 meta/recipes-devtools/base-apt/base-apt.bb
>>    create mode 100644 meta/recipes-devtools/base-apt/files/distributions.in
>>
> 
> Could it be we have some regression here? After updating to current
> next, a build without the cache enabled fails during do_rootfs with
> 
> | (Reading database ... 9600 files and directories currently installed.)
> | Removing isar-cfg-localepurge (1.0+isar) ...
> | find: '/build/tmp/work/debian-stretch-armhf/isar-image-base/rootfs/var/cache/apt/archives/partial': Permission denied
> | chown: invalid user: '/build/tmp/work/debian-stretch-armhf/isar-image-base/apt_cache/adduser_3.115_all.deb'
> | WARNING: exit code 1 from a shell command.
> | ERROR: Function failed: do_rootfs (log file is located at /build/tmp/work/debian-stretch-armhf/isar-image-base/temp/log.do_rootfs.5627)
> 
> I do not have the time to bisect, will just jump back for now.

Hmmm... Of course, I've run CI build before applying to the 'next'
(see http://isar-build.org:8080/job/isar_mosipov_next/61).

I'll check if your problem is reproduced when build is not started from 
the scratch.

Regards,
Maxim.


-- 
Maxim Osipov
ilbers GmbH
Maria-Merian-Str. 8
85521 Ottobrunn
Germany
+49 (151) 6517 6917
mosipov@ilbers.de
http://ilbers.de/
Commercial register Munich, HRB 214197
General Manager: Baurzhan Ismagulov