Re: [PATCH v2 00/10] Introduce local apt repo to cache upstream debian packages for offline usage

["Maxim Yu. Osipov" <mosipov@ilbers.de>]

Hi Jan,


On 10/17/18 9:15 PM, Maxim Yu. Osipov wrote:
> On 10/17/18 8:11 PM, Jan Kiszka wrote:
>> On 11.10.18 18:52, Maxim Yu. Osipov wrote:
>>> Hello everybody,
>>>
>>> This series contains fixes/improvements suggested by Claudius Heine
>>> during v1 series review.
>>>
>>> Changes to v2:
>>>    - Fixes/improvements found in base-apt-helper class
>>>    - Unifies path names to local repositories
>>>
>>> 1) Introduces dedicated local apt (base-apt) repo for upstream Debian 
>>> packages
>>>
>>> 2) Caches in base-apt repo upstream Debian packages during image 
>>> generation.
>>>
>>> 3) After this step, image can be built offline using only base-apt repo.
>>>
>>> Usage instructions can be found in the last patch.
>>>
>>> TODO:
>>> Sign the repo with gpg
>>>
>>> Kind regards,
>>> Maxim.
>>>
>>> Alexander Smirnov (8):
>>>     base-apt: Add helper class
>>>     base-apt: Introduce base implementation
>>>     isar-boot-strap: Add option to keep cache
>>>     image: Add cache_base_repo task
>>>     isar-bootstrap: Make possible to reuse the cache
>>>     buildchroot: Make it buildable from base-apt
>>>     workaround: Use --allow-unauthenticated working with base-apt
>>>     local.conf: Add option to use cached base repository
>>>
>>> Maxim Yu. Osipov (2):
>>>     meta: Unify path names to local repositories
>>>     doc: Creation of local apt repo caching upstream Debian packages
>>>
>>>    doc/user_manual.md                                 | 39 
>>> ++++++++++++++++
>>>    meta-isar/conf/layer.conf                          | 10 ++--
>>>    meta-isar/conf/local.conf.sample                   |  4 ++
>>>    meta-isar/recipes-core/images/isar-image-base.bb   |  3 +-
>>>    meta/classes/base-apt-helper.bbclass               | 54 
>>> ++++++++++++++++++++++
>>>    meta/classes/buildchroot.bbclass                   |  2 +-
>>>    meta/classes/dpkg-base.bbclass                     | 10 ++--
>>>    meta/classes/dpkg.bbclass                          |  2 +-
>>>    meta/classes/image.bbclass                         | 25 +++++++++-
>>>    meta/classes/isar-bootstrap-helper.bbclass         | 17 +++++--
>>>    .../isar-bootstrap/files/base-apt-sources          |  1 +
>>>    .../recipes-core/isar-bootstrap/isar-bootstrap.inc | 32 +++++++++----
>>>    meta/recipes-devtools/base-apt/base-apt.bb         | 31 +++++++++++++
>>>    .../base-apt/files/distributions.in                |  3 ++
>>>    meta/recipes-devtools/buildchroot/files/deps.sh    |  2 +-
>>>    meta/recipes-devtools/isar-apt/isar-apt.bb         |  8 ++--
>>>    meta/recipes-kernel/linux/linux-custom.inc         |  2 +-
>>>    17 files changed, 213 insertions(+), 32 deletions(-)
>>>    create mode 100644 meta/classes/base-apt-helper.bbclass
>>>    create mode 100644 
>>> meta/recipes-core/isar-bootstrap/files/base-apt-sources
>>>    create mode 100644 meta/recipes-devtools/base-apt/base-apt.bb
>>>    create mode 100644 
>>> meta/recipes-devtools/base-apt/files/distributions.in
>>>
>>
>> Could it be we have some regression here? After updating to current
>> next, a build without the cache enabled fails during do_rootfs with
>>
>> | (Reading database ... 9600 files and directories currently installed.)
>> | Removing isar-cfg-localepurge (1.0+isar) ...
>> | find: 
>> '/build/tmp/work/debian-stretch-armhf/isar-image-base/rootfs/var/cache/apt/archives/partial': 
>> Permission denied
>> | chown: invalid user: 
>> '/build/tmp/work/debian-stretch-armhf/isar-image-base/apt_cache/adduser_3.115_all.deb' 
>>
>> | WARNING: exit code 1 from a shell command.
>> | ERROR: Function failed: do_rootfs (log file is located at 
>> /build/tmp/work/debian-stretch-armhf/isar-image-base/temp/log.do_rootfs.5627) 
>>
>>
>> I do not have the time to bisect, will just jump back for now.
> 
> Hmmm... Of course, I've run CI build before applying to the 'next'
> (see http://isar-build.org:8080/job/isar_mosipov_next/61).
> 
> I'll check if your problem is reproduced when build is not started from 
> the scratch.

I've built (cross compiled from the scratch) the 
multiconfig:qemuarm-stretch:isar-image-base, after that I've checkouted 
'next' branch and ran again 'bitbake 
multiconfig:qemuarm-stretch:isar-image-base' in the same build 
directory. Build was OK.  Did you have another test case?


Kind regards,
Maxim.

-- 
Maxim Osipov
ilbers GmbH
Maria-Merian-Str. 8
85521 Ottobrunn
Germany
+49 (151) 6517 6917
mosipov@ilbers.de
http://ilbers.de/
Commercial register Munich, HRB 214197
General Manager: Baurzhan Ismagulov