Re: [PATCH v2 0/8] pre-processing pipeline and transient package replacement

["Maxim Yu. Osipov" <mosipov@ilbers.de>]

Hi Claudius,

Creation of local apt repo caching upstream debian packages
doesn't work on with this patchset (my host PC is Debian 9).

I've set ISAR_CROSS_COMPILE ?= "1" in local.conf and followed the 
procedure (without Signing of local repo) described:

https://github.com/ilbers/isar/blob/next/doc/user_manual.md#creation-of-local-apt-repo-caching-upstream-debian-packages

1) bitbake -c cache_base_repo multiconfig:qemuarm-stretch:isar-image-base

works OK.

2) Set `ISAR_USE_CACHED_BASE_REPO` in `conf/local.conf` and remove build
artifacts to use only local base-apt

sudo rm -rf tmp

3) Trigger again generation of image (now using local caching repo):
bitbake multiconfig:qemuarm-stretch:isar-image-base fails (log is below):

=================
NOTE: Executing RunQueue Tasks
ERROR: mc:qemuarm-stretch:isar-image-base-debian-stretch-qemuarm 
do_rootfs_install: Function failed: rootfs_install_pkgs_download (log 
file is located at 
/home/myo/work/isar/src/trunk/isar/build/tmp/work/debian-stretch-armhf/isar-image-base-debian-stretch-qemuarm/temp/log.do_rootfs_install.11489)
ERROR: Logfile of failure stored in: 
/home/myo/work/isar/src/trunk/isar/build/tmp/work/debian-stretch-armhf/isar-image-base-debian-stretch-qemuarm/temp/log.do_rootfs_install.11489
Log data follows:
| DEBUG: Executing python function do_rootfs_install
| DEBUG: Executing shell function root_cleandirs
| DEBUG: Shell function root_cleandirs finished
| DEBUG: Executing shell function rootfs_prepare
| DEBUG: Shell function rootfs_prepare finished
| DEBUG: Executing shell function rootfs_configure_isar_apt
| DEBUG: Shell function rootfs_configure_isar_apt finished
| DEBUG: Executing shell function image_configure_accounts
| Execute groupadd with "--system" for "isar"
| Do not execute usermod (no changes).
| Execute useradd with "--gid isar --comment My isar user --home-dir 
/var/lib/isar --system --create-home" for "isar"
| DEBUG: Shell function image_configure_accounts finished
| DEBUG: Executing shell function image_configure_fstab
| # Begin /etc/fstab
| /dev/root	/		auto		defaults		0	0
| proc		/proc		proc		nosuid,noexec,nodev	0	0
| sysfs		/sys		sysfs		nosuid,noexec,nodev	0	0
| devpts		/dev/pts	devpts		gid=5,mode=620		0	0
| tmpfs		/run		tmpfs		defaults		0	0
| devtmpfs	/dev		devtmpfs	mode=0755,nosuid	0	0
|
| # End /etc/fstab
| DEBUG: Shell function image_configure_fstab finished
| DEBUG: Executing shell function rootfs_do_mounts
| DEBUG: Shell function rootfs_do_mounts finished
| DEBUG: Executing shell function rootfs_install_pkgs_update
| Get:1 file:/isar-apt isar InRelease
| Ign:1 file:/isar-apt isar InRelease
| Get:2 file:/isar-apt isar Release [3569 B]
| Get:2 file:/isar-apt isar Release [3569 B]
| Get:3 file:/isar-apt isar Release.gpg
| Ign:3 file:/isar-apt isar Release.gpg
| Get:4 file:/isar-apt isar/main armhf Packages [1666 B]
| Reading package lists...
| DEBUG: Shell function rootfs_install_pkgs_update finished
| DEBUG: Executing shell function rootfs_install_resolvconf
| DEBUG: Shell function rootfs_install_resolvconf finished
| DEBUG: Executing shell function rootfs_install_pkgs_download
| Reading package lists...
| Building dependency tree...
| Package linux-image-armmp is not available, but is referred to by 
another package.
| This may mean that the package is missing, has been obsoleted, or
| is only available from another source
|
| E: Unable to locate package init
| E: Package 'linux-image-armmp' has no installation candidate
| WARNING: exit code 100 from a shell command.
| DEBUG: Python function do_rootfs_install finished
| ERROR: Function failed: rootfs_install_pkgs_download (log file is 
located at 
/home/myo/work/isar/src/trunk/isar/build/tmp/work/debian-stretch-armhf/isar-image-base-debian-stretch-qemuarm/temp/log.do_rootfs_install.11489)
ERROR: Task 
(multiconfig:qemuarm-stretch:/home/myo/work/isar/src/trunk/isar/meta-isar/recipes-core/images/isar-image-base.bb:do_rootfs_install) 
failed with exit code '1'
NOTE: Tasks Summary: Attempted 83 tasks of which 0 didn't need to be 
rerun and 1 failed.

Summary: 1 task failed:
 
multiconfig:qemuarm-stretch:/home/myo/work/isar/src/trunk/isar/meta-isar/recipes-core/images/isar-image-base.bb:do_rootfs_install
Summary: There was 1 ERROR message shown, returning a non-zero exit code.
===================

Regards,
Maxim.

On 5/16/19 1:32 PM, claudius.heine.ext@siemens.com wrote:
> From: Claudius Heine <ch@denx.de>
> 
> Hi,
> 
> here is the new rebased version of that patchset, now that the rootfs cleanup
> patchset was merged.
> 
> I tested the fast build:
> http://isar-build.org:8080/job/isar_claudius_ilbers_fast_ci/21/
> 
> and the slow build:
> http://isar-build.org:8080/job/isar_claudius_ilbers-ci/62/
> 
> The fast build finished successfully already and the slow build currently is
> looking like its going to finish that way as well.
> 
> regards,
> Claudius
> 
> changes from v1:
>   - rebased to current next
>   - added some more documentation
> 
> Claudius Heine (8):
>    split up isar-bootstrap helper and implement pre-process pipeline
>    meta: remove transient package support
>    meta/classes: add image-locales-extension class
>    meta/classes: add image-account-extension class
>    doc: update description of image customization
>    doc: some fixes
>    meta-isar: local.conf.sample: update root password and isar user
>      creation
>    RECIPE-API-CHANGELOG: update transient package removal + root password
> 
>   RECIPE-API-CHANGELOG.md                       |  22 ++
>   doc/user_manual.md                            |  53 +++-
>   meta-isar/conf/local.conf.sample              |  12 +-
>   .../recipes-app/example-raw/files/postinst    |  13 -
>   meta/classes/image-account-extension.bbclass  | 257 ++++++++++++++++++
>   meta/classes/image-locales-extension.bbclass  |  97 +++++++
>   meta/classes/image.bbclass                    |  30 +-
>   meta/classes/isar-bootstrap-helper.bbclass    | 143 ----------
>   meta/classes/rootfs.bbclass                   | 176 +++++++++++-
>   .../isar-bootstrap/isar-bootstrap.inc         |   5 +
>   .../buildchroot/buildchroot-host.bb           |  16 +-
>   .../buildchroot/buildchroot-target.bb         |   2 -
>   .../buildchroot/buildchroot.inc               |  26 +-
>   meta/recipes-devtools/sdkchroot/sdkchroot.bb  |  48 ++--
>   .../isar-cfg-localepurge/files/postinst       |  15 -
>   .../isar-cfg-localepurge.bb                   |  70 -----
>   .../isar-cfg-rootpw/files/postinst.tmpl       |  19 --
>   .../isar-cfg-rootpw/isar-cfg-rootpw.bb        |  19 --
>   18 files changed, 663 insertions(+), 360 deletions(-)
>   create mode 100644 meta/classes/image-account-extension.bbclass
>   create mode 100644 meta/classes/image-locales-extension.bbclass
>   delete mode 100644 meta/classes/isar-bootstrap-helper.bbclass
>   delete mode 100644 meta/recipes-support/isar-cfg-localepurge/files/postinst
>   delete mode 100644 meta/recipes-support/isar-cfg-localepurge/isar-cfg-localepurge.bb
>   delete mode 100644 meta/recipes-support/isar-cfg-rootpw/files/postinst.tmpl
>   delete mode 100644 meta/recipes-support/isar-cfg-rootpw/isar-cfg-rootpw.bb
> 


-- 
Maxim Osipov
ilbers GmbH
Maria-Merian-Str. 8
85521 Ottobrunn
Germany
+49 (151) 6517 6917
mosipov@ilbers.de
http://ilbers.de/
Commercial register Munich, HRB 214197
General Manager: Baurzhan Ismagulov