public inbox for isar-users@googlegroups.com
 help / color / mirror / Atom feed
From: Claudius Heine <claudius.heine.ext@siemens.com>
To: isar-users@googlegroups.com
Subject: Re: [PATCH v3 0/8] Cleanup rootfs creation
Date: Thu, 25 Apr 2019 13:22:19 +0200	[thread overview]
Message-ID: <41c5f746-1649-dd67-6f8d-118c0dd7f33e@siemens.com> (raw)
In-Reply-To: <b3b85b47-83c7-b5c9-4cf9-4e5721849618@siemens.com>

On 25/04/2019 13.18, [ext] Claudius Heine wrote:
> Hi Baurzhan,
> 
> On 25/04/2019 12.32, Baurzhan Ismagulov wrote:
>> On Thu, Apr 25, 2019 at 11:11:21AM +0200, Claudius Heine wrote:
>>> I looked into the "fast" build now, and it cross-compiles
>>> "multiconfig:rpi-stretch:isar-image-base". Now I tried that and the 
>>> build
>>> fails even on the current 'next' so the issue seems to be there.
>>
>> How does the problem manifest itself? Please provide some relevant 
>> details
>> (e.g., bitbake output, failure logs, etc.).
> 
> Commit ID: 2396d4f44fe1f867ddae389b61cb7017cb2b908c
> 
> --- local.conf ---
> # cross
> ISAR_CROSS_COMPILE = "1"
> 
> # standard
> CONF_VERSION = "1"
> 
> MACHINE ??= "qemu"
> DISTRO ??= "raspbian-stretch"
> BBMULTICONFIG ?= "rpi-stretch"
> --- end local.conf ---
> 
> bitbake -k -c build multiconfig:rpi-stretch:isar-image-base
> 
> --- error log ---
> ERROR: mc:rpi-stretch:isar-bootstrap-host-1.0-r0 do_bootstrap: Function 
> failed: do_bootstrap (log file is located at 
> /mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/temp/log.do_bootstrap.27078) 
> 
> ERROR: Logfile of failure stored in: 
> /mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/temp/log.do_bootstrap.27078 
> 
> Log data follows:
> | DEBUG: Executing shell function do_bootstrap
> | W: Target architecture is the same as host architecture; disabling 
> QEMU support
> | I: Running command: debootstrap --arch amd64 --verbose 
> --variant=minbase --include=locales --components=main,contrib,non-free 
> --keyring 
> /mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/apt-keyring.gpg 
> stretch 
> /mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs 
> http://ftp.debian.org/debian

Just some speculation here. I find it strange that a normal debian 
stretch bootstrap gets a '--keyring' parameter in that case. What is 
bootstrapped here is a amd64 rootfs and the keyring contains the one for 
raspbian.

But I don't know why this causes an error for me here, but not on the 
CI. But only on the CI when I add my cleanup patches.

Claudius

> | I: Retrieving InRelease
> | I: Retrieving Release
> | I: Retrieving Release.gpg
> | I: Checking Release signature
> | E: Release signed by unknown key (key id EF0F382A1A7B6500)
> | WARNING: 
> /mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/temp/run.do_bootstrap.27078:1 
> exit 1 from 'sudo -E -s  <<'EOSUDO'
> |         ( flock 9
> |         set -e
> |         if [ ! -e 
> "/mnt/ssd/isar/upstream/build/tmp/deploy/bootstrap/debian-stretch-amd64" 
> ]; then
> |             rm -rf 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs" 
> 
> |
> |             if [ ${IS_HOST} ]; then
> |                 qemu-debootstrap $debootstrap_args \
> |                                --components=main,contrib,non-free \
> |                                --keyring 
> /mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/apt-keyring.gpg 
> \
> |                                "stretch" \
> | 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs" 
> \
> |                                "http://ftp.debian.org/debian"
> |
> |             else
> |                  "qemu-debootstrap" $debootstrap_args \
> |                                   --arch="armhf" \
> | --components=main,contrib,non-free,firmware \
> |                                   --keyring 
> /mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/apt-keyring.gpg 
> \
> |                                   "stretch" \
> | 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs" 
> \
> |                                   "http://archive.raspbian.org/raspbian"
> |             fi
> |
> |             # Install apt config
> |             mkdir -p 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs/etc/apt/preferences.d" 
> 
> |             install -v -m644 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/apt-preferences" 
> \
> | 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs/etc/apt/preferences.d/bootstrap" 
> 
> |             mkdir -p 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs/etc/apt/sources.list.d" 
> 
> |             if [ "${ISAR_USE_CACHED_BASE_REPO}" = "1" ]; then
> |                 sed -e "s#{BASE_DISTRO}#"raspbian"#g" \
> |                     -e "s#{BASE_DISTRO_CODENAME}#"stretch"#g" \
> |                 -i 
> /mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/base-apt-sources 
> 
> |                 mkdir -p 
> /mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs/base-apt 
> 
> |                 sudo mount --bind 
> /mnt/ssd/isar/upstream/build/downloads/base-apt/apt 
> /mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs/base-apt 
> 
> |                 install -v -m644 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/base-apt-sources" 
> \
> | 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs/etc/apt/sources.list.d/base-apt.list" 
> 
> |             else
> |                 install -v -m644 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/apt-sources" 
> \
> | 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs/etc/apt/sources.list.d/bootstrap.list" 
> 
> |             fi
> |             install -v -m644 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/apt-sources-init" 
> \
> | 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs/etc/apt/sources-list" 
> 
> |             rm -f 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs/etc/apt/sources.list" 
> 
> |             mkdir -p 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs/etc/apt/apt.conf.d" 
> 
> |             install -v -m644 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/isar-apt.conf" 
> \
> | 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs/etc/apt/apt.conf.d/50isar.conf" 
> 
> |
> |             if [ "stretch" = "stretch" ] && [ "4" -lt "4" ]; then
> |                 install -v -m644 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/isar-apt-fallback.conf" 
> \
> | 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs/etc/apt/apt.conf.d/55isar-fallback.conf" 
> 
> |             fi
> |
> |             # Set locale
> |             install -v -m644 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/locale" 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs/etc/locale" 
> 
> |
> |             sed -i '/en_US.UTF-8 UTF-8/s/^#//g' 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs/etc/locale.gen" 
> 
> |             chroot 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs" 
> /usr/sbin/locale-gen
> |
> |             # setup chroot
> |             install -v -m755 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/chroot-setup.sh" 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs/chroot-setup.sh" 
> 
> | 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs/chroot-setup.sh" 
> "setup" 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs" 
> 
> |
> |             # update APT
> |             mount --rbind /dev 
> /mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs/dev 
> 
> |             mount --make-rslave 
> /mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs/dev 
> 
> |             mount -t proc none 
> /mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs/proc 
> 
> |             mount --rbind /sys 
> /mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs/sys 
> 
> |             mount --make-rslave 
> /mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs/sys 
> 
> |
> |             export DEBIAN_FRONTEND=noninteractive
> |             chroot 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs" 
> /usr/bin/apt-get update -y
> |             chroot 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs" 
> /usr/bin/apt-get dist-upgrade -y \
> |                                   -o Debug::pkgProblemResolver=yes
> |
> |             umount -l 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs/dev" 
> 
> |             umount -l 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs/proc" 
> 
> |             umount -l 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs/sys" 
> 
> |             umount -l 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs/base-apt" 
> || true
> |
> |             # Finalize debootstrap by setting the link in deploy
> |             ln -Tfsr 
> "/mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/rootfs" 
> "/mnt/ssd/isar/upstream/build/tmp/deploy/bootstrap/debian-stretch-amd64"
> |         fi
> |         ) 
> 9>'/mnt/ssd/isar/upstream/build/tmp/deploy/bootstrap/debian-stretch-amd64.lock' 
> 
> | EOSUDO
> | '
> | ERROR: Function failed: do_bootstrap (log file is located at 
> /mnt/ssd/isar/upstream/build/tmp/work/raspbian-stretch-armhf/isar-bootstrap-host-debian-stretch-amd64/temp/log.do_bootstrap.27078) 
> 
> ERROR: Task 
> (multiconfig:rpi-stretch:/mnt/data/isar/layers/isar-master/meta/recipes-core/isar-bootstrap/isar-bootstrap-host.bb:do_bootstrap) 
> failed with exit code '1'
> --- end error log ---
> 
> So pretty much the same error I currently deal with.
> 
> Claudius
> 

-- 
DENX Software Engineering GmbH,      Managing Director: Wolfgang Denk
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany
Phone: (+49)-8142-66989-54 Fax: (+49)-8142-66989-80 Email: ch@denx.de

  reply	other threads:[~2019-04-25 11:22 UTC|newest]

Thread overview: 24+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2019-04-24  9:27 claudius.heine.ext
2019-04-24  9:27 ` [PATCH v3 1/8] isar-boostrap-helper: move 'HOST_ARCH' and 'HOST_DISTRO' to base.bbclass claudius.heine.ext
2019-04-25 11:25   ` Claudius Heine
2019-04-24  9:27 ` [PATCH v3 2/8] move 'HOST_DISTRO_APT_SOURCES' from bootstrap-helper to isar-bootstrap claudius.heine.ext
2019-04-24  9:27 ` [PATCH v3 3/8] buildchroot.bbclass: only cross build if HOST_ARCH != DISTRO_ARCH claudius.heine.ext
2019-04-24  9:27 ` [PATCH v3 4/8] isar-bootstrap/buildchroot/sdkchroot: refactor PF and WORKDIR claudius.heine.ext
2019-04-24  9:27 ` [PATCH v3 5/8] bitbake.conf: remove unneeded and differently used variables claudius.heine.ext
2019-04-24  9:27 ` [PATCH v3 6/8] image.bbclass: make IMAGE_ROOTFS overwritable claudius.heine.ext
2019-04-24  9:27 ` [PATCH v3 7/8] bitbake.conf: set default QEMU_ARCH variables claudius.heine.ext
2019-04-24  9:27 ` [PATCH v3 8/8] buildchroot/configscript: make creation of builder uid/gid idempotent claudius.heine.ext
2019-04-25  6:03 ` [PATCH v3 0/8] Cleanup rootfs creation Maxim Yu. Osipov
2019-04-25  6:40   ` Claudius Heine
2019-04-25  7:55     ` Maxim Yu. Osipov
2019-04-25  8:01       ` Claudius Heine
2019-04-25  8:07         ` Maxim Yu. Osipov
2019-04-25  8:27           ` Claudius Heine
2019-04-25  8:39             ` Maxim Yu. Osipov
2019-04-25  9:11               ` Claudius Heine
2019-04-25  9:33                 ` Maxim Yu. Osipov
2019-04-25  9:51                 ` Baurzhan Ismagulov
2019-04-25 10:32                 ` Baurzhan Ismagulov
2019-04-25 11:18                   ` Claudius Heine
2019-04-25 11:22                     ` Claudius Heine [this message]
2019-04-25  8:52     ` Jan Kiszka

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=41c5f746-1649-dd67-6f8d-118c0dd7f33e@siemens.com \
    --to=claudius.heine.ext@siemens.com \
    --cc=isar-users@googlegroups.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox