Re: [PATCH v2] conf: Add support for new debian distro "buster"

["Maxim Yu. Osipov" <mosipov@ilbers.de>]

Hi Henning,

On 08/16/2018 11:48 AM, Henning Schild wrote:
> Am Wed, 15 Aug 2018 04:26:09 +0200
> schrieb "Maxim Yu. Osipov" <mosipov@ilbers.de>:
> 
>> From: Henning Schild <henning.schild@siemens.com>
>>
>> Let us already include support for "buster" in Isar, to prove that we
>> can build images and to find issues before it is declared stable.
>>
>> Note:
>> arm64-buster support is excluded so far as build on debian stretch
>> system hangs with error "qemu: unsupported syscall 277"
> 
> How about still adding the configs but not building in CI? And does the
> error come from a stretch or a jessie qemu, maybe the newer one will
> work just fine?

The problem comes from a stretch qemu.

I also thought about removal only from CI,
but this may confuse user if he finds arm64-buster support and 
experiences troubles when building on current stable Debian (stretch).

Moreover I currently have troubles with testing the patch on 
isar-build.org (still under jessie) - build for 
multiconfig:qemuarm-buster:isar-image-base  hangs. I see some strange 
errors in bitbake-cookerdaemon.log:

dpkg: warning: failed to open configuration file '/root/.dpkg.cfg' for 
reading: Permission denied

and I observed some number of processes:

Aug15   0:00 sudo -E chroot 
/workspace/build/isar_mosipov_next/23/build/tmp/work/debian-buster-armhf/buildchroot-target/rootfs 
/usr/bin/apt-get install --yes -o Debug::pkgProblemResolver=yes gcc make 
build-essential debhelper autotools-dev dpkg locales docbook-to-man apt 
automake devscripts equivs

root      2071  0.0  0.4 114476 16720 ?        Sl   Aug15   1:36
/usr/bin/qemu-arm-static /usr/bin/apt-get install --yes -o 
Debug::pkgProblemResolver=yes gcc make build-essential debhelper 
autotools-dev dpkg locales docbook-to-man apt automake devscripts equivs

root     12787  0.0  0.0  73444  3364 ?        Sl   Aug15   0:00 
/usr/bin/qemu-arm-static /usr/bin/dpkg --status-fd 15 --configure --pending


As far as I understood you experienced similar problems with your last 
CI build (#45) dated by July 13  - I had to abort it and kill all 
related processes.


Maxim.


> Henning
> 
>> Signed-off-by: Henning Schild <henning.schild@siemens.com>
>> Signed-off-by: Maxim Yu. Osipov <mosipov@ilbers.de>
>> ---
>>   doc/user_manual.md                                   |  2 +-
>>   meta-isar/conf/distro/debian-buster.conf             |  7 +++++++
>>   meta-isar/conf/distro/debian-buster.list             |  3 +++
>>   meta-isar/conf/local.conf.sample                     |  3 +++
>>   meta-isar/conf/multiconfig/qemuamd64-buster.conf     | 19
>> +++++++++++++++++++
>> meta-isar/conf/multiconfig/qemuarm-buster.conf       | 18
>> ++++++++++++++++++
>> meta-isar/conf/multiconfig/qemui386-buster.conf      | 20
>> ++++++++++++++++++++ .../buildchroot/buildchroot-target.bb
>> |  2 ++ scripts/ci_build.sh                                  |  3 +++
>> scripts/vm_smoke_test                                |  3 +++ 10
>> files changed, 79 insertions(+), 1 deletion(-) create mode 100644
>> meta-isar/conf/distro/debian-buster.conf create mode 100644
>> meta-isar/conf/distro/debian-buster.list create mode 100644
>> meta-isar/conf/multiconfig/qemuamd64-buster.conf create mode 100644
>> meta-isar/conf/multiconfig/qemuarm-buster.conf create mode 100644
>> meta-isar/conf/multiconfig/qemui386-buster.conf
>>
>> diff --git a/doc/user_manual.md b/doc/user_manual.md
>> index 4e7f29a..34ea6e6 100644
>> --- a/doc/user_manual.md
>> +++ b/doc/user_manual.md
>> @@ -55,7 +55,7 @@ Install the following packages:
>>   ```
>>   dosfstools
>>   git
>> -debootstrap
>> +debootstrap/jessie-backports# for debian >= "buster"
>>   dpkg-dev
>>   parted
>>   python
>> diff --git a/meta-isar/conf/distro/debian-buster.conf
>> b/meta-isar/conf/distro/debian-buster.conf new file mode 100644
>> index 0000000..162257f
>> --- /dev/null
>> +++ b/meta-isar/conf/distro/debian-buster.conf
>> @@ -0,0 +1,7 @@
>> +# This software is a part of ISAR.
>> +
>> +DISTRO_APT_SOURCES += "conf/distro/debian-buster.list"
>> +DISTRO_CONFIG_SCRIPT ?= "debian-configscript.sh"
>> +DISTRO_KERNELS ?= "4kc-malta 586 5kc-malta 686 686-pae amd64 arm64
>> armmp \
>> +    armmp-lpae kirkwood loongson-3 marvell octeon orion5x
>> powerpc64le \
>> +    rt-686-pae rt-amd64 s390x"
>> diff --git a/meta-isar/conf/distro/debian-buster.list
>> b/meta-isar/conf/distro/debian-buster.list new file mode 100644
>> index 0000000..18311d8
>> --- /dev/null
>> +++ b/meta-isar/conf/distro/debian-buster.list
>> @@ -0,0 +1,3 @@
>> +deb	http://ftp.de.debian.org/debian buster	main
>> contrib non-free +deb	http://ftp.de.debian.org/debian
>> buster-updates	main contrib non-free +deb
>> http://security.debian.org	buster/updates	main contrib
>> non-free diff --git a/meta-isar/conf/local.conf.sample
>> b/meta-isar/conf/local.conf.sample index 27b43d1..0f37121 100644 ---
>> a/meta-isar/conf/local.conf.sample +++
>> b/meta-isar/conf/local.conf.sample @@ -41,12 +41,15 @@ BBMULTICONFIG
>> = " \ qemuarm-wheezy \
>>       qemuarm-jessie \
>>       qemuarm-stretch \
>> +    qemuarm-buster \
>>       qemuarm64-stretch \
>>       qemui386-jessie \
>>       qemui386-stretch \
>> +    qemui386-buster \
>>       qemuamd64-jessie \
>>       qemuamd64-stretch \
>>       bananapi-stretch \
>> +    qemuamd64-buster \
>>       rpi-jessie \
>>   "
>>   
>> diff --git a/meta-isar/conf/multiconfig/qemuamd64-buster.conf
>> b/meta-isar/conf/multiconfig/qemuamd64-buster.conf new file mode
>> 100644 index 0000000..85404ae
>> --- /dev/null
>> +++ b/meta-isar/conf/multiconfig/qemuamd64-buster.conf
>> @@ -0,0 +1,19 @@
>> +# This software is a part of ISAR.
>> +
>> +MACHINE ?= "qemuamd64"
>> +
>> +DISTRO ?= "debian-buster"
>> +DISTRO_ARCH ?= "amd64"
>> +
>> +KERNEL_NAME ?= "amd64"
>> +
>> +IMAGE_PREINSTALL += "init"
>> +
>> +IMAGE_TYPE ?= "wic-img"
>> +
>> +ROOTFS_DEV ?= "sda2"
>> +
>> +QEMU_ARCH ?= "x86_64"
>> +QEMU_MACHINE ?= "q35"
>> +QEMU_CPU ?= ""
>> +QEMU_ROOTFS_DEV ?= "-hda ##ROOTFS_IMAGE##
>> -bios /usr/local/share/ovmf/OVMF.fd" diff --git
>> a/meta-isar/conf/multiconfig/qemuarm-buster.conf
>> b/meta-isar/conf/multiconfig/qemuarm-buster.conf new file mode 100644
>> index 0000000..003f7c4 --- /dev/null
>> +++ b/meta-isar/conf/multiconfig/qemuarm-buster.conf
>> @@ -0,0 +1,18 @@
>> +# This software is a part of ISAR.
>> +
>> +MACHINE ?= "qemuarm"
>> +
>> +DISTRO ?= "debian-buster"
>> +DISTRO_ARCH ?= "armhf"
>> +
>> +KERNEL_NAME ?= "armmp"
>> +
>> +IMAGE_PREINSTALL += "init"
>> +
>> +ROOTFS_DEV ?= "vda"
>> +
>> +QEMU_ARCH ?= "arm"
>> +QEMU_MACHINE ?= "virt"
>> +QEMU_CPU ?= "cortex-a15"
>> +# TODO: start_vm doesn't support multiline vars
>> +QEMU_ROOTFS_DEV ?= "-drive
>> file=##ROOTFS_IMAGE##,if=none,format=raw,id=hd0 -device
>> virtio-blk-device,drive=hd0" diff --git
>> a/meta-isar/conf/multiconfig/qemui386-buster.conf
>> b/meta-isar/conf/multiconfig/qemui386-buster.conf new file mode
>> 100644 index 0000000..e09cd0c --- /dev/null +++
>> b/meta-isar/conf/multiconfig/qemui386-buster.conf @@ -0,0 +1,20 @@
>> +# This software is a part of ISAR.
>> +
>> +MACHINE ?= "qemui386"
>> +
>> +DISTRO ?= "debian-buster"
>> +DISTRO_ARCH ?= "i386"
>> +
>> +KERNEL_NAME ?= "686-pae"
>> +
>> +IMAGE_PREINSTALL += "init"
>> +
>> +IMAGE_TYPE ?= "wic-img"
>> +WKS_FILE ?= "directdisk-isar"
>> +
>> +ROOTFS_DEV ?= "sda2"
>> +
>> +QEMU_ARCH ?= "i386"
>> +QEMU_MACHINE ?= "pc"
>> +QEMU_CPU ?= ""
>> +QEMU_ROOTFS_DEV ?= "-hda ##ROOTFS_IMAGE##"
>> diff --git a/meta/recipes-devtools/buildchroot/buildchroot-target.bb
>> b/meta/recipes-devtools/buildchroot/buildchroot-target.bb index
>> 66b526a..34abb72 100644 ---
>> a/meta/recipes-devtools/buildchroot/buildchroot-target.bb +++
>> b/meta/recipes-devtools/buildchroot/buildchroot-target.bb @@ -29,6
>> +29,8 @@ BUILDCHROOT_PREINSTALL_WIC = " \ e2fsprogs \
>>                                python3"
>>   
>> +BUILDCHROOT_PREINSTALL_WIC_append_debian-buster = "
>> python3-distutils" +
>>   BUILDCHROOT_PREINSTALL_WIC_append_amd64 = " \
>>                                syslinux \
>>                                syslinux-common \
>> diff --git a/scripts/ci_build.sh b/scripts/ci_build.sh
>> index 28290c2..24b3353 100755
>> --- a/scripts/ci_build.sh
>> +++ b/scripts/ci_build.sh
>> @@ -84,10 +84,13 @@ else
>>       bitbake $BB_ARGS \
>>           multiconfig:qemuarm-jessie:isar-image-base \
>>           multiconfig:qemuarm-stretch:isar-image-base \
>> +        multiconfig:qemuarm-buster:isar-image-base \
>>           multiconfig:qemuarm64-stretch:isar-image-base \
>>           multiconfig:qemui386-jessie:isar-image-base \
>>           multiconfig:qemui386-stretch:isar-image-base \
>> +        multiconfig:qemui386-buster:isar-image-base \
>>           multiconfig:qemuamd64-jessie:isar-image-base \
>>           multiconfig:qemuamd64-stretch:isar-image-base \
>> +        multiconfig:qemuamd64-buster:isar-image-base \
>>           multiconfig:rpi-jessie:isar-image-base
>>   fi
>> diff --git a/scripts/vm_smoke_test b/scripts/vm_smoke_test
>> index a88d127..f2f6aea 100755
>> --- a/scripts/vm_smoke_test
>> +++ b/scripts/vm_smoke_test
>> @@ -144,14 +144,17 @@ done
>>   # ARM machine
>>   run_test arm jessie
>>   run_test arm stretch
>> +run_test arm buster
>>   
>>   # AMD64 machine
>>   run_test amd64 jessie
>>   run_test amd64 stretch
>> +run_test amd64 buster
>>   
>>   # i386 machine
>>   run_test i386 jessie
>>   run_test i386 stretch
>> +run_test i386 buster
>>   
>>   # ARM64 machine
>>   run_test arm64 stretch
> 


-- 
Maxim Osipov
ilbers GmbH
Maria-Merian-Str. 8
85521 Ottobrunn
Germany
+49 (151) 6517 6917
mosipov@ilbers.de
http://ilbers.de/
Commercial register Munich, HRB 214197
General Manager: Baurzhan Ismagulov