[PATCH] scripts/ci: rebuild recipes based on dpkg-base

[PATCH] scripts/ci: rebuild recipes based on dpkg-base

[Henning Schild]

This commit adds rebuilding to CI and shows the current rebuilding
issues in Isar. After they are fixed it will be a general improvement to
CI to make sure we do not run into similar problems again.

Signed-off-by: Henning Schild <henning.schild@siemens.com>
---
 scripts/ci_build.sh | 4 ++++
 1 file changed, 4 insertions(+)

diff --git a/scripts/ci_build.sh b/scripts/ci_build.sh
index d2ed6fe..dc093ec 100755
--- a/scripts/ci_build.sh
+++ b/scripts/ci_build.sh
@@ -102,3 +102,7 @@ else
     # qemu-user-static of <= buster too old to build that
     #multiconfig:qemuarm64-buster:isar-image-base
 fi
+
+echo -e "do_fetch_append() {\n\n}" >> ${ISARROOT}/meta/classes/dpkg-base.bbclass
+
+bitbake $BB_ARGS multiconfig:qemuamd64-buster:isar-image-base
-- 
2.19.1

Re: [PATCH] scripts/ci: rebuild recipes based on dpkg-base

[Henning Schild]

This will fail on current next. It depends on
"meta/dpkg-raw: build raw packages like all others"

or
"[PATCH v2] meta/dpkg-raw: do_install into a fresh directory every time"

but the second should probably not be used.

Henning

Am Thu, 22 Nov 2018 10:12:45 +0100
schrieb Henning Schild <henning.schild@siemens.com>:

> This commit adds rebuilding to CI and shows the current rebuilding
> issues in Isar. After they are fixed it will be a general improvement
> to CI to make sure we do not run into similar problems again.
> 
> Signed-off-by: Henning Schild <henning.schild@siemens.com>
> ---
>  scripts/ci_build.sh | 4 ++++
>  1 file changed, 4 insertions(+)
> 
> diff --git a/scripts/ci_build.sh b/scripts/ci_build.sh
> index d2ed6fe..dc093ec 100755
> --- a/scripts/ci_build.sh
> +++ b/scripts/ci_build.sh
> @@ -102,3 +102,7 @@ else
>      # qemu-user-static of <= buster too old to build that
>      #multiconfig:qemuarm64-buster:isar-image-base
>  fi
> +
> +echo -e "do_fetch_append() {\n\n}" >>
> ${ISARROOT}/meta/classes/dpkg-base.bbclass +
> +bitbake $BB_ARGS multiconfig:qemuamd64-buster:isar-image-base

Re: [PATCH] scripts/ci: rebuild recipes based on dpkg-base

[Jan Kiszka]

On 22.11.18 10:12, [ext] Henning Schild wrote:
> This commit adds rebuilding to CI and shows the current rebuilding
> issues in Isar. After they are fixed it will be a general improvement to
> CI to make sure we do not run into similar problems again.
> 
> Signed-off-by: Henning Schild <henning.schild@siemens.com>
> ---
>   scripts/ci_build.sh | 4 ++++
>   1 file changed, 4 insertions(+)
> 
> diff --git a/scripts/ci_build.sh b/scripts/ci_build.sh
> index d2ed6fe..dc093ec 100755
> --- a/scripts/ci_build.sh
> +++ b/scripts/ci_build.sh
> @@ -102,3 +102,7 @@ else
>       # qemu-user-static of <= buster too old to build that
>       #multiconfig:qemuarm64-buster:isar-image-base
>   fi
> +
> +echo -e "do_fetch_append() {\n\n}" >> ${ISARROOT}/meta/classes/dpkg-base.bbclass
> +

Why not destroying some stamp file instead?

> +bitbake $BB_ARGS multiconfig:qemuamd64-buster:isar-image-base
> 

Otherwise, a valuable step forward.

Jan

-- 
Siemens AG, Corporate Technology, CT RDA IOT SES-DE
Corporate Competence Center Embedded Linux

Re: [PATCH] scripts/ci: rebuild recipes based on dpkg-base

[Henning Schild]

Am Thu, 22 Nov 2018 10:15:51 +0100
schrieb Jan Kiszka <jan.kiszka@siemens.com>:

> On 22.11.18 10:12, [ext] Henning Schild wrote:
> > This commit adds rebuilding to CI and shows the current rebuilding
> > issues in Isar. After they are fixed it will be a general
> > improvement to CI to make sure we do not run into similar problems
> > again.
> > 
> > Signed-off-by: Henning Schild <henning.schild@siemens.com>
> > ---
> >   scripts/ci_build.sh | 4 ++++
> >   1 file changed, 4 insertions(+)
> > 
> > diff --git a/scripts/ci_build.sh b/scripts/ci_build.sh
> > index d2ed6fe..dc093ec 100755
> > --- a/scripts/ci_build.sh
> > +++ b/scripts/ci_build.sh
> > @@ -102,3 +102,7 @@ else
> >       # qemu-user-static of <= buster too old to build that
> >       #multiconfig:qemuarm64-buster:isar-image-base
> >   fi
> > +
> > +echo -e "do_fetch_append() {\n\n}" >>
> > ${ISARROOT}/meta/classes/dpkg-base.bbclass
> > +  
> 
> Why not destroying some stamp file instead?

I would like to see the bitbake magic work here. Problem is we leave a
dirty tree behind. We can discuss the trigger ... But as long as this
is the last thing we do, making the tree dirty is ok.

Henning

> > +bitbake $BB_ARGS multiconfig:qemuamd64-buster:isar-image-base
> >   
> 
> Otherwise, a valuable step forward.
> 
> Jan
> 

Re: [PATCH] scripts/ci: rebuild recipes based on dpkg-base

[Maxim Yu. Osipov]

On 11/22/18 12:12 PM, Henning Schild wrote:
> This commit adds rebuilding to CI and shows the current rebuilding
> issues in Isar. After they are fixed it will be a general improvement to
> CI to make sure we do not run into similar problems again.
> 
> Signed-off-by: Henning Schild <henning.schild@siemens.com>
> ---
>   scripts/ci_build.sh | 4 ++++
>   1 file changed, 4 insertions(+)
> 
> diff --git a/scripts/ci_build.sh b/scripts/ci_build.sh
> index d2ed6fe..dc093ec 100755
> --- a/scripts/ci_build.sh
> +++ b/scripts/ci_build.sh
> @@ -102,3 +102,7 @@ else
>       # qemu-user-static of <= buster too old to build that
>       #multiconfig:qemuarm64-buster:isar-image-base
>   fi
> +
> +echo -e "do_fetch_append() {\n\n}" >> ${ISARROOT}/meta/classes/dpkg-base.bbclass
> +
> +bitbake $BB_ARGS multiconfig:qemuamd64-buster:isar-image-base
> 

Taking into account recent commit dce32dd ("ci: Add option to build/test 
a reduced set of configurations") any objections to change 
qemuamd64-buster to qemuamd64-stretch to properly cover the reduced set 
of configurations?

Maxim.

-- 
Maxim Osipov
ilbers GmbH
Maria-Merian-Str. 8
85521 Ottobrunn
Germany
+49 (151) 6517 6917
mosipov@ilbers.de
http://ilbers.de/
Commercial register Munich, HRB 214197
General Manager: Baurzhan Ismagulov

[PATCH v2] scripts/ci: rebuild recipes based on dpkg-base

[Henning Schild]

This commit adds rebuilding to CI and shows the current rebuilding
issues in Isar. After they are fixed it will be a general improvement to
CI to make sure we do not run into similar problems again.

Signed-off-by: Henning Schild <henning.schild@siemens.com>
---
 scripts/ci_build.sh | 5 +++++
 1 file changed, 5 insertions(+)

diff --git a/scripts/ci_build.sh b/scripts/ci_build.sh
index d5e4d41..54adc9d 100755
--- a/scripts/ci_build.sh
+++ b/scripts/ci_build.sh
@@ -108,3 +108,8 @@ else
     # qemu-user-static of <= buster too old to build that
     #multiconfig:qemuarm64-buster:isar-image-base
 fi
+
+# trigger a rebuild of an image, this should be the last step since we
+# make the tree dirty and do not clean up
+echo -e "do_fetch_append() {\n\n}" >> ${ISARROOT}/meta/classes/dpkg-base.bbclass
+bitbake $BB_ARGS multiconfig:qemuamd64-stretch:isar-image-base
-- 
2.19.1

[PATCH v2] scripts/ci: rebuild recipes based on dpkg-base

[Maxim Yu. Osipov]

From: Henning Schild <henning.schild@siemens.com>

This commit adds rebuilding to CI and shows the current rebuilding
issues in Isar. After they are fixed it will be a general improvement to
CI to make sure we do not run into similar problems again.

Signed-off-by: Henning Schild <henning.schild@siemens.com>
---
 scripts/ci_build.sh | 4 ++++
 1 file changed, 4 insertions(+)

diff --git a/scripts/ci_build.sh b/scripts/ci_build.sh
index d5e4d41..059df21 100755
--- a/scripts/ci_build.sh
+++ b/scripts/ci_build.sh
@@ -108,3 +108,7 @@ else
     # qemu-user-static of <= buster too old to build that
     #multiconfig:qemuarm64-buster:isar-image-base
 fi
+
+echo -e "do_fetch_append() {\n\n}" >> ${ISARROOT}/meta/classes/dpkg-base.bbclass
+
+bitbake $BB_ARGS multiconfig:qemuamd64-stretch:isar-image-base
-- 
2.11.0

Re: [PATCH v2] scripts/ci: rebuild recipes based on dpkg-base

[Henning Schild]

Ah, thanks. Did not see that before sending a v2 myself. Take whichever
you want.

Henning

Am Fri, 23 Nov 2018 08:09:41 +0100
schrieb "Maxim Yu. Osipov" <mosipov@ilbers.de>:

> From: Henning Schild <henning.schild@siemens.com>
> 
> This commit adds rebuilding to CI and shows the current rebuilding
> issues in Isar. After they are fixed it will be a general improvement
> to CI to make sure we do not run into similar problems again.
> 
> Signed-off-by: Henning Schild <henning.schild@siemens.com>
> ---
>  scripts/ci_build.sh | 4 ++++
>  1 file changed, 4 insertions(+)
> 
> diff --git a/scripts/ci_build.sh b/scripts/ci_build.sh
> index d5e4d41..059df21 100755
> --- a/scripts/ci_build.sh
> +++ b/scripts/ci_build.sh
> @@ -108,3 +108,7 @@ else
>      # qemu-user-static of <= buster too old to build that
>      #multiconfig:qemuarm64-buster:isar-image-base
>  fi
> +
> +echo -e "do_fetch_append() {\n\n}" >>
> ${ISARROOT}/meta/classes/dpkg-base.bbclass +
> +bitbake $BB_ARGS multiconfig:qemuamd64-stretch:isar-image-base

Re: [PATCH v2] scripts/ci: rebuild recipes based on dpkg-base

[Maxim Yu. Osipov]

On 11/23/18 10:09 AM, Maxim Yu. Osipov wrote:
> From: Henning Schild <henning.schild@siemens.com>
> 
> This commit adds rebuilding to CI and shows the current rebuilding
> issues in Isar. After they are fixed it will be a general improvement to
> CI to make sure we do not run into similar problems again.

Applied to the 'next',

Thanks,
Maxim.

> Signed-off-by: Henning Schild <henning.schild@siemens.com>
> ---
>   scripts/ci_build.sh | 4 ++++
>   1 file changed, 4 insertions(+)
> 
> diff --git a/scripts/ci_build.sh b/scripts/ci_build.sh
> index d5e4d41..059df21 100755
> --- a/scripts/ci_build.sh
> +++ b/scripts/ci_build.sh
> @@ -108,3 +108,7 @@ else
>       # qemu-user-static of <= buster too old to build that
>       #multiconfig:qemuarm64-buster:isar-image-base
>   fi
> +
> +echo -e "do_fetch_append() {\n\n}" >> ${ISARROOT}/meta/classes/dpkg-base.bbclass
> +
> +bitbake $BB_ARGS multiconfig:qemuamd64-stretch:isar-image-base
> 


-- 
Maxim Osipov
ilbers GmbH
Maria-Merian-Str. 8
85521 Ottobrunn
Germany
+49 (151) 6517 6917
mosipov@ilbers.de
http://ilbers.de/
Commercial register Munich, HRB 214197
General Manager: Baurzhan Ismagulov