public inbox for isar-users@googlegroups.com
 help / color / mirror / Atom feed
From: Raphael Lisicki <raphael.lisicki@siemens.com>
To: Adriaan Schmidt <adriaan.schmidt@siemens.com>,
	isar-users@googlegroups.com
Subject: Re: [RFC PATCH] Remove isar-apt and the corresponding lock
Date: Fri, 21 Oct 2022 10:02:28 +0200	[thread overview]
Message-ID: <f2d145d3-3914-1f23-047f-f4b1d141b39f@siemens.com> (raw)
In-Reply-To: <20221019104745.479166-1-adriaan.schmidt@siemens.com>

On 19.10.22 12:47, Adriaan Schmidt wrote:
> Hi all,
> 
> the isar-apt file lock has been bothering me for a while now, mainly because
> it leads to situations where we see many bitbake tasks running in parallel,
> but unable to make any progress (deploy_deb, install_builddeps, ...).
> 
> I ran a quick experiment on what would be required to change that, and
> came up with this approach:
> - isar-apt/ is no longer a repository maintained with reprepro
> - each recipe has "its own" directory below isar-apt/
> - there are directories isar-apt/${PN}/in and isar-apt/${PN}/out
> - out/ contains the deb packages produced, put there by deploy_deb
> - in/ is populated by prepare_build and contains the contents of in/ and out/
>    of all DEPENDS (need all the in/ contents due to transitive dependencies)
> - then, again in prepare_build, we copy our in/ directory to WORKDIR, and
>    create an apt repository (actually just a "Packages" file) using dpkg-scanpackages.
> 
> In addition to removing the lock, this also gives us better control
> over what goes into a package build, and eliminates effects due to "accidental"
> packages in isar-apt.

This sounds like a great side-effect. Love it.


> 
> I've implemented a very rough PoC, just to give you an idea. Please don't
> look too closely at the code, there are many things missing (e.g. SDKs,
> architectures != amd64, ...). But it can build isar-image-base for amd64.
> 
> If we decide that this would be a worthwile change, I will spend some
> more time on it.
> 
> Best,
> Adriaan

best regards
raphael

  reply	other threads:[~2022-10-21  8:02 UTC|newest]

Thread overview: 6+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2022-10-19 10:47 Adriaan Schmidt
2022-10-21  8:02 ` Raphael Lisicki [this message]
2022-10-21 10:15 ` Baurzhan Ismagulov
2022-12-12 12:36   ` Schmidt, Adriaan
2022-12-13  3:44     ` Moessbauer, Felix
2022-12-13  9:13       ` Baurzhan Ismagulov

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=f2d145d3-3914-1f23-047f-f4b1d141b39f@siemens.com \
    --to=raphael.lisicki@siemens.com \
    --cc=adriaan.schmidt@siemens.com \
    --cc=isar-users@googlegroups.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox