Re: [RFC PATCH 0/3] Reproducible build

["Maxim Yu. Osipov" <mosipov@ilbers.de>]

Hi Claudius,

Let me summarize the patchset status.

1. This patchset is just a first step towards more generic traceable 
reproducible build - tarball versioning/reproducibility features are out 
of scope of this patch set.

2. Baurzhan always asks to provide some bits of information into the 
documentation when a new feature is added (or changed).

3. Henning asked about "stealing DL_DIR of bitbake as well" (see his 
email below). What is your opinion?

Kind regards,
Maxim.

On 05/25/2018 10:10 AM, Claudius Heine wrote:
> Hi Henning,
> 
> On 05/24/2018 06:00 PM, Henning Schild wrote:
>> Am Wed, 23 May 2018 08:32:03 +0200
>> schrieb "[ext] claudius.heine.ext@siemens.com"
>> <claudius.heine.ext@siemens.com>:
>>
>>> From: Claudius Heine <ch@denx.de>
>>>
>>> Hi,
>>>
>>> this patchset contains a implementation of my proposed solution for
>>> reproducible builds.
>>>
>>> I am currenlty not quite sure if that is the right approach, but it is
>>> the simplest I can think of currently.
>>
>> I did not look at the patches yet. And because it sounds so simple my
>> first reaction is that it can not be complete.> One thing we will need for sure is the sources that lead to the
>> packages we built ourselfs, otherwise we can not rebuild them later on.
>> And that seems to be a tricky part, not covered by stealing the cache.
> 
> You are right, this solution is not complete and Rom was not build on
> one day. My goal was to improve the situation just one small step and
> then build on top of it.
> 
>> Maybe stealing the DLDIR of bitbake as well?
>>
>>> As already described in my proposal, this patchset does the following:
>>>
>>>    1. Takes care that the package cache in the isar-bootstrap root file
>>>       system contains all the packages used for this
>>> distro/architecture. 2. A tarball is created after the package cache
>>> contains all the packages needed by the image.
>>
>> Are you sure that "apt-get clean" is the only reason for cache
>> eviction? What will happen if i install a ton of packages, not that apt
>> will want to safe space at some point.
> 
> Yes, I might be useful to set the apt.conf to disable all autocleaning
> options.
> But normally apt removes packages from cache only if they are no longer
> downloadable and since the local index of the upstream repos are not
> updated it shouldn't detect if they are no longer downloadable and
> therefore not remove them. Disabling this completely is still the better
> option.
> 
> Claudius
> 
>>
>> Henning
>>
>>>    3. This tarball can be used as the basis of subsequent builds by
>>>       setting a bitbake variable.
>>>
>>> This is just a first draft of this feature, maybe we can further
>>> improve some steps and maybe there are better ideas to improve the
>>> usability.
>>>
>>> Cheers,
>>> Claudius
>>>
>>> Claudius Heine (3):
>>>    meta/isar-bootstrap-helper+dpkg.bbclass: bind mount
>>>      /var/cache/apt/archives
>>>    meta/classes/image: added isar_bootstrap_tarball task
>>>    meta/isar-bootstrap: add 'do_restore_from_tarball' task
>>>
>>>   meta/classes/dpkg.bbclass                     |  5 ++++
>>>   meta/classes/image.bbclass                    | 10 +++++++
>>>   meta/classes/isar-bootstrap-helper.bbclass    |  9 ++++++-
>>>   .../isar-bootstrap/isar-bootstrap.bb          | 27
>>> ++++++++++++++++++- 4 files changed, 49 insertions(+), 2 deletions(-)
>>>
>>
> 


-- 
Maxim Osipov
ilbers GmbH
Maria-Merian-Str. 8
85521 Ottobrunn
Germany
+49 (151) 6517 6917
mosipov@ilbers.de
http://ilbers.de/
Commercial register Munich, HRB 214197
General Manager: Baurzhan Ismagulov