From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 6558372643829972992 X-Received: by 2002:a19:d85b:: with SMTP id p88-v6mr77724lfg.8.1527249442999; Fri, 25 May 2018 04:57:22 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a19:51d2:: with SMTP id g79-v6ls2593129lfl.8.gmail; Fri, 25 May 2018 04:57:22 -0700 (PDT) X-Google-Smtp-Source: ADUXVKIWdFMnBasl36MZHOSRBUn2BRsJt/1iwgYjYd+XqBuVJntAXb/O9VJ94Q+SoV5RxJrRzjJX X-Received: by 2002:a19:7412:: with SMTP id v18-v6mr78392lfe.5.1527249442535; Fri, 25 May 2018 04:57:22 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1527249442; cv=none; d=google.com; s=arc-20160816; b=JyRIuLGD6/k/7iYPiMxYsQVSnTSOk58gelVXqA5oPxqa0/+eXFthpN0z1YuErUwpkt ScWZgeVXp/Wmh9UcbGmVgxtnBvq+fRAkTBCLmmO5zge0xvyM3EwLRRrMfl2LmhPA8+XQ IJ9+SASn8Hi6jyt2CKFjaMLZZjXIyphprjCPyiega69rMR2Ve2jW+EWO+wc/QC8/mHcp /ZtokwadjPCbmtzxUbLBp9IXk9m4oiDc8frlELuy8tzNhDhkw1RRW2wQeg9a1HqVbVPT QUqfSjv4i7KSd12QMB6D6EK5Jzcm4+f2SkDEFf7u+I5Ol0atYXo6mrDTzyWD0dqeqBwM XDEQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:content-language:in-reply-to:mime-version :user-agent:date:message-id:organization:from:references:cc:to :subject:arc-authentication-results; bh=1VC+G2jyOI0RVCpnSIfdsTHbi0jak7tW/CbDZZAkk9E=; b=tQI3NotvCXaFyNkuRNjkf8idL2do2P3xXEK4mzghSatkjWQjVIqs2FL2mcfPaVLr6K /hB7BM9RnSVdX9O66wfK38gIleu1zLBeGLDWMEMqHHArfFwkjkzZ8uZh9kvjod2/5fmN uqbY9rbqjSDJ2nEumA69cmGhR2zOzpBzNpTFh/SvMFgqWvKIzS1Jnbn36m2nCsftcnIF O48fJbxHtkR/28Yslk9MHGbZ24tQ7IP4Xwfm7G+dTtHKAB4PgGL9l5JIbgBDC/DANadZ 6ojjy3bMHEjyHE/cUOu4rvb5/njUIz6HotdXou6X8yi5p7EQFx9yFnOpE48KR8RhpYHk sOLA== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: best guess record for domain of mosipov@ilbers.de designates 85.214.62.211 as permitted sender) smtp.mailfrom=mosipov@ilbers.de Return-Path: Received: from aqmola.ilbers.de (aqmola.ilbers.de. [85.214.62.211]) by gmr-mx.google.com with ESMTPS id i26-v6si1142064ljj.2.2018.05.25.04.57.22 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 25 May 2018 04:57:22 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of mosipov@ilbers.de designates 85.214.62.211 as permitted sender) client-ip=85.214.62.211; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: best guess record for domain of mosipov@ilbers.de designates 85.214.62.211 as permitted sender) smtp.mailfrom=mosipov@ilbers.de Received: from [192.168.50.163] (d51A48A80.access.telenet.be [81.164.138.128]) (authenticated bits=0) by aqmola.ilbers.de (8.14.4/8.14.4/Debian-4+deb7u1) with ESMTP id w4PBvI5K013800 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Fri, 25 May 2018 13:57:20 +0200 Subject: Re: [RFC PATCH 0/3] Reproducible build To: Claudius Heine , Henning Schild , "[ext] claudius.heine.ext@siemens.com" Cc: isar-users@googlegroups.com References: <3467a5ec-182e-8c9a-cd19-7ad898323be7@siemens.com> <20180523063206.29180-1-claudius.heine.ext@siemens.com> <20180524180027.09b7b880@md1pvb1c.ad001.siemens.net> From: "Maxim Yu. Osipov" Organization: ilbers GmbH Message-ID: Date: Fri, 25 May 2018 13:57:18 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-TUID: uVAJ7N5nnD5k Hi Claudius, Let me summarize the patchset status. 1. This patchset is just a first step towards more generic traceable reproducible build - tarball versioning/reproducibility features are out of scope of this patch set. 2. Baurzhan always asks to provide some bits of information into the documentation when a new feature is added (or changed). 3. Henning asked about "stealing DL_DIR of bitbake as well" (see his email below). What is your opinion? Kind regards, Maxim. On 05/25/2018 10:10 AM, Claudius Heine wrote: > Hi Henning, > > On 05/24/2018 06:00 PM, Henning Schild wrote: >> Am Wed, 23 May 2018 08:32:03 +0200 >> schrieb "[ext] claudius.heine.ext@siemens.com" >> : >> >>> From: Claudius Heine >>> >>> Hi, >>> >>> this patchset contains a implementation of my proposed solution for >>> reproducible builds. >>> >>> I am currenlty not quite sure if that is the right approach, but it is >>> the simplest I can think of currently. >> >> I did not look at the patches yet. And because it sounds so simple my >> first reaction is that it can not be complete.> One thing we will need for sure is the sources that lead to the >> packages we built ourselfs, otherwise we can not rebuild them later on. >> And that seems to be a tricky part, not covered by stealing the cache. > > You are right, this solution is not complete and Rom was not build on > one day. My goal was to improve the situation just one small step and > then build on top of it. > >> Maybe stealing the DLDIR of bitbake as well? >> >>> As already described in my proposal, this patchset does the following: >>> >>> 1. Takes care that the package cache in the isar-bootstrap root file >>> system contains all the packages used for this >>> distro/architecture. 2. A tarball is created after the package cache >>> contains all the packages needed by the image. >> >> Are you sure that "apt-get clean" is the only reason for cache >> eviction? What will happen if i install a ton of packages, not that apt >> will want to safe space at some point. > > Yes, I might be useful to set the apt.conf to disable all autocleaning > options. > But normally apt removes packages from cache only if they are no longer > downloadable and since the local index of the upstream repos are not > updated it shouldn't detect if they are no longer downloadable and > therefore not remove them. Disabling this completely is still the better > option. > > Claudius > >> >> Henning >> >>> 3. This tarball can be used as the basis of subsequent builds by >>> setting a bitbake variable. >>> >>> This is just a first draft of this feature, maybe we can further >>> improve some steps and maybe there are better ideas to improve the >>> usability. >>> >>> Cheers, >>> Claudius >>> >>> Claudius Heine (3): >>> meta/isar-bootstrap-helper+dpkg.bbclass: bind mount >>> /var/cache/apt/archives >>> meta/classes/image: added isar_bootstrap_tarball task >>> meta/isar-bootstrap: add 'do_restore_from_tarball' task >>> >>> meta/classes/dpkg.bbclass | 5 ++++ >>> meta/classes/image.bbclass | 10 +++++++ >>> meta/classes/isar-bootstrap-helper.bbclass | 9 ++++++- >>> .../isar-bootstrap/isar-bootstrap.bb | 27 >>> ++++++++++++++++++- 4 files changed, 49 insertions(+), 2 deletions(-) >>> >> > -- Maxim Osipov ilbers GmbH Maria-Merian-Str. 8 85521 Ottobrunn Germany +49 (151) 6517 6917 mosipov@ilbers.de http://ilbers.de/ Commercial register Munich, HRB 214197 General Manager: Baurzhan Ismagulov