From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 6558372643829972992 X-Received: by 2002:a19:db8e:: with SMTP id t14-v6mr47842lfi.30.1527235818053; Fri, 25 May 2018 01:10:18 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a19:1a43:: with SMTP id a64-v6ls2799905lfa.0.gmail; Fri, 25 May 2018 01:10:17 -0700 (PDT) X-Google-Smtp-Source: ADUXVKJbIszW6uwjaI1MwNh5Gq+hXnM8GbL0pzX2mW7MKc+8sFRdZMsFl65pqXrdrXA8ZySKvmHS X-Received: by 2002:a19:5014:: with SMTP id e20-v6mr47722lfb.9.1527235817321; Fri, 25 May 2018 01:10:17 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1527235817; cv=none; d=google.com; s=arc-20160816; b=cs0diOSuxJ7i8svxr804mJEDG1ouHD/CVUixnH3pu3nNq6PEfrGL7G+8hes20jwcLc nF4/CUoRdZ/e39pmAyMeH2COeskPh4oR+TR3fiS58m27aYzfUd5dOGdK1N1gGyfHZMvc JeY6jwqAEC5smH5iUSETfybA2tEQt/VyX/aFhkZfVaa7f+hL6Q82BxmzP3dMkqT9iRED ypVXbhVAc0H0Wxt3lzwX4fG+/wp4QNGVT888IMjDjyx+fDbkZwdTF5s8CpydTa8p2vpJ DDN10iPageflPtsEkqJaLJ7rD0lbfTptZNryT297ETMXwSv/nCEp5FdYdfi0WALcN3cG c0dQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=in-reply-to:mime-version:user-agent:date:message-id:autocrypt :openpgp:from:references:cc:to:subject:arc-authentication-results; bh=Gz1SmCoNj15hC7j8eGX198y6dpSKzM0juwWzEkhlnQI=; b=mSo2p2rIl/QTEwoMv2VXQKWmFmBpyKlO+3VeR0P7JGthOw9FZqhjihaPOY6liOpTMs 1he3isxvw0AVXT4zIjQvtb4QgGI9t+SP6nfmKXO9zwDLl0SX9haje7VbxM47KL2xb6Af n4Np7a5GxgRrrKgXm2RYygRslO/j0oF7Vfq4qxe+isx80GC4mbylPJqbgguAew+1Njd/ JgrlNX1TBKG/Y40pRM065PnQXhNutcIwwE/11ir9I0VlgneEB2DSL0A+F3cfdH7jAZcq XQqm31Btqxb79n/GUNTvBvfMRLZ8VjRrfZNRlErr8IoCdkD//LpnorQM3kd4IHQncP/G 4KCw== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=neutral (google.com: 2001:a60:0:28:0:1:25:1 is neither permitted nor denied by best guess record for domain of ch@denx.de) smtp.mailfrom=ch@denx.de Return-Path: Received: from mail-out.m-online.net (mail-out.m-online.net. [2001:a60:0:28:0:1:25:1]) by gmr-mx.google.com with ESMTPS id j127-v6si780739lfe.4.2018.05.25.01.10.17 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 25 May 2018 01:10:17 -0700 (PDT) Received-SPF: neutral (google.com: 2001:a60:0:28:0:1:25:1 is neither permitted nor denied by best guess record for domain of ch@denx.de) client-ip=2001:a60:0:28:0:1:25:1; Authentication-Results: gmr-mx.google.com; spf=neutral (google.com: 2001:a60:0:28:0:1:25:1 is neither permitted nor denied by best guess record for domain of ch@denx.de) smtp.mailfrom=ch@denx.de Received: from frontend02.mail.m-online.net (unknown [192.168.8.183]) by mail-out.m-online.net (Postfix) with ESMTP id 40sf7X2vSFz1qvNf; Fri, 25 May 2018 10:10:16 +0200 (CEST) Received: from localhost (dynscan2.mnet-online.de [192.168.6.68]) by mail.m-online.net (Postfix) with ESMTP id 40sf7X2SKhz1qqkY; Fri, 25 May 2018 10:10:16 +0200 (CEST) X-Virus-Scanned: amavisd-new at mnet-online.de Received: from mail.mnet-online.de ([192.168.8.182]) by localhost (dynscan2.mail.m-online.net [192.168.6.68]) (amavisd-new, port 10024) with ESMTP id 7e9FOaTdo3ie; Fri, 25 May 2018 10:10:15 +0200 (CEST) X-Auth-Info: VxnZMY2NigkHUjpBRi6PfiOEjQYTCy7rBSY3r176I0c= Received: from deneb.denx.de (p578adb1c.dip0.t-ipconnect.de [87.138.219.28]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.mnet-online.de (Postfix) with ESMTPSA; Fri, 25 May 2018 10:10:15 +0200 (CEST) Subject: Re: [RFC PATCH 0/3] Reproducible build To: Henning Schild , "[ext] claudius.heine.ext@siemens.com" Cc: isar-users@googlegroups.com References: <3467a5ec-182e-8c9a-cd19-7ad898323be7@siemens.com> <20180523063206.29180-1-claudius.heine.ext@siemens.com> <20180524180027.09b7b880@md1pvb1c.ad001.siemens.net> From: Claudius Heine Openpgp: id=6FF2E59F00C6BC2831D864C11173CB199808B153; url=http://pool.sks-keyservers.net/pks/lookup?op=get&search=0x1173CB199808B153 Autocrypt: addr=ch@denx.de; prefer-encrypt=mutual; keydata= xsFNBFSuWugBEADI18RqDRNsXrWtQBuI60knLMfJ6j26C4ArB5ht4TzTQg9PfTJf1BwKUMYH 1s5qKikAX1mAFm7ca4uxc8uY1AdTFKepNp6ewcRShWPFo1+7DJcTlS1O+cIUyOeo6yrMMI2D DeILzcird0ATI+v7QzO1TmAmEGB28kp9KozZqFKS28p6/GLJ8qCYo50MpacsB0oi8pUeU6+8 KUlKfDDNZvwM+7rVlshOdp0iuAe12IH4gePkXycTm/PvCdqpvm6Uc0FryYh2AzB78Zvzpysb VTdGzFYavdLJJjNifj1XKgeRayR1UG0dMpcUwzLxqRmeRN1Ca7/NVT/NUHm8r80ta6mvjDHj 0vHWfn0CFgfikRtB4tftWmsvYs8YtDtR7X4gaYk5CHhR9iAGU2zElYp2Q417oe1FuXn0eFxG 1SzENtFdUZv64oQSOblJ9ZKslXLBlwCLacSdNK499IEs03UAaTPgh5L/t8G81FDeXduFt129 h6UY6Si2xDYE9wZ90XGag7Uv0wC2LKyOWzEgeOJDIGjQVAMlcr5i6nNa30n/qMTWSf+jahLa 7cr8Mgzw0W9lSAX1CytJJjh5hTHF/atZkl6+vInHJLTtBA2leRF7og2H6PHfUmpJ/A46x71l rODfqjq4/ZblSgqgQCU3rXq8bPwnl7zo/dlyqYUPVAJQ79m9jwARAQABzRtDbGF1ZGl1cyBI ZWluZSA8Y2hAZGVueC5kZT7CwZUEEwEKAD8CGwMGCwkIBwMCBhUIAgkKCwQWAgMBAh4BAheA FiEEb/LlnwDGvCgx2GTBEXPLGZgIsVMFAlplrUwFCQeYheQACgkQEXPLGZgIsVNvpxAApWwj EBFLOmkT743quLs+G8he5XDVlqKsu4eKr3ggFwSg/kZPSWAaz3HRtw+RBcO3+Z+Ut/0QekwR cv3q/24ykK8f0kWM/Jinaf1sUBuAx+VFfTimPC6XyJK9PHYxYqsN5ax1r7eM8oMZiLH/sKD1 FM/CA0yDPF+PI+iBdPz/Bnt46reEPnaOdNpVRro84W4qlyiMokxz1N0CQfdS5Z3FO51e5dsa cPID+7ugML7zvgSxXNR9sQPVMJdzyqfaY9/xNbGilBii0YJQwsKJP5gIsAvPmX+1WLoF8pFX gaYTdnPRWR+6mc8Csx7BqOSPQdbwgCYPCG9qSTOFdUguEAsFvTJVaKu1rKphPxAIp3W0IuoT K1e+a5j4HpFaHRIARrDUFdNHk3oZ18n1UXA1f5IDh7zJqxpToBoLkfsJFfRd0oOkZyYdoiXE 1ULN3snhRM3D+xWGkKLMPdHQGalLADc3B0w2aYQms46DN8Xpiz9T3u85ynljTy5XcbYjsEW8 WQy1vYVsF9R3dFtVvKrlurstPIJWigbUHvoThZPaj8xiQaIg+/SZy58hjXsJpIEBwubSYX7n GD2QxCvqfUJfNlmBnZ0gB0+71r3k8UyvE8lyxvIrB38zbOoK6PqTt8S9SzDYHbjFQZZa/tr9 t4MNE6Dsk/SYMKevOZFtRQZVVgUpBLrOwU0EVK5a6AEQANbSW8FeAXDMaL26JYiaWriOCB4g zqSIGXPjy1pdtS3dghks2WvADdoUuXBE6ZdbEGl+3QUlXhv167iY1M48oOVCmBnp/ENt1D9s mYB8lby4bVfb5e6eP4VivRUKiU1S2Yvp3en6/Bnts8q6clDezcbWu8lOjzlZEgXbcUPM77r3 3knriTtjnGEGc4Blta/1ED6U00NjqZ3mxpyVT1dmafmMt2Onh6XsYUgCuuAFOkhg0hUB3ems 7NPawURj6PYDYxnbpt/qTJiKbWM6CCkPDHrHesoY/ONvCeGaxzIytaUwXJ/mi3ws36hJXSST Nfyo2W5SskPJvGyn06KXr9YMW9IyZ4AV1pIs2iJ6T1rUXlXpxZ63BMY8Ja8r58Zg5+0cOaBr IAtMCo2aPsfChHEBc3m7XBCfM8yNtvzex8SCVLa/pOVXbKmXKbseInpdtP+3EM1p3R/PjBvK bvsyesk90F6+zsyVu46JVCyqrN3RGGyZCdicFHIPfqzUAnuFIOlUYSDwqvJXMwT5XcZ1jvNR eUvYwqpIJJYumoL3V5SFu434Wu81vMLeFPEccgLW4tbqpckBdbwP8GaPVmgnCWsQhcO9KUDE bnL4nO4lNPgz94dmb579BLsoAH5VVNQONyBEBxeiQBsK3DebwCmQha3qunRc4VUJQlZm/if4 lBdkNMavABEBAAHCwWUEGAECAA8CGwwFAlaXcw8FCQPKS6QACgkQEXPLGZgIsVMcKg/+NYx5 kor13F6GhTKxvYu/ip6GB8h6S2w2LPFG4pg+b0rievpzBFOPCC6ciY2zebjPCTcA6C4GvPWO q1nWOLQOJ6L66Soqn81VRQRzk63p8GpKI4oKM3KoRcKjkYsVqKL8+qE7+J2iG29bjBwMa5w8 U6/9fEEpxCndi3jYIZuwi6bEvSO63BUMMgFYN+Enfx40jeFPEreyV8IDuBeqk3GTLbGQTKNU zsA26rLrKBMB2b2h9TF3LBy2TH43xC+qluUO4esXSfp5U+4/CRHx7nOKBcukldFWylbPnmOe 2ATgRR6u9dXVReiFjoLcvv13RYnuDzSYUvBKn5RcEwzdtM69WbeSo0+peKpPM/ErM37q/e2j /cSOAMUlCegEcabFH4NHBJkIEztGD7yoD/bO0dhdrZ6KPLSYAxm8NIQRGToRPa3PNAxZ/+/I RpzWsR5pamOUrapKEqBULQQTW6qaOIfuqJ+H3FCfEwtKKYnonGZNd1zDzhEs3tgzWRXZHcl9 X1vkMrEOFd6ooX5XRrrxhgLP56jWX73v2kX6FCidzN7hj+GRRaFbfMT0U0oWsvgAgBnX/rlL Gn1pgpgUy4EqbCKTTn5MbCL4+FegzIP2K7vSjeHO1f8ZeHHZYViuquzoTJtUzPaCj3Ei1pLb jQ3lYlXICGFcL1aotH2AkcdU5LSP3VbCwXwEGAEKACYCGwwWIQRv8uWfAMa8KDHYZMERc8sZ mAixUwUCWmWtUgUJB5iF6gAKCRARc8sZmAixU1EiEACFyYq9rYAeADdrDai3Eap5uQ/F2rrI H2oqjotB/HcH+3xFs3Q3mT4oCDoQhZ1uIOwHQ0iraffFC3T8H5LULAvOOMCZho4VKqdOQdPs HFan596pAuCbIHnclzI66Be90VEmqAKn1dS2yZJF1SNi3YCEaoMwEP0xOHuucwCc+OHW+uT4 SO727tbo2ag5bKVbZ+f6ZB/okA9UXzTL/oI55Imb0q37o2NRzBDTu7SpcqOIEzRdyz5sIhIm dIJp7wW0HKqa1SJRB/37zbUqPon2XTXrFQFfI4D+EDEDscO0sxElG7EK0LaqhqycHzA0IkO+ amuN4Gif+OruJqlHpodmC1po481At/SQp55l7/qpsFWkUvDDMrjVRSz6WMMxFec42Bc0sTBu TsJwPkeZO+oA6FPoMoh6ijwwTcCW64Etgx8GqV8Acq9ivwg5aYP/fMzHDiqLS19sHXWvsepy 65+mmdhLbhr8AjbgKh4ytz2QNNEu2niyBAH4Bysrs9ePIPoCBomKrufvWAT4DtuhiCvMLXPI 9xYZWkLyxRQ1ZcjM9B9MAua//qsBvjBYCWL34+CNc1OtvuD99NktYr7xZN/AIDg6Koj1x/dZ PVJcR8y2De4hUuX5L8Ln5hAGoglCuHWQaqiLvA9vo3aPoxedmp+X1kLbnP2MbWYgqCgfsr8K 7f25zg== Message-ID: Date: Fri, 25 May 2018 10:10:09 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <20180524180027.09b7b880@md1pvb1c.ad001.siemens.net> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="eOY0WJniYPF3hrsP7fxBOqAb2WIMbADGu" X-TUID: OvghQhtNZH7J This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --eOY0WJniYPF3hrsP7fxBOqAb2WIMbADGu Content-Type: multipart/mixed; boundary="isnBrC0Z1AH7XNF3044G6Y1XkbLF9GWQr"; protected-headers="v1" From: Claudius Heine To: Henning Schild , "[ext] claudius.heine.ext@siemens.com" Cc: isar-users@googlegroups.com Message-ID: Subject: Re: [RFC PATCH 0/3] Reproducible build References: <3467a5ec-182e-8c9a-cd19-7ad898323be7@siemens.com> <20180523063206.29180-1-claudius.heine.ext@siemens.com> <20180524180027.09b7b880@md1pvb1c.ad001.siemens.net> In-Reply-To: <20180524180027.09b7b880@md1pvb1c.ad001.siemens.net> --isnBrC0Z1AH7XNF3044G6Y1XkbLF9GWQr Content-Type: text/plain; charset=utf-8 Content-Language: en-MW Content-Transfer-Encoding: quoted-printable Hi Henning, On 05/24/2018 06:00 PM, Henning Schild wrote: > Am Wed, 23 May 2018 08:32:03 +0200 > schrieb "[ext] claudius.heine.ext@siemens.com" > : >=20 >> From: Claudius Heine >> >> Hi, >> >> this patchset contains a implementation of my proposed solution for >> reproducible builds. >> >> I am currenlty not quite sure if that is the right approach, but it is= >> the simplest I can think of currently. >=20 > I did not look at the patches yet. And because it sounds so simple my > first reaction is that it can not be complete.> One thing we will need = for sure is the sources that lead to the > packages we built ourselfs, otherwise we can not rebuild them later on.= > And that seems to be a tricky part, not covered by stealing the cache. You are right, this solution is not complete and Rom was not build on one day. My goal was to improve the situation just one small step and then build on top of it. > Maybe stealing the DLDIR of bitbake as well? >=20 >> As already described in my proposal, this patchset does the following:= >> >> 1. Takes care that the package cache in the isar-bootstrap root file= >> system contains all the packages used for this >> distro/architecture. 2. A tarball is created after the package cache >> contains all the packages needed by the image. >=20 > Are you sure that "apt-get clean" is the only reason for cache > eviction? What will happen if i install a ton of packages, not that apt= > will want to safe space at some point. Yes, I might be useful to set the apt.conf to disable all autocleaning options. But normally apt removes packages from cache only if they are no longer downloadable and since the local index of the upstream repos are not updated it shouldn't detect if they are no longer downloadable and therefore not remove them. Disabling this completely is still the better option. Claudius >=20 > Henning >=20 >> 3. This tarball can be used as the basis of subsequent builds by >> setting a bitbake variable. >> >> This is just a first draft of this feature, maybe we can further >> improve some steps and maybe there are better ideas to improve the >> usability. >> >> Cheers, >> Claudius >> >> Claudius Heine (3): >> meta/isar-bootstrap-helper+dpkg.bbclass: bind mount >> /var/cache/apt/archives >> meta/classes/image: added isar_bootstrap_tarball task >> meta/isar-bootstrap: add 'do_restore_from_tarball' task >> >> meta/classes/dpkg.bbclass | 5 ++++ >> meta/classes/image.bbclass | 10 +++++++ >> meta/classes/isar-bootstrap-helper.bbclass | 9 ++++++- >> .../isar-bootstrap/isar-bootstrap.bb | 27 >> ++++++++++++++++++- 4 files changed, 49 insertions(+), 2 deletions(-) >> >=20 --=20 DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-54 Fax: (+49)-8142-66989-80 Email: ch@denx.de PGP key: 6FF2 E59F 00C6 BC28 31D8 64C1 1173 CB19 9808 B153 Keyserver: hkp://pool.sks-keyservers.net --isnBrC0Z1AH7XNF3044G6Y1XkbLF9GWQr-- --eOY0WJniYPF3hrsP7fxBOqAb2WIMbADGu Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEb/LlnwDGvCgx2GTBEXPLGZgIsVMFAlsHxOYACgkQEXPLGZgI sVMFiw//RcHRiTD4HmBq0lpys7Q/cXBFHUPvbLfMSEa/FK9v8ukKn0JfwlSSLnKq 9KTA1WZSUsIBywI3FEmK42Q4EBzoX/76PQ+wSGGs1PlkSjZTKrmOWGqCmHqfzVnN 0QN4Shl4qr8GEJlG5a87XVfOBGHEvpIz+3k60WoZIpVOVwyXrztBaXBzdpTZta7k rkhc8ldu3ZQBre9wMLrXc723EYYbt5OOb12mnXrLvUobc6f3UfLeAMBG+isbpwD+ xR3QotrsaopepOLy7UUduvm2NQhk9iGTVcVZqsTp+PuzM7ylrYY5xcVDyBQnY4A4 1YzKKAJHpPHBvwaQENXrqGEf3co4BY++zDESCMeHVb0XdOH7nw74qplTTHJMDmVx R43gz1+wR8tQpNycab8DzheAGWU/rtTBzWru5w9VRTS0muBI39h4ArOumtnwS7yW 0mn7SuVUuWUJu+rhnVK/BaEwz3+O4xzyWa8wEfN0mfGweoekfPfwToBF1QDb9q2L 9p97TZvwDNIagSopds+2OytOFYkST25jwbWzRqwtu+FoAJvW/fLc4DVHbApe/Qpe kWFRBa/IEssM9ief8/2B45wBPtJ3rlBeOVBxRCk9FewZ+yMdDsgk3ieF1Kp4YVd8 soPGMHoZMC7edlZ3Tv/khZotoKoDqEJ+QkwhWYxPoZ7I7KzkbvI= =W1lE -----END PGP SIGNATURE----- --eOY0WJniYPF3hrsP7fxBOqAb2WIMbADGu--