From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 6878157486786871296 X-Received: by 2002:a62:e90b:0:b029:13e:b622:3241 with SMTP id j11-20020a62e90b0000b029013eb6223241mr1254018pfh.12.1601445834291; Tue, 29 Sep 2020 23:03:54 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a17:902:7613:: with SMTP id k19ls426376pll.10.gmail; Tue, 29 Sep 2020 23:03:53 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwRAbQQ9cPz0Djfjic0QfiInV2LJ0xKFcH/FTbg8kfeP3KG+Jz7v6aKolKHK29DKSjjVyYA X-Received: by 2002:a17:90a:7bcd:: with SMTP id d13mr1182913pjl.18.1601445833523; Tue, 29 Sep 2020 23:03:53 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1601445833; cv=none; d=google.com; s=arc-20160816; b=zXlpnV1y1cRP289RKUvGFYl3KeXhUzA74y0khP39BIBl2y2JyoS07A0wWV5FKIU8Og knhHOOjBM4IQ9S2pRAarlc+A53B8Fau6ch0itdChHWufSzjZApaUzx64O7ZJHaddULlk 5V47D0l9JncZNUX16M970u4MCLDLIYpD4mJzfR18gtEdaafpvqklCi3UYrBlwPldfuk0 ZlCy3vvKSPO+k/S57YKvP1p8OHC3r+gAMrxziSHs0YjZnXr7tIyOIBkn/+gSwKbMsmPD vqT5caZwYPV0cHu4i7LYhwpB7nD4mqJ0VuY9QK25xeBn/he9CndPNhbCwYcmMV1fI0wP Q4FQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:message-id:date:subject:cc:to:from:ironport-sdr :ironport-sdr; bh=+IcXObClRetBssGR2S/nj3yCDMSRrWDrBjuSsH6YF0U=; b=fj1ACco97e8FnejqPrasK0LkyfW4tbn9LVrVi+EgeRTyAR/A54nUIV8kKP6XsrS6QA ibz+Jo4QzyVthepC8hfNSKuDuCtr4kKiR2BK2H0Lq6kNVD+fJLA28OaprqEde4sT702X vNQNFy2D7bqAoGzgAtZXBY2K3wIlJsamXqwBOtiG275Krmd1Sn3UWPxwqHMlrYueyl98 FxA8a27HKudr/UM4IIl+gZOG+Uva2C8PdyiXYNnUwWi+TW+EUZpwn1PWjXCGxvSkwFL0 je2mcaVfcFeDfcXsmTS8d45kYB2l0BQ1uQOigW86EMhOAmdH5VuJ0dKMNnTwa3h2rBew e3ZA== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.141.98 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Return-Path: Received: from esa2.mentor.iphmx.com (esa2.mentor.iphmx.com. [68.232.141.98]) by gmr-mx.google.com with ESMTPS id mm16si51246pjb.2.2020.09.29.23.03.53 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 29 Sep 2020 23:03:53 -0700 (PDT) Received-SPF: pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.141.98 as permitted sender) client-ip=68.232.141.98; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.141.98 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com IronPort-SDR: hCRWASK1Psu4BIAIBD0mDPGlN7/YMwWsu0YEWUD/BivDhLloxYFE8wl4LNHryi+OBZPKOaz/T5 cvqJ+NfhyiRDQslO4KotBNSo3TMZNmbcLAEnVJc3yOB67ygED6iJ56PifkHPGaqqjpYpAgLzoV pIKR6M6Y2Lr5AqKY6Uqj0zW3sjpM4bdJS3xZ6B/1BOBuf/RRKoNihgQw0VMOaivls9tVAr3bvA p0eRX1UzZFTTnwI52Jh1K9hBZzcP0Fph7p16nGY23U54wIxIAElC5ZNkLqd8WRIOgaF6qhSXxe D3w= X-IronPort-AV: E=Sophos;i="5.77,321,1596528000"; d="scan'208";a="53461954" Received: from orw-gwy-01-in.mentorg.com ([192.94.38.165]) by esa2.mentor.iphmx.com with ESMTP; 29 Sep 2020 22:03:53 -0800 IronPort-SDR: 4cN/Dtl1aw1+VGT9wu8vdQvF7K+5KiDyJ5H3wP2cw52oupyvKTwM6Dwyt+AYcSb1Zg8cvQVk31 79y3JeMxRSSnWG4WSUCTL6QjkyVqW6SFCmKTFrgfQUalGQSJSulMwKLdC/Z6THjN7lfXKeVjR2 20+9eUSGGVt2ipO6FUGlegl+i0Z9P0jutXuWtLGrwEjiB4UqeVrmxY/iP4sSVrWXZfzHZ/175k rpVt1iZ5u7SpKHSYp7Sj27uqmR/JcQyw3Pk9lZsiqDNVJP/iTbbQHZ4lNFPkdAOUxwJ4wDPPOU Lps= From: Vijai Kumar K To: CC: Vijai Kumar K Subject: [PATCH v6 00/13] Deb-src caching Date: Wed, 30 Sep 2020 11:32:46 +0530 Message-ID: <20200930060259.12422-1-Vijaikumar_Kanagarajan@mentor.com> X-Mailer: git-send-email 2.17.1 MIME-Version: 1.0 Content-Type: text/plain Return-Path: Vijaikumar_Kanagarajan@mentor.com X-ClientProxiedBy: SVR-ORW-MBX-05.mgc.mentorg.com (147.34.90.205) To svr-orw-mbx-01.mgc.mentorg.com (147.34.90.201) X-TUID: CJA9un5ro3mF Changes in v6: - Rebase against latest next - Address review comments from Henning Git Tree: https://github.com/vj-kumar/isar/tree/vijai/debsrc6.3 Changes in v5: The major changes in this series are as below, - (P2) Handle cases where HOST_DISTRO!=DISTRO. This avoids mixing of debs from different distro which inturn helps the src caching logic. - (P5) Avoid downloading package from other builds. - (P8) Add a reprepro based sanity test to check if the repo contains the sources for all the debs. - (P9) Introduce a new variable BASE_REPO_FEATURES which provides means to enable or disable various base-apt features. (cache-deb-src for now) - Some fixes in (P12 & P13) Also, addressed some review comments from Henning. Git Tree: https://github.com/vj-kumar/isar/tree/vijai/debsrc5 Changes in v4: - Use = format instead of just using to download the right version of source package. Changes in v3: - Take care of non-existent downloads/deb-src directory. Changes in v2: - Introduced additional patch to cache deb src - Rebased on top of henning/staging4 tree Vijai Kumar K (13): rootfs: Make rootfs finalize a separate task deb-dl-dir: Cache host distro debs separately meta: cache deb srcs as part of postprocessing deb-dl-dir: Make debsrc_download faster deb-dl-dir: Download files only belonging to the current image deb-dl-dir: Factor out the mounting part deb-dl-dir: Fix skipping of removed files repository: Add a sanity test to check missing sources base-apt: Introduce BASE_REPO_FEATURES repository: Fix failures due to missing section scripts/ci_build.sh: Enable deb-src caching rootfs: Fix possible overwrite of existing resolv.conf rootfs: Handle failures when postprocess is rerun meta-isar/conf/local.conf.sample | 4 ++ meta/classes/deb-dl-dir.bbclass | 61 +++++++++++++++++- meta/classes/dpkg-gbp.bbclass | 8 ++- meta/classes/dpkg.bbclass | 8 ++- meta/classes/image-tools-extension.bbclass | 4 +- meta/classes/image.bbclass | 43 ++++++++++++- meta/classes/repository.bbclass | 13 +++- meta/classes/rootfs.bbclass | 62 +++++++------------ .../isar-bootstrap/isar-bootstrap.inc | 12 +++- meta/recipes-devtools/base-apt/base-apt.bb | 3 + scripts/ci_build.sh | 1 + 11 files changed, 166 insertions(+), 53 deletions(-) -- 2.17.1