From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 6878157486786871296 X-Received: by 2002:a25:38c1:: with SMTP id f184mr2062496yba.41.1606291419072; Wed, 25 Nov 2020 00:03:39 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a25:2d56:: with SMTP id s22ls822180ybe.0.gmail; Wed, 25 Nov 2020 00:03:38 -0800 (PST) X-Google-Smtp-Source: ABdhPJxr1tTXdOGjLCMQRI+wVGHI5RW9QztkHUITK784XOCpahCB9hEFhHrNAUv74K/B45cTxrg2 X-Received: by 2002:a25:3281:: with SMTP id y123mr3062867yby.467.1606291418652; Wed, 25 Nov 2020 00:03:38 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1606291418; cv=none; d=google.com; s=arc-20160816; b=qy/P2qAu57QJhvtCF8fyax16EDMp0nOKr29CDqUojtwm9LMsqCbpnoJzKL2gYbmC3V Ij8uPPiXfyh61qzCG1Lz3QR3ZpkRSWuv+cRgfWyYr56IASAKj64Z8be5wvXqNRP+e75m hpFSYp/zXr5BYannoYRKoL4/WeuHn3sJI8sIr32VUWJ2u2TT/2TNQmOa36htw09mtyTD Gpta+C1Xuc5APrP9PJ+hrnUZat0vy422q0KINS6XPNPO9mcpOLXR9SLQEkHYsjt9Y65R PXAyQj+j2C3nPXHqqyc4S3QkhKxjhx7WUPg2UGLBLOkJba6WQfL4P8nsgmx6QdN0Y6vR iuzw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:references:in-reply-to:message-id:date:subject:cc:to :from:ironport-sdr:ironport-sdr; bh=eNGr2sY82htXXv/f2Ypru+JC6ylWvonjFgG9JC2l700=; b=rmdqnPOzqu8qG59wizYzO0WAlHKf9RDfdZyJ0my0uhNLauKd/EYE4uRrUtNtJQgB6u zyDG+Gb4pjNE/MSDxBrhGEi/JTPedyHWqYFc2tk5OphDfbIZ81zHNudMAj0uAzwLdIrx JlM1nWLNlUYaVj7w6fci380kR6K7pimvNrkjZycCZE5JP0d3LtzPcXriGeSEMris4H6F VHFJdaT83u8OOHmnYVpUTo3vXhsJNQm6dyx9B1juVbNL9TqfYmiOd5Zu+ZZJEzU9B+1n P4vuJMtZvjQr2pFGTwYbfnEHJz/vRZ59vpbgACPYZMTHQ2Q+CPB+nTVtvNQIXKGkzeG9 Grew== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.129.153 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Return-Path: Received: from esa1.mentor.iphmx.com (esa1.mentor.iphmx.com. [68.232.129.153]) by gmr-mx.google.com with ESMTPS id 199si77218ybd.5.2020.11.25.00.03.38 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 25 Nov 2020 00:03:38 -0800 (PST) Received-SPF: pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.129.153 as permitted sender) client-ip=68.232.129.153; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.129.153 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com IronPort-SDR: WSZJ4zuuwRvdhB89fwcgXBmCqSKqOisxZJb1HjTmOBXr7McySwQYZpCGkxskhMrsGmaYIuqS8D cD4c84gS0N7k4h17TFxcAZg93Uqg78kSdi0uPpDzl3E6V161c7BsVDq4ZCLcqX2CuN5S/BxaJC +I+PIXJR4izpPRuuHg2b0leSzmLv+Pl4Vlxf4k+hNs2bF2HcX8sS2GtAzW2m/2t3wPJ0YjeAkV dSQDJkfhviQ8QhaINoXVTpeCLXqRQmtEro1mf4tt9Kn/G83B3JuQ5ZXJe3VsI28QoSGoGfsUbK XUE= X-IronPort-AV: E=Sophos;i="5.78,368,1599552000"; d="scan'208";a="57762480" Received: from orw-gwy-02-in.mentorg.com ([192.94.38.167]) by esa1.mentor.iphmx.com with ESMTP; 25 Nov 2020 00:03:38 -0800 IronPort-SDR: jwhWBw76WZ9fDO8zMQrGYOCCvePSEM6b1Wk1wrkDyqDlnFcCAUwXO5SMiyAhMIN/NQfqU931Ei u44I4M5PPRizaZdoQEjzacKm87h8egA5ZPUKY9hsEbM6HXzc+aqAsVRBOoqEe3121p9zX2NtYL OBVfpc97Tuy5TLjdm+/rYDpjAhvmRNlPOER6NFJEk2WOYLXIg3nl5xuIBB/shzIS+VVomz0Ien FsMDXYLupulUJQ3hs/eKktEmYqxfjXGCJF0TxPoKPraialh254P06bLXhXjV/W1hjaiav9yFnH g/8= From: Vijai Kumar K To: CC: Vijai Kumar K Subject: [PATCH v7 04/14] deb-dl-dir: Make debsrc_download faster Date: Wed, 25 Nov 2020 13:32:51 +0530 Message-ID: <20201125080301.15818-5-Vijaikumar_Kanagarajan@mentor.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20201125080301.15818-1-Vijaikumar_Kanagarajan@mentor.com> References: <20201125080301.15818-1-Vijaikumar_Kanagarajan@mentor.com> MIME-Version: 1.0 Content-Type: text/plain Return-Path: Vijaikumar_Kanagarajan@mentor.com X-ClientProxiedBy: svr-orw-mbx-04.mgc.mentorg.com (147.34.90.204) To svr-orw-mbx-01.mgc.mentorg.com (147.34.90.201) X-TUID: cjcs5Rq6Vzzp Eventhough apt-get source skips redownloading of files, it is still slow and takes a lot of time. Instead, lookup if the dsc file is already present in the cache and skip based on it. Signed-off-by: Vijai Kumar K --- meta/classes/deb-dl-dir.bbclass | 2 ++ 1 file changed, 2 insertions(+) diff --git a/meta/classes/deb-dl-dir.bbclass b/meta/classes/deb-dl-dir.bbclass index 659fe4b..79a9a88 100644 --- a/meta/classes/deb-dl-dir.bbclass +++ b/meta/classes/deb-dl-dir.bbclass @@ -20,6 +20,8 @@ EOSUDO find "${rootfs}/var/cache/apt/archives/" -maxdepth 1 -type f -iname '*\.deb' | while read package; do local src="$( dpkg-deb --show --showformat '${source:Package}' "${package}" )" local version="$( dpkg-deb --show --showformat '${source:Version}' "${package}" )" + local dscfile=$(find "${DEBSRCDIR}"/"${rootfs_distro}" -name "${src}_${version}.dsc") + [ -n "$dscfile" ] && continue sudo -E chroot --userspec=$( id -u ):$( id -g ) ${rootfs} \ sh -c ' mkdir -p "/deb-src/${1}/${2}" && cd "/deb-src/${1}/${2}" && apt-get -y --download-only --only-source source "$2"="$3" ' download-src "${rootfs_distro}" "${src}" "${version}" -- 2.17.1