From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 6547633542169362432 X-Received: by 2002:a19:d249:: with SMTP id j70-v6mr945995lfg.6.1524495899480; Mon, 23 Apr 2018 08:04:59 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a19:dbd7:: with SMTP id t84-v6ls1792385lfi.16.gmail; Mon, 23 Apr 2018 08:04:58 -0700 (PDT) X-Google-Smtp-Source: AB8JxZrymyV3Ep4mdtwu2CwvJ5yosWFonyxjlG/8EIGmkTgjsDM2ilhaGTrP/7NLy+iqMCMi+PiC X-Received: by 2002:a19:dd9d:: with SMTP id w29-v6mr916744lfi.0.1524495898957; Mon, 23 Apr 2018 08:04:58 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1524495898; cv=none; d=google.com; s=arc-20160816; b=XV3ZfFdTvIeiNhd4NEC34t3yaBUXeQapWEis98Rtg8Fk0CI3/Lw0PzvdbBMWGmu0Bm If3Jl55hJ0DHXNnMd50qDIpH9EPSUvLLAObQQgsPGf5jNdDO2Lm14ELCvpOu9K/03m2U ybMRJL+GIga2rLov8I8OcRgFrnsDvPhhMgaUna6RpHge93DAjUVNCtwH19oUrOuvcyIO 5e0a3dOIOtFlaI5O3tEhsxSm0pZBOBX71s5xqLqZvqWOc6Smvb+5OTnvU+tOFZ97GDIt GUyywcrDB++hLP9dR8iuWTJ3YlQFi3gMoUPU+F4R2AVj7zHU6It3WWtk46z26crR1wqU R2KA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date:arc-authentication-results; bh=KKYUKxIME+yreN/vc1BUES/yd0S7oYxltHCZ6P/9UeE=; b=BJ72NHbZGgLdJVum81RPBmTOfs6cZo5EXjuaveuwFfb9rGMW/1sHgU9yv7jqaA9RfW wKVUM4/H3qC7bXlbMZgmkw3dwupfpwByHPlvNDLDXwqP8DAUFCaE6zw+Q/+X/0+xGDli q5QQco8vklCk5qzgLANdtR+iQMlihM20g8hlOtZ19bSI4Qv9misB1aO0ItYby1yDVnB9 hYVZrJeTrvkj8ZOGAkUw2iSI3tQIhay7Qbycj71xWBfVQeAgZXtqoC3a8B3idnfkcaQy vn6CelG2P1kJmttddy3cTnq60YKmr6d14Cu5ZUhVOYPqHmmwd2ds1bf6tl2PaHuUUXKg WNqA== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of henning.schild@siemens.com designates 192.35.17.14 as permitted sender) smtp.mailfrom=henning.schild@siemens.com Return-Path: Received: from david.siemens.de (david.siemens.de. [192.35.17.14]) by gmr-mx.google.com with ESMTPS id a141-v6si270247lfb.3.2018.04.23.08.04.58 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 23 Apr 2018 08:04:58 -0700 (PDT) Received-SPF: pass (google.com: domain of henning.schild@siemens.com designates 192.35.17.14 as permitted sender) client-ip=192.35.17.14; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of henning.schild@siemens.com designates 192.35.17.14 as permitted sender) smtp.mailfrom=henning.schild@siemens.com Received: from mail3.siemens.de (mail3.siemens.de [139.25.208.14]) by david.siemens.de (8.15.2/8.15.2) with ESMTPS id w3NF4w5b029881 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Mon, 23 Apr 2018 17:04:58 +0200 Received: from mmd1pvb1c.ad001.siemens.net (md1pvb1c.ad001.siemens.net [139.25.68.40] (may be forged)) by mail3.siemens.de (8.15.2/8.15.2) with ESMTP id w3NF4w3f008327; Mon, 23 Apr 2018 17:04:58 +0200 Date: Mon, 23 Apr 2018 17:04:57 +0200 From: Henning Schild To: Alexander Smirnov Cc: Subject: Re: [RFC][PATCH 2/3] classes/dsc: Basic Debian .dsc backend implementation Message-ID: <20180423170457.3e25e51a@mmd1pvb1c.ad001.siemens.net> In-Reply-To: <20180423132146.14743-3-asmirnov@ilbers.de> References: <20180423132146.14743-1-asmirnov@ilbers.de> <20180423132146.14743-3-asmirnov@ilbers.de> X-Mailer: Claws Mail 3.15.0-dirty (GTK+ 2.24.31; x86_64-pc-linux-gnu) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-TUID: R4USlke/xT8K Am Mon, 23 Apr 2018 16:21:45 +0300 schrieb Alexander Smirnov : > This patch introduces class to work with Debian .dsc files. The > main goal is to simplify re-building and customization of original > Debian packages. > > To rebuild package from the upstream the following recipe template > could be used: > > DSC_URI = "http://ftp.de.debian.org/...dsc;md5sum=..." > inherit debian-dsc > > All the remaining information bitbake will derive automatically. > This is only first implementation, so there are still several open > issues like: > - Chose correct upstream package version depending on Debian distro > - quilt-3.0 source format support > - Cross-recipe dependencies recognition > > Signed-off-by: Alexander Smirnov > --- > meta/classes/debian-dsc.bbclass | 112 > ++++++++++++++++++++++++++++++++++++++++ 1 file changed, 112 > insertions(+) create mode 100644 meta/classes/debian-dsc.bbclass > > diff --git a/meta/classes/debian-dsc.bbclass > b/meta/classes/debian-dsc.bbclass new file mode 100644 > index 0000000..4159e3a > --- /dev/null > +++ b/meta/classes/debian-dsc.bbclass > @@ -0,0 +1,112 @@ > +# Debian .dsc backend > +# > +# This software is a part of ISAR. > +# Copyright (c) ilbers GmbH, 2018 > +# > +# SPDX-License-Identifier: MIT > + > +# List of non-standard variables added to package workspace > +# > +# Set by user: > +# * DSC_URI - uri link to .dsc file in upstream apt > +# > +# Generated automatically: > +# * DEBIAN_URI - uri link to Debian patch in upstream apt > + > +python __anonymous() { > + # Fetch .dsc package file > + dsc_uri = (d.getVar("DSC_URI", True) or "").split() > + if len(dsc_uri) == 0: > + return Can we not use SRC_URI and append more sources as we read .dscs? A copy of the fetching code just reminds me of the broken fetch/unpack in the early Isar days. Because i have got my dscs in tarballs and in git ... and i am behind a proxy. > + try: > + fetcher = bb.fetch2.Fetch(dsc_uri, d) > + fetcher.download() > + except bb.fetch2.BBFetchException as e: > + raise bb.build.FuncFailed(e) > + > + # Open .dsc file from downloads > + dl_dir = d.getVar("DL_DIR", True) > + dsc_file = (dsc_uri[0].split(";")[0]).split("/")[-1] > + filepath = dl_dir + "/" + dsc_file > + > + pv = "" > + src_uri = "" > + > + # Parse .dsc file to get package details > + with open(filepath, "r") as file: > + line = file.readline() > + > + while line: > + # Get package version and export PV > + if line.startswith("Version:") and not pv: > + pv = line.split(": ")[-1].rstrip() > + d.setVar("PV", pv) > + > + # Get package and Debian patch arcives names > + if line.startswith("Files:") and not src_uri: > + line = file.readline() > + src = line.split(" ")[-1].rstrip() > + src_uri = (dsc_uri[0].rsplit("/", 1))[0] + "/" + src > + src_uri = src_uri + ";md5sum=" + line.split(" > ")[1].rstrip() > + d.setVar("SRC_URI", src_uri) > + > + line = file.readline() > + debian = line.split(" ")[-1].rstrip() > + debian_uri = (dsc_uri[0].rsplit("/", 1))[0] + "/" + > debian > + debian_uri = debian_uri + ";md5sum=" + line.split(" > ")[1].rstrip() > + d.setVar("DEBIAN_URI", debian_uri) > + > + line = file.readline() > + > + file.close() > + > + # Set correct path to unpacked sources > + pv_orig = (src.split("_")[-1]).split(".orig")[0] > + pn = d.getVar("PN", True) > + d.setVar("S", pn + "-" + pv_orig) > +} > + > +python do_fetch_append() { > + debian_uri = (d.getVar("DEBIAN_URI", True) or "").split() > + if len(debian_uri) == 0: > + return > + > + try: > + fetcher = bb.fetch2.Fetch(debian_uri, d) > + fetcher.download() > + except bb.fetch2.BBFetchException as e: > + raise bb.build.FuncFailed(e) > +} Wow another fetcher ... same question as above. > +python do_unpack_append() { > + import subprocess > + > + s = d.getVar("S", True) > + workdir = d.getVar("WORKDIR", True) > + debian_uri = (d.getVar("DEBIAN_URI", True) or "").split() > + > + try: > + fetcher = bb.fetch2.Fetch(debian_uri, d) > + fetcher.unpack(workdir + "/" + s) fetch^3 this time with unpack Henning > + except bb.fetch2.BBFetchException as e: > + raise bb.build.FuncFailed(e) > +} > + > +# NOTE: this is workaround to serve quilt-3.0 package format support. > +# To build such package, the original tarball should be placed > +# in "../" folder. In general, this should be handled by Isar > +# core build classes, but for now this class in the only one > user +# for quilt-3.0, so for the first implementation let"s > keep it here. +# Open issues: > +# - How to identify if package has quilt-3.0 source format? > +# - How to avoid copying of tarballs from downloads to working dir? > +do_build_prepend() { > + dl_dir="${@ d.getVar('DL_DIR', True)}" > + workdir="${@ d.getVar('WORKDIR', True)}" > + file="${@ ((d.getVar('SRC_URI', > True)).split(";")[0]).split("/")[-1]}" + > + install -m 644 $dl_dir/$file $workdir > +} > + > +inherit dpkg