From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 6473366578589073408 X-Received: by 10.223.156.139 with SMTP id d11mr1467415wre.17.1508346866330; Wed, 18 Oct 2017 10:14:26 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 10.223.157.208 with SMTP id q16ls1428460wre.6.gmail; Wed, 18 Oct 2017 10:14:26 -0700 (PDT) X-Google-Smtp-Source: AOwi7QBeANVmo86CzeSBqEYT8W1BwaqHrAvxsUcCMazSiomwrcqD+tJ3CxHzl6VaHv/B2bV3l5Oc X-Received: by 10.223.135.55 with SMTP id a52mr1431435wra.28.1508346866052; Wed, 18 Oct 2017 10:14:26 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1508346866; cv=none; d=google.com; s=arc-20160816; b=0xU1A9L7nBZPGeL8xlNlS+TNSdEu2+mAUwdl0GHwobIjq4n3W/5awVKTpOgasrazsc gSAzaXhNeclT3PJMYGR95F/eVkcnyTvg4S7E6ZBraI+xZGHwGhu+NTh9dJPw1IeRCE2n hm6tzRMFp0bywxophwHBqac7G0lWoPBJrGq8iFJtMTRAntzJ0va+rZ+jenW7PaDf8YVe 3VMt2zQOr/ILU11mjaN+VrmZnV4rrNIP3kZMC162j9YQZ85Qvt8h2xF86+jH+jGQWKyF gWyZ4EcyLaHlY8unhE/5VMweCaddCAOr5cNRck+F/MqucovWRWD5cRdhYP/jfFyAnwev q9EA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-language:in-reply-to:mime-version:user-agent:date :message-id:references:cc:to:from:subject:arc-authentication-results; bh=yZh0JcKx+3HcZhAd0Z/fROjjrutBLc1iQbAfAfID5aA=; b=Ap0hWClry05FfEfqQmBT2pQg16kCKzPuc8y4Bg4hhEiCy7Dg1Duz/8ljM5WH97w4b8 9d60+99g2Ugb2Fc4XjHCaSbIrAukUQVgSoSagioZFdU5VNY60sG8rIkeLyIXSxh7f+3H L8qzrtBX14LcXQLlA5rnNhpemU4RenbzdLia3XVXBTRTEDbTdsKXm44SdRgYtRCwnc0z Fa377Rls9uOaphOpS5mqCrcYq1mC/gqwJofUI7jUU4EVsjHkpCTKQhgu+mI2MOwtoeqm sVNnXMiM2kK7x3473s8doy+7234ul3koHM1YQ3iN1EGyPL6dK4Vdfq8h7ZN+Oj47SqWi DVbg== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: best guess record for domain of asmirnov@ilbers.de designates 85.214.62.211 as permitted sender) smtp.mailfrom=asmirnov@ilbers.de Return-Path: Received: from aqmola.ilbers.de (aqmola.ilbers.de. [85.214.62.211]) by gmr-mx.google.com with ESMTPS id 74si190903wme.2.2017.10.18.10.14.25 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 18 Oct 2017 10:14:25 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of asmirnov@ilbers.de designates 85.214.62.211 as permitted sender) client-ip=85.214.62.211; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: best guess record for domain of asmirnov@ilbers.de designates 85.214.62.211 as permitted sender) smtp.mailfrom=asmirnov@ilbers.de Received: from [10.0.2.15] ([188.227.110.165]) (authenticated bits=0) by aqmola.ilbers.de (8.14.4/8.14.4/Debian-4+deb7u1) with ESMTP id v9IHENBt004582 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Wed, 18 Oct 2017 19:14:24 +0200 Subject: Re: [PATCH 0/4 v5] Isar apt deployment From: Alexander Smirnov To: Henning Schild Cc: isar-users@googlegroups.com References: <20171005100807.3369-1-asmirnov@ilbers.de> <20171009140006.219154c8@md1em3qc> <20171018154404.25953ccd@md1em3qc> Message-ID: <3b0e57a9-b5e2-5fe7-77ae-fd14773bc845@ilbers.de> Date: Wed, 18 Oct 2017 20:14:18 +0300 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.2.1 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/mixed; boundary="------------9E2E38FBA51A481154C7659B" Content-Language: en-US X-TUID: fXkHVw3QAj4D This is a multi-part message in MIME format. --------------9E2E38FBA51A481154C7659B Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit On 10/18/2017 08:10 PM, Alexander Smirnov wrote: > On 10/18/2017 04:44 PM, Henning Schild wrote: >> On Wed, 18 Oct 2017 14:06:53 +0300 >> Alexander Smirnov wrote: >> >>> Hi, >>> >>>> i just tried it and the task do_cache_config was not executed before >>>> the first do_populate. >>> >>> Could you please specify more details: >>> >>> - Build command >> >> Well i am using layering, and so is Claudius. So the command wont help >> you much. It should basically boil down to >> >> bitbake multiconfig:qemuamd64-stretch:isar-image-base >> >>> - Commit ID >> >> f33e48bd07039032e3 >> >> I am guessing you can not reproduce the issue, we should find out why. >> But since Claudius confirmend that he can not use these patches either, >> and there are still some open points, i think you should remove those >> patches from next. >> > > At first, as I understand you use private layering. So if something > doesn't work in your custom environment, without details and analysis > it's not the case to reset 'next' branch. > > Before perform any merge, apart from my local builds, the reference > build on CI machine is also passed. So the upstream Isar does support > the claimed features. > > If I'm not able to reproduce your issue and there is no information > about problem, then I'm not able to fix it. So if you need assistance in > resolving the issue, please provide more details. If the problem will be > found, the fix should be sent. Please try the patch attached. > > Regarding new open points appeared after v5, they contain several > proposals what to try, but they doesn't influence on apt feature. > > I'll try the things you proposed with multiconfig and if they work, I'll > send updates for current apt implementation. But working feature in > upstream should not be blocked. > > Alex > >> Henning >> >>> Alex >>> >>>> >>>> I would suggest the following changes: >>>> - create one task in dpkg-base.bbclass that does the following >>>> - config and init reprepro if no other recipe did that before >>>> - add package >>>> - use bitkages task[lockfiles] to deal with races between recipes, >>>> put distro into lockfile-name so we have one lock per distro >>>> - drop do_populate >>>> - call the new task instead of, or in do_deploy_deb >>>> >>>> Henning >>>> >>>> Am Thu, 5 Oct 2017 13:08:03 +0300 >>>> schrieb Alexander Smirnov : >>>>> Hi all, >>>>> >>>>> this series switch Isar internal binary package processing to apt >>>>> repository. It performs this following: >>>>> >>>>> 1. Create repositories 'tmp/deploy/apt' for all architectures >>>>> requested by multiconfig. >>>>> >>>>> 2. Generate reprepro database. >>>>> >>>>> 3. Put all the newly built packages to apt repository. >>>>> >>>>> 4. Pass this Isar repository to image multistrap. >>>>> >>>>> Documentation will be updated after agreement on this >>>>> implementation. >>>>> >>>>> Changes since v4: >>>>> - Drop meta-isar-bin layer. >>>>> >>>>> With best regards, >>>>> Alex >>>>> >>>>> Alexander Smirnov (4): >>>>> apt: Generate configs for apt >>>>> apt: Generate Isar reprepro database >>>>> apt: Populate Isar apt >>>>> apt: Install packages via multistrap >>>>> >>>>> meta-isar/conf/layer.conf | 13 ++++- >>>>> meta-isar/conf/local.conf.sample | 4 ++ >>>>> .../recipes-core/images/files/distributions.in | 3 + >>>>> .../recipes-core/images/files/multistrap.conf.in | 9 ++- >>>>> meta-isar/recipes-core/images/isar-image-base.bb | 6 +- >>>>> meta/classes/ext4-img.bbclass | 2 +- >>>>> meta/classes/image.bbclass | 65 >>>>> +++++++++++++++++++--- 7 files changed, 88 insertions(+), 14 >>>>> deletions(-) create mode 100644 >>>>> meta-isar/recipes-core/images/files/distributions.in >>> >> > -- With best regards, Alexander Smirnov ilbers GmbH Baierbrunner Str. 28c D-81379 Munich +49 (89) 122 67 24-0 http://ilbers.de/ Commercial register Munich, HRB 214197 General manager: Baurzhan Ismagulov --------------9E2E38FBA51A481154C7659B Content-Type: text/x-patch; name="apt_fix.patch" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="apt_fix.patch" diff --git a/meta/classes/image.bbclass b/meta/classes/image.bbclass index 2284655..42386a6 100644 --- a/meta/classes/image.bbclass +++ b/meta/classes/image.bbclass @@ -54,7 +54,7 @@ do_cache_config() { fi } -addtask cache_config before do_fetch +addtask cache_config before do_populate do_populate[stamp-extra-info] = "${DISTRO}-${MACHINE}" --------------9E2E38FBA51A481154C7659B--