From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7036005094436896768 X-Received: by 2002:a1c:3b04:: with SMTP id i4mr30395wma.126.1638290730750; Tue, 30 Nov 2021 08:45:30 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:adf:f1c2:: with SMTP id z2ls305162wro.2.gmail; Tue, 30 Nov 2021 08:45:29 -0800 (PST) X-Google-Smtp-Source: ABdhPJwtwZ4etWU8nMIr8p2FeWUUENN4ZNvebaE2RGBNzUZR/AjsfDOxGj2rbvsra1giy/tjFi1E X-Received: by 2002:a5d:40cf:: with SMTP id b15mr39229wrq.161.1638290729753; Tue, 30 Nov 2021 08:45:29 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1638290729; cv=none; d=google.com; s=arc-20160816; b=AUnjr2Qe2iF3w246MUeJrP8i8v8EGtd3tf+U0t6yNo/5D4W5yGcPmQmOOiklZG3pXd hFfjZFWZ2JOTGmjuxy7nmD58YeCjW8pAJM3+SgCsvkL5V/f12nKsQayiU3SG2W9GSg/j 0RHy7wwIZz3EELyOnt6FywvLEdrgKFAiLXkQ5+1urVRYsOiLzcBNkhzvAoTvMu8dCvTI R8lT0wjjKPMWSFYrLfbMbVEd1q32ddTuDd85q5HJG3e+TSA97NOdamvW3XTxg821s63y kBrpu3NertA4ORI/2v0Wc9PfnRIWDOgvCBpcYMwg/n97hlY9XRoK2CuqpepzohqKOBx2 gYzw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:content-language:in-reply-to:mime-version :user-agent:date:message-id:from:references:to:subject; bh=c0MBJdiOBg/s1z6dfW9aphkpLkcOH7uaKWhDQ28owVI=; b=fKWtnGaL1WSJg2S+K58xEuUBuRQ2sIAg8O0uTdq8boL5yrkzR8iPvbKHVRqotI1Qie 0ZdMWZUKIvtFDTgSca1LRG4rD0rVLVdlgGo30VFNJtKiiCiQx8m8vn224OO4IG5V+WGT rNBX0SiolBYqSR8dcgcCqimyWUlqp1xiHtHIdqKuh4Jx4sv2185kjofoXqvLQUXcqgkU aXLOkV3vb1MN8LpAYHgbc1qc1NClDWt7rmOCSqWnB99EFytayooI6tkoXeA8U0urgphy qOX/0lyiKOmkECjSypLvp7Q4vpLafP+7QXN3U2NCRJNlMh7rkaeEy9qo6fQm8Y0qzt0p uEyQ== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of jan.kiszka@siemens.com designates 192.35.17.14 as permitted sender) smtp.mailfrom=jan.kiszka@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Return-Path: Received: from david.siemens.de (david.siemens.de. [192.35.17.14]) by gmr-mx.google.com with ESMTPS id o29si582481wms.1.2021.11.30.08.45.29 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 30 Nov 2021 08:45:29 -0800 (PST) Received-SPF: pass (google.com: domain of jan.kiszka@siemens.com designates 192.35.17.14 as permitted sender) client-ip=192.35.17.14; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of jan.kiszka@siemens.com designates 192.35.17.14 as permitted sender) smtp.mailfrom=jan.kiszka@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Received: from mail2.sbs.de (mail2.sbs.de [192.129.41.66]) by david.siemens.de (8.15.2/8.15.2) with ESMTPS id 1AUGjTaL004413 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Tue, 30 Nov 2021 17:45:29 +0100 Received: from [167.87.33.163] ([167.87.33.163]) by mail2.sbs.de (8.15.2/8.15.2) with ESMTP id 1AUGjSkh030386; Tue, 30 Nov 2021 17:45:28 +0100 Subject: Re: [RFC PATCH 0/2] Buildchroot non-determinism To: Vijai Kumar K , isar-users@googlegroups.com, henning.schild@siemens.com References: <20211129145241.2932943-1-Vijaikumar_Kanagarajan@mentor.com> From: Jan Kiszka Message-ID: <4fe6a4e7-22fa-275a-ce92-9f62e62c4c30@siemens.com> Date: Tue, 30 Nov 2021 17:45:28 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 MIME-Version: 1.0 In-Reply-To: <20211129145241.2932943-1-Vijaikumar_Kanagarajan@mentor.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-TUID: QaldWnJImB6F On 29.11.21 15:52, Vijai Kumar K wrote: > Hello All, > > Sometimes buildchroot-host completes long before isar-bootstrap-target > and proceeds with building packages and populates it in isar-apt. > > By the time buildchroot-target is triggered, some packages are available > via isar-apt and as per the default preference[1], is installed instead > of the one from other mirrors. > > This is not always the case, sometimes there is no such race and the > packages from DISTRO_APT_SOURCES mirrors are installed. > > This makes buildchroot non-deterministic and affects caching. Just to make the scenario even clearer: This is about packages needed for the buildchroot-target which happen to be rebuilt by the buildchroot-host (the other way around is not possible), practically essential packages that - for whatever reason - requires a rebuild. > > One solution is to provide a mechanism to set preferences for > buildchroot. This way, the user would have flexibility to control the > mirrors from which certain packages are installed. > > This RFC introduces 2 new variables > 1. BUILDCHROOT_HOST_APT_PREFERENCES > 2. BUILDCHROOT_TARGET_APT_PREFERENCES > to set the preferences for buildchroot-host/target respectively. What is the difference to HOST_DISTRO_APT_PREFERENCES vs. DISTRO_APT_PREFERENCES? That must be made clear I think. Jan > > Ofcourse, there might be more ways to solve this problem. Happy to > discuss them here. > > Thanks, > Vijai Kumar K > > [1]: https://github.com/ilbers/isar/blob/919fc995fc8ecb675f8bf639ee8628f90728b1ea/meta/classes/rootfs.bbclass#L90 > > Vijai Kumar K (2): > meta: Move aggregate_files to base class > buildchroot: Add provision to specify apt preferences > > meta/classes/base.bbclass | 10 +++++++ > .../isar-bootstrap/isar-bootstrap.inc | 10 ------- > .../buildchroot/buildchroot.inc | 30 +++++++++++++++++++ > 3 files changed, 40 insertions(+), 10 deletions(-) > -- Siemens AG, T RDA IOT Corporate Competence Center Embedded Linux