From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7156173593333727232 X-Received: by 2002:a2e:320e:0:b0:275:ad41:1e47 with SMTP id y14-20020a2e320e000000b00275ad411e47mr1216032ljy.211.1666339354489; Fri, 21 Oct 2022 01:02:34 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a2e:a4ba:0:b0:26e:3a10:642d with SMTP id g26-20020a2ea4ba000000b0026e3a10642dls390393ljm.9.-pod-prod-gmail; Fri, 21 Oct 2022 01:02:32 -0700 (PDT) X-Google-Smtp-Source: AMsMyM7HA3pj6LvQ5ul3g+H2myhQXks+yRMKnRxi7K/K7DKo/pGOs/48T86NCEqjBFrOxuweOoY4 X-Received: by 2002:a05:651c:12c1:b0:26f:dca6:6a6b with SMTP id 1-20020a05651c12c100b0026fdca66a6bmr6854219lje.230.1666339352799; Fri, 21 Oct 2022 01:02:32 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1666339352; cv=pass; d=google.com; s=arc-20160816; b=FFsIjaY0d3Bcf8LADjxqjEQ3ghu3EHKPcxzumyQ42gZXnpSBWZpYBURb63kNsj297U bu/lBI1E9NkAwXH511mPkivFItkmLb5TrETpKL22jCKbUVHNX+Trqcj8lXKzSIwECmRf ilhdWtBg+tjpbqskHKJmwOLy/DAOogsYxhBfs6lXzv+VKcohYK0lMBHHJeG1uD0v+Nz6 BbeguLuvcQyJ+WgPkCbcbdjyYn0X3u8xZIUCUng9U3aMPyhbyNhrxbWPHqMWJh77fyVj hmFhRbW3a222YPk4joYCk738wSmAa3XjvgdH9xrEV2ZZZ0mrpykyvVw3WW9LIIGn0LZA BsuQ== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:content-transfer-encoding:in-reply-to:from:references :to:content-language:subject:user-agent:date:message-id :dkim-signature; bh=7qZJmFm+CFGoUJ/XL7Wvv+aXhlOqQpWzRmmVAoM/lrU=; b=SSt9z4iUSy1ri1mvOfNYwEJM+GZpScV03nHl7+dlXOXKjDzbNhGL5TpRWrpxv8cbhc DvU/ksBI7v7dCUJOB0xGszIp5U97JghcBxgmBVLHV4lL4kpc66VtPuzjMxpfPx7Y0Qv7 dBQSq9x/WMFuH7NnF1vmOydbZieH2EnYHN5QDtjkA4tCnctYesOdehwMT8euZVz/N0UK 9syGtrGSdfdCZu9uiqW0QYO41XyXj+wjpVDy35LDNIdokIcJ7UUPYoN6zI3b75Nfk+qS s6zURxHVOQEiMmVXVuzTMrPMlnQ7EbdutRUx7tZ5pwJBnEtroQbMhATH/910GwG/wE6D b0Sw== ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=c3ZmHFfR; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of raphael.lisicki@siemens.com designates 40.107.14.71 as permitted sender) smtp.mailfrom=raphael.lisicki@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Return-Path: Received: from EUR01-VE1-obe.outbound.protection.outlook.com (mail-eopbgr140071.outbound.protection.outlook.com. [40.107.14.71]) by gmr-mx.google.com with ESMTPS id o4-20020ac25e24000000b0049ade2c22e5si745661lfg.9.2022.10.21.01.02.32 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Fri, 21 Oct 2022 01:02:32 -0700 (PDT) Received-SPF: pass (google.com: domain of raphael.lisicki@siemens.com designates 40.107.14.71 as permitted sender) client-ip=40.107.14.71; Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=c3ZmHFfR; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of raphael.lisicki@siemens.com designates 40.107.14.71 as permitted sender) smtp.mailfrom=raphael.lisicki@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=HuS2p7D/10mUsL0YiVZ1K8PSi898PEoqEfFL6DZTBGEkbGM3pneRnFjxqxQVDN89OAed2yQrMVKucJgoGTqA13c0/cU/62ZaBtoXzKApPHyHbyCRbXz0OvRPDR/CSjNL85vJD4z5ysPjK9wa+/MjgTfduDif6I+TdskbDjHoRJnUs8aylvpYSoH8uJ2/nuEfGRQaZIV1ghmcsm9ebV5rJYLXyLTegyti5VF/++kOkL37RhD0rIsP2U0bNQPEfE8tdDv9q2ycSqjhKC7xtreeKOOzJpvQIP5iP7GPCaWU7gisrDZX5S5zxsMdeAePDeb4fvo+dvfth3g6QHW7hDl8Zg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=7qZJmFm+CFGoUJ/XL7Wvv+aXhlOqQpWzRmmVAoM/lrU=; b=H7Ui57ETdJ1ijg8gCnqWfg5vU5BnZI8fRA/K0C2aVU3Z30eKaeUvnwP3VHBLAuSyUrfSyItpmzmQUrpgcoYz/m8nR7Y6RaGqN/3aMII5rTTHGNMcJy3vRyf+VOhr4pfb+nlIRCHk17jzRun8IjMoGEXNcYz+MbC7Ge/l1Aa25c7faHTqsmBjZzqrmcoGxMZdw8l99jJa8vo/pTjUuDq9optYtEZgyQCyP5qrXZR8ZgbXz+Qx0UA3sb0dZ5tBoW75XB7PZZj6CtolVCiDOL4lHaJgPHyjk6vCny2t2CEfnurYfFVMmuYxQln2XUYVviJNvfcbS/Fy9vMaGbVZcbgtKA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=siemens.com; dmarc=pass action=none header.from=siemens.com; dkim=pass header.d=siemens.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=siemens.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=7qZJmFm+CFGoUJ/XL7Wvv+aXhlOqQpWzRmmVAoM/lrU=; b=c3ZmHFfRnWzS8IplDgLabnKHM7NUrS8gT3YBjg6iRwQmUFM+r8hDYU5Q56pZUfHh7Q8vPmmjMSr6A/YEEVr1ACiZlxYL1eJ+rstQUJiz4wwEAoEdnAxOXO1eQXj9NJGxrg+C+Np16m/u4aeZ/7a1PV0PByDxAE49UHTK0pp9NQGh3/t6/ZOEnYw9t+BPuTGBoGlegC8V6GSJ4rNPboOhJLuQv6cN2UvyQ88dssAT8PRd1Q6Li94XAoafCsnSB/qWKKmZJTDfzsVFUj7wJq6V0epoPMfCODjboGVFJaUPfAJXG1V0goWXU2X3Xd9gc1U/1YBmASX9K0DsMdKf8SZ31w== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=siemens.com; Received: from AS2PR10MB6685.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:55c::6) by DU0PR10MB7407.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:10:444::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5746.21; Fri, 21 Oct 2022 08:02:30 +0000 Received: from AS2PR10MB6685.EURPRD10.PROD.OUTLOOK.COM ([fe80::91b8:e5ba:a609:78e9]) by AS2PR10MB6685.EURPRD10.PROD.OUTLOOK.COM ([fe80::91b8:e5ba:a609:78e9%9]) with mapi id 15.20.5723.033; Fri, 21 Oct 2022 08:02:30 +0000 Message-ID: Date: Fri, 21 Oct 2022 10:02:28 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.2.2 Subject: Re: [RFC PATCH] Remove isar-apt and the corresponding lock Content-Language: de-DE, en-US To: Adriaan Schmidt , isar-users@googlegroups.com References: <20221019104745.479166-1-adriaan.schmidt@siemens.com> From: Raphael Lisicki In-Reply-To: <20221019104745.479166-1-adriaan.schmidt@siemens.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-ClientProxiedBy: BE0P281CA0005.DEUP281.PROD.OUTLOOK.COM (2603:10a6:b10:a::15) To AS2PR10MB6685.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:55c::6) Return-Path: raphael.lisicki@siemens.com MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: AS2PR10MB6685:EE_|DU0PR10MB7407:EE_ X-MS-Office365-Filtering-Correlation-Id: ce3e37ea-75ca-4d27-70d8-08dab33a9a5d X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: bRiciXMZv+hjCeiFtEJVrddUVEvI/LZjQdb1ndLQLG7pZH0OULaa0Hh0X1ilL7Oi8Q40OvHFM3O8nRsJ+FwNhlbiKJ1tj3j15PHEkhb2vOA8p2Xy6PA4C3YxznmyJ3EQXpgSokAzZRV0dm/Iiei1us5/yu8FMIPii2ulrk3VlKlGxHjedDaJSM96pbk4kzskTau44F67rqLP3NCnNOzg7bH+lpmAEFLmxF9Cb/egtvbOorbznvmHc1pVEWbBu2yo32EWxU/awkWK56yHjG5oJaK/TEZTroO3gC+pshBLr8QJq2mS7hDCZ3OrgnCQRStxJdMxPHwhK0EYHzz/uBq6SPQ2mFSMX052A5OOqshFo4DMgIW/wCLtXoWcOrSN7eHg0KqFJm3QV+0h9ABxL3Ewb9BDfRwuuJLF3R/L72C5WeCxOfp7rmdmNMRBVWAFunnTH+z4hbf+S0+F6Ip6uvHwaxQ+mnpuarWuHxLKLPyqhhRHX0A2ehRF2z0DuSe1ZJxZU5dFVEObFBvxbmixlsUyYuH2mrU5rSIVS0XK9Nc3mk6uOVY+OJeSzqTTsz3tyTJKyFLGEyNy4T2e/+rJ4jJkySaFCC6j9e4Em0FVMredgcBPzNHXRFfRpgB85tRM4F3EAxzuQ+aWmHn5J57AkfTQ3egAdp4lrOt89MCk0T3wkL6sQLLPEzNokOmhaJLxtClLbMhLhJw9SV6wgUxdfoFMlF9bJRw9706lxYPGpmTWHkd133D/3i4T48VbGIHNpAIghs41NY0CcIC6DHFCLBmZht2bBPX2S1mEAUenaMhk4aU= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:AS2PR10MB6685.EURPRD10.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230022)(4636009)(39860400002)(136003)(366004)(396003)(376002)(346002)(451199015)(6486002)(86362001)(66556008)(316002)(31696002)(31686004)(8676002)(66476007)(66946007)(186003)(26005)(6512007)(36756003)(2906002)(82960400001)(83380400001)(6506007)(2616005)(38100700002)(44832011)(41300700001)(478600001)(5660300002)(8936002)(53546011)(43740500002)(45980500001);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?THVxOUV6UENkV05lZWFoVm1aVFhSRlNxY0FQbElzblFYYTZRcnR5eTQ1Uk5t?= =?utf-8?B?RVJ4Y0FrUEFRVXhqV1c3WnBmMllVY3czV3lnWVVjb01ud0EyWVZnb3Nxd3Yr?= =?utf-8?B?cTVlamgweitBWG4yZThTaFlUTk5LOTRXQU5LaDd3V0VlTFFLa2NSUWt4SXpU?= =?utf-8?B?eWFOeUR1TXRsTTNva0RHMWFwLzh1SkxBMHVMQVcwNnlXTHllR0dxTXBUQmE3?= =?utf-8?B?cHZudS9nVXEvVGtralYxSHUwdXlvMEJWV0tjdGpVN1RpazV4Y2w5aEVPZ0s5?= =?utf-8?B?SksxUS9xV0NRSnVMWDcra1VhUHBhOGhjczJIREcwWDRRcHpqc0g4UE9FOGpM?= =?utf-8?B?RXlUaEpFVE5SUnJNTnZnazdHeHdsenY5L01GelpiamdNUXpqbithaEVwUXhm?= =?utf-8?B?OXAxTmpoVFdvZGV0bkFvNmFXWGlmMGVoM0F0Q2pMeVdyb1o0SjJWNXlUNUlh?= =?utf-8?B?K3g3ZWR3RHdldStQTVJkTFJuSVpGSW9WYitzQnk1Qk5odmlPL2djRXRZT3BK?= =?utf-8?B?RFpWa0Y0VnRSaXVTaUxnbmhsTVJ5Zm5NZ2dNMk90VVVRUEJJM0puUmxjdjR5?= =?utf-8?B?R3diWVFWUjY4TUVoVEVsd01EYTVxOE9JZUpDci9TM1RTMzlVRmtLOEZ4VVNp?= =?utf-8?B?N2c3SXRJT0xuM0I4b0dEMWlkWWQ3RjdEaEtCVXJoTFlMYWhCY01sZm5DSmwx?= =?utf-8?B?WWVmbWgzenJDVjlhLzJiV01MbkpqZFp1TCtHZlUxOGppRkZHS1VsNmhxUDlZ?= =?utf-8?B?VnRhQmRVSllTL1RHemZxRUFqaGxPbmhBUW5mNjlkRWRMdzVLeDAxZDIxYkcv?= =?utf-8?B?cUVkMFp1OStqaVdHUC9ZaVU0ZnF6TGkvL1lla3lidTErS1ZzTFByM1RVcG03?= =?utf-8?B?M2JlM1Y5NkRJcmdiQkkxTXFwc29nZDcyTnEyOUFRRHhlZlZwL1FwZnB1WWI3?= =?utf-8?B?QmtIUjk4Q2NIZndZc3RDb0JLbFd1NmVFR2YxdEVtbG9jZUdhOEwzV0Y2OE9Q?= =?utf-8?B?emFXOVdIaVV6Y04xUGsweGMwdWVuMnlTajNWQTVreXZxNHJRUFg0VTVsa2lE?= =?utf-8?B?RE9ZSzRxZ2lFTFVMR3R2YWhzK3QydEFkMG81MTMzWG1Zd2g1OEtXWVVmWDRT?= =?utf-8?B?aHZjekxJVGJmWDhQQzQ2TU5wRWUrcE83bWtUZklycVNLRWx5MFg0U2dHZTV6?= =?utf-8?B?STN1Y3RQNzJpaWo4N0ozUU9PZkVxL0wwSVRUc1JvSkdvcEdGQ1N3V25JUm95?= =?utf-8?B?K1ZTUlFudEdMcWhEL2RheS9UQzFmWnVORUpQcytybG8wdTdUUExZdzBxZ3lO?= =?utf-8?B?MUhEbFJRSEEybzgyNDNuRmplczY4SGJEcUN4bWtQNUpHMitDK0VNK2hzeER0?= =?utf-8?B?Q1J5Q2hvSHZHVTMxYWNPMCtYZVgyYkhWYmYzUk5CamphYVRiYjgvTW5pRkx1?= =?utf-8?B?ZkdGaHExVmFYNkhoRmlhUWZGaFp5VUExaWdCSGFWMVY5eGROdkZQTXJVRWo3?= =?utf-8?B?NVp4clZUQ2VwNUd3YjBXY1dPOHdjNzlxZ0dsSDVLMFpJdFA4SVhkZ0E4M1Er?= =?utf-8?B?a1BUcUFyOXpaNzZMcWlhWUI1WXdlNWdRZXRqS3RacHVjTmJidytZMlVDR0kr?= =?utf-8?B?d2NqSWdCQ0dpQUxXY3dvS3FKOTBwTk4vSEFSOHhrc0IwNkEyRDZoZzV5RlBr?= =?utf-8?B?UG13SUdTWW5vTkdYRGprTUhPVWFMS0hLQ3dhTGNoNG0zeXRmemVlMzVVZHB3?= =?utf-8?B?a1Y0N3dCeXZoOVhFQnpFaVNxQnpBOC9DbTNWbWRLdmswYkg2VHVURzM4Y3ZQ?= =?utf-8?B?cHZ6Y055YXlZRlJnSS9KUE5VQVpSWmk2UGZkdkN6c25XZ05EbkxRemhjc29K?= =?utf-8?B?eHNscW9pL1UrU3dOZHc1WUsyYUNCZlNxNW9sWHE0UFMxRFUvSTZCQWpnaTF1?= =?utf-8?B?amREUjY5aVpUMnJIb1pTTXBQQUxuOGN1Z1VVNGtaeGdRRG1iazQyU2dmcDB0?= =?utf-8?B?Ymtvd1F0QVVTVTZVRU94N3pUdmRlNVhDU2kyUnMzWGNoNVRReEJ0bU9rN01K?= =?utf-8?B?amxXZnNqcVVDcDRWbWhzSlBQMXJjUVZUMEpqLy9RdlA3MVJjRFg3bkpwTWFW?= =?utf-8?B?RGhXMXdQSUVTaGk3elhWSEVHbjJWS3E1WkxaeC9ST3RsRWxsclFCa2xoRCtU?= =?utf-8?B?M0E9PQ==?= X-OriginatorOrg: siemens.com X-MS-Exchange-CrossTenant-Network-Message-Id: ce3e37ea-75ca-4d27-70d8-08dab33a9a5d X-MS-Exchange-CrossTenant-AuthSource: AS2PR10MB6685.EURPRD10.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 Oct 2022 08:02:30.6573 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 38ae3bcd-9579-4fd4-adda-b42e1495d55a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: ageUxLLZk80OBsFeM1eRGnToTPijMycSFbXs/vj5OsPy/dfuCgDHYn4I6h3T+9z296bbcv/zqKDBRuvRNQXcetZazPAQEMXNbty3uWKCvdA= X-MS-Exchange-Transport-CrossTenantHeadersStamped: DU0PR10MB7407 X-TUID: g57amm43iAP7 On 19.10.22 12:47, Adriaan Schmidt wrote: > Hi all, > > the isar-apt file lock has been bothering me for a while now, mainly because > it leads to situations where we see many bitbake tasks running in parallel, > but unable to make any progress (deploy_deb, install_builddeps, ...). > > I ran a quick experiment on what would be required to change that, and > came up with this approach: > - isar-apt/ is no longer a repository maintained with reprepro > - each recipe has "its own" directory below isar-apt/ > - there are directories isar-apt/${PN}/in and isar-apt/${PN}/out > - out/ contains the deb packages produced, put there by deploy_deb > - in/ is populated by prepare_build and contains the contents of in/ and out/ > of all DEPENDS (need all the in/ contents due to transitive dependencies) > - then, again in prepare_build, we copy our in/ directory to WORKDIR, and > create an apt repository (actually just a "Packages" file) using dpkg-scanpackages. > > In addition to removing the lock, this also gives us better control > over what goes into a package build, and eliminates effects due to "accidental" > packages in isar-apt. This sounds like a great side-effect. Love it. > > I've implemented a very rough PoC, just to give you an idea. Please don't > look too closely at the code, there are many things missing (e.g. SDKs, > architectures != amd64, ...). But it can build isar-image-base for amd64. > > If we decide that this would be a worthwile change, I will spend some > more time on it. > > Best, > Adriaan best regards raphael