From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Wed, 24 Jul 2024 14:38:47 +0200 X-Sieve: CMU Sieve 2.4 Received: from mail-pl1-f192.google.com (mail-pl1-f192.google.com [209.85.214.192]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 46OCciC0032387 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Wed, 24 Jul 2024 14:38:46 +0200 Received: by mail-pl1-f192.google.com with SMTP id d9443c01a7336-1fc5e61f0bbsf21108955ad.1 for ; Wed, 24 Jul 2024 05:38:45 -0700 (PDT) ARC-Seal: i=3; a=rsa-sha256; t=1721824719; cv=pass; d=google.com; s=arc-20160816; b=F9UMFdv5cnH2x1TclBW5LAk41aAISY3z+6TrLdE3pxhBoPCiAC+9wAxuE2AMEmPFSA 0ex+8kaM1hz1cnKsxd4VPYC7lasoPh2Byg7v69wxYlx1lUQpDGJQHg8faga9zhAdhQXR QpU34ZUDmxT3bjZ35VQa1+GmV8bFrl9qjWDOWEMx0KNQ5bNRNIcdBKbAl/tDMMibMAC0 WgpPpA64TG/4Sbla9EXkymPiG1WliwK0QrJz+DBdHtI7Ge5d7Yrx/T7j6Qe8jgQ61u3T yCeUz/PqjG2sn1RlJzL0n4M4YtPrOEj5YSyLkeH8WOtOKYgcwLG1Y+20WF2syXFVeAZA leuQ== ARC-Message-Signature: i=3; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to:mime-version :content-transfer-encoding:content-id:user-agent:content-language :accept-language:in-reply-to:references:message-id:date:thread-index :thread-topic:subject:cc:to:from:dkim-signature; bh=uPO24IwjEnscBdouLvf63YloYS1gAvurW8NOKLnjFU4=; fh=4aFoN5l03ugSsEEQJ78fqJQxPZVXrxAsCiH1L9wE4l8=; b=vy+Ikm24dg4yeB27OKRov+pwMMXPsOm1sfNGQTqGu5KCx7J45a/Zqatbv9gwVyJ6Wf QQQ53VWywF6xAhF3BSmP4LPIFNV3MGwpF9x2T177Fae+uQ2D9FRbrQocuPHYTFillotw LC2bbmm+vcsKtL0jcX8VMy9+s6rbcAz0UuS5oOybxLY43H3sCqb1Y6k5z2NXVN+5MS2G PB3of0JbkbwAnu/IAFue3bCUqsh/0IX5nb9MMBRmScOLpOxDDActuXkB2m9f2jmnK5+C vSG435yw2NzOwjuICWub2WfnhOMjsV1H/Av9Gouql8yLGPbKPZvF7L4L3Zne/gDF10l2 VTcQ==; darn=isar-build.org ARC-Authentication-Results: i=3; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=HN8lYHyJ; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of felix.moessbauer@siemens.com designates 2a01:111:f403:2613::601 as permitted sender) smtp.mailfrom=felix.moessbauer@siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1721824719; x=1722429519; darn=isar-build.org; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:mime-version :content-transfer-encoding:content-id:user-agent:content-language :accept-language:in-reply-to:references:message-id:date:thread-index :thread-topic:subject:cc:to:from:from:to:cc:subject:date:message-id :reply-to; bh=uPO24IwjEnscBdouLvf63YloYS1gAvurW8NOKLnjFU4=; b=P4aQGL8bm3vpkHPqWg6MjaSfddx+he1n5W6Bq+W/uEm0k7zdCc38RVpiyJsMGoyTtk 16kdTFuznJLzpmcEaJmeBe6bEN1Q/A4jH8wAbiLYWK4VccREMaRIWLaD7WAjolZWNn65 3U/fX6FE3hK1j96I5F9IV2GR8LWYmJhiuH4BSMgqqxZz/t/oH+PEW5IS9ElDOPu6UGk6 f1jd3blBV70qLaLoKSCI+tSxa+stPBz5OEY5aVIZfy68cEmax+Nrhr1KyHeM3Ea1Fcq2 QwOwzwssPZWSMwcqQ2UQWXcN/SmDVczCVj82nQWWqZW01aOODGhUFmQPRiFiUirbXZjJ BrpQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1721824719; x=1722429519; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:mime-version :content-transfer-encoding:content-id:user-agent:content-language :accept-language:in-reply-to:references:message-id:date:thread-index :thread-topic:subject:cc:to:from:x-beenthere:x-gm-message-state:from :to:cc:subject:date:message-id:reply-to; bh=uPO24IwjEnscBdouLvf63YloYS1gAvurW8NOKLnjFU4=; b=JVLStVqpTG2sS7BPU7Auv/CsJDNFRrhj/2acPlVQNxPJOXhDSL8/bmAxNXg7+r7Mrg sNEWfXnAjxKFNrEkW2IYizUDBLmzzLKKX8ebtaLREBRJbNWk5ZcOw4b2+T9acZ7Q1bLR bvsdxgeprBjWTKA9sAvwZicJWAHcgNcfSdyUdsX4JZLYx80J7grlw97m2Kc8WsMNIeF2 U6q6V1upgUkKdccskyUDCsqJX9DkKVvHrGGP4qMWVIlMLrWGGMWMuZJSqYzzTdLIJK80 +VvEfA1jd8tnTOGECappFNywebilM6sm3shtvs1uK1Yk4tv52Jw3ttu3EWFmHDBVAE/n BOYQ== X-Forwarded-Encrypted: i=3; AJvYcCU9QEmpY/pwnqRO5LkdW9D+uh4raCcew9QSciXCptgRvZOJ0kFeIm5mdGk1RyQYbkMLaZ28L5DJ1ka2OZp8KdbYLZg= X-Gm-Message-State: AOJu0Yxevk8eVw0jyFEPDuIdKWpbn6cKIjxo3OzMCZSgwQeNgJnFx79U kdpZPDn4DiqF9diMYYvzFIVGfbILJCAQlTeIhOR4QHLi89OxH4Xn X-Google-Smtp-Source: AGHT+IGYWPKDxHEjRjfwgfRg4qL1Kw4dDcH6bt4s2XE0JA5RTZFpSNnbVQWSWYLY9RxgE4ow4gCbNQ== X-Received: by 2002:a17:902:e551:b0:1f9:b681:194b with SMTP id d9443c01a7336-1fdd5512099mr22453915ad.22.1721824718927; Wed, 24 Jul 2024 05:38:38 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a17:902:e850:b0:1f7:2780:7276 with SMTP id d9443c01a7336-1fc5b3d69bdls38923605ad.1.-pod-prod-02-us; Wed, 24 Jul 2024 05:38:37 -0700 (PDT) X-Forwarded-Encrypted: i=3; AJvYcCXs9S9gVYn6GMJ+Xc+5g19SPd7ZgQv+crr0FuR2AfyR88mEQtFRh1Y+oEGG2vUPcSoIhskr16HqaJcYciZVmPDVt6d1LcXoLAH4/1I= X-Received: by 2002:a17:903:248:b0:1fd:d807:b29e with SMTP id d9443c01a7336-1fdd807b62amr15165335ad.35.1721824717545; Wed, 24 Jul 2024 05:38:37 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1721824717; cv=pass; d=google.com; s=arc-20160816; b=hqBzhXkoZt+BUMFHkcFrT+qIIktmlxENmmMx0HbFrPnRf6zRFMJWQ1xP6p/uxS6ONY grUkBuWNCf4Z6YEnwsioOUURMRK8xonJSeAp6PAlldMamwa96lAc6JM2pQfN+9NSefue +nt5fm0ljUVVnIa1hbKqVBOrBUtmqaqwx0P/yfQ4avdJlRrYT03Eb3gQe7Z8BefGGwOD inG4ofEyvD47tZvFF4FP8Ek9EEv8t+jZBOWt7q1YXT7DMVUmNQccLM6FLrWO6GbHR5Nz zEiCecuOauyAe0SCM6ZfLY0h+GNfquXXDk6X/tU3COFb3AfAv1F8raBrIKOKPu01os/N 8rSQ== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:content-transfer-encoding:content-id:user-agent :content-language:accept-language:in-reply-to:references:message-id :date:thread-index:thread-topic:subject:cc:to:from:dkim-signature; bh=VBibD7YiMm8zIEOgONWkq1jMq5fegiFvB9c8P9jDus0=; fh=KvsduEFY/GuDUSq8wAv7uczWTgenPdEO1kD1FRklb/U=; b=pxgwzIwheVfNc1B8cIb99LA5+q29UCP98Z+q77s1dHcL6uJSpFZi1VnXPVgmKq2izy F9BhcIXfOywo+JYpRDAyWAw7nutY4DTYi5G/6wS+MMbm9HmiN58poD7uivaxVa6eKF+c UZTJaRLDQu8EtJBvn37bzagfHELkHG3exowmo9M8PcMpIwRqOtct2l6zsRblDTCCMORu R+HTas9DoXPK5rddDhnC1q2xxEy637hwGhJ3nCQwS3NmuRkXjyD6FdpYyzAkDZ9qLZU+ xVH453MfVlYLYuECS/7hF5E2FxV2ZKX5Uj9/jedTUeT2skGL724q4u4Ihn8OI9o2+/cf eh2g==; dara=google.com ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=HN8lYHyJ; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of felix.moessbauer@siemens.com designates 2a01:111:f403:2613::601 as permitted sender) smtp.mailfrom=felix.moessbauer@siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com Received: from EUR05-VI1-obe.outbound.protection.outlook.com (mail-vi1eur05on20601.outbound.protection.outlook.com. [2a01:111:f403:2613::601]) by gmr-mx.google.com with ESMTPS id d9443c01a7336-1fd6f3199c2si4320215ad.10.2024.07.24.05.38.37 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 24 Jul 2024 05:38:37 -0700 (PDT) Received-SPF: pass (google.com: domain of felix.moessbauer@siemens.com designates 2a01:111:f403:2613::601 as permitted sender) client-ip=2a01:111:f403:2613::601; ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=xrJih1oJGkRhfF36LFtHPb98lSIXnLsYOJPwP8V6HDBDgS+NsSLRDxqqH7BBzpm1KZoJUZgPjf3GUEmEpb0mGMXvH/G0pQe/pzTHD/W4p3Qr3Ec6GGF1ekxnJHmWfbZqbDWKUdIBB5MtBbqzmlssIcLrZFl9eLquZpmgA15nytMDwqTvZmiv0Z5eMw8DGaQWZlJg66IR8dDz4WkcbKQB93+prndAWPt11JC2+uJL63jZqzrp+ATaSVt+qyYF/bRkqKKFeTRq09T4KrGk7hbFqQSz/2Qij3ZH7RjckFZJuqw0jZ4wylEiHdS/ApePrSG3LSKsVAhQ/FCFp1l0G2muGA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=VBibD7YiMm8zIEOgONWkq1jMq5fegiFvB9c8P9jDus0=; b=XV1NZZ0D3uVmy5ltoqI86Eph05C2CM9ORQsusZaUomEmy4E5zXKDA9EQCOfQ4SIvrSfeAgAWDOUMENbM1pyGHmNNXNdp57gvE7eeZavoLB+O/tledKB97tl2PyuC0CRYj0bhvfgUq99dfOe5tYGAlzG1htHMMJscWPITvh2GKH4LvxBHfgVCDGQii5an3Eiy0GUoac7M8GEQET7BU/wZWuSs6xzAVOWCeEzBy4qXzPr9j7QhXLwSMm+hgYUvY+DnoC/g65uXpyXJnEoVvj8Vm8qXhaY2crVk7m6tYwWHZBZQf4vaBZQ7IxbqWpRWh+f/PyywvTQuetKQizNLxWnF4w== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=siemens.com; dmarc=pass action=none header.from=siemens.com; dkim=pass header.d=siemens.com; arc=none Received: from DU0PR10MB6828.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:10:47f::13) by AS4PR10MB6278.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:58d::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7784.20; Wed, 24 Jul 2024 12:38:34 +0000 Received: from DU0PR10MB6828.EURPRD10.PROD.OUTLOOK.COM ([fe80::8198:b4e0:8d12:3dfe]) by DU0PR10MB6828.EURPRD10.PROD.OUTLOOK.COM ([fe80::8198:b4e0:8d12:3dfe%3]) with mapi id 15.20.7784.016; Wed, 24 Jul 2024 12:38:34 +0000 From: "'MOESSBAUER, Felix' via isar-users" To: "Schaffner, Tobias" , "isar-users@googlegroups.com" CC: "Schmidt, Adriaan" Subject: Re: [PATCH] isar-sstate: reupload utilized files older than max-age Thread-Topic: [PATCH] isar-sstate: reupload utilized files older than max-age Thread-Index: AQHa3Puhek0gMUiV7EOZ4U/vHB6CybIF0tKA Date: Wed, 24 Jul 2024 12:38:34 +0000 Message-ID: <904fa1146f4d9e5c05f0c22e416bd39c87feb712.camel@siemens.com> References: <20240723122703.1210290-1-tobias.schaffner@siemens.com> In-Reply-To: <20240723122703.1210290-1-tobias.schaffner@siemens.com> Accept-Language: de-DE, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Evolution 3.46.4 x-ms-publictraffictype: Email x-ms-traffictypediagnostic: DU0PR10MB6828:EE_|AS4PR10MB6278:EE_ x-ms-office365-filtering-correlation-id: c1af1021-0ab1-4395-8495-08dcabdd8852 x-ms-exchange-atpmessageproperties: SA x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0;ARA:13230040|376014|1800799024|366016|38070700018; x-microsoft-antispam-message-info: =?utf-8?B?OG1CeUpKc2JSY1B0SC9kMDJ4dmhEdTdMajJRZmR4UWhreTV0dGhuekpHUzMy?= =?utf-8?B?V2MyUGxnczNJeEgyZHh5Q1ZHMXNOS1BPRHJvZWp1ZTl6cTZqKzRXdTNNbzNP?= =?utf-8?B?V0VYQkZYd1V4QldReTYwVjNVc0VpQTRmUHFlL0VBV0wxa0paOURnaEx5bU9M?= =?utf-8?B?R1NSZFJGN05jTndISWRqdzJhSklqSUZKQXhPM0RGMXVGeFZiMlFxYnNwNzlW?= =?utf-8?B?bHk1aHd2QjJtZGdzM2o1WGV1dXl4cEUwcG5Gek84ckxCMCttbHZuQ3ppSXRK?= =?utf-8?B?WmI4c2k3UE1ZOU9rdm9YbEhGQlpSSmdzcjQxT2xNUEUzQUN5UXU3VkFGb2d6?= =?utf-8?B?UTZnbm5OeUsxL0UzWkNXd2RPOThnZjJFNGVRSG9uSGVjWWNnS1ZmZ2NYVnhO?= =?utf-8?B?WHdXc1oyTzM0QXZtNCtTYzhuN2pKUlNlMzFRTVZQUHU0OXFMSFM4MGprc0ov?= =?utf-8?B?OHFpVUVsQjVKNHlUdDdoa0N5Mkk3SE11UklvZWpDT0ViT2RQL2dXdkhGZXJX?= =?utf-8?B?cHBGa2hXWlFQYi9MekQ4T2NJN21raXVLb1ZKaFJidUJXeHlaM25qSWplbFlB?= =?utf-8?B?ZU9HVWV5dUFQSSs4Z3ZjK0J6YkQ0Mk8yZDRiaUY4QndhVHhOZm9Xd21BaVlo?= =?utf-8?B?UGxHOWdXZkdxLzkvaXBsak9jUEVnMWxDTU1nS2V5a0F2c3RhakJwdllCYUpk?= =?utf-8?B?WFJiWmpEdExWOFV5NWpQcXJ0VUQzQW1UbVB1MFpGcHlxelR0S1Y3ZEdySThz?= =?utf-8?B?M0R3ZjJMdXY4UElhb2MrbGZuaUh2bDdIVitWdEkzTlhHT0dGcitiaGJ0cVRx?= =?utf-8?B?ay9yTHJwZ2d1cFNnOFpjUWc3aks1MDY2b0xuQjNNWUMrTEFTY2t1WmNjaTBH?= =?utf-8?B?K3NZYk53NXJZY1Y5NTdOZDBBNnZGSXFvYW9rMXVGVnR6SndtMEJ5ZGs2a2s5?= =?utf-8?B?Vm95T0k3SzdVUVZXU3FJU2lmRFpUWk0rSXQ5TUJ0MHQySmdicGNpTXpWMDFy?= =?utf-8?B?azJwNld6OU95T0NPYVZ5WEh4SExzUmUrYS9KTnBUaGd5ckpOY1N1bkN3K0Rh?= =?utf-8?B?d2hXa1loRUZlZkZTWnVDWWd4N1Z2b0RGRUZ3TERmYXVuUU82S0FiRHBtYnN6?= =?utf-8?B?alNJaTF2TU12QXRFRnlzQTVXcXU4UjFxZ1FCZGorZ2MwS3MzZHJLck5DZjFE?= =?utf-8?B?NGppYTEyZGZGL1Ezb3dZbERyQ0VhV3p4S3ExWURYazdjM0Nsa0hqWU9tZGVn?= =?utf-8?B?QUpDRDczdjIwNHpCc1BFYnNDRjJjUElyMXVhTlBwcXdTVCt5T0tHTkFVMTBS?= =?utf-8?B?dEdvanVSbEprTjJPbVJoNXViSzlGT1dCbHJBOURRVUpUdnlFTFBEN1VKSEVQ?= =?utf-8?B?ZmttbHl1dXBMaTMxaFFDL3lZc1JTQWg5eURXQW5oWDl0RDdGMkk5UEU1RXky?= =?utf-8?B?elZvcHBQQzVEcS9NdzR4SVVIVDY1OFk0WDhWZUVReVFJYUtveFAyclB5K3hk?= =?utf-8?B?RnNwTTBDbGV0VlRDenk3WlVCdUtNUlFYSkp4ZGxlWW1GUjVlc0pOSXVNZ0xW?= =?utf-8?B?M0xrQ1AxbVlYQ1pWRU9uejJQYmxVRHhiVGR1K0ZQYzkvZHhKS0JXNVVWQWJx?= =?utf-8?B?Mkd2SWR3Y0FGczhIYW1vcEc0QkJkNGlGVUg5ZS9xUUpJSkxQQTlyc1J3OGRw?= =?utf-8?B?aTdaN0VZNjE4Smh5S0Vqai82VFUzNk9oYzNNV0xBY1cwaWgycDZKbFhnQTNu?= =?utf-8?B?Q1ZtaGJJNm1EVWxUWDFPMkNHZFVwSHdKMHZyRHVaclVYZUdUekFaRURsTzZq?= =?utf-8?B?enhkVTdFNkxndk40RG9aZDRHRlpSNGNDZ0p1WmcxUWZmUjFoOUhRMFF2WXNz?= =?utf-8?B?Y2M2cWx5VnNsUUszTVdXdGNlT1Uxb2xPemgveXRtUStLMFE9PQ==?= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DU0PR10MB6828.EURPRD10.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230040)(376014)(1800799024)(366016)(38070700018);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?utf-8?B?RHl2MFo3U1NRRDF4ZjZVa2lPdjUvTjVJWWh1cGw3VE52bStWYlB1NUsvaEhH?= =?utf-8?B?ZXhnR2NGSnRtWnQzdXZoZXI0SldHalk3MG9odktpTXIwbElETmM0OXUzSER1?= =?utf-8?B?dEZOQlZhNXp2QlJIMUcrSWtiVWVmZkNEUEVCZ3RuZE45U1d0NDJxaWNUL0w5?= =?utf-8?B?bDZ4TjZIK20xdjhBc1REMW51STYvTjkxRGpFbjVrWVd2V2pVbDY1M3o3S1I0?= =?utf-8?B?azl2Z0xKUFh6aklGYWtaYnlsTVNpbDRmVU5IaVdOZm04K2x3Uzc0YmYrZ095?= =?utf-8?B?czV0WFZuWnMwbXVNL1N5SndCa3pocThTaXcyY3RwNHVVREdFSGF1NU9SZkRX?= =?utf-8?B?MVZ1bHU3bUpsUkN6UWQvWkdZaytVL0Vkd1ZaR0FjSExYVDhCbHUxZGN2QUNu?= =?utf-8?B?UWYrMUlDV0R0czFTU015WEQzU2VGanB6d044d2FxQTNuSkJaMzNHSTdGT3V4?= =?utf-8?B?MG1xSjYwK3lGYS9zSEV3dU5TSW8rYzc3RmJsbFkzLzBFYkpqRXJtWmxWNXFr?= =?utf-8?B?cFE1YWxMT0Z4amhWWVRRK0w0bFhSU0NwM3dzTFQyTThiZUxveVdyWkxUVDZn?= =?utf-8?B?cnBmM0RvWnhPTndDZ1ltcDFaZ21DSWlhTHdWS3hYdGQrZUo4RVZNU1B1TUcx?= =?utf-8?B?MkR6bTJrQ08vQkluREhtN0RGd1p3SnoxRTU3QXk0UlZaVkN2eG9ESjBIem42?= =?utf-8?B?bUhtM2N4cGhQcCtQUEJoWWRJVDB0MzJnSEtFNENvZzdvVml4QzJDRmMvbGth?= =?utf-8?B?dlE2dDBmMGNwS0crcTJ6cWx5RzZsUkVMRjRkS3llQUFzdEZSV0ZaUU9BcFdS?= =?utf-8?B?NE0rY0xnNFF1SVFHUmlvOThuYWpZNllPc3NhSHJyaWo5cXNrZEluai8yZHEz?= =?utf-8?B?QnVQZml6Mml4cFI3ZEwrenlCL29Cb1BFWkdnV0w5UTc0UU53VVhISitOcWYr?= =?utf-8?B?cU5LckxNNXpza0dhT0xocGdTQkFCMmord3dsTUUydEpXMmRTVXN1MEN1OVJL?= =?utf-8?B?d1libzRhV2RsMTNRaUVUTmlFcHdmRWV2SlowMXhtNVBZRllMbVBEc1RNaGJV?= =?utf-8?B?V3hzNzdRUGdBdUpnUEJ5N0tvQ04zNk9HNC9UWGpwSElkVzY3VWp6V0ljY2NW?= =?utf-8?B?SEFjMy9rVXdBVzZOdFVZMUZkTDFJejk3L0NhbTZMNmpSTW5NemZmd3k5LzhO?= =?utf-8?B?N1FQU0JUS1BHRm5QUzMvbklKZGJPanA0ajlGc3JMMmt6ellrWUhiWDdZd1JB?= =?utf-8?B?YjVTcUNDd0N6RXNrUjh6RDNHYnpROVN1b2c4ekJzaE1jQmpZN2tjb0pveThB?= =?utf-8?B?ejVuZ0hsaHRvUG1kelNvd1NWRGtWb05ZSkJ0ak9zZVZLSXZubHJuOGZ4Wml2?= =?utf-8?B?MDMrWlBMMXNaM2J6QmxpK2pmZzk5aW5PZHhDYzlFMTRaaHExdVN3anFEUWhl?= =?utf-8?B?RkxydEhKUzR3R0tHb3h5eEVyVGgyOUZBbHQwbEt4d2FjVDlsY2RhTTJ0VVph?= =?utf-8?B?aWd2M3FqVjJybnNEdUh2QzJ0SVF4c3h6d1ZwUkpya1kvR2Y4MDBWczNXMmR2?= =?utf-8?B?R2RIWVc3NnJ0SkU3N3pCZEo2TVExeFExam5sS1pPcUM1RXVBWWsrdVhjVW5W?= =?utf-8?B?MXZ2UDdLYVp3eUFTa2M5MVNJYjZEZDEwYnptc0l1YStZTUtCQi96TVRXUFlx?= =?utf-8?B?YkpDclJpc2JmL3lBbXJiVFR0L293SGpqeGtGNC9ZRnFuM0tCcmVGdnc3NFM1?= =?utf-8?B?Z01INmhTdHRKdlNtVm14aDB6eUYxdmlqblYrZzV6dHArUWExMXUvZVBuOUhk?= =?utf-8?B?UUNtSFdLODFDclhvQmh5S0ZkNFZ4V2NaSHhLQWFYSHFvVlBPaUlTNFdOTUxx?= =?utf-8?B?NWl5WFJFVnpPOGNJS21LYVdjamZYck5JYW5sSGxqektNZS9Vb3NTdG5EZDBs?= =?utf-8?B?M3d3bzNhT2d2Vm9XMks4OFA5eGxzWjY4cFV2ZDBCUFRHMlVvb1U5YXFDYTk0?= =?utf-8?B?WlM5b1FuUWcyTC80eDNhRmtKelVBdTduT0JNNmpwSzJDWFhILzFDT0EzOVpk?= =?utf-8?B?VUhrNUw5aUpNN3RyOFdLTk1vT1hNRDkyR0xlOWlwdzIzMlRqRUlsSGpwV2cx?= =?utf-8?B?ZXNhQ0Rkb29YeEgralk1ekJwTEtXTE5WSW5RYUVBeEVTZTA5Nnd1NTZuOHJ2?= =?utf-8?B?NWlsL0prZXhGRWl3U05USGR4ZFhVb0x1aEo5NDJ0cDdBbDZlRGtjTytCNm5D?= =?utf-8?Q?+5j5afpZ8z5UUeQZY74AWtU/VMCNk+dA9QwtiCSzLg=3D?= Content-Type: text/plain; charset="UTF-8" Content-ID: Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: siemens.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: DU0PR10MB6828.EURPRD10.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: c1af1021-0ab1-4395-8495-08dcabdd8852 X-MS-Exchange-CrossTenant-originalarrivaltime: 24 Jul 2024 12:38:34.2888 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 38ae3bcd-9579-4fd4-adda-b42e1495d55a X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: WO01AT4iCgzfFaw5gqET+h4gal2p9hJiaxlY4DHCVC0cUC8xic7tyOxV4KGCIpxwKrGK2quyW5QTV3oBlUf0LFEBD1GUzLzxCtalK8Rk+Kc= X-MS-Exchange-Transport-CrossTenantHeadersStamped: AS4PR10MB6278 X-Original-Sender: felix.moessbauer@siemens.com X-Original-Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=HN8lYHyJ; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of felix.moessbauer@siemens.com designates 2a01:111:f403:2613::601 as permitted sender) smtp.mailfrom=felix.moessbauer@siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com X-Original-From: "MOESSBAUER, Felix" Reply-To: "MOESSBAUER, Felix" Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-Spam-Status: No, score=-4.9 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,MAILING_LIST_MULTI, RCVD_IN_MSPIKE_H2,RCVD_IN_RP_CERTIFIED,RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE, SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-TUID: orQnVTLcRTyS On Tue, 2024-07-23 at 14:27 +0200, Tobias Schaffner wrote: > Currently, the Isar-sstate script deletes all files older than max- > age > during a clean call, regardless of whether they are still in use. > Given > that S3 buckets do not offer a means to update timestamps other than > through a reupload, this commit introduces a change to reupload all > files utilized by the current build if they are older than max-age > during an isar-sstate upload call. Hi, I'm wondering if it is sufficient to just re-upload the signature, but not the file itself. Otherwise we "punish" good caching by a lot of traffic between the build servers and S3. CC'ing Adriaan. Felix >=20 > Signed-off-by: Tobias Schaffner > --- > =C2=A0scripts/isar-sstate | 57 ++++++++++++++++++++++++++++++------------= - > -- > =C2=A01 file changed, 38 insertions(+), 19 deletions(-) >=20 > diff --git a/scripts/isar-sstate b/scripts/isar-sstate > index 4ea38bc8..a60f50dd 100755 > --- a/scripts/isar-sstate > +++ b/scripts/isar-sstate > @@ -32,6 +32,11 @@ and supports three remote backends (filesystem, > http/webdav, AWS S3). > =C2=A0The `upload` command pushes the contents of a local sstate cache to > the > =C2=A0remote location, uploading all files that don't already exist on th= e > remote. > =C2=A0 > +`--max-age` specifies after which time artifacts in the cache should > be > +refreshed. Files older than this age will be reuploaded to update > its timestamp. > +This value should be chosen to be smaller than the clean max-age to > ensure that > +the artifacts are refreshed before they are cleaned. > + > =C2=A0### clean > =C2=A0 > =C2=A0The `clean` command deletes old artifacts from the remote cache. It > takes two > @@ -179,6 +184,17 @@ StampsRegex =3D re.compile( > =C2=A0=C2=A0=C2=A0=C2=A0 > r"(.*/)?(?P[^/]+)/(?P[^/]+)/([^/]+)\.do_(?P[^/]+)\.(? > Psigdata)\.(?P[0-9a-f]{64})" > =C2=A0) > =C2=A0 > +def convert_duration_string_to_seconds(x): > +=C2=A0=C2=A0=C2=A0 seconds_per_unit =3D {'s': 1, 'm': 60, 'h': 3600, 'd'= : 86400, 'w': > 604800} > +=C2=A0=C2=A0=C2=A0 m =3D re.match(r'^(\d+)(w|d|h|m|s)?', x) > +=C2=A0=C2=A0=C2=A0 if m is None: > +=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 return None > +=C2=A0=C2=A0=C2=A0 unit =3D m.group(2) > +=C2=A0=C2=A0=C2=A0 if unit is None: > +=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 print("WARNING: MAX_AGE witho= ut unit, assuming 'days'") > +=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 unit =3D 'd' > +=C2=A0=C2=A0=C2=A0 return int(m.group(1)) * seconds_per_unit[unit] > + > =C2=A0class SstateTargetBase(object): > =C2=A0=C2=A0=C2=A0=C2=A0 def __init__(self, path, cached=3DFalse): > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 """Constructor > @@ -598,7 +614,7 @@ def arguments(): > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 '-v', '--verbose', defau= lt=3DFalse, action=3D'store_true') > =C2=A0=C2=A0=C2=A0=C2=A0 parser.add_argument( > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 '--max-age', type=3Dstr,= default=3D'1d', > -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 help=3D"clean: remove archive= files older than MAX_AGE (a > number followed by w|d|h|m|s)") > +=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 help=3D"clean/upload: remove/= reupload archive files older than > MAX_AGE (a number followed by w|d|h|m|s)") > =C2=A0=C2=A0=C2=A0=C2=A0 parser.add_argument( > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 '--max-sig-age', type=3D= str, default=3DNone, > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 help=3D"clean: remove si= ginfo files older than MAX_SIG_AGE > (defaults to MAX_AGE)") > @@ -632,7 +648,7 @@ def arguments(): > =C2=A0=C2=A0=C2=A0=C2=A0 return args > =C2=A0 > =C2=A0 > -def sstate_upload(source, target, verbose, **kwargs): > +def sstate_upload(source, target, verbose, max_age=3D"1d", **kwargs): > =C2=A0=C2=A0=C2=A0=C2=A0 if not os.path.isdir(source): > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 print(f"WARNING: source = {source} does not exist. Not > uploading.") > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 return 0 > @@ -640,23 +656,37 @@ def sstate_upload(source, target, verbose, > **kwargs): > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 print(f"WARNING: target = {target} does not exist and could > not be created. Not uploading.") > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 return 0 > =C2=A0 > +=C2=A0=C2=A0=C2=A0 print(f"INFO: scanning {target}") > +=C2=A0=C2=A0=C2=A0 all_files =3D target.list_all() > + > +=C2=A0=C2=A0=C2=A0 def target_file_present(file_path): > +=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 for file in all_files: > +=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 if fi= le.path =3D=3D file_path: > +=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 return file > + > =C2=A0=C2=A0=C2=A0=C2=A0 print(f"INFO: uploading {source} to {target}") > =C2=A0=C2=A0=C2=A0=C2=A0 os.chdir(source) > -=C2=A0=C2=A0=C2=A0 upload, exists =3D [], [] > +=C2=A0=C2=A0=C2=A0 upload, exists, update =3D [], [], [] > =C2=A0=C2=A0=C2=A0=C2=A0 for subdir, dirs, files in os.walk('.'): > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 target_dirs =3D subdir.s= plit('/')[1:] > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 for f in files: > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 = file_path =3D (('/'.join(target_dirs) + '/') if > len(target_dirs) > 0 else '') + f > -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 if ta= rget.exists(file_path): > +=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 targe= t_file =3D target_file_present(file_path) > +=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 if ta= rget_file: > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 if verbose: > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 print(f"[EXISTS] {file_pat= h}") > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 exists.append(file_path) > +=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 if target_file.age > > convert_duration_string_to_seconds(max_age): > +=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 update.append((file_path, target= _dirs)) > +=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 if verbose: > +=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 print(f"= [UPDATE] {file_path}") > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 = else: > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 upload.append((file_path, target_dirs)) > -=C2=A0=C2=A0=C2=A0 upload_gb =3D (sum([os.path.getsize(f[0]) for f in up= load]) / > 1024.0 / 1024.0 / 1024.0) > +=C2=A0=C2=A0=C2=A0 upload_gb =3D (sum([os.path.getsize(f[0]) for f in (u= pload + > update)]) / 1024.0 / 1024.0 / 1024.0) > =C2=A0=C2=A0=C2=A0=C2=A0 print(f"INFO: uploading {len(upload)} files ({up= load_gb:.02f} > GB)") > =C2=A0=C2=A0=C2=A0=C2=A0 print(f"INFO: {len(exists)} files already presen= t on target") > -=C2=A0=C2=A0=C2=A0 for file_path, target_dirs in upload: > +=C2=A0=C2=A0=C2=A0 print(f"INFO: {len(update)} files will be refreshed") > +=C2=A0=C2=A0=C2=A0 for file_path, target_dirs in upload + update: > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 if verbose: > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 = print(f"[UPLOAD] {file_path}") > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 target.mkdir('/'.join(ta= rget_dirs)) > @@ -665,24 +695,13 @@ def sstate_upload(source, target, verbose, > **kwargs): > =C2=A0 > =C2=A0 > =C2=A0def sstate_clean(target, max_age, max_sig_age, verbose, **kwargs): > -=C2=A0=C2=A0=C2=A0 def convert_to_seconds(x): > -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 seconds_per_unit =3D {'s': 1,= 'm': 60, 'h': 3600, 'd': 86400, > 'w': 604800} > -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 m =3D re.match(r'^(\d+)(w|d|h= |m|s)?', x) > -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 if m is None: > -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 retur= n None > -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 unit =3D m.group(2) > -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 if unit is None: > -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 print= ("WARNING: MAX_AGE without unit, assuming 'days'") > -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 unit = =3D 'd' > -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 return int(m.group(1)) * seco= nds_per_unit[unit] > - > -=C2=A0=C2=A0=C2=A0 max_age_seconds =3D convert_to_seconds(max_age) > +=C2=A0=C2=A0=C2=A0 max_age_seconds =3D convert_duration_string_to_second= s(max_age) > =C2=A0=C2=A0=C2=A0=C2=A0 if max_age_seconds is None: > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 print(f"ERROR: cannot pa= rse MAX_AGE '{max_age}', needs to be > a number followed by w|d|h|m|s") > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 return 1 > =C2=A0=C2=A0=C2=A0=C2=A0 if max_sig_age is None: > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 max_sig_age =3D max_age > -=C2=A0=C2=A0=C2=A0 max_sig_age_seconds =3D max(max_age_seconds, > convert_to_seconds(max_sig_age)) > +=C2=A0=C2=A0=C2=A0 max_sig_age_seconds =3D max(max_age_seconds, > convert_duration_string_to_seconds(max_sig_age)) > =C2=A0 > =C2=A0=C2=A0=C2=A0=C2=A0 if not target.exists(): > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 print(f"WARNING: cannot = access target {target}. Nothing to > clean.") --=20 Siemens AG, Technology Linux Expert Center --=20 You received this message because you are subscribed to the Google Groups "= isar-users" group. To unsubscribe from this group and stop receiving emails from it, send an e= mail to isar-users+unsubscribe@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/= isar-users/904fa1146f4d9e5c05f0c22e416bd39c87feb712.camel%40siemens.com.