From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Mon, 10 Mar 2025 12:51:42 +0100 X-Sieve: CMU Sieve 2.4 Received: from mail-il1-f188.google.com (mail-il1-f188.google.com [209.85.166.188]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 52ABpeox009900 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Mon, 10 Mar 2025 12:51:41 +0100 Received: by mail-il1-f188.google.com with SMTP id e9e14a558f8ab-3d453d367a0sf38202685ab.3 for ; Mon, 10 Mar 2025 04:51:41 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1741607495; cv=pass; d=google.com; s=arc-20240605; b=F4DdLgX4VuO8h60sIWkbiFZgFvnLKKKnGiEntAPk/kJizYDL2ya/PR962PUkhKyxsw gBDgGO5A1T9CZSMLThr3Yx/4ywrgPFBn+ZtFWGGQDlIJ5bnsLI6dGru9jNsIXw6KRSmP 8Pp9VhcMi0877oEuzt3oPXi57nq35TQ4RTeRnlrgRMfR9+zMWYaCtUOaXc14V5Ru2DET 9uS8tMSwgL0lTbrw/TGmeDfNEc/wgS9WdXjU2pFru3X6OUpt1i8/WeGZmMtyDv2zN+HT 9Ui1J/QWgOgJ1dBoR4CEAd495Ws8JncJqnQBULxr7t/LjFbq5n+uxj9QCf2a1PQt/51g rU6g== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to:feedback-id:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=B/r5ivivMjuMOS9e2pGGkFZNG2MRe5vuOC6BkRSFPzw=; fh=3z9jJO7XmfUnssgePZON5B+VqYNP/UeLJxGCAmgjdeo=; b=GazFT3bulmGpMpE/Sc4hkoAhfve5znOoKSsbFyh8FqnygxttpyKr1V5M8eFVA/ixa1 bToxJ7XKSFUeGSZdMhB7DejjZBGI5jfOWsdLTXhL5nT72MRKEqKgGz9PNWTCnXObAHzu vj+ebWvTNHF7zPmK/jOMJxCZFQJ/Tx0e0INIprQNe/uF+fTcodoundWlb/2hqsQglYLh 20ARJ/woS8dCsr0lT7vkPcfzZfQsypr78kLm3sax28pRF3yAMAadzcONtMrdRJvQbFS1 8hczaY/5XCE5VaLy57j7IzQBhjk8rgpCw3FLDOSB3AhTt3FJ8NP/RmmrHRwHPZTyl/Rt T7IA==; darn=ilbers.de ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm1 header.b=Ds+i+4Nn; spf=pass (google.com: domain of fm-1324425-202503101151289e97932d3717106a7f-dyh3sa@rts-flowmailer.siemens.com designates 185.136.64.227 as permitted sender) smtp.mailfrom=fm-1324425-202503101151289e97932d3717106a7f-DYH3sa@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1741607495; x=1742212295; darn=ilbers.de; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :mime-version:message-id:date:subject:cc:to:from:from:to:cc:subject :date:message-id:reply-to; bh=B/r5ivivMjuMOS9e2pGGkFZNG2MRe5vuOC6BkRSFPzw=; b=W33wZE4pe4LBQlWA5ksYdb8eNHtJRdc1GhQxbQG4HQuJ6Z+zTLrdVl6qEcYTwDOHwN /cgOh9sv/wjTjB1E/Lt5T+xWFhfWCK7BDIoKzLh30kwUJdzjqW76YLVbHGQvQA/LfmYQ HzWpUI+BAqypSpyq1a2ypq3qZYi4YUWg9YAnNsBQ8r6vlnAHd+DtcCmWOb9/A++TsYoR zehaoC95NlPpIPysooBvY/CaroOzuGvP1QEN1LntjW22+On7fHyTWPZG0IMgE3rIgr/G f4MkphagInZXYXbIAvGtjOqF+GYkPEFUZVExsmXvkYnBPvvF9SL5CzLh8Vq7Ro5QAgxS uA0Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1741607495; x=1742212295; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :mime-version:message-id:date:subject:cc:to:from:x-beenthere :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=B/r5ivivMjuMOS9e2pGGkFZNG2MRe5vuOC6BkRSFPzw=; b=FQ6H+y7fkvO7vN+Kq+NJUkLBocNRBzfs9pRsd5r1mE2B3NiCKD3xebQF4FzhIoj6fp 6Dlk8AxgraHOlMjaNUEPRzW30lFRC1j+ncFWH+IahLCxplpPqfDOemnqBdfVjV/vQ0oz sWWdvRqi10AxCsTUmjB6SkS0Kx/L4oWpzivAaE9tp8NSAz4pBK+JZDDFj6/EsjMYHBBc cl7oB2gVLSrnAjliKG3/jeMky2BPObnG5PzY3dCVCGx6BL6QRAR6FTV1VWS5YbljVhDH 1YinLgeF4Zdhzk0QcWOWsDogjlxx3c4TtZ9bqXBZAj6G291/IgNMOU5j/d8LZuoJ6ZHC v5HA== X-Forwarded-Encrypted: i=2; AJvYcCUVYMgC54ogVWzxES02mkdssoTLi2/KeVkukWQaY8v/xP+D+/WJ45z9vfrJp8Ihe8feplvD@ilbers.de X-Gm-Message-State: AOJu0Yw3+vGy4aLIpAr3gD0AqY9z62yiu7ocK6tzgXq3/08CIZvE6Vor gb9L4csnVsTyAzBcxYDrI1JcXyhEBfBPTawv8/lS5EgVA5H2v8bF X-Google-Smtp-Source: AGHT+IEUYbIYx70/c3Snugt70ejeMCelRbbYgRPIhcOBHMwd9yhsiDOdf+2vy957/QAIqVVRno2KBg== X-Received: by 2002:a05:6e02:144f:b0:3d2:aa73:7b65 with SMTP id e9e14a558f8ab-3d44193d19emr152001845ab.6.1741607494997; Mon, 10 Mar 2025 04:51:34 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com; h=Adn5yVH1QwVRIuBikB615mOYPST9fnACvGug4pamIwLM78xcDA== Received: by 2002:a05:6e02:3003:b0:3d4:58a3:f62 with SMTP id e9e14a558f8ab-3d458a310f4ls16351685ab.0.-pod-prod-01-us; Mon, 10 Mar 2025 04:51:34 -0700 (PDT) X-Received: by 2002:a05:6602:4816:b0:85b:59d4:b00 with SMTP id ca18e2360f4ac-85b59d41073mr265228039f.0.1741607494043; Mon, 10 Mar 2025 04:51:34 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1741607494; cv=none; d=google.com; s=arc-20240605; b=TB9qRpSzGerUPreW7tKbmF8XTTMk1UOyhKZGTybg9fHKRcvYBd01iskFfXUFNu9ax6 Sn7YcCBDQ3RlENHfN7ngHg1BaI1KZnt7U022+/wzGQYiOQiGzX+2jyisIW8lerI6SHNn 1xwj0JZV4pmnUz+nDIOx/hf8M+DUUbgPWZT5N5hHSB+481JFsvJGkqAD8nvO12i0WR/i 9x1W4604XIA3jMnDOJK+QiSN9USpPodqpEbet0fegvQpu3v1nMKPndCpOfb9XZ2xfjoV 7JKFuaaB1xRhw9MytCkYEt1XEyWfglNIg13UdQDKcjp75E7mLe069ci5PqbhoQTKPL8n zmYg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=feedback-id:content-transfer-encoding:mime-version:message-id:date :subject:cc:to:from:dkim-signature; bh=bW4JSlH2OlXsbnFsKoGa0T2ULhgndL2zstJFim7d4ys=; fh=vSDejBuUD8kp+mUPb3rALatMrpk6EntwGWFTmK/3QX8=; b=OxiEJhKbOmXELBBmbzRD4aicew/t4OfBffeK8mdgVoStR0sh4SCBeqNWzuJVOXloyY 0TwVqZDYjOmNjrps2ZpDiCUGzOK4a9VTJHDvzEeAKZ17TtN7ryHQj9KPOcd8tCi6nNhu QP2mmsikF45mI9UE8rITgLnb9jvYllIBnYyXAW9E1N/A/vgjNBiN6wYk1ljT5/4SYsKm 3AFnk+j3pGhhn+cUrAx90E9ud4NUoYBFsEgg7j1tLmPaDuJJCjBBkI9R3K4lCV777j9n wR2wldjVfCms8O+ySilQ4NeZyINZamqtod9cRM/NfzaP17hHlxR3KNrIjP2TmL8FL5t5 Hg7g==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm1 header.b=Ds+i+4Nn; spf=pass (google.com: domain of fm-1324425-202503101151289e97932d3717106a7f-dyh3sa@rts-flowmailer.siemens.com designates 185.136.64.227 as permitted sender) smtp.mailfrom=fm-1324425-202503101151289e97932d3717106a7f-DYH3sa@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com Received: from mta-64-227.siemens.flowmailer.net (mta-64-227.siemens.flowmailer.net. [185.136.64.227]) by gmr-mx.google.com with ESMTPS id ca18e2360f4ac-85b3dbe397bsi14421439f.1.2025.03.10.04.51.33 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Mon, 10 Mar 2025 04:51:33 -0700 (PDT) Received-SPF: pass (google.com: domain of fm-1324425-202503101151289e97932d3717106a7f-dyh3sa@rts-flowmailer.siemens.com designates 185.136.64.227 as permitted sender) client-ip=185.136.64.227; Received: by mta-64-227.siemens.flowmailer.net with ESMTPSA id 202503101151289e97932d3717106a7f for ; Mon, 10 Mar 2025 12:51:28 +0100 From: "srinuvasan.a via isar-users" To: isar-users@googlegroups.com Cc: jan.kiszka@siemens.com, cedric.hombourger@siemens.com, ubely@ilbers.de, benedikt.niedermayr@siemens.com, Adithya.Balakumar@toshiba-tsip.com, srinuvasan Subject: [PATCH 0/1] Fix deb-src caching issue Date: Mon, 10 Mar 2025 17:21:48 +0530 Message-Id: <20250310115149.1977443-1-srinuvasan.a@siemens.com> MIME-Version: 1.0 X-Flowmailer-Platform: Siemens Feedback-ID: 519:519-1324425:519-21489:flowmailer X-Original-Sender: srinuvasan.a@siemens.com X-Original-Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm1 header.b=Ds+i+4Nn; spf=pass (google.com: domain of fm-1324425-202503101151289e97932d3717106a7f-dyh3sa@rts-flowmailer.siemens.com designates 185.136.64.227 as permitted sender) smtp.mailfrom=fm-1324425-202503101151289e97932d3717106a7f-DYH3sa@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com X-Original-From: srinuvasan.a@siemens.com Reply-To: srinuvasan.a@siemens.com Content-Type: text/plain; charset="UTF-8" Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-Spam-Status: No, score=-4.9 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,MAILING_LIST_MULTI, RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H2,RCVD_IN_RP_CERTIFIED, RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-TUID: 83jlqCVvm202 From: srinuvasan Dear isar-user, When we enabled the deb-src caching during base-apt creation, we noticed a few deb-src packages missing in the pool. Missing deb-src packages categorized in the below stages: 1. bootstrap related deb-src packages 2. imager related deb-src packages 3. image rootfs related deb-src packages This regression we found after mmdebstrap migration, this issue addressed in the below patch series, for more details, please refer to [1]. but here we use the /var/log/dpkg.log file to ensure the parsing of deb (from /var/cache/apt/archive) is installed or not. By default, mmdebstrap deletes the /va/log/dpkg.log file and we enabled that option in [1], but our images are becoming longer reproducible. Meanwhile, Cedric proposed one change to remove excessive calls to dpkg-deb in debsrc_download, refer [2]. Here he completely rid of the checking status in /var/log/dpkg.log file and introduced the ftp-aptarchive to scan all the deb packages and download the src against them, i feel it is more robust and works for all the stages. With his patch i validated the deb-src caching, now we can able to download the src packages for bootstrap and image related packages only missing part here is imager related packages, this one is addressed with a refactor of my patch 2/3 in [1]. Validated for amd64 and armf, it seems deb-src caching working fine and able to see all the deb-src packages. I hope the combination of Cedric changes [2] and mine is the better solution for this deb-src caching issue. [1]: https://groups.google.com/g/isar-users/c/8QstIaudyts [2]: https://groups.google.com/g/isar-users/c/OwrSBmCPe0Y Note: [PATCH 1/1] image: move deb-src-caching functionality after image creation heavily depend on [2]. srinuvasan (1): image: move deb-src-caching functionality after image creation meta/classes/image.bbclass | 8 +++++++- meta/classes/rootfs.bbclass | 3 ++- 2 files changed, 9 insertions(+), 2 deletions(-) -- 2.39.5 -- You received this message because you are subscribed to the Google Groups "isar-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to isar-users+unsubscribe@googlegroups.com. To view this discussion visit https://groups.google.com/d/msgid/isar-users/20250310115149.1977443-1-srinuvasan.a%40siemens.com.