From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Tue, 06 Aug 2024 12:54:59 +0200 X-Sieve: CMU Sieve 2.4 Received: from mail-wm1-f61.google.com (mail-wm1-f61.google.com [209.85.128.61]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 476AswW1008445 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Tue, 6 Aug 2024 12:54:58 +0200 Received: by mail-wm1-f61.google.com with SMTP id 5b1f17b1804b1-427b7a2052bsf5906725e9.2 for ; Tue, 06 Aug 2024 03:54:58 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1722941693; cv=pass; d=google.com; s=arc-20160816; b=YSCpLIlpmDtuKlD52RchLLi4UYuibhdVDzqS/5f6YsDmNuHtEkwL94idqeQpNhRj93 r+M45ApRypLRniilHyls3rL0smzzUF1hhSRuPAG+CEIxzS1POkWt0jVxR20TYS7hlPWm ztkYOs9UGqrZ3dACoYJ38Eb6n2FFh5NYW1bny1od/O1JwLjjWgW4mfF+XdZPfD6C72VY s8RCLzWulFgSxzBm8SGaaqboLlZkt5sjbCJpE9J+s1e5Cb5fUdYWhCcZxqNcgsATrhrZ 34aN60or78AKUn0Wb+/YmlxTEKbjEigiST37fgq00OudWyfFA6OWhaC9eBy0oaJ11qR5 QfRA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:user-agent :content-transfer-encoding:autocrypt:references:in-reply-to:date:to :from:subject:message-id:sender:dkim-signature; bh=+nqCDX7SnLo+zqU1fnvUHs3SDzfrBDr56BpTHZVq/R0=; fh=2J3oYw1rnEo4H4OL0B+BxOlpjjg6O53St7DhHlcoM/Q=; b=Bm8iNcImku1EpHdGgUwv6WYubDbdonqbJfNd3tZvfhHsqyPlPtD4zwhjogmGTQlT6h RhqYVYM0bcJd4DXIrhyN4m8D7Vv4MqJxBwupuel0TSjSAmEz/puZbyrFevQ2qbkuf4ra MD/JoaywFGcE2ftFZQYNOnOctyJHE+E1W0r3Sk1jL0V7FSefvCWFAyfmSMOwFJXFnveA 2BbfG7pOUcvbFn7obj7ae5C46qa11YGkWBZHGJXQuI9qowkWyXmjkywD1wBleGl57YYI eOL2nvovY+zi4E4DXGy39p4LY7B98rMBe0YLM1S6OhPNFfH36Hj+A4M9foBZqMnve5jJ fjMw==; darn=isar-build.org ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1722941693; x=1723546493; darn=isar-build.org; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:x-original-authentication-results :x-original-sender:mime-version:user-agent:content-transfer-encoding :autocrypt:references:in-reply-to:date:to:from:subject:message-id :sender:from:to:cc:subject:date:message-id:reply-to; bh=+nqCDX7SnLo+zqU1fnvUHs3SDzfrBDr56BpTHZVq/R0=; b=lUhOTSxTvLqnXFxduJZr5t2qtoJ2BRwYR/xq56m7fEtnMf3HhfEpE1kkvotW9G4uky YiVfBpO+DZS20muZR0AeaTAJ0L42Gk1Fth8hrWpTxnIHJe7kSQKCn3UEgxbltVLii8I6 whSaSN2d6K0MYOd2SgkpmnbWut4yfnEOblcWZRsWf2hJuywo3I+Own5i7EvaCt5/RoXL eh0/I96qTTdHEEOZUiGNGedjM9T/1yuHR0kVZcJzYLN1fJTrr8Bxrch2PjbXHxXj9Ofq n7RxeWA8qVxiJ/BPe3B6JhVmjBTUy8QrAKPO0M4KUs/LsiAHO4KIGO48p/w+Xz1J0YfY AOhw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1722941693; x=1723546493; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence :x-original-authentication-results:x-original-sender:mime-version :user-agent:content-transfer-encoding:autocrypt:references :in-reply-to:date:to:from:subject:message-id:x-beenthere :x-gm-message-state:sender:from:to:cc:subject:date:message-id :reply-to; bh=+nqCDX7SnLo+zqU1fnvUHs3SDzfrBDr56BpTHZVq/R0=; b=OS7vEyuYseQsHB1y3sV/T9vjFM9Nb779q8ud1oUcaz6fnVVLm9eLD9XV182D1gAVYG j4cJxcXrxbzq6bBAQY/NGqsvWKyu8QbHJInrGqZZeXb62PFGk5OjSzZKGeMUm7J5ZeR3 X8KXw8dQha7IGkikB5TgWqCX/mKLlYM7LJit3Fdv/0kUJIsk5pbIg5ge0fmj32C/AGil 3tPuv+gFs+O5wmIgeI0DAbxdGFwBi5Y13o6Fu+3g7VNbzCiZ9nghFJ+3fT6uQQC9NfCa X79lHW+/VHuj7ZDzGBlPEbkhV7FklYfoSCCJdlNU3GEVCJVsbqCoVUNm8v+XIO4QJY1e oBxw== Sender: isar-users@googlegroups.com X-Forwarded-Encrypted: i=2; AJvYcCUkJsIg7tJBVh6KCpOPAuKp490YsxLbzapMhpmwiABQ77n7ga07WcWXb7D27uV+BKOLsxXwyReA0jaAsDaAuS90ZO4= X-Gm-Message-State: AOJu0YxBKZkU5pRZbe0/tAE5+KMQHRYPU+zvaHN3e9OTnYoOy4PLoFRW jC7KNE5XT0zvyMTflKY3CnpjDjCmdGL2mNTwmLjL4fWb1cmSNcd8 X-Google-Smtp-Source: AGHT+IEylyUhMpSkNLAYOBL8pjJhI+4ksQ7yM8/hg6PfR2rchBNaEvM361WxtqOEoS5a9OB6tKcFrA== X-Received: by 2002:a05:600c:4e87:b0:426:5b44:2be7 with SMTP id 5b1f17b1804b1-428e6b02594mr135257495e9.10.1722941692432; Tue, 06 Aug 2024 03:54:52 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:600c:310d:b0:426:7318:c5a0 with SMTP id 5b1f17b1804b1-428ede25302ls20435035e9.2.-pod-prod-05-eu; Tue, 06 Aug 2024 03:54:49 -0700 (PDT) X-Forwarded-Encrypted: i=2; AJvYcCXZ49jZbfpICsEQPEAvaZysPfz2IdZvD3pS5bMtZVfKS9nlslkcHsEIUMYTCnz18OIO/ds39dDzrie82AHnryxDzxW1K7v7x6oY22g= X-Received: by 2002:a05:600c:35ca:b0:426:545b:ec00 with SMTP id 5b1f17b1804b1-428e6b2f0c5mr134664145e9.19.1722941689535; Tue, 06 Aug 2024 03:54:49 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1722941689; cv=none; d=google.com; s=arc-20160816; b=ISh9xLE/99Fopx5Ap4i+7soIrIXzpepQLk/0wAenYBvVbnABC6EOwZHxLBO2nyAf3f jjVZ4qpOIoUGfWV8fy+agTzj0H5TxRx36fD+a/O+G+UaY41jq2JIjsCk2l8m2hhg/7Ul 2HJ2iHv1jIPOA3xquIW866VUMO6ud2FThpesSH3Mtm4cha4CASwXnMQ2RLis/r4WgoMV lPe9ZY+KFWDuRvsFfTIdUAbL8m1/UaW8vz6LsGJTSniDIR8EQTG9gJbzHeOJFCc7ruNo Y+oMgIf8sj4OZjBsaPSVOffabpzNuLkygsgkmP+mMAhhAqmt0hu0EutAxvVBEKVB2Txa bCDQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:user-agent:content-transfer-encoding:autocrypt :references:in-reply-to:date:to:from:subject:message-id; bh=Wyo3e7f6qDe3SFRtulkW+XPiAXFrhvIWqLitmu+i3zg=; fh=O+ZMFUiiuyZKsfz7Fw8hsdknZlxcSFSsLsCydBEGD0o=; b=eZ3Y4XPOzqVqktqkj3/mD1OcAMCgwecOG0ACN4K8YhFrYSs6bNbU/dNM7cRZUebdh4 FimosTRJmkFCg+CxQIJAMlzxL0UgX7MFQp5PKP0hQSroCWeW+wSnT95QOvZfuHZqZOOK kBv8ovnj+yyRgpJFs9MPU5YaV5auByJFTb2GD2kxCY+vRAmwyG7AEK0f9PpNRCJs0r0X P/e+pxg+b90swyBd/PvYlpFViaWZM8bhv4D9PivU1u3DuUy+F1gcCiedrGOeKfNb+f+K 4LcHKQJOIRj4STWvgEEWrme+60yO3cxjIMgwFIACjkCttJ/q7XUFQ8q+V2FlWePC6svk RMXw==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id 5b1f17b1804b1-428fecf5d1bsi622875e9.1.2024.08.06.03.54.49 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Tue, 06 Aug 2024 03:54:49 -0700 (PDT) Received-SPF: pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Received: from [IPv6:::1] (host-80-81-17-52.static.customer.m-online.net [80.81.17.52]) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 476AslB8008433 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 6 Aug 2024 12:54:48 +0200 Message-ID: Subject: Re: [PATCH] ci: Add test cases for container fetching and loading From: Uladzimir Bely To: Jan Kiszka , isar-users@googlegroups.com Date: Tue, 06 Aug 2024 13:54:46 +0300 In-Reply-To: <61952236-14a3-40d6-99cd-14a42d067ae0@siemens.com> References: <20240805071755.19853-1-ubely@ilbers.de> <61952236-14a3-40d6-99cd-14a42d067ae0@siemens.com> Autocrypt: addr=ubely@ilbers.de; prefer-encrypt=mutual; keydata=mQENBGO2eUkBCACtT+T3OrPVSExBmqfgXT3lp9XcdxRzjYp26wezkgYjjBXaf36bxtaAf S471VoQtpar0RVeFfW7WDDdfX9ZclSj36zBQe+RVSJzoNoNQfjOXWuSHb5Z+cpAFtqBY4muxK4+ia IlLJd6CN3ejOsLHATtCeHHq8wi0z2T+KdLQO+wQRgo2hjj0Lp9pGTrKJry50HP/o7Vbdu14dOx2xq r8+wPc6SQbBIrcqaa4MqCQC00vQG7eXvo+k2MOw59FDdpMH0KR9mHgp3u/s4I+4YRBArukt9G9xz/ rsEFmxAIBC6N/a6Hzwg4puc91n7ABDsPg8Vp+X3MDraujN0dvR6OKVNtABEBAAG0IFVsYWR6aW1pc iBCZWx5IDx1YmVseUBpbGJlcnMuZGU+iQFOBBMBCAA4FiEEJqPNVhVGyk12Eh+PAUQYBM/2FkoFAm O2eUkCGwMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQAUQYBM/2FkprlAgAmuna8Hm9EyoEtTl DBGDg6Zm4ZLp5ffvZBE946h92jepDrteoxsJ7pSzJVC2HmDLa4iZUao7lLLbDsUj5x45/iLJcqBZK k3YnAxP2r6a+kI+1VVQY1pxdG1nlJAbdNzoojm/qmezNPSrqni61KVMQKsXBCWhIjSXDSM9CsBj21 a+9qaVqfxovJGTn9lgrZO+xzKQNMKZeOouJlscVuFj21P0ww3/YENiU/nMeTSuYypO76mDtAd08Jo nc3yuHa9MJGei5ixN3wT+IrGR2aL2hdw2M6NgH7sYbL2Zi4ugD6RXHJai1Bh2yvFSVqSQ+M6QOInT 4ud7wslm1XRB065dXtA== Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable User-Agent: Evolution 3.52.3 (by Flathub.org) MIME-Version: 1.0 X-Spam-Status: No, score=-4.6 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_EF,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,RCVD_IN_MSPIKE_H2,RCVD_IN_RP_CERTIFIED, RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-Original-Sender: ubely@ilbers.de X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-TUID: FAAT0zzk8Yma On Tue, 2024-08-06 at 12:46 +0200, Jan Kiszka wrote: > On 06.08.24 11:48, Uladzimir Bely wrote: > > On Tue, 2024-08-06 at 07:48 +0300, Uladzimir Bely wrote: > > > On Mon, 2024-08-05 at 13:51 +0300, Uladzimir Bely wrote: > > > > On Mon, 2024-08-05 at 12:43 +0200, Jan Kiszka wrote: > > > > > On 05.08.24 11:40, Uladzimir Bely wrote: > > > > > > On Mon, 2024-08-05 at 11:17 +0200, Jan Kiszka wrote: > > > > > > > On 05.08.24 09:16, Uladzimir Bely wrote: > > > > > > > > From: Jan Kiszka > > > > > > > >=20 > > > > > > > > This plugs the two example recipes for loading > > > > > > > > container > > > > > > > > images > > > > > > > > into > > > > > > > > VM-based testing. The test consists of running 'true' > > > > > > > > in > > > > > > > > the > > > > > > > > installed > > > > > > > > alpine images. > > > > > > > >=20 > > > > > > > > Rather than enabling the ci user to do password-less > > > > > > > > sudo, > > > > > > > > this > > > > > > > > uses su > > > > > > > > with the piped-in password. Another trick needed is to > > > > > > > > poll > > > > > > > > for > > > > > > > > the > > > > > > > > images because loading is performed asynchronously. > > > > > > > >=20 > > > > > > > > Signed-off-by: Jan Kiszka > > > > > > > > Signed-off-by: Uladzimir Bely > > > > > > > > --- > > > > > > > > =C2=A0.../recipes-core/images/isar-image-ci.bb=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 |=C2=A0 2 ++ > > > > > > > > =C2=A0testsuite/citest.py=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 | 24 > > > > > > > > +++++++++++++++++++ > > > > > > > > =C2=A02 files changed, 26 insertions(+) > > > > > > > >=20 > > > > > > > > This is a drop-in replacement of patch 4 from "[PATCH > > > > > > > > v4 > > > > > > > > 0/5] > > > > > > > > Introduce > > > > > > > > container fetcher and pre-loader" series: > > > > > > > > - Fixed syntax errors (incorrectly escaped '\$') > > > > > > >=20 > > > > > > > IIRC, we do need the escape inside the shell (sh -c > > > > > > > '...'). > > > > > > > So, > > > > > > > you > > > > > > > likely rather need to escape the escape character. > > > > > > >=20 > > > > > > > Jan > > > > > > >=20 > > > > > > > >=20 > > > > > >=20 > > > > > > I just tried to make a simple check: > > > > > >=20 > > > > > > ``` > > > > > > $ su -c 'for i in $(seq 3); do echo $i; done' > > > > > > Password:=20 > > > > > > 1 > > > > > > 2 > > > > > > 3 > > > > > >=20 > > > > > > $ su -c 'for i in \$(seq 3); do echo $i; done' > > > > > > Password:=20 > > > > > > bash: -c: line 1: syntax error near unexpected token `(' > > > > > > bash: -c: line 1: `for i in \$(seq 3); do echo $i; done' > > > > > >=20 > > > > > > $ su -c 'for i in \\$(seq 3); do echo $i; done' > > > > > > Password:=20 > > > > > > \1 > > > > > > 2 > > > > > > 3 > > > > > > ``` > > > > > >=20 > > > > > > We are likely don't need escaping at all. > > > > >=20 > > > > > Interesting - anyway, if this sequence is not properly > > > > > resolved, > > > > > the > > > > > test will fail. And I assume you had it running successfully, > > > > > so > > > > > we > > > > > must > > > > > be fine. > > > > >=20 > > > > > >=20 > > > > > > Anyway, we could just convert the tests from > > > > > > "cmd=3D > > > > > to "script=3Dtest_prebuild_container.sh" and have test logic > > > > > > in a > > > > > > human- > > > > > > readable form. > > > > > >=20 > > > > >=20 > > > > > Also fine with me. > > > > >=20 > > > > > Jan > > > > >=20 > > > >=20 > > > > OK, I've already prepared the script internally and will check > > > > in > > > > CI > > > > with it. > > > >=20 > > >=20 > > > ... and still having problems with running commands inside arm64 > > > container. > > >=20 > > > I manually run (with same command-line as CI does) qemuamd64 and > > > qemuarm64 images. > > >=20 > > > Running prebuilt container in amd64 machine works well: > > >=20 > > > ``` > > > root@isar:~# docker images > > > REPOSITORY=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0 TAG=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 IMAGE ID=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 CREATED=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 > > > SIZE > > > quay.io/libpod/alpine=C2=A0=C2=A0 3.10.2=C2=A0=C2=A0=C2=A0 9617696764= 11=C2=A0=C2=A0 4 years ago=C2=A0=C2=A0 > > > 5.58MB > > > root@isar:~# docker run --rm quay.io/libpod/alpine:3.10.2 true > > > [=C2=A0=C2=A0 61.233873] docker0: port 1(veth1c2b6f9) entered blockin= g > > > state > > > [=C2=A0=C2=A0 61.234280] docker0: port 1(veth1c2b6f9) entered disable= d > > > state > > > [=C2=A0=C2=A0 61.240243] device veth1c2b6f9 entered promiscuous mode > > > [=C2=A0=C2=A0 62.650328] eth0: renamed from veth2aff680 > > > [=C2=A0=C2=A0 62.664713] IPv6: ADDRCONF(NETDEV_CHANGE): veth1c2b6f9: = link > > > becomes > > > ready > > > [=C2=A0=C2=A0 62.665407] docker0: port 1(veth1c2b6f9) entered blockin= g > > > state > > > [=C2=A0=C2=A0 62.665656] docker0: port 1(veth1c2b6f9) entered forward= ing > > > state > > > [=C2=A0=C2=A0 62.666394] IPv6: ADDRCONF(NETDEV_CHANGE): docker0: link > > > becomes > > > ready > > > [=C2=A0=C2=A0 63.220542] docker0: port 1(veth1c2b6f9) entered disable= d > > > state > > > [=C2=A0=C2=A0 63.229530] veth2aff680: renamed from eth0 > > > [=C2=A0=C2=A0 63.308290] docker0: port 1(veth1c2b6f9) entered disable= d > > > state > > > [=C2=A0=C2=A0 63.311282] device veth1c2b6f9 left promiscuous mode > > > [=C2=A0=C2=A0 63.311507] docker0: port 1(veth1c2b6f9) entered disable= d > > > state > > > root@isar:~# echo $? > > > 0 > > > root@isar:~# podman images > > > REPOSITORY=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 TAG=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 IMAGE I= D=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 CREATED=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 > > > SIZE > > > quay.io/libpod/alpine=C2=A0 latest=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 9617= 69676411=C2=A0 4 years ago=C2=A0 > > > 5.85 MB > > > root@isar:~# podman run --rm quay.io/libpod/alpine:latest true > > > [=C2=A0=C2=A0 78.274955] cni-podman0: port 1(vethf6fde03e) entered bl= ocking > > > state > > > [=C2=A0=C2=A0 78.275225] cni-podman0: port 1(vethf6fde03e) entered di= sabled > > > state > > > [=C2=A0=C2=A0 78.277667] device vethf6fde03e entered promiscuous mode > > > [=C2=A0=C2=A0 78.626628] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link be= comes > > > ready > > > [=C2=A0=C2=A0 78.627038] IPv6: ADDRCONF(NETDEV_CHANGE): vethf6fde03e:= link > > > becomes ready > > > [=C2=A0=C2=A0 78.627313] cni-podman0: port 1(vethf6fde03e) entered bl= ocking > > > state > > > [=C2=A0=C2=A0 78.627513] cni-podman0: port 1(vethf6fde03e) entered > > > forwarding > > > state > > > [=C2=A0=C2=A0 79.690462] audit: type=3D1400 audit(1722919083.116:6): > > > apparmor=3D"STATUS" operation=3D"profile_load" profile=3D"unconfined" > > > name=3D"containers-default-0.50.1" pid=3D750 comm=3D"apparmor_parser" > > > [=C2=A0=C2=A0 80.574314] cni-podman0: port 1(vethf6fde03e) entered di= sabled > > > state > > > [=C2=A0=C2=A0 80.575874] device vethf6fde03e left promiscuous mode > > > [=C2=A0=C2=A0 80.576060] cni-podman0: port 1(vethf6fde03e) entered di= sabled > > > state > > > root@isar:~# echo $? > > > 0 > > > ``` > > >=20 > > > The same under arm64 fails: > > >=20 > > > ``` > > > root@isar:~# docker images > > > REPOSITORY=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0 TAG=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 IMAGE ID=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 CREATED=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 > > > SIZE > > > quay.io/libpod/alpine=C2=A0=C2=A0 3.10.2=C2=A0=C2=A0=C2=A0 915beeae46= 75=C2=A0=C2=A0 4 years ago=C2=A0=C2=A0 > > > 5.33MB > > > root@isar:~# docker run --rm quay.io/libpod/alpine:3.10.2 true > > > [=C2=A0 407.689016] docker0: port 1(veth81a2857) entered blocking > > > state > > > [=C2=A0 407.689231] docker0: port 1(veth81a2857) entered disabled > > > state > > > [=C2=A0 407.698637] device veth81a2857 entered promiscuous mode > > > [=C2=A0 410.003030] eth0: renamed from vethbe8a124 > > > [=C2=A0 410.026357] IPv6: ADDRCONF(NETDEV_CHANGE): veth81a2857: link > > > becomes > > > ready > > > [=C2=A0 410.026727] docker0: port 1(veth81a2857) entered blocking > > > state > > > [=C2=A0 410.026872] docker0: port 1(veth81a2857) entered forwarding > > > state > > > [=C2=A0 410.767475] docker0: port 1(veth81a2857) entered disabled > > > state > > > [=C2=A0 410.788277] vethbe8a124: renamed from eth0 > > > [=C2=A0 410.941958] docker0: port 1(veth81a2857) entered disabled > > > state > > > [=C2=A0 410.944534] device veth81a2857 left promiscuous mode > > > [=C2=A0 410.944676] docker0: port 1(veth81a2857) entered disabled > > > state > > > docker: Error response from daemon: failed to create shim task: > > > OCI > > > runtime create failed: runc create failed: unable to start > > > container > > > process: exec: "true": executable file not found in $PATH: > > > unknown. > > > root@isar:~# echo $? > > > 127 > > > root@isar:~# podman images > > > REPOSITORY=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 TAG=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 IMAGE I= D=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 CREATED=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 > > > SIZE > > > quay.io/libpod/alpine=C2=A0 latest=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 915b= eeae4675=C2=A0 4 years ago=C2=A0 > > > 5.59 MB > > > root@isar:~# podman run --rm quay.io/libpod/alpine:latest true > > > [=C2=A0 423.567388] cni-podman0: port 1(veth29135974) entered blockin= g > > > state > > > [=C2=A0 423.567593] cni-podman0: port 1(veth29135974) entered disable= d > > > state > > > [=C2=A0 423.569719] device veth29135974 entered promiscuous mode > > > [=C2=A0 423.754420] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes > > > ready > > > [=C2=A0 423.754765] IPv6: ADDRCONF(NETDEV_CHANGE): veth29135974: link > > > becomes ready > > > [=C2=A0 423.755036] cni-podman0: port 1(veth29135974) entered blockin= g > > > state > > > [=C2=A0 423.755183] cni-podman0: port 1(veth29135974) entered > > > forwarding > > > state > > > [=C2=A0 426.090252] cni-podman0: port 1(veth29135974) entered disable= d > > > state > > > [=C2=A0 426.098292] device veth29135974 left promiscuous mode > > > [=C2=A0 426.098455] cni-podman0: port 1(veth29135974) entered disable= d > > > state > > > Error: runc: runc create failed: unable to start container > > > process: > > > exec: "true": executable file not found in $PATH: OCI runtime > > > attempted > > > to invoke a command that was not found > > > root@isar:~# echo $? > > > 127 > > > ``` > > >=20 > > > At first glance this looks like arm64 images are not functional. > > > Continue debugging. > > >=20 > >=20 > > After some debugging I can see that something makes docker prebuilt > > image inside qemu broken. But removing it from and loading to > > docker > > engine again helps: > >=20 > >=20 > > ``` > > root@isar:~# docker images > > REPOSITORY=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 TAG=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 IMAGE ID=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 CREATED=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 = SIZE > > quay.io/libpod/alpine=C2=A0=C2=A0 3.10.2=C2=A0=C2=A0=C2=A0 915beeae4675= =C2=A0=C2=A0 4 years ago=C2=A0=C2=A0 > > 5.33MB > >=20 > > root@isar:~# docker run --rm quay.io/libpod/alpine:3.10.2 true > > [=C2=A0 902.770874] docker0: port 1(veth8275b2c) entered blocking state > > [=C2=A0 902.771066] docker0: port 1(veth8275b2c) entered disabled state > > [=C2=A0 902.777051] device veth8275b2c entered promiscuous mode > > [=C2=A0 904.813519] eth0: renamed from veth2f2256f > > [=C2=A0 904.830269] IPv6: ADDRCONF(NETDEV_CHANGE): veth8275b2c: link > > becomes > > ready > > [=C2=A0 904.830857] docker0: port 1(veth8275b2c) entered blocking state > > [=C2=A0 904.830997] docker0: port 1(veth8275b2c) entered forwarding > > state > > [=C2=A0 904.831407] IPv6: ADDRCONF(NETDEV_CHANGE): docker0: link become= s > > ready > > [=C2=A0 905.372753] docker0: port 1(veth8275b2c) entered disabled state > > [=C2=A0 905.385163] veth2f2256f: renamed from eth0 > > [=C2=A0 905.487707] docker0: port 1(veth8275b2c) entered disabled state > > [=C2=A0 905.491396] device veth8275b2c left promiscuous mode > > [=C2=A0 905.491533] docker0: port 1(veth8275b2c) entered disabled state > > docker: Error response from daemon: failed to create shim task: OCI > > runtime create failed: runc create failed: unable to start > > container > > process: exec: "true": executable file not found in $PATH: unknown. > > ERRO[0003] error waiting for container: context canceled=20 > >=20 > > root@isar:~# echo $? > > 127 > >=20 > > root@isar:~# docker image rm 915beeae4675 > > Untagged: quay.io/libpod/alpine:3.10.2 > > Deleted: > > sha256:915beeae46751fc564998c79e73a1026542e945ca4f73dc841d09ccc6c2c > > 0672 > > Deleted: > > sha256:5e0d8111135538b8a86ce5fc969849efce16c455fd016bb3dc53131bcedc > > 4da5 > >=20 > > root@isar:~# docker images > > REPOSITORY=C2=A0=C2=A0 TAG=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 IMAGE ID= =C2=A0=C2=A0 CREATED=C2=A0=C2=A0 SIZE > >=20 > > root@isar:~# pzstd -c -d /usr/share/prebuilt-docker- > > img/images/quay.io.libpod.alpine\:3.10.2.zst | docker load > > /usr/share/prebuilt-docker- > > img/images/quay.io.libpod.alpine:3.10.2.zst: > > 5598720 bytes=20 > > 5e0d81111355: Loading layer=C2=A0=C2=A0 5.59MB/5.59MB > > Loaded image: quay.io/libpod/alpine:3.10.2 > >=20 > > root@isar:~# docker run --rm quay.io/libpod/alpine:3.10.2 true > > [ 1023.800568] docker0: port 1(veth3eb45d3) entered blocking state > > [ 1023.800790] docker0: port 1(veth3eb45d3) entered disabled state > > [ 1023.805585] device veth3eb45d3 entered promiscuous mode > > [ 1025.295999] eth0: renamed from veth7e4183e > > [ 1025.310388] IPv6: ADDRCONF(NETDEV_CHANGE): veth3eb45d3: link > > becomes > > ready > > [ 1025.310681] docker0: port 1(veth3eb45d3) entered blocking state > > [ 1025.310801] docker0: port 1(veth3eb45d3) entered forwarding > > state > > [ 1025.979813] docker0: port 1(veth3eb45d3) entered disabled state > > [ 1025.990858] veth7e4183e: renamed from eth0 > > [ 1026.087161] docker0: port 1(veth3eb45d3) entered disabled state > > [ 1026.088367] device veth3eb45d3 left promiscuous mode > > [ 1026.088471] docker0: port 1(veth3eb45d3) entered disabled state > >=20 > > root@isar:~# echo $? > > 0 > > ``` > >=20 > > This looks strange. Nothing changed (image hash is the same), but > > the > > second run works well. After rebooting qemu machine it still works. > >=20 > > Podman prebuilt image looks unaffected - it works from the > > beginning. > >=20 >=20 > Strange, all that used to work. You manually reproduced this as well, > not only via the testsuite, right? Let me test again locally... >=20 > Jan >=20 For manual tests I used images taken from CI (that failed). As I could see, the issue in my case was caused by zero-size "/bin/busybox" somewhere in /var/lib/docker/overlay2/. The file was broken and reinstalling the container fixed this. But I guess this was caused by already "spoiled" image that was tested in CI. When I just built (on a local machine) a new image and didn't try to run qemu with it (e.g., didn't modify it), manual running docker image in it worked well.. The busybox binary from alpine container was OK in that case. Continue debugging ... --=20 Best regards, Uladzimir. --=20 You received this message because you are subscribed to the Google Groups "= isar-users" group. To unsubscribe from this group and stop receiving emails from it, send an e= mail to isar-users+unsubscribe@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/= isar-users/f2ed8eaf27f23533a0de6039f0124291edc4ffc6.camel%40ilbers.de.