From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Tue, 06 Aug 2024 06:48:58 +0200 X-Sieve: CMU Sieve 2.4 Received: from mail-wr1-f61.google.com (mail-wr1-f61.google.com [209.85.221.61]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 4764mv3N006647 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Tue, 6 Aug 2024 06:48:57 +0200 Received: by mail-wr1-f61.google.com with SMTP id ffacd0b85a97d-3683794e6a9sf64777f8f.0 for ; Mon, 05 Aug 2024 21:48:57 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1722919731; cv=pass; d=google.com; s=arc-20160816; b=V1yvUcrCa59grBMul14JCqrQxjhPKQtsY18xr8VRDmNODUR8b6owBrJYhfNbYCk7qW dg5BcVu624kvn0Qy3NHKBLnsboxGihH/u349qG+E4qKKdo5k5h/+Ui7jcZiFLkIrwava TyNjluKs0skQeiyMfoOMRy4b6mCh8Biu9aAk8qJFc5/x8s6rzcyTKFxa6RPASbxybSPw XL88W0ai2wDdMd9Jh3bC1kZgBqfwUvHAl0Lc6dLdt8rube1QgySIbWnrxQqZVRMz3agi UE3jgsa//F77IS25paAihQvh2dcNuXe93ir/jdb0R+XgUMQbpYh6p3bgJpsGg1NFXTJJ vH0A== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:user-agent :content-transfer-encoding:autocrypt:references:in-reply-to:date:to :from:subject:message-id:sender:dkim-signature; bh=Mrmi3Q9LfZCQfC/E9uN2hhbhj3CnLCho4oq1KiETgPQ=; fh=6LgGDlIBE3KD/QMW9ByZDH5kocbIzCRFpKz7tm8bs4c=; b=wQ/8Btm/sPZQz7/CsqVZQ18vnifyrTsOGdxzjZi3sKyPwh3kEvV9+21fiQZZVTpQ0b ksH6qMu6vVWyspoZ7IVqp9RMWOYsTUzKTSEAk5W5pz+yc94H9eSHlgVf5p194En0VQNg CudyaTiws9a1K/FTzxTwOwHyRb4zDGAz45dyOswT5ef2ph2TQ9TyEzFQ9J9XuMU+hEtV c2yDr8vtpypb3NeOk7QziBF7qpKz3DgH7KE0Mjrjwq6TEmjbHn6IxV3zPYfCHHoE1IfG Y+CHQcVp5XBjRgaR3gbBZaEdcgvd3LdHcYFs9+iCYIkfW+d1kd1T2cgzdK62u/4Ljaf5 0Vyg==; darn=isar-build.org ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1722919731; x=1723524531; darn=isar-build.org; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:x-original-authentication-results :x-original-sender:mime-version:user-agent:content-transfer-encoding :autocrypt:references:in-reply-to:date:to:from:subject:message-id :sender:from:to:cc:subject:date:message-id:reply-to; bh=Mrmi3Q9LfZCQfC/E9uN2hhbhj3CnLCho4oq1KiETgPQ=; b=sOpXCvPp68VMciXyDu+vAGfy/xRqBYZR/1zt3NwPHmQgSMTy9lWwneKS0hx21pntFC nKmnsohZmIsMdvXrrW7jFQYPvxpN+V5TVg3W5jCcLXzAyvL2xSZY70EW3fVrpi50+lWk 2fG7kR31VzQ5/iinD/qPNVVhpXu40EWoHPmyngC7KjScEmn8+xLTyvRHZHCAgPh4LeXd eQj0PvB5gtoheUkeyWOcGkJeTAz++m/kd2/uv/ARitP6VasO1cQXhgSPecfLhDH5PKdH lcK7/wah9xHVqtEISGTvnLYf6twVP3v/vsjiG3LvSlqooUTQVJd+ogo6B5+Uyk0Lcpnk pMxQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1722919731; x=1723524531; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence :x-original-authentication-results:x-original-sender:mime-version :user-agent:content-transfer-encoding:autocrypt:references :in-reply-to:date:to:from:subject:message-id:x-beenthere :x-gm-message-state:sender:from:to:cc:subject:date:message-id :reply-to; bh=Mrmi3Q9LfZCQfC/E9uN2hhbhj3CnLCho4oq1KiETgPQ=; b=GqGrzTbbKL38GM4B3F7ajZm0nQKmD3f7+MNHlV1azPDKBHI0MFSHtmqbulRbWLPCI+ MPC0ad0jBI7aIW1vGz+TXMXvUkGHs3CSsaJSbSPjVSn/TTJpvBiR4LzqYzVTmhxG3I5D yidAKTCE9wFY/mKjg3ynkUjc5J53oNiymW+QoBLPsqZyswUF4iITP/jIMj/JKp2eVJ1M dwWVgf2h7zijdxAjzFETczFok95RJRQmqzja3JNfpW9eWDUpVRchMMwnNl/vBaQy2ZNF G1vllj6fQ6rnPwSx5bCF2OxHYZH83QeBGzEqpxEx/msvlg49T/aKzh5ozxG39JPT+IN8 kS9A== Sender: isar-users@googlegroups.com X-Forwarded-Encrypted: i=2; AJvYcCXN0k5pyDENacBSJNFrX7kTZG8DMp4H0kNiER59FR5ZqtqrD/beeS3xhN1Hus/WeKzcaDw=@isar-build.org X-Gm-Message-State: AOJu0Yz+ICQiHfx58qvw8eZrVJobR7ZyF7gYqMyGNfxvbUq77G5Mbthg ANVW6cElCG7Li8JX4HXuKfrS23NKSqd090YaTA7EOcvZRWzVt378 X-Google-Smtp-Source: AGHT+IFFDbie9v434O/yNjEMb0TSk7QEDwM2hKLUOB0+EXWiJxa9IShcCoFOkJbODMmBF0T0/rMRjw== X-Received: by 2002:a05:600c:19d3:b0:427:9f6f:9c00 with SMTP id 5b1f17b1804b1-428e6ba92e9mr61249125e9.6.1722919730867; Mon, 05 Aug 2024 21:48:50 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:600c:3b08:b0:426:ab3f:fafb with SMTP id 5b1f17b1804b1-428ede1cccfls13172295e9.1.-pod-prod-04-eu; Mon, 05 Aug 2024 21:48:48 -0700 (PDT) X-Forwarded-Encrypted: i=2; AJvYcCWfhOK1SjegXM9gV6D2qL9YuuvvV9IypRKsHJ20qXjoQjPerbA6Udo5RtfHgh7rKSQl7Xfs+YbAovxL+o+SIYs+HhtaNQxTStxvDiQ= X-Received: by 2002:a05:600c:314a:b0:426:6688:2421 with SMTP id 5b1f17b1804b1-428e6b059a6mr83576715e9.11.1722919727993; Mon, 05 Aug 2024 21:48:47 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1722919727; cv=none; d=google.com; s=arc-20160816; b=SdRwwSBCa9OuuQWhCpK0z7u9yedvcr//4eFtMMREMtbeM2gYFoNLOQFzQDJmzX8Nfp amtdNaOmnjxT/if21kLo1LgOA0dTyF/2HvHPvnxlX3N+zlTzIJhhO/opdVYDGBcMfTOw 3HFfALRZxY14Lafqbx6dDvO9RAWkTeFzWP5gjdsAKXK+LBCCqk+bnSt2T/REnfkzXBkE lO5zR5bJ7AG/9XeT0O+MizRdnCYBW0dowyKVwOzDxBwpyY8YRBjwP3iHf0hZLbmLkbbv 5QefyeFtrny3bqrkebrzG+xxg32uPbfI++RTx4sP3pohUB5DxU9UO6kw1wZ7wvKB8UyO +Z3A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:user-agent:content-transfer-encoding:autocrypt :references:in-reply-to:date:to:from:subject:message-id; bh=YujYbG8sYFScHRt62gIzP+Kj9aAL5HnjQM06XigMCa0=; fh=O+ZMFUiiuyZKsfz7Fw8hsdknZlxcSFSsLsCydBEGD0o=; b=bVzhci5pGIZBsp8H9DTk2vAmkcolOEOCxoN5Bwq/xmtnPMFQ7ZEjCSsLH/jHkdMeEq /SoVLtqt/RxQ0/AeRD7psFMfHM9/YmuZMIs/+jPdVoFgDe+ZvFeKDe3dO6GVKwsKQywP VmvX5ATkDX2ewapTA+pDRegDCuljBv/URR/21+4gT+JRqRW2z0uKCM5ncZP7r8H7R+8m WjjlWMqQXJyP0bsfdjMHmZLiFcll6sB1mSO7jnczLBBwtlutbn9o7TqJ19lU6KaFzs38 Uxv+VJJXl4LXNpiLKlDfFhFnsoDJ3HWaTHbP80vcHdRYoDRJPqoRkRqeNvrd0XCMEE9S IyPg==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id 5b1f17b1804b1-428e6e710a9si2229815e9.2.2024.08.05.21.48.47 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Mon, 05 Aug 2024 21:48:47 -0700 (PDT) Received-SPF: pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Received: from [IPv6:::1] (host-80-81-17-52.static.customer.m-online.net [80.81.17.52]) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 4764mjxT006631 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 6 Aug 2024 06:48:46 +0200 Message-ID: Subject: Re: [PATCH] ci: Add test cases for container fetching and loading From: Uladzimir Bely To: Jan Kiszka , isar-users@googlegroups.com Date: Tue, 06 Aug 2024 07:48:45 +0300 In-Reply-To: References: <20240805071755.19853-1-ubely@ilbers.de> Autocrypt: addr=ubely@ilbers.de; prefer-encrypt=mutual; keydata=mQENBGO2eUkBCACtT+T3OrPVSExBmqfgXT3lp9XcdxRzjYp26wezkgYjjBXaf36bxtaAf S471VoQtpar0RVeFfW7WDDdfX9ZclSj36zBQe+RVSJzoNoNQfjOXWuSHb5Z+cpAFtqBY4muxK4+ia IlLJd6CN3ejOsLHATtCeHHq8wi0z2T+KdLQO+wQRgo2hjj0Lp9pGTrKJry50HP/o7Vbdu14dOx2xq r8+wPc6SQbBIrcqaa4MqCQC00vQG7eXvo+k2MOw59FDdpMH0KR9mHgp3u/s4I+4YRBArukt9G9xz/ rsEFmxAIBC6N/a6Hzwg4puc91n7ABDsPg8Vp+X3MDraujN0dvR6OKVNtABEBAAG0IFVsYWR6aW1pc iBCZWx5IDx1YmVseUBpbGJlcnMuZGU+iQFOBBMBCAA4FiEEJqPNVhVGyk12Eh+PAUQYBM/2FkoFAm O2eUkCGwMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQAUQYBM/2FkprlAgAmuna8Hm9EyoEtTl DBGDg6Zm4ZLp5ffvZBE946h92jepDrteoxsJ7pSzJVC2HmDLa4iZUao7lLLbDsUj5x45/iLJcqBZK k3YnAxP2r6a+kI+1VVQY1pxdG1nlJAbdNzoojm/qmezNPSrqni61KVMQKsXBCWhIjSXDSM9CsBj21 a+9qaVqfxovJGTn9lgrZO+xzKQNMKZeOouJlscVuFj21P0ww3/YENiU/nMeTSuYypO76mDtAd08Jo nc3yuHa9MJGei5ixN3wT+IrGR2aL2hdw2M6NgH7sYbL2Zi4ugD6RXHJai1Bh2yvFSVqSQ+M6QOInT 4ud7wslm1XRB065dXtA== Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable User-Agent: Evolution 3.52.3 (by Flathub.org) MIME-Version: 1.0 X-Spam-Status: No, score=-4.6 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_EF,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,RCVD_IN_MSPIKE_H2,RCVD_IN_RP_CERTIFIED, RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-Original-Sender: ubely@ilbers.de X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-TUID: LyGclL2hwwiZ On Mon, 2024-08-05 at 13:51 +0300, Uladzimir Bely wrote: > On Mon, 2024-08-05 at 12:43 +0200, Jan Kiszka wrote: > > On 05.08.24 11:40, Uladzimir Bely wrote: > > > On Mon, 2024-08-05 at 11:17 +0200, Jan Kiszka wrote: > > > > On 05.08.24 09:16, Uladzimir Bely wrote: > > > > > From: Jan Kiszka > > > > >=20 > > > > > This plugs the two example recipes for loading container > > > > > images > > > > > into > > > > > VM-based testing. The test consists of running 'true' in the > > > > > installed > > > > > alpine images. > > > > >=20 > > > > > Rather than enabling the ci user to do password-less sudo, > > > > > this > > > > > uses su > > > > > with the piped-in password. Another trick needed is to poll > > > > > for > > > > > the > > > > > images because loading is performed asynchronously. > > > > >=20 > > > > > Signed-off-by: Jan Kiszka > > > > > Signed-off-by: Uladzimir Bely > > > > > --- > > > > > =C2=A0.../recipes-core/images/isar-image-ci.bb=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 |=C2=A0 2 ++ > > > > > =C2=A0testsuite/citest.py=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 | 24 > > > > > +++++++++++++++++++ > > > > > =C2=A02 files changed, 26 insertions(+) > > > > >=20 > > > > > This is a drop-in replacement of patch 4 from "[PATCH v4 0/5] > > > > > Introduce > > > > > container fetcher and pre-loader" series: > > > > > - Fixed syntax errors (incorrectly escaped '\$') > > > >=20 > > > > IIRC, we do need the escape inside the shell (sh -c '...'). So, > > > > you > > > > likely rather need to escape the escape character. > > > >=20 > > > > Jan > > > >=20 > > > > >=20 > > >=20 > > > I just tried to make a simple check: > > >=20 > > > ``` > > > $ su -c 'for i in $(seq 3); do echo $i; done' > > > Password:=20 > > > 1 > > > 2 > > > 3 > > >=20 > > > $ su -c 'for i in \$(seq 3); do echo $i; done' > > > Password:=20 > > > bash: -c: line 1: syntax error near unexpected token `(' > > > bash: -c: line 1: `for i in \$(seq 3); do echo $i; done' > > >=20 > > > $ su -c 'for i in \\$(seq 3); do echo $i; done' > > > Password:=20 > > > \1 > > > 2 > > > 3 > > > ``` > > >=20 > > > We are likely don't need escaping at all. > >=20 > > Interesting - anyway, if this sequence is not properly resolved, > > the > > test will fail. And I assume you had it running successfully, so we > > must > > be fine. > >=20 > > >=20 > > > Anyway, we could just convert the tests from "cmd=3D > > to "script=3Dtest_prebuild_container.sh" and have test logic in a > > > human- > > > readable form. > > >=20 > >=20 > > Also fine with me. > >=20 > > Jan > >=20 >=20 > OK, I've already prepared the script internally and will check in CI > with it. >=20 ... and still having problems with running commands inside arm64 container. I manually run (with same command-line as CI does) qemuamd64 and qemuarm64 images. Running prebuilt container in amd64 machine works well: ``` root@isar:~# docker images REPOSITORY TAG IMAGE ID CREATED SIZE quay.io/libpod/alpine 3.10.2 961769676411 4 years ago 5.58MB root@isar:~# docker run --rm quay.io/libpod/alpine:3.10.2 true [ 61.233873] docker0: port 1(veth1c2b6f9) entered blocking state [ 61.234280] docker0: port 1(veth1c2b6f9) entered disabled state [ 61.240243] device veth1c2b6f9 entered promiscuous mode [ 62.650328] eth0: renamed from veth2aff680 [ 62.664713] IPv6: ADDRCONF(NETDEV_CHANGE): veth1c2b6f9: link becomes ready [ 62.665407] docker0: port 1(veth1c2b6f9) entered blocking state [ 62.665656] docker0: port 1(veth1c2b6f9) entered forwarding state [ 62.666394] IPv6: ADDRCONF(NETDEV_CHANGE): docker0: link becomes ready [ 63.220542] docker0: port 1(veth1c2b6f9) entered disabled state [ 63.229530] veth2aff680: renamed from eth0 [ 63.308290] docker0: port 1(veth1c2b6f9) entered disabled state [ 63.311282] device veth1c2b6f9 left promiscuous mode [ 63.311507] docker0: port 1(veth1c2b6f9) entered disabled state root@isar:~# echo $? 0 root@isar:~# podman images REPOSITORY TAG IMAGE ID CREATED SIZE quay.io/libpod/alpine latest 961769676411 4 years ago 5.85 MB root@isar:~# podman run --rm quay.io/libpod/alpine:latest true [ 78.274955] cni-podman0: port 1(vethf6fde03e) entered blocking state [ 78.275225] cni-podman0: port 1(vethf6fde03e) entered disabled state [ 78.277667] device vethf6fde03e entered promiscuous mode [ 78.626628] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready [ 78.627038] IPv6: ADDRCONF(NETDEV_CHANGE): vethf6fde03e: link becomes ready [ 78.627313] cni-podman0: port 1(vethf6fde03e) entered blocking state [ 78.627513] cni-podman0: port 1(vethf6fde03e) entered forwarding state [ 79.690462] audit: type=3D1400 audit(1722919083.116:6): apparmor=3D"STATUS" operation=3D"profile_load" profile=3D"unconfined" name=3D"containers-default-0.50.1" pid=3D750 comm=3D"apparmor_parser" [ 80.574314] cni-podman0: port 1(vethf6fde03e) entered disabled state [ 80.575874] device vethf6fde03e left promiscuous mode [ 80.576060] cni-podman0: port 1(vethf6fde03e) entered disabled state root@isar:~# echo $? 0 ``` The same under arm64 fails: ``` root@isar:~# docker images REPOSITORY TAG IMAGE ID CREATED SIZE quay.io/libpod/alpine 3.10.2 915beeae4675 4 years ago 5.33MB root@isar:~# docker run --rm quay.io/libpod/alpine:3.10.2 true [ 407.689016] docker0: port 1(veth81a2857) entered blocking state [ 407.689231] docker0: port 1(veth81a2857) entered disabled state [ 407.698637] device veth81a2857 entered promiscuous mode [ 410.003030] eth0: renamed from vethbe8a124 [ 410.026357] IPv6: ADDRCONF(NETDEV_CHANGE): veth81a2857: link becomes ready [ 410.026727] docker0: port 1(veth81a2857) entered blocking state [ 410.026872] docker0: port 1(veth81a2857) entered forwarding state [ 410.767475] docker0: port 1(veth81a2857) entered disabled state [ 410.788277] vethbe8a124: renamed from eth0 [ 410.941958] docker0: port 1(veth81a2857) entered disabled state [ 410.944534] device veth81a2857 left promiscuous mode [ 410.944676] docker0: port 1(veth81a2857) entered disabled state docker: Error response from daemon: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: exec: "true": executable file not found in $PATH: unknown. root@isar:~# echo $? 127 root@isar:~# podman images REPOSITORY TAG IMAGE ID CREATED SIZE quay.io/libpod/alpine latest 915beeae4675 4 years ago 5.59 MB root@isar:~# podman run --rm quay.io/libpod/alpine:latest true [ 423.567388] cni-podman0: port 1(veth29135974) entered blocking state [ 423.567593] cni-podman0: port 1(veth29135974) entered disabled state [ 423.569719] device veth29135974 entered promiscuous mode [ 423.754420] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready [ 423.754765] IPv6: ADDRCONF(NETDEV_CHANGE): veth29135974: link becomes ready [ 423.755036] cni-podman0: port 1(veth29135974) entered blocking state [ 423.755183] cni-podman0: port 1(veth29135974) entered forwarding state [ 426.090252] cni-podman0: port 1(veth29135974) entered disabled state [ 426.098292] device veth29135974 left promiscuous mode [ 426.098455] cni-podman0: port 1(veth29135974) entered disabled state Error: runc: runc create failed: unable to start container process: exec: "true": executable file not found in $PATH: OCI runtime attempted to invoke a command that was not found root@isar:~# echo $? 127 ``` At first glance this looks like arm64 images are not functional. Continue debugging. --=20 Best regards, Uladzimir. --=20 You received this message because you are subscribed to the Google Groups "= isar-users" group. To unsubscribe from this group and stop receiving emails from it, send an e= mail to isar-users+unsubscribe@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/= isar-users/f6d6becbe36b069a1d660266a18e69f4223ceddd.camel%40ilbers.de.