From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 6629320495720300544 X-Received: by 2002:a17:906:6899:: with SMTP id n25-v6mr3469442ejr.11.1543944694749; Tue, 04 Dec 2018 09:31:34 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a17:906:5a09:: with SMTP id p9-v6ls3716313ejq.3.gmail; Tue, 04 Dec 2018 09:31:34 -0800 (PST) X-Google-Smtp-Source: AFSGD/X5V60PMNi66Ou2nsFIat9YwOZzZiYkdfZmRZ+16I3vEYbb75B93N3ZtyWHcTocg3+QLFN4 X-Received: by 2002:a17:906:6899:: with SMTP id n25-v6mr3469439ejr.11.1543944694194; Tue, 04 Dec 2018 09:31:34 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1543944694; cv=none; d=google.com; s=arc-20160816; b=fatHqeeVjhznp9AO1ROtdokBdZmlol2OK9gwuhV+Rw3CIvMqEBMDxbUCbqFHR0C7h+ M2vId8mqHv8KwjcT2fUPM6K5asM1VWtGBKPNBfB+8gcnXDfB9BqDRwSe8u2FK3ZOlkLe UVdjPGPvpszElimO+DlJ8pSTyK8rakCCnWzVZvtJzYxTXWs5kZ141FkAWIiK8mAvVlwz 7wJR4joV9Hu7fFRAL3CVOWf0lYWrYQZQ2tCe0LfdBCQ+HixSvwHoZRtsWz3cisjW1uvz AHaySKD91SHfaLFgl3ad5sewU/xgsXPkpXefgLvip7N7xfOJGe2KWkJPKR6doshiYThm j32g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:content-language:in-reply-to:mime-version :user-agent:date:message-id:references:cc:to:from:subject; bh=A261peNDLSQhvTqb7FBNskN6k0zHRZEflWLbeOumSJ4=; b=FDbHiDOJ8S0pP+b3ymqzLnQIRuixLxPUWV9dTIZI4FxdKirfsXHp8JWFFeTbwJOhb+ qCZZSJs0k0gWOr+eQkBapanEZnZQWBmaTk/B+BioFLSt1xPNMo0fJ8dqohHBx4gIjHgB ltrQHa1010DmEu917N31gSamhZf4IhXkkM97g6u38kxLrirb+XIbyAOIpCOwTLi2c0vv uoB2wer4sAYPwGZ4fY9qSqm5e7oZsFJ2S24vGm8JeE2if5Xo8oAzE6o7jBX1llxN1d7o U8ZFpfrg+HoIGP79yjQe3X+vGXFBmYrH7DdE58D9N8UxXdLzqYTpIXg0vV09c42Tz/y2 eclA== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of jan.kiszka@siemens.com designates 192.35.17.28 as permitted sender) smtp.mailfrom=jan.kiszka@siemens.com Return-Path: Received: from goliath.siemens.de (goliath.siemens.de. [192.35.17.28]) by gmr-mx.google.com with ESMTPS id d10-v6si554176ejx.0.2018.12.04.09.31.34 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 04 Dec 2018 09:31:34 -0800 (PST) Received-SPF: pass (google.com: domain of jan.kiszka@siemens.com designates 192.35.17.28 as permitted sender) client-ip=192.35.17.28; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of jan.kiszka@siemens.com designates 192.35.17.28 as permitted sender) smtp.mailfrom=jan.kiszka@siemens.com Received: from mail2.sbs.de (mail2.sbs.de [192.129.41.66]) by goliath.siemens.de (8.15.2/8.15.2) with ESMTPS id wB4HVX91003958 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Tue, 4 Dec 2018 18:31:33 +0100 Received: from [167.87.41.97] ([167.87.41.97]) by mail2.sbs.de (8.15.2/8.15.2) with ESMTP id wB4HVVw6032519; Tue, 4 Dec 2018 18:31:32 +0100 Subject: Re: [PATCH] isar-bootstrap: Fix and cleanup bind mounting From: Jan Kiszka To: "Maxim Yu. Osipov" , "Hombourger, Cedric" Cc: Henning Schild , isar-users References: <6f5714bc-d5f5-c08f-c408-b32bab9169fc@siemens.com> <20181129193929.61a35056@md1za8fc.ad001.siemens.net> <2229f975-0752-ebe3-c165-979e1d5864b2@siemens.com> <61a6a17c-06e0-a13b-591e-3ea8bc09632e@ilbers.de> <405c22d0-48cd-4ea4-4c1b-c78e6c5570ed@siemens.com> <3daa2bd836424990a478b3981f9ca222@svr-ies-mbx-02.mgc.mentorg.com> <66f3fd81-c996-2583-f0d5-ce9db583fe24@siemens.com> Message-ID: <11ebd9a0-58ac-05a6-18e3-502497cb1201@siemens.com> Date: Tue, 4 Dec 2018 18:31:31 +0100 User-Agent: Mozilla/5.0 (X11; U; Linux i686 (x86_64); de; rv:1.8.1.12) Gecko/20080226 SUSE/2.0.0.12-1.1 Thunderbird/2.0.0.12 Mnenhy/0.7.5.666 MIME-Version: 1.0 In-Reply-To: <66f3fd81-c996-2583-f0d5-ce9db583fe24@siemens.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-TUID: tZk5VzmGRYzg On 04.12.18 18:10, Jan Kiszka wrote: > On 04.12.18 17:59, Maxim Yu. Osipov wrote: >> Hi Jan, Cedric, >> >> Another question: >> >> Which debian/kernel do you use inside your VM/docker? > > Container is kasproject/kas-isar:latest here, kernel is $random-host. > >> >> Is it also stretch? > > Yes. > >> >> The problem is reproducible at the the same point on stretch systems (with >> kernel SMP Debian 4.9.110-3+deb9u6 (2018-10-08) x86_64 GNU/Linux) >> >> when commands are launched by hand: > > What was your Isar baseline for that? I tested with this branch: > > https://github.com/siemens/isar/commit/03e394b2aa58b5b1404fde76881774baf4a541bc > >> >> Command 1) >> bitbake  -c cache_base_repo multiconfig:qemuarm-stretch:isar-image-base >> multiconfig:qemuarm64-stretch:isar-image-base multiconfig:qemuamd64- >> stretch:isar-image-base > > Did you check if everything was unmounted at this point already? > >> >> Command 2) >> sudo rm -rf tmp >> >> Command 3) >> sed -i -e 's/#ISAR_USE_CACHED_BASE_REPO ?= "1"/ISAR_USE_CACHED_BASE_REPO ?= >> "1"/g' conf/local.conf >> >> No problems detected at this point - the same mounts etc. >> >> The next command hungs on the last task (according strace bitbake tries to >> unmount /sys /dev) > > And who is holding back that mounts (lsof)? How does pstree -apl look like? > > BTW, can you recover the build system for this stage? As I said, one of the > symptoms or side-effect is removal of device nodes on those side when /dev is > mounted at the wrong time. > It's also worth trying if any of these hunks help: diff --git a/meta/classes/isar-events.bbclass b/meta/classes/isar-events.bbclass index b3ce434..b2607b6 100644 --- a/meta/classes/isar-events.bbclass +++ b/meta/classes/isar-events.bbclass @@ -18,7 +18,7 @@ python isar_handler () { with open('/proc/mounts', 'rU') as f: for line in f: if basepath in line: - if subprocess.call('sudo umount ' + line.split()[1], + if subprocess.call('sudo umount -l ' + line.split()[1], stdout=devnull, stderr=devnull, shell=True) != 0: result = False diff --git a/scripts/ci_build.sh b/scripts/ci_build.sh index 20b77b7..aae9084 100755 --- a/scripts/ci_build.sh +++ b/scripts/ci_build.sh @@ -92,6 +92,7 @@ if [ -n "$FAST_BUILD" ]; then multiconfig:qemuarm-stretch:isar-image-base \ multiconfig:qemuarm64-stretch:isar-image-base \ multiconfig:qemuamd64-stretch:isar-image-base + while [ -e bitbake.sock ]; do sleep 1; done sudo rm -rf tmp sed -i -e 's/#ISAR_USE_CACHED_BASE_REPO ?= "1"/ISAR_USE_CACHED_BASE_REPO ?= "1"/g' conf/local.conf bitbake $BB_ARGS \ Jan -- Siemens AG, Corporate Technology, CT RDA IOT SES-DE Corporate Competence Center Embedded Linux