From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 6631438923266523136 X-Received: by 2002:a2e:5d84:: with SMTP id v4-v6mr2061598lje.4.1544004279590; Wed, 05 Dec 2018 02:04:39 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a2e:1259:: with SMTP id t86-v6ls2729754lje.13.gmail; Wed, 05 Dec 2018 02:04:39 -0800 (PST) X-Google-Smtp-Source: AFSGD/WHoBqlc+u30zNkJ+qQtgnIgfVN6DNQyLiu0Ihv+frakC0i9Rd78d/lYgHYp711MymG87ZE X-Received: by 2002:a2e:9053:: with SMTP id n19-v6mr2187550ljg.12.1544004279096; Wed, 05 Dec 2018 02:04:39 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1544004279; cv=none; d=google.com; s=arc-20160816; b=qNt7/KslCb2CJgfY40sPlKPtSNJk23iytBhdtazAb156DlZ1CCzM27LpWn1XONis1h NV5u1KovbEWJfLPlx3+N42R7/gD5vmvuQvsy4Bn5RjHGUC4tSWD8bMjc+fksD2jeJFay ct5owInFRe6hQLf23O59CH9XjH0yIf4cHEL9fcDOJYy98OwIJhIAJjmf3b8yFzLfSDwu d1uHmsL9+Fg5TK0ZgAlpjuWcvHcemdCQNqscs4Q/4lCqKwuFwT2cB2BAHO1rNwwaEPbv oh8yLuNtAsd2OdJBHRAZPOciGifbO2E9eAbkF3U8flaDlmP5MUhbs1kq2k1YYNlCopO/ +ZMw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:content-language:in-reply-to:mime-version :user-agent:date:message-id:from:references:cc:to:subject; bh=5ND3o9vYDf8qbLaRKJJju1+ZX/pmL1AbIvaK/5Hglnw=; b=AGB9hyZ87FqHcNXZRBY3L2XdiRR23OPammu6hwNUdwNrbPH5kt5mSDPJlbR4Gblmq/ I5JRAJ0g+KhhjhBhanGe97+grpO5l0ns2rIvYpES/F4xcKlFelCgQNdAP/EnYiTejACs lvdXLsjOdD3J08PKb+yie6+UeA89FfobSX8OF38bA6gSOhg1yi22S6WxYethbKRxougk ilOy1rXUptvNwJsKaZ9oU5kLl8nxZCgmaJQGVh6mFMFXSF/t9mtk936CAZWjxfZdqlO3 7nVPA0IHTOufJ4Sa5s9jOfEL5JTP/YFE3+WSV4nWVAgZbuTp90IlKPXNUrHXs6Uovp+U In+Q== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of jan.kiszka@siemens.com designates 194.138.37.39 as permitted sender) smtp.mailfrom=jan.kiszka@siemens.com Return-Path: Received: from lizzard.sbs.de (lizzard.sbs.de. [194.138.37.39]) by gmr-mx.google.com with ESMTPS id e17-v6si645853ljg.5.2018.12.05.02.04.38 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 05 Dec 2018 02:04:39 -0800 (PST) Received-SPF: pass (google.com: domain of jan.kiszka@siemens.com designates 194.138.37.39 as permitted sender) client-ip=194.138.37.39; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of jan.kiszka@siemens.com designates 194.138.37.39 as permitted sender) smtp.mailfrom=jan.kiszka@siemens.com Received: from mail2.sbs.de (mail2.sbs.de [192.129.41.66]) by lizzard.sbs.de (8.15.2/8.15.2) with ESMTPS id wB5A4cEl001035 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Wed, 5 Dec 2018 11:04:38 +0100 Received: from [139.22.40.116] ([139.22.40.116]) by mail2.sbs.de (8.15.2/8.15.2) with ESMTP id wB5A4bwJ026700; Wed, 5 Dec 2018 11:04:37 +0100 Subject: Re: [PATCH 1/3] ci: Wait for bitbake worker to finish before deleting artifacts To: "Maxim Yu. Osipov" , isar-users Cc: Cedric Hombourger References: <4a738881362bc31233c348ca6cb051163f5d5a26.1544002190.git.jan.kiszka@siemens.com> <09dc1e24-4ac4-32d5-5dc4-054e6725a05b@ilbers.de> From: Jan Kiszka Message-ID: Date: Wed, 5 Dec 2018 11:04:37 +0100 User-Agent: Mozilla/5.0 (X11; U; Linux i686 (x86_64); de; rv:1.8.1.12) Gecko/20080226 SUSE/2.0.0.12-1.1 Thunderbird/2.0.0.12 Mnenhy/0.7.5.666 MIME-Version: 1.0 In-Reply-To: <09dc1e24-4ac4-32d5-5dc4-054e6725a05b@ilbers.de> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-TUID: 5AXhbdlzoki5 On 05.12.18 10:59, Maxim Yu. Osipov wrote: > On 12/5/18 12:29 PM, Jan Kiszka wrote: >> From: Jan Kiszka >> >> bitbake completes asynchronously to the worker daemon. Therefore, we >> must not start deleting its tmp folder before the termination because it >> may contain active mounts. >> >> Wait for the socket that links frontend and backend to go away. This is >> a reliably sign that the worker finished as well. >> >> Signed-off-by: Jan Kiszka >> --- >>   scripts/ci_build.sh | 1 + >>   1 file changed, 1 insertion(+) >> >> diff --git a/scripts/ci_build.sh b/scripts/ci_build.sh >> index 20b77b7..aae9084 100755 >> --- a/scripts/ci_build.sh >> +++ b/scripts/ci_build.sh >> @@ -92,6 +92,7 @@ if [ -n "$FAST_BUILD" ]; then >>           multiconfig:qemuarm-stretch:isar-image-base \ >>           multiconfig:qemuarm64-stretch:isar-image-base \ >>           multiconfig:qemuamd64-stretch:isar-image-base >> +    while [ -e bitbake.sock ]; do sleep 1; done > > I'm OK with this change, but this doesn't solve problems > with hangs - when commands are launched by hand: > > Command 1) > bitbake  -c cache_base_repo multiconfig:qemuarm-stretch:isar-image-base > multiconfig:qemuarm64-stretch:isar-image-base multiconfig:qemuamd64- > stretch:isar-image-base > > At this step I've doublechecked  that bitbake.sock is cleaned. > Command 2) > sudo rm -rf tmp > > Command 3) > sed -i -e 's/#ISAR_USE_CACHED_BASE_REPO ?= "1"/ISAR_USE_CACHED_BASE_REPO ?= > "1"/g' conf/local.conf > > No problems detected at this point - the same mounts etc. > > The next command hangs on the last task (according strace bitbake tries to > unmount /sys /dev) Again: What is the pstree of that? Where does the hang come from, what parameters were passed etc.? What is holding the mount point? We really need to understand the problem, not just paper over it. Jan > > Command 4) > bitbake multiconfig:qemuarm-stretch:isar-image-base > multiconfig:qemuarm64-stretch:isar-image-base > multiconfig:qemuamd64-stretch:isar-image-base > > Maxim. > >>       sudo rm -rf tmp >>       sed -i -e 's/#ISAR_USE_CACHED_BASE_REPO ?= "1"/ISAR_USE_CACHED_BASE_REPO >> ?= "1"/g' conf/local.conf >>       bitbake $BB_ARGS \ >> > > -- Siemens AG, Corporate Technology, CT RDA IOT SES-DE Corporate Competence Center Embedded Linux