From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 6693749539433611264 X-Received: by 2002:a5d:51d0:: with SMTP id n16mr41347315wrv.167.1558516206687; Wed, 22 May 2019 02:10:06 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a5d:6812:: with SMTP id w18ls444057wru.2.gmail; Wed, 22 May 2019 02:10:06 -0700 (PDT) X-Google-Smtp-Source: APXvYqymoCo1xwZnYjDPmDTE4JNztBC1UkWP+f6/vJfS0XETUMJDLuYlcB+Aa4RRU3fzKBPLutuE X-Received: by 2002:a5d:494e:: with SMTP id r14mr2141470wrs.333.1558516206302; Wed, 22 May 2019 02:10:06 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1558516206; cv=none; d=google.com; s=arc-20160816; b=LibsybicYuIxPh517ujkqMceBpXB750iTkM3FheCjqutMYvOAx90mieEI1G7JMm4P+ caS/QMqSqOXhgP9hjOELDjEjoMEAtEZXCuxRuxpB8oIxl6kj4QWxu8wSwv6y34zTiZKq F4nk/LhouhgLsG1gGEhFgS9ZJkTNgxFoaYVS31/zNEZdjC/vsvaQYRbMXBEQpDpesQUv a86kBCadBxrhRH9EyZQjiz9MiKt6jdk8HODMxNcLJAJJv5vW6tuvO1rsZrow1mSUeO7A aQbqZm+I7uAEioazWJ9D/73awG+CZOPOs9yWXMfyf1DYXL+b1BwyeBZD2shEjYa/0dw4 tCBQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:content-language:in-reply-to:mime-version :user-agent:date:message-id:from:references:to:subject; bh=z6NJu0CoB4RGAIImDTN1UfXobv4ReoODxT7KEFb7dXY=; b=P56cjvXrnlKXn0HcnxyCLG7u+lLlLsVIQKe5dmaQcnF6BgFjmfyKFRr0uZRObFuuOd cKzzZaD1gxLmnCuuuV3wgMEreXd9fO4FUUu3Nci+uWC+8XKpqn84nM1o5WT6j2c+Cc5q b4xybWWiXCSz0De+JTnHAPJ0eFe0flWMThVaHRxREZqlEGXGX/ecSSYxTGBsfSK+ZgWW ELBsp3t6HWMk1FM/q/iGxAQQUXDgRo7w7BeLDOeGu6HQN5pWElaS/V8HnVuAN4BKA0+I K9NkGYstT004UOa9ptNVnKS6tYPx6vDSTQ/jDs1Ps+XgGEpC2ABcsiWGfQ4ehFXhz+b3 FByQ== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of claudius.heine.ext@siemens.com designates 192.35.17.28 as permitted sender) smtp.mailfrom=claudius.heine.ext@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Return-Path: Received: from goliath.siemens.de (goliath.siemens.de. [192.35.17.28]) by gmr-mx.google.com with ESMTPS id y70si308588wmd.0.2019.05.22.02.10.06 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 22 May 2019 02:10:06 -0700 (PDT) Received-SPF: pass (google.com: domain of claudius.heine.ext@siemens.com designates 192.35.17.28 as permitted sender) client-ip=192.35.17.28; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of claudius.heine.ext@siemens.com designates 192.35.17.28 as permitted sender) smtp.mailfrom=claudius.heine.ext@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Received: from mail2.sbs.de (mail2.sbs.de [192.129.41.66]) by goliath.siemens.de (8.15.2/8.15.2) with ESMTPS id x4M9A5x4022779 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Wed, 22 May 2019 11:10:05 +0200 Received: from [139.25.69.232] (linux-ses-ext02.ppmd.siemens.net [139.25.69.232]) by mail2.sbs.de (8.15.2/8.15.2) with ESMTP id x4M9A5w6020761; Wed, 22 May 2019 11:10:05 +0200 Subject: Re: [DISCUSSIONS] CI build To: "Maxim Yu. Osipov" , isar-users References: <5128c754-55f8-924b-365c-2d529131bd3a@ilbers.de> From: Claudius Heine Message-ID: <16e80d33-4f24-8b5a-de02-c02a90cc2c77@siemens.com> Date: Wed, 22 May 2019 11:10:05 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.6.1 MIME-Version: 1.0 In-Reply-To: <5128c754-55f8-924b-365c-2d529131bd3a@ilbers.de> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-TUID: ULB6Tzhju8cE Hi Maxim, On 22/05/2019 10.20, Maxim Yu. Osipov wrote: > On 5/22/19 9:26 AM, Claudius Heine wrote: [...] >>     -> Configuration of the environment is not controllable from the >> repository: Installed packages, System configuration (locales), >> Distribution, etc. > > In my opinion we need to have some "reference" common (better as minimal > as possible) environment, to avoid a zoo of different environments... Well the more different environments to test against the more you can find bugs. If we don't want that, then we should deliver a such and environment together with isar. [...] > >>     -> Cannot be spread over multiple servers >>     -> Giant log file, that makes it difficult to figure out exactly >> which command or test case caused an issue to reproduce that locally > > Your project is configured with -q (quiet) option and doesn't generate > huge trace - it becomes verbose only on encountered errors - > I had no problems with such log file as you can easily find the > encountered error and always analyze the build workspace which is not > cleaned up for the last build. > > Just have a look at your latest build > http://isar-build.org:8080/job/isar_claudius_ilbers-ci/64/console > it took for me 10 seconds to locate the failed recipe. Well its not always about a failed recipe. The ci_build.sh script now contains multiple different calls to bitbake, but we don't see those calls in the log. There is also no mention about other calls, like sed which changes the configuration. > >>   - Manually triggering of build jobs >>     -> After pushing of CI branch, build has to be triggered via button > > One may enable such build trigger (I believe that such trigger is > enabled for Henning's project). but from my user's experience I prefer > to start the build manually. I normally just push to the ci branch when I want to start tests. > > Of course, overnights builds are started periodically. > > See for details: > https://wiki.jenkins.io/display/JENKINS/Building+a+software+project > >>     -> Patches on ML should be automatically tested and reported back >> to ML (that only makes sense if the build is reliable though) > > Do we really want such feature? > My concern is that ML will be polluted by such reports... You are currently testing and reporting back manually, if instead of you some bot would do that automatically, then I don't how that would increase the noise on the ML. But as I said that only makes sense if the false positive and negative rates of CI is lessened. regards, Claudius -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-54 Fax: (+49)-8142-66989-80 Email: ch@denx.de