From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 6693749539433611264 X-Received: by 2002:a19:2005:: with SMTP id g5mr4247667lfg.157.1558513257635; Wed, 22 May 2019 01:20:57 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a2e:12cd:: with SMTP id 74ls151007ljs.4.gmail; Wed, 22 May 2019 01:20:57 -0700 (PDT) X-Google-Smtp-Source: APXvYqwuaoOaATMK2uq0oRFdUDeGWgs5f6OgGkhpM4D99T1Eqti2Ks/2aIgPArUhvDcIL98ZtawS X-Received: by 2002:a2e:87c9:: with SMTP id v9mr16639868ljj.100.1558513257094; Wed, 22 May 2019 01:20:57 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1558513257; cv=none; d=google.com; s=arc-20160816; b=wG6n5g+ZR3MJktPJnzrv89qxsyVtHy7mX0hPB0BS3sgO/tXfyVjgW+7r3jMkgkTrPh ZjtC112ivwuPaZJifSCrEDIfnTV/6EteZnVFtk6cpoNJ25f20Fz5oVkF+ZwNO3IzXnjO JgfAk7okeiP7OwlAS966Yo9FJgxV8SLGkntC4+dhFOviBePgKSV6Zzuq4D6r1+OZ9z7u 7IehFmIFg0ONdy1S05twFxEfdfMg2uf86j5UkSV3rslXDP4CZRlpDpHTQADxF6r3YPed Zxd+/qr4XqrGiuzhPR0favXMl4jIOA/ChmvsU80rR+v3VSkIZMCKnmc5DG27DKRQAm/n pzxw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:content-language:in-reply-to:mime-version :user-agent:date:message-id:organization:from:references:to:subject; bh=vZ6ZZSRKki54DZDdpGZZfhe1lHbrDoz1urpuK02j86w=; b=KKja9rjY3X5B4+RST4DSZyDopn/8Uw/hwlZ0Dq+cTHO4ncMzU7vpOey2JJDUFYtQ/i iCGMEl2jZ836nLZU9YDxLpHa2wKUxO9ToqA0ZPpUW9zHyUPpMyBWFtQUlqVDG5H9wtK3 JL+vIrFRG0vo5ahMHs3L8SxKFLfTQmN/rHaTAe2GPuWoauPKAFYo5UUAJpK+ZiPXFcWZ 6v0wLbGWAKRT8RxvUNv/G0LpY6el6SJBaHDHgpbKqU7XC3kZSumS5R3qg4YFDaVlHjtk 5nTmlICWjWlB24GA2a4Unz5Y5NOg8hzNQIiFaXpeelq0Xy0EUYjYkxQdkoq/KB+PmtPn 7v2g== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of mosipov@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=mosipov@ilbers.de Return-Path: Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id c9si2330225lff.2.2019.05.22.01.20.56 for (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Wed, 22 May 2019 01:20:56 -0700 (PDT) Received-SPF: pass (google.com: domain of mosipov@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of mosipov@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=mosipov@ilbers.de Received: from [192.168.1.29] (115.165-131-109.adsl-dyn.isp.belgacom.be [109.131.165.115] (may be forged)) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8) with ESMTPSA id x4M8KtdD003612 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 22 May 2019 10:20:55 +0200 Subject: Re: [DISCUSSIONS] CI build To: Claudius Heine , isar-users References: From: "Maxim Yu. Osipov" Organization: ilbers GmbH Message-ID: <5128c754-55f8-924b-365c-2d529131bd3a@ilbers.de> Date: Wed, 22 May 2019 10:20:49 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.6.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,URIBL_BLOCKED autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-TUID: I/GY6PslR9S4 On 5/22/19 9:26 AM, Claudius Heine wrote: > Hi, > > we discussed some issues with the CI offline. > > Here are my issues of the current CI with Jenkins in text: >  - Unreliable build: >    -> Network and other unrelated issues to the patch >    -> Contains expected to fail tests >  - Not transparent configuration/environment: >    -> parameters with which ci_build.sh is called are not controllable > from the repository >    -> difficult to select which test case should be run Yes. that's why we are going to migrate to avocado test suite. >    -> Configuration of the environment is not controllable from the > repository: Installed packages, System configuration (locales), > Distribution, etc. In my opinion we need to have some "reference" common (better as minimal as possible) environment, to avoid a zoo of different environments... >  - Just one giant build process >    -> Takes a long time I fear that it can't be avoided for such kind of build systems - several months ago we upgraded/tweaked the server and whole CI build itself takes now around 1 hour (which is acceptable in my opinion). We are improving now smoke test launching. >    -> Cannot be spread over multiple servers >    -> Giant log file, that makes it difficult to figure out exactly > which command or test case caused an issue to reproduce that locally Your project is configured with -q (quiet) option and doesn't generate huge trace - it becomes verbose only on encountered errors - I had no problems with such log file as you can easily find the encountered error and always analyze the build workspace which is not cleaned up for the last build. Just have a look at your latest build http://isar-build.org:8080/job/isar_claudius_ilbers-ci/64/console it took for me 10 seconds to locate the failed recipe. >  - Manually triggering of build jobs >    -> After pushing of CI branch, build has to be triggered via button One may enable such build trigger (I believe that such trigger is enabled for Henning's project). but from my user's experience I prefer to start the build manually. Of course, overnights builds are started periodically. See for details: https://wiki.jenkins.io/display/JENKINS/Building+a+software+project >    -> Patches on ML should be automatically tested and reported back to > ML (that only makes sense if the build is reliable though) Do we really want such feature? My concern is that ML will be polluted by such reports... >  - No "test everything" (acceptance test) build job I'll introduce such acceptance test. >  - Logs aren't public accessible I think that Baurzhan may comment this. Regards, Maxim. > > Anyone has other issues or comments? > > regards, > Claudius > -- Maxim Osipov ilbers GmbH Maria-Merian-Str. 8 85521 Ottobrunn Germany +49 (151) 6517 6917 mosipov@ilbers.de http://ilbers.de/ Commercial register Munich, HRB 214197 General Manager: Baurzhan Ismagulov