**** BEGIN LOGGING AT Thu Jan 24 02:59:56 2019 Jan 24 09:11:23 morning Jan 24 09:11:45 on our builders we're running Ubuntu 18.04 (or at least should be!) Jan 24 09:11:53 but definitely sticking with Ubuntu Jan 24 09:12:16 nizovn: you should be able to remove python 3.4 & 3.5 unless specifically needed, couple of months ago Gentoo moved to 3.6 as default Jan 24 09:12:30 check your /etc/portage/make.conf settings to determine which are the defaults Jan 24 09:12:57 you *may* need to re-emerge some packages if there's been a change in python in use, you can force some to use 2 over 3 if necessary Jan 24 09:13:07 eselct will also tell you which is the system default Jan 24 09:13:15 *eselect Jan 24 10:36:20 novaldex: OK Jan 24 10:36:43 It seems a few repos got lost in migration from old git. Any chance you could dig around on some disks? Maybe the files are there? Jan 24 10:36:49 I'm looking for pulseaudiorestarter Jan 24 10:36:54 Let me find the other names Jan 24 10:37:49 devtoolbox, ClassicInvaders, terminus, xterm, mendeley, tide Jan 24 10:40:03 hmmm, those ones we used to host? they may be in a similar state to the 'issues' server.. i'll need to have a word with the others Jan 24 10:40:17 off the top of my head just now I don't know of any of those existing on our current estate Jan 24 10:44:22 novaldex: This was previously on git.webos-internals.org Jan 24 10:44:38 I imported 95 or so repos into http://github.com/wosigh Jan 24 10:44:55 Of which 30 or so were now transferred to http://github.com/webos-internals Jan 24 10:45:13 But I'm missing these 7 mentioned above somehow Jan 24 10:45:33 There should be folders with exactly these names Jan 24 11:06:34 novaldex: I'm getting a bunch on 404 errors on Optware feed. I'm not too familiar with those to be honest. It seems some IPK's are missing. http://jenkins.nas-admin.org/job/webos-preware-feeds/lastBuild/consoleFull Jan 24 11:06:44 Those should be more recent and easier to track I guess Jan 24 11:09:07 Ah wait, it seems it checks for alternative URL in case of 404, most of those exist actually Jan 24 11:13:11 Ah seems we're only missing lighttpd_1.4.29-1_arm.ipk for now Jan 24 11:14:05 novaldex: I found a mirror on http://demongloom.dyndns.info/wd/lighttpd_1.4.29-1_arm.ipk Jan 24 11:14:20 Any chance you could push it to http://ipkg.nslu2-linux.org/feeds/optware/cs08q1armel/cross/unstable/ Jan 24 11:14:56 Or maybe I should bump version number Jan 24 11:16:18 Seeing we have 1.4.32 on the server, I guess I should update https://github.com/webos-internals/build/blob/master/optware/lighttpd/Makefile#L5 Jan 24 11:19:01 I can grab it if you'd like anyway? but I think a version number bump might be more appropriate Jan 24 11:19:05 not as though it's a large file.. Jan 24 11:21:34 novaldex: Yeah doesn't hurt to put it and I'll bump as well Jan 24 11:21:51 just grabbed it now Jan 24 11:23:35 Bumped it, so now will try a new build Jan 24 11:23:40 Getting there step by step it seems Jan 24 11:23:46 Just logs get very big... 25MB or so ;) Jan 24 11:23:50 So hard to spot issues Jan 24 11:48:11 Oops syntax error Jan 24 11:48:14 Another try Jan 24 12:56:31 BTW managed to get a very good deal on a LG OLED from 2018, so a shiny new 65" with webOS 4.0 will be delivered today ;) Jan 24 12:57:14 To replace the 8,5 years old 42" Panasonic plasma ;) Must have had it's best time anyway :D Jan 24 12:58:41 novaldex: Reached out to the dev from pulseaudiorestarter to see if he has it laying around somewhere still. Worth a shot Jan 24 14:30:54 novaldex: OK build is proceeding now :) Jan 24 14:31:01 At least past lighttpd Jan 24 14:31:14 LEt's see where it ends up... Just tedious it takes hours before it gets to the point ) Jan 24 14:31:15 ;) Jan 24 14:31:39 Takes longer compared to QtBase & QtWebEngine to compile.... Jan 24 14:31:43 So that's long ;) Jan 24 14:33:23 novaldex: Seems it finished with all the "building" more or less successfully (it failed to build a few due to missing sources), but the Jenkins job didn't fail because of this. Now it's a bit config from your side it seems to get stuff published to the right location? Jan 24 14:33:31 See last lines in http://jenkins.nas-admin.org/job/webos-preware-feeds/40/console Jan 24 14:34:03 novaldex: "Host key verification failed." Jan 24 14:35:44 The destinations come from https://github.com/webos-internals/build/blob/master/Makefile#L386 Jan 24 14:43:53 novaldex: I'd be curious to see the files that are being build on Bonaire, just to compare the created feed files with the ones currently in Preware to make sure we don't break anything before we actually push things to live environment ;) Jan 24 14:49:01 novaldex: The good thing is, that when this is working, we can at least start to manually merge patches to https://github.com/webos-internals/patches and generate feeds that include them :) Jan 24 14:49:14 And push nizovn's work to more visible feeds for the QtBrowser etc :) Jan 24 15:33:27 okay, that should be the host keys fixed now Jan 24 15:43:36 novaldex: Well there are still some things I need to iron out before it should sync... Just I have no way to verify output on bonaire before syncing, because I don't have access there Jan 24 15:43:49 I'm going through the 23MB logfile now to spot things that need some TLC still; Jan 24 15:44:38 novaldex: yes, thanks, my gentoo setup is older than couple of months indeed... Jan 24 15:46:20 nizovn: You don't happen to have local copies of the git repos from way back by any chance? Jan 24 15:46:30 Stuff like pulseaudiorestarter, xterm etc ? Jan 24 15:46:40 The 7 I mentioned earlier today basically Jan 24 15:47:23 nizovn: Seems we're getting close to feeds being generated & published again :D Jan 24 15:50:13 Herrie|Laptop_: I don't think the sync'd tree is too big, you could change the target rsync path to a new sub & it'd replicate the entire tree? Jan 24 15:50:23 Herrie|Laptop_: looks like i don't have any :( Jan 24 15:50:24 then could do some kind of comparison between the two Jan 24 15:51:23 novaldex: True I guess I could do that Jan 24 15:51:39 i'm guessing the whole tree is just short of 12GB in size Jan 24 15:51:49 Let me first iron out those minor issues I still see Jan 24 15:52:07 we do have room on the target to host that, although I wouldn't want it around for too long..? Jan 24 15:52:09 understood Jan 24 15:52:34 novaldex: How much space we have? Jan 24 15:52:45 about 120GB Jan 24 15:52:49 free that is Jan 24 15:52:57 Once it's @ target I can access it, compare it and delete it as well :P Jan 24 15:55:23 novaldex: I'm seeing this in the Jenkins job log for the chroot packages: /bin/sh: 4: rootstock: not found Jan 24 15:56:04 And sudo apt-get install qemu (or on ubuntu > karmic sudo apt-get install qemu-kvm-extras) to install the qemu package ! Jan 24 15:56:09 I was about to say 'rootstock? never heard of it', so I looked it up instead Jan 24 15:56:25 For "qemu not installed, please use:" sudo apt-get install qemu (or on ubuntu > karmic sudo apt-get install qemu-kvm-extras) to install the qemu package ! Jan 24 15:56:32 Seems it was deprecated in 2011 yikes Jan 24 15:56:35 https://wiki.ubuntu.com/ARM/RootStock Jan 24 15:56:53 Not sure it's still installable? Jan 24 15:56:54 ouch.. that's quite a while Jan 24 15:57:38 i'm guessing not, many references to other projects as alternatives Jan 24 15:57:48 qemu-debootstrap, live-build, etc Jan 24 15:58:34 I think we've been through 3 major revisions of Ubuntu since it was deprecated Jan 24 15:59:45 OK Jan 24 15:59:52 Well the chroot was anyway for a very old version I think Jan 24 15:59:56 10.04 or 11.04 Jan 24 16:02:05 i was able to create newer ubuntu image using debootstrap in 2015, and rootstock was already deprecated iirc Jan 24 16:05:31 I'm just working through the logfile of 350k lines to see what needs fixing still Jan 24 16:05:35 Seems nothing too major tbh Jan 24 16:05:55 nizovn: Thnx for checking, most of the 7 missing packages aren't critical Jan 24 16:06:57 novaldex: Any clues as to the random issues with the http://sources.nslu2-linux.org/ ? Still happens here and there Jan 24 16:07:43 still DNS issues? Jan 24 16:09:46 Seems so, not as frequent but saw them a couple of times this week Jan 24 16:11:42 we've not made any DNS changes in a while, you'd think they'd all settle down by now Jan 24 16:14:08 Seems really random. Works for a large build, but there's 1 or 2 recipes that fail to resolve :S Jan 24 16:16:53 it happens on the build server itself? Jan 24 16:23:59 Yes on Bonaire it seems, though not very frequently, but happens Jan 24 16:24:24 Which is annoying, because it can break an almost 3 hrs build :P Jan 24 16:25:09 i'm hoping that change will help, adjusted the DNS server list to remove old entries Jan 24 16:28:39 novaldex: Thnx, time will tell I guess Jan 24 16:28:48 Any word on the mailing list & issues? Jan 24 16:32:50 mailing list no, and ka6sox is out of the country at the moment to ask Jan 24 16:32:59 did we not discuss issues earlier? Jan 24 16:33:19 novaldex: Yes we did, you said you were working on something, but it wasn't easy Jan 24 16:33:22 That was latest update Jan 24 16:33:38 ahhh.. there's been another one, sorry I thought i'd passed it on, hang on let me check my notes Jan 24 16:35:18 right, it looks as though we're not able to resurrect the old issues server, and not even recover the data from it either Jan 24 16:35:23 sorry Jan 24 16:37:00 seems chilliproject is beyond recovery (i'm getting it sort of 3rd hand as I wasn't the one working on it) Jan 24 16:37:16 we started looking at providing you with a new one Jan 24 16:37:27 'look' i'm afraid is as far as we've got so far Jan 24 16:45:11 novaldex: So means all tickets are gone as well and beyond recovery? Jan 24 16:45:38 Even the DB with the info Jan 24 16:48:03 that was my understanding, but i'm now getting questions about it in our other channel Jan 24 16:48:11 leave it with me for a bit & i'll see if the picture clears some! Jan 24 16:48:14 I'm happy with just the DB Jan 24 16:48:22 So we can extract the info & migrate elsewhere Jan 24 16:48:29 I thought you might be too.. Jan 24 16:50:14 Happy to join in discussion if needed Jan 24 17:45:45 OK found some inconsistencies in the patch repos and autopatch repos for various patches that cause errors during build. So will look into those too Jan 24 17:45:50 Not too many, but causing issues still Jan 24 17:47:13 About 56 in total. So I guess I'd need to add those patches, but instead of blindly adding I'd need to check them 1:1 I guess Jan 24 17:47:18 So will take me a little while Jan 24 22:50:53 Herrie|Laptop: I don't have any of the missing repos, but I did stumble on 2 old 2016 build logs that might hold clues: http://logs.nslu2-linux.org/buildlogs/ **** ENDING LOGGING AT Fri Jan 25 02:59:58 2019