**** BEGIN LOGGING AT Sat May 08 02:59:57 2021
May 08 08:11:12 <DocScrutinizer05> sicelo: that sounds about right but honestly it's orphanware naow
May 08 08:11:17 <DocScrutinizer05> now*
May 08 08:11:29 <DocScrutinizer05> sorry, sixwheeledbeast ^^^
May 08 08:13:07 <DocScrutinizer05> if there's anything still copyright-tagged "Nokia" on maemo servers then that's because nobody fixed that licence readme
May 08 08:14:24 <DocScrutinizer05> community (HildonFaoundation, then MCeV) inherited the complete server with everything on it and Nokia asked us to remove "Nokia" tags everywhere
May 08 08:22:49 <DocScrutinizer05> as (Ex)member of Council, HiFo and MCeV I dare to state that nobody will object any hosting of any of that stuff anywhere now
May 08 08:23:40 <DocScrutinizer05> Nokia waived rights to all the stuff that is open source
May 08 08:23:53 <DocScrutinizer05> and to the rest as well, as far as they could
May 08 08:26:59 <DocScrutinizer05> there were a few ~closed bits that neither Nokia nor subcontractor Collabora owned the complete copyright and both didn't feel like investing the months of lawyers' hassle to change that, but both had no more interest in it telling "ask $opposite_party about it
May 08 08:31:25 <DocScrutinizer05> parazyd: ^^^ you as well
May 08 08:33:47 <DocScrutinizer05> ~closed
May 08 08:33:47 <infobot> hmm... closed is http://wiki.maemo.org/Why_the_closed_packages or https://wiki.maemo.org/Fremantle_closed_packages, or http://elinux.org/N900, or https://wiki.maemo.org/Free_Maemo
May 08 10:49:23 <sixwheeledbeast> so if it where hosted on git it should have Maemo copyright with same license?
May 08 11:21:29 <DocScrutinizer05> warfare: xes: there are three dead ganglia monitors
May 08 11:21:48 <DocScrutinizer05> garage, wiki, www
May 08 11:38:32 <DocScrutinizer05> the F...!  >>PHP Notice:  Uninitialized string offset: 0 in /usr/local/bin/packages/import-packages.php on line 135<< * bazillion,  var/log/fetch-extras.stderr.log 5519M
May 08 11:39:25 <DocScrutinizer05> to compensate that, syslog and messages is dead and empty
May 08 11:51:34 <DocScrutinizer05> fetch-extras.stdout.log  2640M
May 08 11:52:26 <DocScrutinizer05> I guess that thing needs a fix and then some realtime truncating of logs
May 08 11:57:05 <DocScrutinizer05> OOM strke, I gonna reboot that critter
May 08 12:05:54 * enyc meows
May 08 12:06:26 * CatButts brain prolapses
May 08 12:06:36 * CatButts brain prolapses out his nostrils
May 08 12:06:51 * enyc hrrms at the closed-packages-list
May 08 12:08:55 * CatButts vomits a hairball over his prolapsed brain
May 08 16:27:22 <freemangordon> DocScrutinizer05: did anyone fix that?
May 08 16:28:20 <DocScrutinizer05> well, I fixed the ganglia part, was just a `service foobar restart`, but there's more to be done
May 08 16:29:59 <freemangordon> I was rather asking about those endless php errors
May 08 16:30:09 <DocScrutinizer05> didn't touch those
May 08 16:30:40 <DocScrutinizer05> please do a backup before to tackle it
May 08 16:31:10 <freemangordon> I guess it is me to fix that... though I wonder if it makes sense at all, given nothing gets imported in the autobuilder. Neither anything gets promoted
May 08 16:31:32 <DocScrutinizer05> I wondered same
May 08 16:32:02 <freemangordon> DocScrutinizer05: could you plase just rm/mv that huge log and call it a day?
May 08 16:32:10 <DocScrutinizer05> it does a 5gig logs though, just errors, plus a 2.6G logs
May 08 16:32:10 <freemangordon> *please
May 08 16:32:24 <freemangordon> 5GB for how long?
May 08 16:32:31 <DocScrutinizer05> I'd guess it gets redone every other day
May 08 16:32:59 <freemangordon> I doubt there is anything valuable in those logs
May 08 16:33:40 <DocScrutinizer05> there is zilch, except that >>PHP Notice:  Uninitialized string offset: 0 in /usr/local/bin/packages/import-packages.php on line 135<<
May 08 16:34:13 <DocScrutinizer05> and in a syslog there been quite a number of fastcgi segfaults
May 08 16:34:53 <freemangordon> And given I have some health issues ATM (nothing serious, but still) and given I am going on a holiday for the next week, pretty please, if xes/warfare appear and don't object, just rm those logs
May 08 16:35:25 <freemangordon> Or take the decision on your own, dunno
May 08 16:36:13 <freemangordon> this php notice will most-probably appear in the new logs as well, so nothing will get lost :)
May 08 16:36:31 <DocScrutinizer05> of course
May 08 16:36:39 <freemangordon> I may look at it. Someday.
May 08 16:37:46 <DocScrutinizer05> so far the logs are no problem yet. But I might do a tail -n 3333 >~/fetch-extras.stderr.20210508.log && rm 
May 08 16:38:29 <freemangordon> IIUC this will keep the last 3333 lines, no?
May 08 16:38:52 <freemangordon> if that's the case, it sounds sane to me
May 08 16:40:20 <DocScrutinizer05> root@www1:/var/log# ll fet*
May 08 16:40:21 <DocScrutinizer05> -rw-rw-r--+ 1 root root          0 Jun 28  2015 fetch-extras.std
May 08 16:40:23 <DocScrutinizer05> -rw-rw-r--+ 1 root root 5801072873 May  8 15:31 fetch-extras.stderr.log
May 08 16:40:24 <DocScrutinizer05> -rw-rw-r--+ 1 root root 2774721719 May  8 15:39 fetch-extras.stdout.log
May 08 16:41:42 <freemangordon> those are huge, better rm/split those
May 08 16:41:53 <DocScrutinizer05> *first* line+  https://termbin.com/kqp3
May 08 16:42:06 <DocScrutinizer05> tch the date
May 08 16:42:12 <DocScrutinizer05> watch*
May 08 16:42:40 <DocScrutinizer05> ooh, ok. February
May 08 16:42:54 <freemangordon> yeah, February
May 08 16:43:07 <DocScrutinizer05> about the time several other thinks broke too
May 08 16:43:28 <freemangordon> any clue what has happened then?
May 08 16:43:40 <freemangordon> dist-upgrade?
May 08 16:44:10 <freemangordon> what is the current ubuntu version? 
May 08 16:44:17 <DocScrutinizer05> OOM
May 08 16:44:21 <freemangordon> ah
May 08 16:44:43 <DocScrutinizer05> syslog goes OOM kill POOOF
May 08 16:44:51 <freemangordon> maybe better reboot the server 
May 08 16:44:57 <freemangordon> dunno
May 08 16:44:57 <DocScrutinizer05> syslog stalled, other stuff borked
May 08 16:45:05 <DocScrutinizer05> already did
May 08 16:45:08 <freemangordon> :)
May 08 16:45:11 <freemangordon> ok
May 08 16:45:16 <DocScrutinizer05> works again for now
May 08 16:45:22 <freemangordon> nice
May 08 16:45:25 <freemangordon> thanks!
May 08 16:45:34 <DocScrutinizer05> I do the tail 3333 and call it a day
May 08 16:45:41 <freemangordon> :nod:
May 08 16:45:58 <DocScrutinizer05> goes to the todo postit
May 08 16:46:09 <DocScrutinizer05> *eventually* ;-)
May 08 16:46:33 <DocScrutinizer05> root@www1:/var/log# df -h .
May 08 16:46:34 <DocScrutinizer05> Filesystem      Size  Used Avail Use% Mounted on
May 08 16:46:36 <DocScrutinizer05> /dev/xvda        60G   40G   19G  68% /
May 08 16:46:55 <freemangordon> not bad I guess
May 08 16:46:56 <DocScrutinizer05> and I didn't rm yet
May 08 16:46:59 <freemangordon> ah
May 08 16:47:02 <freemangordon> even better :)
May 08 16:47:10 <DocScrutinizer05> thus no problem yet
May 08 16:47:14 <freemangordon> yeah
May 08 16:47:33 <DocScrutinizer05> maybe I just call it a day and leave the rm for the todo
May 08 16:48:05 <freemangordon> well, anyway you're on it. But... as you wish.
May 08 16:50:43 <DocScrutinizer05> more concerning: https://termbin.com/2hhz
May 08 16:52:21 <freemangordon> yeah, but I think admins shall fix that
May 08 16:52:46 <DocScrutinizer05> the less I change now the less we need to learn about history when we actually tackle it
May 08 16:53:04 <freemangordon> I tried to reach them on the admin channel ,lets see
May 08 16:53:08 <freemangordon> :nod:
May 08 16:53:16 <DocScrutinizer05> I queries them
May 08 16:53:23 <freemangordon> ok
May 08 16:53:24 <DocScrutinizer05> queried
May 08 16:53:54 <DocScrutinizer05> thanks for having a look at this
May 08 16:54:18 <freemangordon> but ofc. thanks to you for noticing it :)
May 08 16:54:44 <DocScrutinizer05> :-) thanks to parazyd directing my focus on it
May 08 16:55:27 <DocScrutinizer05> I wasn't aware there was a new VM that not even shows up in ganglia
May 08 16:58:53 <DocScrutinizer05> there you are May  8 15:10:01 www1 CRON[21133]: (root) CMD (/usr/local/bin/packages/fetch-extras.sh 2>>/var/log/fetch-extras.stderr.log 1>>/var/log/fetch-extras.stdout.log)
May 08 16:59:02 <DocScrutinizer05> (syslog)
May 08 17:03:40 <DocScrutinizer05> cronjob every hour
May 08 17:04:33 <freemangordon> it should be like that
May 08 17:05:00 <DocScrutinizer05> the question is rather why it's not in logrotate. Prolly was an ephemeral debugging thing meant to vanish
May 08 17:05:56 <freemangordon> or rather inheritance фром Нокиа
May 08 17:06:02 <freemangordon> *from Nokia
May 08 17:06:09 <DocScrutinizer05> hmmm
May 08 17:06:56 <DocScrutinizer05> wasn't this the damn critter that hogged all our RAM?
May 08 17:07:17 <DocScrutinizer05> that I patched after months of fuzzing around with it
May 08 17:07:17 <freemangordon> it shouldn;t be
May 08 17:08:07 <freemangordon> not sure what you're talking about though
May 08 17:10:42 <DocScrutinizer05> nah, I looked into /usr/local/bin/packages/fetch-extras.sh - extreme crap, if that's my stuff I will never again touch a keyboard
May 08 17:11:04 <DocScrutinizer05> -rwxr-xr-x 1 root root 9044 Mar 16  2013 /usr/local/bin/packages/fetch-extras.sh*
May 08 17:11:12 <freemangordon> no, for sure this script came from Nokia
May 08 17:11:17 <DocScrutinizer05> yep
May 08 17:11:20 <DocScrutinizer05> nemein
May 08 17:11:23 <freemangordon> yeah
May 08 17:11:51 <DocScrutinizer05> warfare: hi!
May 08 17:11:56 <freemangordon> warfare: please look at the backlog from the last 30 minutes or so
May 08 17:12:13 <warfare> regarding syslog-ng - rsyslogd can‘t start, there can‘t be two log daemons listening on the same udp socket ;)
May 08 17:12:27 <DocScrutinizer05> ooh
May 08 17:12:49 <DocScrutinizer05> nevertheless syslog stalled (size 0) since february or somesuch
May 08 17:13:25 <DocScrutinizer05> I created dmesg dumps to ~root
May 08 17:13:36 <DocScrutinizer05> I rebootet www
May 08 17:13:49 <DocScrutinizer05> syslog works again
May 08 17:14:07 <warfare> that was probably fallout from apache getting oom killed. 
May 08 17:14:30 <DocScrutinizer05> yep fallout from a OOM but I didn't check what caused it
May 08 17:15:23 <warfare> Apache/midgard most likely.
May 08 17:16:23 <DocScrutinizer05> not sure about this one either https://termbin.com/dpy7n
May 08 17:17:46 <DocScrutinizer05> I gotta run. I got booze for tonight / tomorrow but no milk for my coffee
May 08 17:18:04 <DocScrutinizer05> bbl
May 08 17:18:49 <freemangordon> warfare: also, seems there are more than 100 packages to be upgraded
May 08 17:21:57 <DocScrutinizer05> oh warfare could you add maedevu VM to ganglia/icinga?
May 08 17:23:23 <warfare> freemangordon: yes, the machines need som love.
May 08 17:25:45 <freemangordon> :)
May 08 17:36:13 <DocScrutinizer05> no smartctl on bladeb ? o.O
**** ENDING LOGGING AT Sun May 09 03:00:50 2021