**** BEGIN LOGGING AT Thu Sep 23 02:59:57 2021 Sep 23 07:45:52 good morning Sep 23 09:15:44 mort: 10.3.2021... that's why it looked familiar ;d Sep 23 10:19:09 it would've been nice if bitbake said "Ran X tasks in Y seconds/minutes/hours/whatever" whenever it exited Sep 23 10:19:32 I know you can time it with `time`, but there's a lot of situations where I have already started a build and then get curious how long it's actually taking Sep 23 10:21:06 mort: I would say "make a patch?". Hope you do not feel offended Sep 23 10:21:23 I might do that actually Sep 23 10:21:56 sorry, being gentle is not quite covered in my english Sep 23 10:22:11 it's hard over text in general Sep 23 10:22:22 I agree that such info is handy. Added such in other project Sep 23 10:22:37 I love that cargo tells me how long it took every time Sep 23 10:23:12 for bitbake it would be nice to have it as part of task so you could check time of each task and then the whole build Sep 23 10:23:13 I have some spare time now anyways while waiting for a linux system to build from scratch, and it should be easy to add the feature Sep 23 10:23:33 hmm, how would the info for each task be exposed? Sep 23 10:24:31 it would be cool to save some form of time log file which shows the duration occupied by each task, kind of like the output it's showing as it's building but serialized into a single file and visualized as a 2D thing Sep 23 10:24:57 In OpenStack Kolla start/end is output (and then can land in log) Sep 23 10:25:35 mort: and a list of 'longest tasks' like Ansible does? Sep 23 10:26:17 02:04:31.060 Sunday 19 September 2021 20:14:31 +0000 (0:00:13.370) 2:03:37.947 ****** Sep 23 10:26:20 02:04:31.060 =============================================================================== Sep 23 10:26:23 02:04:31.060 tensorflow : build TensorFlow git for cp36-cp36m --------------------- 1563.40s Sep 23 10:26:26 02:04:31.060 tensorflow : build TensorFlow git for cp37-cp37m --------------------- 1560.63s Sep 23 10:26:29 kind Sep 23 10:26:32 but this stuff sounds much more complicated than just adding the total duration to the tasks summary Sep 23 10:26:37 no Sep 23 10:26:47 1. gather time in task Sep 23 10:26:53 2. gather time info from tasks Sep 23 10:27:01 2. do whatever you want with data Sep 23 10:27:07 I know it's not extremely complicated, but it's a much bigger feature Sep 23 10:27:30 "How do we eat an elephant?" "Piece by piece" Sep 23 10:28:46 I wonder if there's a way to extract the info from the log files bitbake currently generates Sep 23 10:28:50 note that I am quite rusty when it comes to OE/BitBake internals. maybe that info is there already Sep 23 10:29:25 ow, console-latest.log doesn't contain time stamps otherwise it would've been perfect Sep 23 10:31:27 bitbake-cookerdaemon.log is annotated with timestamps but doesn't seem to contain enough info to piece together which tasks or recipes take how much time Sep 23 10:38:39 maybe just a matter of expanding that info? Sep 23 10:40:01 Quite possibly Sep 23 10:59:45 mort: if you want a good breakdown of tasks etc then that's already in the buildinfo Sep 23 11:00:01 mort: i did write https://github.com/rossburton/meta-ross/blob/master/classes/timer.bbclass because i wanted a dumb "this took X minutes" Sep 23 11:00:35 surprise visit by hrw! Sep 23 11:07:25 rburton: I am here since 2004 ;D Sep 23 11:07:42 well, yes, but you're rarely actually here :) Sep 23 11:07:56 rburton: let other talk ;D Sep 23 11:32:27 rburton: here's the buildinfo? Sep 23 11:32:38 buildstats, sorry Sep 23 11:33:15 is this something you have to explicitly turn on before starting the build? Sep 23 11:33:24 iirc its on by default Sep 23 11:33:31 huge amount of data buried in there, and scripts/ has a pybootchart fork that visualises it Sep 23 11:33:51 my timer class is good for 'how long did that build take' Sep 23 11:34:00 buildstats is great for digging into a previous build Sep 23 11:34:55 you're right, buildstats seems to have all the necessary data and is enabled by default Sep 23 11:35:37 instead of parsing the data, the class shows you how to hook onto task/build start/end Sep 23 11:36:13 where's this pybootchart script? Is it easy to find in a yocto system or do I need to separately clone bitbake to get it ro Sep 23 11:36:19 s/ro/or/ Sep 23 11:36:25 oe-core or poky scripts/ Sep 23 11:36:45 aha Sep 23 11:39:52 I found pybootchartgui but that seems to be a GUI application, it would be nice to get a png or svg (or even html) out which I can open on a dev machine Sep 23 11:40:25 I usually run builds on headless machines Sep 23 11:45:16 yeah Sep 23 11:46:29 ive a script somewhere that turns the data into a html page using google charts Sep 23 11:46:36 where did i put that... Sep 23 11:47:16 I might make something which turns the data into a html page which just creates divs which are 50px wide and 10*s px tall where s is the amount of seconds the task took Sep 23 11:47:29 google's timeline chart is pretty neat Sep 23 11:48:04 aha found it Sep 23 11:48:05 is it just a foss client-side javascript library? Sep 23 11:48:39 doubt its foss, but client side js Sep 23 11:49:27 https://gitlab.com/rossburton/bbtimeline Sep 23 11:49:48 I don't think that's public? Gitlab asks me to sign in to see it Sep 23 11:50:43 try again Sep 23 11:51:02 one thing that's kinda missing from the buildstats log looks to be which of the N simultaneous jobs it is. Did you make your own layout engine type thing to show lots of stuff side by side or am I overlooking something Sep 23 13:05:01 mort: google's timeline chart does nice things and does the layout for you Sep 23 13:05:55 pybootchart has a line per job in time order, to make it easier to spot stalls Sep 23 14:03:40 mort: i've customized my ${PS1} so that it always tells me for how long each command runs ;-) Sep 23 16:23:05 weird, bitbake is failing with a bb.data_smart.ExpansionError where it fails to expand variable SRCPV Sep 23 16:23:19 eh this might be a red herring Sep 23 16:31:46 Is there a way to debug why bitbake tries to use a particular git URI? Sep 23 16:32:58 I have a recipe which just literally has a SRC_URI with a git://github.com/blah URI, and doesn't inherit from anything, but bitbake tries to clone it from somewhere in the filesystem and I don't understand why Sep 23 17:28:13 mort: do you have a workspace (done any devtool stuff)? Sep 23 17:50:03 khem, I'll ping koen about merging meta-kodi in meta-openembedded (maybe meta-multimedia, not under meta-oe) Sep 23 17:50:13 there is already an active maintainer Sep 23 17:50:20 (not koen) Sep 23 17:50:57 they carry just a couple of extra ancillary recipes in meta-kodi Sep 23 17:51:44 users are asking about kodi in the stb world :) Sep 23 19:16:08 We need a recipe for Julia! https://julialang.org/ Sep 23 19:44:19 khem, that recipe contains avery dubious Sep 23 19:44:21 OECMAKE_FIND_ROOT_PATH_MODE_PROGRAM = "BOTH" Sep 23 19:44:40 seems because git (native?) was not found Sep 23 19:46:16 well, and INSANE_SKIP:${PN} = "rpaths" which I removed from our clone w/o issues **** ENDING LOGGING AT Fri Sep 24 02:59:56 2021