**** BEGIN LOGGING AT Thu Jan 10 03:00:02 2019 Jan 10 03:12:57 derRichard: I'm currently creating a go package recipe and I think I feel your pain now. go.bbclass is quite tough to work with outside of the most simple use case.. Jan 10 03:51:24 robbawebba: if you spellout the problems we might be able to improve situation Jan 10 07:32:09 moto-timo, You make sense and I agree. I'll make the changes tomorrow. Jan 10 08:37:02 khem: first of all it _always_ does a shared link, which sounds good but is in fact broken. here in x86_64 i get runtime errors Jan 10 08:38:48 secondly, it tries to be smart and sets GOPATH and gueses what you want to build. the GO_IMPORT and GO_INSTALL variables are anything but easy to understand Jan 10 08:39:06 third, absolute zero documentation, except trivial examples with no dependencies Jan 10 08:39:25 dependency management is also not existent Jan 10 08:39:43 you need to mess yourself with go get or go dep in do_compile_prepend() hooks Jan 10 08:42:04 oh yes, and sdk support is also odd. if you install go in your sdk it works only if you set GOROOT yourself :( Jan 10 08:42:50 given the complexity of go.bbcalls the amount of usefulness is low :( Jan 10 08:42:54 :-) Jan 10 08:43:06 hi everyone Jan 10 08:43:08 in a nutshell: don't go, just bash :) Jan 10 08:43:20 LetoThe2nd: sorry, but this is bs.... Jan 10 08:44:32 derRichard: heh, the pun was intended to use bash instead of go. i'm all fine with the rant, just go ahead! (even another intended pun! yay!) Jan 10 08:45:57 LetoThe2nd: in fact, we (my company) try very hard to avoid any bash scripts in systems we design. bash just sucks for everything with more than 50 lines of code :-) Jan 10 08:46:09 but we are getting ot :) Jan 10 08:46:28 could you help me with removing the kernel image from the rootfs? I'm installing it separately and I want to make my rootfs image (ubifs) smaller. I have tried RDEPENDS_kernel-base = "" but it didn't do anything and I still have my "/boot" directory filled with uImage symlink and uImage_{version} file that is never used Jan 10 08:46:38 derRichard: ot or not, i feel that you feel a little cheered up now? so if yes, mission accomplished! Jan 10 08:47:08 is there a good way of removing the whole "/boot" directory in rootfs? Jan 10 08:47:35 piotrlewicki: thats just tinkering with the symptoms, better find out what actually causes it to be installed, because it isn't by default Jan 10 08:48:44 ok... that's new to me. so it gets built by default but not installed? Jan 10 08:48:51 piotrlewicki: EEEEXACTLY :) Jan 10 08:49:05 ok. I'll check that.. Thanks for the tip :D Jan 10 08:49:20 piotrlewicki: so, getting started would be to bitbake -e your image, and from there dig what actually pulls it in. Jan 10 08:51:03 piotrlewicki: and, hint: the package that causes the kernel to be installed is surprisingly named: "kernel" :-) Jan 10 08:51:09 that's a lot of lines of python codexD Jan 10 08:51:22 piotrlewicki: happy grepping! Jan 10 08:52:07 piotrlewicki: otherwise, (syntax might by flaky now): bitbake -g your image and then look at package-depends.dot Jan 10 08:52:16 hehe. thx. and for me the name of the package is "kernel-image-uimage" Jan 10 08:53:00 ok. That should be enough for me to get going. your help is appreciated :-) Jan 10 08:53:11 have fun! Jan 10 09:22:16 * derRichard wonders why yocto does not enable set -fstack-clash-protection Jan 10 09:31:10 derRichard: patches welcome! add it to security_flags.inc Jan 10 09:31:58 rburton: well, this is the easy part. how to you test all this? Jan 10 09:32:14 i really want avoid sending patches which break things Jan 10 09:36:02 bitbake world Jan 10 09:36:33 or send a patch that you've tested as much as possible, and ask nicely that we run it through the AB Jan 10 09:37:06 yeah, bitbake world is not an option for me :D Jan 10 09:37:32 doesn't take *that* long Jan 10 09:37:48 (50% of the time in webkit) Jan 10 09:38:11 the thing is, we're corrently working on 4 yocto migrations, our build servers are rather busy with this :D Jan 10 09:38:22 ha Jan 10 09:38:35 test it locally with an image, if that works post a RFC patch and ask nicely Jan 10 09:38:47 this is why i run in so much odd stuff. -> moving from custom buildsystems to yocto Jan 10 09:43:55 New news from stackoverflow: Create a mirror of all dependencies of Yocto-based project Jan 10 09:44:43 rburton: wait, you mean "bitbake world" on poky? no openembedded-core or meta-openembedded? Jan 10 09:44:52 then the amount of targets is really not that much Jan 10 09:45:04 poky is oe-core+bitbake+some qa BSPs Jan 10 09:45:07 not meta-oe Jan 10 09:48:24 without meta-qt5, meta-browser and meta-oe it's just 1/10 of the time of bitbake world :) Jan 10 09:49:38 rburton: the amount of layers and their combinations will ever confuse me ;-P Jan 10 09:51:10 poky is just bitbake+oe-core+meta-poky, as 1) an example of creating a distro and 2) something designed for QA to test Jan 10 09:51:39 this actually makes a lot of sense :-) Jan 10 09:58:16 really? :) Jan 10 09:58:42 yes Jan 10 10:00:08 sense? go away! get behind me, satan! Jan 10 11:46:03 Has anyone build a Yocto build from MacOS. Getting an error relating to sed that i cant seem to resolve. Jan 10 11:46:57 $ MACHINE=var-som-mx6 DISTRO=fslc-x11 . setup-environment build_x11 this command returns sed: illgal option -- r Jan 10 11:54:53 murray_: That's.. not supported.. :) https://www.yoctoproject.org/docs/current/ref-manual/ref-manual.html#detailed-supported-distros Jan 10 11:55:47 Ok so i will have to build it from a linux machine Jan 10 11:55:57 This is a pain as it means i have to use a VM :( Jan 10 11:56:29 jofr: Messages above for you :) Jan 10 11:57:43 murray_: Yes :) Jan 10 11:58:29 jofr: Thanks, I do have one building on a VM but its been over 12 hours so far... @ 82% Jan 10 12:01:18 murray_: Sounds like you need a new machine :p Depending on your host-specs, you could assign tons of RAM to your VM and then mount a ramdisk on your guest-system and do your builds there. Jan 10 12:02:03 jofr: This is not really an option as this is just a side project to what we are using the machines to develop. Jan 10 12:02:57 jofr: We have a team that are creating us a custom Yocto build but they seem to be taking ages with it. Was hoping to create a build myself with the packages that i require so i can do some initial hardware/framework testing Jan 10 12:03:25 jofr: Namley, NodeJs, Webserver, FTP and Maybe a package manager Jan 10 12:04:40 murray_: I see Jan 10 13:11:56 murray_: because yocto runs upstream configure/make scripts, and they're for linux, you need a linux-compatible userspace. you can install the gnu tools using brew on macos to get close, then you need to patch out the linuxisms in bitbake itself (i.e. inotify use), but then you'll discover that pseudo can't work on macos as LD_PRELOAD isn't functional unless you disable all the security features. Jan 10 13:12:22 murray_: basically, use a lean vm. builds are mostly cpu intensive so a good container won't be much slower. Jan 10 13:12:56 for a one off job, get an amazon cloud machine and do a build in that for a few cents Jan 10 13:30:09 Is there a way to make a recipe re-unpack if its patch task changes (e.g., a variable used in a patch postfunc or patch append changes that would need a fresh copy of source code to run correctly)? Jan 10 13:32:41 tgoodwin: its assumed that rerunning a task is always possible. The patch tasks therefore unapply any patches and reapply allowing them to be rerun Jan 10 13:33:55 RP: So implicitly then, it unapplies only things that were patched, not additional tasks associated with the patch task? Jan 10 13:34:12 (i.e., .patch files) Jan 10 13:34:13 tgoodwin: correct Jan 10 13:34:31 tgoodwin: the patch task would rerun if the patch files change Jan 10 13:34:52 well, unpack would since the files it was fetching changed Jan 10 13:35:42 RP: right. What I'm dealing with are patches that are a bit more dynamic where the patch just preps the file for a generic replacement. Jan 10 13:36:35 tgoodwin: I think that would break our assumption that tasks can rerun Jan 10 13:37:43 And indeed it is breaking it. I was hoping for some mechanism that if a variable in one of those patch tasks changes, then unpack must re-occur as if the patch changed. It sounds like maybe appending the unpack is the way to go. Jan 10 13:38:10 or a new task between unpack and patch Jan 10 13:38:45 rburton: I think that would fail for the same reason as running these tasks as a part of patch. The tasks themselves cannot re-run without a fresh copy of source. Jan 10 13:42:22 How can I save changes that I have made with: bitbake -c menuconfig virtual/kernel ? Jan 10 13:43:12 RP: so if I append unpack and update a variable used in that task, would that invalidate the task so that it reoccurs? Jan 10 13:50:22 tgoodwin: yes Jan 10 13:51:13 RP: do you happen to know if a function defined in postfuncs would trigger the same behavior (vs. actually appending the task)? Jan 10 13:51:35 iirc a postfunc that needs to be re-ran will fire the entire task Jan 10 13:51:48 (Thanks for the help BTW. I think I had some failed assumptions here on using vardeps, etc.) Jan 10 13:53:17 BlauskaerM: I usually go into the recipe work area and pull the `.config` out as a defconfig that I add via SRC_URI. Or if you know what flags you changed, you can append the kernel's SRC_URI to add in the `file.cfg` with those changes. Jan 10 13:54:27 rburton: thanks, that's what I've been assuming. I haven't mocked up a test to prove it though. Jan 10 13:57:09 rburton: in a similar train of thought, I was considering adding the variables from my patch task that are "patching the patches" to the do_unpack[vardeps] in an effort to "trick" an unpack to reoccur. Jan 10 13:57:44 Pretty hackish, but that's what I get for having to bake arch strings into sourcecode. :-/ Jan 10 13:57:46 after "smart install kernel-dev", rpm -ql kernel-dev only shows a few files being installed in /boot, none of which are headers. Jan 10 13:58:00 any idea on where to start looking ? Jan 10 13:58:54 how are the kernel-dev file package files specified? Jan 10 13:59:07 correction: how are the kernel-dev package files specified? Jan 10 14:09:27 rburton: and RP: FWIW that (probably rubbish) idea of adding the related variable to unpack's vardeps did cause it to unpack fresh source for my patch tasks. Jan 10 14:19:35 perhaps i'm not making sense. let me back up. i am trying to write a on the target LKM. the first step is to get the kernel headers installed on the target. Jan 10 14:20:04 however, normally these are installed via "smart install kernel-dev" (right?) Jan 10 14:20:41 s/i am trying to write a on the target LKM/i am trying to write a LKM on the target/ Jan 10 14:20:46 (sheesh..) Jan 10 14:21:15 but that package has no kernel include files etc. Jan 10 14:21:23 help? Jan 10 14:22:36 please? Jan 10 14:23:16 to build kernel modules you need more than header files. you need more or less the full kernel source Jan 10 14:23:40 i don't know if yocto even allows this use case. better build the module cross using yocto Jan 10 14:27:03 derRichard: perhaps you are right Jan 10 14:27:17 i'll do some further digging. Jan 10 14:37:40 rburton: do you have any thoughts on kernel-dev? shouldn't that just work, like on a regular distro (ubuntu, etc.)? Jan 10 14:39:02 yates_home: also on a regular distro you need more than "-dev" Jan 10 14:39:11 the kernel is not like a library Jan 10 14:39:24 and kernel modules are not users of a lib, they are part of the kernel Jan 10 14:41:23 what other things would one need on a desktop distro? Jan 10 14:41:36 kernel-source Jan 10 14:42:00 suse has -syms, -macros, ... Jan 10 14:46:02 fedora's kernel-devel states it's all you need to build kernel modules: kernel-devel.x86_64 : Development package for building kernel modules to match the kernel Jan 10 14:46:11 maybe it's different from suse? Jan 10 14:47:52 maybe Jan 10 14:48:51 when do kernel modules get loaded? is it before init or after? Jan 10 14:49:11 (probably OT) Jan 10 14:49:31 should we go to pm, derRichard? Jan 10 14:50:33 yates_home: you have seen the kernel-devsrc recipe? Jan 10 14:50:43 RP: no! Jan 10 14:51:32 oh yeah baby! Jan 10 15:01:09 yates_home: there are even tests that test it works! Jan 10 15:08:36 * kergoth yawns Jan 10 15:16:58 RP: nice to see kernel-devsrc :) Jan 10 15:17:30 tgoodwin: .cfg approach seems a little bit advance for me so copied /proc/config.gz and replaced my deconfig file Jan 10 15:17:34 Hope it works Jan 10 15:17:44 Thanks for your reply Jan 10 15:35:08 hm, having realitve paths in bblayers.conf is tricky Jan 10 15:35:14 yeah, don't do it Jan 10 15:35:30 determine the path relative to TOPDIR and use that Jan 10 15:36:24 like here? https://stackoverflow.com/questions/38890788/why-does-the-yocto-bblayers-conf-file-use-absolute-paths Jan 10 15:37:29 pretty much, yes. or use custom setup scripts to add and use a variable for the yocto root, if it isn't always ${TOPDIR}/.. Jan 10 15:37:52 mentor embedded linux uses custom setup scripts that do that, to point to the mel installation directory Jan 10 15:38:32 the issue with relative paths is you never know precisely what context any given variable is evaluated and used in Jan 10 15:38:40 and $PWD changes at points during the build process Jan 10 15:38:57 for the initial layer setup it may work, but in general it's not a great idea to use relative paths in variables Jan 10 15:41:42 kergoth: so, i can use something like ${LAYERDIR} in bblayers.conf if i set LAYERDIR in bitbake using my local.conf? Jan 10 15:42:27 that woudln't make any sense in about 4 different ways Jan 10 15:42:37 layerdir is already set by bitbake and used in layer.conf for each individual layer, for one Jan 10 15:42:47 beyond that, local.conf is parsed long, long, long after bblayers.conf is parsed Jan 10 15:42:59 local.conf can't be parsed until we can use bblayers to find the layers to locate and parse bitbake.conf Jan 10 15:43:10 okay, two different ways :) Jan 10 15:43:47 ok :D Jan 10 15:44:15 bbalyers.conf can only use what's defined in bblayers.conf Jan 10 15:44:19 it's the first file parsed Jan 10 15:45:01 * derRichard takes a note Jan 10 16:37:04 RP: I see the email now and will bottom out on if KVM is supported native and will respond before the end of the day Jan 10 16:40:57 jonmason: thanks Jan 10 17:17:15 rburton: patch is on the way :) Jan 10 17:18:54 kanavin: :) Jan 10 17:22:17 We should pay attention to this: http://it.tmcnet.com/topics/it/articles/2019/01/10/440873-simplifying-harmonizing-open-source-more-efficient-compliance.htm Jan 10 17:28:49 ooo. shiny and new: Jan 10 17:28:52 root@qemux86-64:~# uname -a Jan 10 17:28:52 Linux qemux86-64 5.0.0-rc1-yoctodev-standard #1 SMP PREEMPT Thu Jan 10 16:01:22 UTC 2019 x86_64 GNU/Linux Jan 10 17:29:01 SHIP IT Jan 10 17:29:17 zeddii, ++ Jan 10 17:29:55 * zeddii pushes it to linux-yocto-dev to see what'll explode. booted once. must be golden. Jan 10 19:04:16 WTF! Bitbake it dying from SIGBUS??? Jan 10 19:04:45 JPEW: do you have a core file or a line in dmesg? Jan 10 19:09:03 derRichard: No... it's dying inside a docker container. I'm pretty sure it's my own fault (somewhere).... SIGBUS is just the last thing I would have expected Jan 10 19:31:31 JPEW: well, inside docker... Jan 10 19:31:44 maybe a mem cgroup kicked in Jan 10 19:31:55 or you reached the max number of allowed mappings Jan 10 19:35:40 derRichard: I didn't setup any memory restrictions, so I don't think it's that.... trying with a larger vm.max_map_count Jan 10 19:36:19 JPEW: did you check dmesg? no oom message? Jan 10 19:36:36 No, OOM Jan 10 19:37:10 nothing suspicious in dmesg Jan 10 19:37:48 hmmm Jan 10 19:38:04 i still think bitbake ran into a odd restriction and had no clue how to handle it :D Jan 10 19:38:29 derRichard: That seems likely Jan 10 19:38:44 a few days ago i saw qt configure failing in odd ways because docker guys thought it is a good idea to block the rather new statx() syscall :D Jan 10 19:54:23 derRichard: Ok, it appears to be the fault of some code I wrote, not some endemic system problem. Thanks for the help! Jan 10 19:57:36 JPEW: :-) Jan 10 20:06:51 huh Jan 10 20:06:54 | x86_64-poky-linux-ld.bfd: arch/x86/kernel/head_64.o: unable to initialize decompress status for section .debug_line Jan 10 20:06:57 anyone seen that before? Jan 10 20:07:47 zeddii: ^ Jan 10 20:08:20 one moment, i saw this Jan 10 20:10:08 rburton: okay, not x86_64. this was on arc Jan 10 20:16:32 rburton, what does "mut" (as in the git branch) stand for ? Jan 10 20:19:13 kroon: master under test Jan 10 20:25:17 bluelightning, ah! Jan 10 20:33:27 derRichard: still might be useful. any idea how to solve? Jan 10 20:34:55 rburton: in the arc case it was a bug in their gcc port Jan 10 20:35:10 what kernel and gcc version are you using? Jan 10 20:37:32 4.19.0 Jan 10 20:37:36 and whatever gcc is in thud Jan 10 20:38:14 8.2 Jan 10 20:38:17 hm i wonder if its a elfutils bug, lets revert that Jan 10 20:38:33 yes, i was about to ask that Jan 10 20:38:40 maybe another objtool issue ;-\ Jan 10 20:38:42 https://bugs.archlinux.org/task/61151 Jan 10 20:38:54 khem: hitting https://bugs.archlinux.org/task/61151 in thud, can we pick the fix for binutils Jan 10 21:30:31 is it possible to disable bitbake from building *-dev and *-staticdev packages for a specific recipe? Jan 10 21:43:12 aehs29, I am trying your multiconf patches to see if they fix my problem Jan 10 21:45:27 robbawebba, for *-staticdev, checkout no-static-libs.inc *I think* Jan 10 21:46:08 robbawebba, oh, didnt read the part "for a specific recipe" Jan 10 21:47:20 robbawebba, but yeah figure out how to pass extra configure flags so that no static libs are created and append that to your build configuration Jan 10 21:47:26 robbawebba: are the packages empty or do they contain files? Jan 10 21:48:00 if they contain files you'll need to delete those or otherwise prevent them from being installed at do_install time Jan 10 21:49:06 then, you'd need to set ALLOW_EMPTY_${PN}-dev = "0" and ALLOW_EMPTY_${PN}-staticdev = "0" Jan 10 21:49:58 (you could exclude them from PACKAGES instead but that can be tricky depending on what else is going on) Jan 10 22:02:41 not sur ewhat efect removing them from pakcages would have on the depchains logic, if any Jan 10 22:02:44 hmm Jan 10 22:20:04 armpit: they probably will fix the issue in your case, but I had a talk with RP and some changes are still gonna be necessary, so I'll still send a v2 at some point Jan 10 22:20:32 k. Jan 10 22:37:26 wtf Jan 10 22:37:27 file /usr conflicts between attempted installs of pango-1.42.4-r0.core2_64 and libcairo2-1.14.12-r0.core2_64 Jan 10 22:43:25 bluelightning: they contain files. This is for a custom recipe that inherits from go.bbclass. The -dev and -staticdev packages contain the source code, but I would like to not create these packages if possible. This recipe fetches from a monorepo and has a ton of stuff inside it, such as static library files, documentation, makefiles, etc... Jan 10 22:44:07 bluelightning: okay, I'll try to delete the files during do_install_append. Thanks for the tip! Jan 10 22:55:25 aehs29, that fixes my problem Jan 10 22:55:27 thanks Jan 10 22:55:46 armpit: great Jan 10 23:13:27 halstead: should we point to eclipse-full for the SDK files that will be kept or should we use the partial mirror URL? Jan 10 23:15:34 moto-timo, Use the partial mirror since it will stay around for sure. The full mirror will just be for the community. Jan 10 23:15:59 moto-timo, Lets get those files copying automatically. Jan 10 23:26:18 halstead: thank you, just wanted to double check. Agreed on automation. Jan 10 23:44:11 moto-timo, Can you confirm that http://downloads.yoctoproject.org/eclipse/downloads/drops4/R-4.9-201809060745/ is all we need? Jan 10 23:45:02 moto-timo, I can mirror the whole drop if that is better. Just mirring *linux-gtk-x86_64.tar.gz right now. Jan 10 23:54:57 halstead: trying to figure out their new versioning scheme (2018-09, 2018-12 and so on versions) Jan 10 23:55:25 halstead: 4.7.3, 4.7.3.a, 4.8.* should all be backed up Jan 10 23:56:49 halstead: https://download.eclipse.org/eclipse/downloads/drops4/R-4.8-201806110500/ Jan 10 23:57:07 halstead: https://download.eclipse.org/eclipse/downloads/drops4/R-4.9-201809060745/ Jan 10 23:57:24 halstead: https://download.eclipse.org/eclipse/downloads/drops4/R-4.10-201812060815/ Jan 10 23:57:43 hey all, trying to install an ESDK generated from krogoth based env....I've tried ESDKs generated from several images (including core-image-minimal), and on the last install step I get a ton of these errors: Jan 10 23:57:51 ERROR: Unexpected tasks or setscene left over to be executed: Jan 10 23:57:51 task 1114 of 2442 (ID: 1178, /home/ebolton/poky_sdk/layers/poky/meta/recipes-extended/parted/parted_3.2.bb, do_fetch) Jan 10 23:59:14 ebolton: if you can, consider using normal SDKs instead Jan 10 23:59:48 the traditional ones are more reliable, especially in an older release like krogoth Jan 11 00:00:09 rburton: lol, they work fine....but the whole point of what I'm working on is trying out ESDK, I guess they first showed up in krogoth so maybe not so much? Jan 11 00:00:10 moto-timo, I meant when you open the link and look at the index. Are files there the only ones needed to save for YP in a drop? Jan 11 00:00:35 ebolton: pretty much. the flexibility is nice but they're a bit more fragile, especially in krogoth Jan 11 00:01:24 rburton: will do Jan 11 00:17:41 RP: fyi, mut was mostly green on the ab Jan 11 00:32:15 * armpit ab's of steel Jan 11 01:02:49 halstead: oh duh. yes. **** ENDING LOGGING AT Fri Jan 11 02:59:57 2019