**** BEGIN LOGGING AT Tue Jul 31 03:00:01 2018 Jul 31 06:27:13 Please, take a look over this post! https://stackoverflow.com/questions/51496061/using-files-generated-by-other-recipes-in-yocto Jul 31 07:26:07 hello i need to update some files in SDK Jul 31 07:27:14 in yocto build it is placed in /home/jozo/0/boards/my/tmp/sysroots/x86_64-nativesdk-company_sdk-linux/opt/dm/2.3-r4/sysroots/x86_64-company_sdk-linux/usr/include Jul 31 07:27:34 how can I access this directory from my .bb recipe ? Jul 31 07:27:47 bitbake -e shows nothing Jul 31 07:28:09 i need to apply dirty hack in my recipe Jul 31 07:35:50 hello Jul 31 07:36:54 I have a project in which I would like for a recipe in layer A to include a bbclass that is in a layer B Jul 31 07:38:52 I tried to modify the recipe from layer A " inherit ../metalayerB/classes/bbclass Jul 31 07:39:03 Alex___: no problem, inherit it Jul 31 07:39:50 Alex___: recipes in various layers are all taken into account by bitbake, considerig the layer priority though Jul 31 07:40:27 Alex___: you don't need to specify the full path Jul 31 07:51:23 Why does my /tmp/sysroots/ directory is empty? As far as I know there should be inter-recipe shared files... Jul 31 07:56:33 thank you mckoan Jul 31 07:58:15 can I inherit only a single task from that bbclass? eg inherit bbclass task1 ? Jul 31 07:59:07 Alex___: why? you inherit the class and you use only the functions you need Jul 31 07:59:38 is there a way how to get path to pdk ? Jul 31 07:59:43 sdk Jul 31 08:00:05 jozo: what do you mean? Jul 31 08:00:53 mckoan: i have yocto with openssl 1.0 Jul 31 08:01:04 in my project i need openssl 1.1 Jul 31 08:01:10 but can't upgrade yocto Jul 31 08:01:40 so easyest way is to create openssl11 package and replace headers/libraries Jul 31 08:02:04 but i don;t know how to get path to dir where SDK is generated Jul 31 08:02:30 in my system it is /home/jozo/0/boards/my/tmp/sysroots/x86_64-nativesdk-company_sdk-linux/opt/dm/2.3-r4/sysroots/x86_64-company_sdk-linux/usr/include Jul 31 08:24:46 I'm using a tmpfs for the workdir, but I dont have enough RAM to build a complete image in it. Is there an alternative solution how I can keep the workdir in RAM as long as possible? Jul 31 08:29:00 styx_: tmpfs ? Jul 31 08:29:24 jozo: tmpfs has a fixed sized afaik Jul 31 08:29:46 styx_: you can remount it with desired size Jul 31 08:30:20 mount -o remount,size=[NEW MAX SIZE HERE] tmpfs /tmp Jul 31 08:30:33 I dont have enough RAM to make it big enough Jul 31 09:06:43 styx_: rm_work to remove the work dirs as they're finished with Jul 31 09:07:10 i do all my builds in a 32gb tmpfs, webkit in parallel with llvm is the only time it fills up Jul 31 09:07:30 obviously put the sstate outside of the tmpfs then if you need to unmount/remount you still have sstate Jul 31 09:09:32 rburton: I already have the sstate cache out of the workdir and also rm_work. I increated the ramfs size and then added some swap to balance it Jul 31 09:10:35 how big is your tmpfs? Jul 31 09:10:54 if you're putting a tmpfs in swap then what's the point? Jul 31 09:11:19 the entire point is that you have enough ram spare that you can do builds in memory without touching disk Jul 31 09:11:42 80GB has the tmpfs and the SWAP is a swap file on disk. Jul 31 09:13:05 i've 64GB of RAM, 30GB tmpfs, no swap Jul 31 09:13:34 but i do avoid building llvm or webkit Jul 31 09:17:50 I guess you're building only small "oe-core", with world builds I was getting quite close to 80GB with TMPDIR Jul 31 09:18:09 and it wasn't enought every time more components were broken (so rm_work wasn't executed for them) Jul 31 09:18:43 with few *webkit*, chromium, llvm recipes included in the same build it's difficult to fit Jul 31 09:20:05 JaMa: yeah, if i need to build llvm/clang/webkit i tend to just build those on their own first Jul 31 09:20:14 and the scheduler still doesn't allow to run rm_work as soon as possible, so the only option which worked for me for quite long time, was to build in couple steps, instead of whole image at once Jul 31 09:21:09 yes, with 8GB tmfps long time ago I remember running gcc-cross, virtual/kernel, gcc, minimal-image, bigger-image, full-image :) Jul 31 09:21:23 nice! Jul 31 09:22:23 but now even with rm_work it leaves (or rather recreates) bunch of files, so the separate steps aren't as efficient as they used to be and 8GB isn't worth trying even for smallish images Jul 31 12:01:50 \join #poky Jul 31 12:09:41 maxin: sad that we still have those issues 4 years later :( Jul 31 12:12:09 RP: true , in the case of vulkan-demos, gitsm fails to fetch behind the proxy :( Jul 31 12:14:00 maxin: I'd have hoped that would work but clearly not. That is perhaps worth a bug Jul 31 12:15:15 RP: will file a bug for it Jul 31 12:15:42 maxin: thanks Jul 31 12:20:46 rburton: I've an fallocate change I'll queue locally Jul 31 12:30:18 Can anyone point me to where I should send a patch for https://github.com/Freescale/kernel-module-imx-gpu-viv ? Jul 31 12:42:43 deuteron: you could try to send it back to the repo itself Jul 31 12:43:25 deuteron: probably otavio[m] will take it into account Jul 31 12:44:53 deuteron: send a PR Jul 31 12:45:47 Can I just tell you what's wrong? It really is trivial. Jul 31 12:45:57 hi Jul 31 12:46:25 deuteron: it would be better if you fork the repository and send a PR against master. So we can review and merge it. Jul 31 12:46:33 im trying to understand what is "POKYQEMUDEPS_remove = "packagegroup-core-device-devel"" doing Jul 31 12:46:49 i checked packagegroup-core-device-devel and its a recipe from openembedded Jul 31 12:47:02 http://cgit.openembedded.org/openembedded-core/tree/meta/recipes-devtools/packagegroups/packagegroup-core-device-devel.bb?h=master Jul 31 12:47:04 its this one Jul 31 12:47:35 and im trying to understand if that line, pokyqemudeps_remove is removing the packages specified in the recipe Jul 31 12:47:50 RDEPENDS_${PN} = "\ distcc-config \ nfs-export-root \ bash \ binutils-symlinks \ " Jul 31 12:47:51 it removes 'packagegroup-core-device-devel' from the variable POKYQEMUDEPS Jul 31 12:47:54 These ones Jul 31 12:48:17 aha i see Jul 31 12:48:47 and where can i see the the packages on pokyqemudeps? Jul 31 12:48:57 is there a manual where pokyqemudeps is specified or ? Jul 31 12:52:04 its part of the poky.conf distro config Jul 31 12:52:35 if you're not using poky then it does nothing Jul 31 13:04:27 im using poky, im building a qemu image with it Jul 31 13:04:39 and im tring to understand what that line is doing Jul 31 13:04:56 im still quite new tho Jul 31 13:05:09 so i checked on poky/meta/conf/distro Jul 31 13:05:37 and i found a conf there but i dont see anything related to pokyqemudeps nor the packagegroup-core-device-devel Jul 31 13:05:48 did i misunderstand you or? Jul 31 13:07:37 nvm found it Jul 31 13:07:46 its on meta-poky not meta :/ Jul 31 13:08:55 yes, poky is in meta-poky Jul 31 13:09:40 POKYQEMUDEPS = "${@bb.utils.contains("INCOMPATIBLE_LICENSE", "GPL-3.0", "", "packagegroup-core-device-devel",d)}" DISTRO_EXTRA_RDEPENDS_append_qemuarm = " ${POKYQEMUDEPS}" DISTRO_EXTRA_RDEPENDS_append_qemuarm64 = " ${POKYQEMUDEPS}" DISTRO_EXTRA_RDEPENDS_append_qemumips = " ${POKYQEMUDEPS}" DISTRO_EXTRA_RDEPENDS_append_qemuppc = " ${POKYQEMUDEPS}" DISTRO_EXTRA_RDEPENDS_append_qemux86 = " ${POKYQEMUDEPS}" DISTRO_EXTRA_RDEPENDS_append_ Jul 31 13:10:15 all your statement is doing is removing packagegroup-core-device-devel from POKYQEMUDEPS Jul 31 13:10:42 so that packagegroup gets removed from images (unless something else pulls it in) Jul 31 13:10:54 cool Jul 31 13:11:07 now my aim is to check whether that package is being removed or not Jul 31 13:11:35 and im assuming that package contains these tools: RDEPENDS_${PN} = "\ distcc-config \ nfs-export-root \ bash \ binutils-symlinks \ " Jul 31 13:11:39 yes Jul 31 13:11:43 http://cgit.openembedded.org/openembedded-core/tree/meta/recipes-devtools/packagegroups/packagegroup-core-device-devel.bb?h=master Jul 31 13:11:44 from this Jul 31 13:11:51 image manifest will tell you what is in the image, in deploy/images Jul 31 13:12:18 assumely, if i run the qemu image now, bash shouldnt be installed there Jul 31 13:12:20 right? Jul 31 13:12:32 well, thats just one way that bash can get into an image Jul 31 13:12:47 you might find it easier to say what youre actually trying to do Jul 31 13:13:33 i need to make a testcase to check if the packagegroup is being removed or not, but since im new to yocto, im trying to understand if on the way Jul 31 13:14:16 the project im working on is https://github.com/pelagicore/pelux-manifests Jul 31 13:14:46 then you just need to look at the image manifest Jul 31 13:15:08 New news from stackoverflow: Use Cmake with Yocto Jul 31 13:15:38 image manifest? you mentioned that this will be on deploy/images Jul 31 13:15:56 yes, if you want to know what actually ended up in an image, you look at the image manifest Jul 31 13:16:01 build/tmp/deploy/images/qemux86-64$ Jul 31 13:16:22 all i've got here are the images.. i dont understand what u mean by image manifest? Jul 31 13:16:29 you mean run the image? Jul 31 13:16:37 otavio[m]: Done! Jul 31 13:20:49 rburton: sorry for the stupid question, found it now Jul 31 13:38:16 neverpanic : Thank you for taking time and putting me in the right direction. The folder had some files which was indeed in wrong architecture. Jul 31 14:09:15 otavio[m]: Do I need to do another pull request to change the commit log? Jul 31 14:19:27 https://stackoverflow.com/questions/51496061/using-files-generated-by-other-recipes-in-yocto Jul 31 14:42:57 otavio[m]: I think I did it wrong. The pull request now refers to my new changeset but your original comments have gone missing. Jul 31 15:20:53 Hi guys & gals. Does anyone know how to use header files from another recipe to the one I am trying to build? Jul 31 15:21:21 you have to package them in the first recipe into a dev package.. Jul 31 15:21:31 then require the recipe/dev package in the recipe that is going to use them.. Jul 31 15:21:43 you can not 'directly' access stuff from one recipe to another, intentionally Jul 31 15:23:29 Okay thanks for the fast reply!! Jul 31 15:24:55 When you say require the recipe/dev package do you mean via depends? Jul 31 15:25:24 the package you want to build should just have DEPENDS = "the-other-recipe-name" in Jul 31 15:26:24 That is what I tried to do but it does not seem to work. Also when I use the bitbake -e |^WORKDIR i cannot find the headers in there while they are being built when I use the other recipe Jul 31 15:27:15 I mean in the Work Directory* Jul 31 15:28:13 and this happens with a meta-intel-qat recipe, so I find it quite odd Jul 31 15:28:20 Hi, after applying a patch, I get the following error when building https://paste.gnome.org/pu9gddqwx. I checked out back a known working state and am still getting the same error. If I `rm -rf build/tmp` I can get it to build again (~30m to build), but applying my patch causes the error again. How can I clean just enough state for this to build properly. It looks like this dir is missing `/home/tpreston/muos/build/tmp/sysroots-components/jetson_tx2/dep Jul 31 15:28:20 modwrapper-cross` Jul 31 15:28:41 qantel: You have to install the headers as part of the do_install task. Jul 31 15:29:13 @deuteron : you mean of the first package that I need? Jul 31 15:29:33 Yes. The one you want the headers of. Jul 31 15:30:07 tpreston: bitbake -c cleansstate perhaps? Jul 31 15:37:20 deuteron: now it can't seem to find `/home/tpreston/muos/build/tmp/sysroots-components/aarch64` Jul 31 15:37:51 How can I find out what provides sysroots-components? Jul 31 15:38:53 Sorry, the latest yocto I've used is 2.2 (I think). Never seen sysroot-components before. Jul 31 15:39:07 sysroots-components isn't provided by anything, it's a folder that contains subfolders that contain files a recipe would put into the sysroot if you declare a dependency on it Jul 31 15:39:44 okay so the error is that it can't find Jul 31 15:39:46 /home/tpreston/muos/build/tmp/sysroots-components/aarch64/qemuwrapper-cross/usr/bin/crossscripts/qemuwrapper Jul 31 15:39:54 And the first thing missing is Jul 31 15:39:57 /home/tpreston/muos/build/tmp/sysroots-components/aarch64/ Jul 31 15:40:37 Will `bitbake -c cleansstate resin-image-initramfs` not clean up/rebuild it's dependencies? Jul 31 15:40:48 it should Jul 31 15:41:06 did you check that it has a dependency on the task that provides qemuwrapper-cross? Jul 31 15:41:52 cleansstate won't rebuild dependencies Jul 31 15:42:05 oh, right. But cleansstate also shouldn't cause this error? Jul 31 15:42:16 You probably need to rebuild qemuwrapper-cross Jul 31 15:44:36 deuteron: how does one "rebuild" in yocto? I feel lost just throwing out random incantations of `-f` `-c clean` `-c cleansstate` Jul 31 15:45:18 just bitbake $recipe should usually be enough, unless the sstate cache is broken Jul 31 15:46:33 I usually do 'bitbake -c cleansstate ; bitbake ' Jul 31 15:47:00 That's a rebuild from scratch without (re)fetching the source. Jul 31 15:49:26 fwiw a better way is bitbake foo -C unpack Jul 31 15:49:33 build foo, forcibly running the unpack task Jul 31 15:49:49 *but* remember a proper rebuild like that implies that your recipe is broken Jul 31 15:51:49 a clean rebuild of qemuwrapper-cross has another dependency Jul 31 15:51:56 it's dependencies all the way down! Jul 31 15:51:59 :p Jul 31 15:52:22 and that also fails? Jul 31 15:53:09 Exception: FileNotFoundError: [Errno 2] No such file or directory: '/home/tpreston/muos/build/tmp/sysroots-components/x86_64/qemu-native/usr/libexec/qemu-bridge-helper' -> '/home/tpreston/muos/build/tmp/work/aarch64-poky-linux/qemuwrapper-cross/1.0-r0/recipe-sysroot-native/usr/libexec/qemu-bridge-helper' Jul 31 15:53:43 that suggests the sysroot for the build of qemuwrapper-cross cannot be set up, because files from sysroots-components are missing Jul 31 15:54:10 those shouldn't be missing if bitbake thinks it doesn't need to repeat the do_populate_sysroot task of qemu-native, so something's off in your installation Jul 31 15:54:27 Can I recommend wiping your tmp/ and re-trying? That should re-setup the sysroot components from sstate cache Jul 31 15:55:37 bah, I did this earlier and it took 30 mins to build. I think you're right though, let's see where a clean rebuild gets us Jul 31 15:56:00 It should just be a lot of IO due to the sstate cache Jul 31 15:58:45 tpreston: is that with master, or a release? Jul 31 15:59:20 rburton: if you're asking about yocto we're on rocko Jul 31 16:04:29 ah ha, it didn't take so long for that recipe. Looks like the rm tmp fixed this one. Jul 31 16:10:49 wiping tmp doesn't rebuild anything under normal circumstnaces, as rburton just said, it just involves i/o to extract the sstate cache archives Jul 31 16:54:02 <+SP9002_@efnet> so, he wants the win. so we're just gonna get lunch or something, then hes gonna push me to the ground and tap my ass with his foot so he can claim he "kicked my ass" tbh im going along with it becase I dont wanna lose any teeth Jul 31 16:54:02 With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ Jul 31 16:54:06 I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ Jul 31 16:54:09 or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ Jul 31 16:59:03 <18VAESHNY> <+SP9002_@efnet> so, he wants the win. so we're just gonna get lunch or something, then hes gonna push me to the ground and tap my ass with his foot so he can claim he "kicked my ass" tbh im going along with it becase I dont wanna lose any teeth Jul 31 16:59:07 <18VAESHNY> With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ Jul 31 16:59:10 <18VAESHNY> I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ Jul 31 16:59:13 <18VAESHNY> or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ Jul 31 17:03:42 <+SP9002_@efnet> so, he wants the win. so we're just gonna get lunch or something, then hes gonna push me to the ground and tap my ass with his foot so he can claim he "kicked my ass" tbh im going along with it becase I dont wanna lose any teeth Jul 31 17:03:42 With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ Jul 31 17:04:51 what is up with these bots Jul 31 17:06:38 somebody is on a personal vendetta against some freenode staff, apparently. Jul 31 17:14:33 deuteron: merged; thanks. Jul 31 17:14:44 Are you going to send a bump for the recipe? Jul 31 17:29:03 <+SP9002_@efnet> so, he wants the win. so we're just gonna get lunch or something, then hes gonna push me to the ground and tap my ass with his foot so he can claim he "kicked my ass" tbh im going along with it becase I dont wanna lose any teeth Jul 31 17:29:06 With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ Jul 31 17:29:10 I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ Jul 31 17:29:13 or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ Jul 31 18:38:56 <+SP9002_@efnet> so, he wants the win. so we're just gonna get lunch or something, then hes gonna push me to the ground and tap my ass with his foot so he can claim he "kicked my ass" tbh im going along with it becase I dont wanna lose any teeth Jul 31 18:38:56 With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ Jul 31 18:38:59 I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ Jul 31 18:39:02 or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ Jul 31 18:43:59 <+SP9002_@efnet> so, he wants the win. so we're just gonna get lunch or something, then hes gonna push me to the ground and tap my ass with his foot so he can claim he "kicked my ass" tbh im going along with it becase I dont wanna lose any teeth Jul 31 18:43:59 With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ Jul 31 18:44:02 I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ Jul 31 18:44:05 or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ Jul 31 18:54:02 <+SP9002_@efnet> so, he wants the win. so we're just gonna get lunch or something, then hes gonna push me to the ground and tap my ass with his foot so he can claim he "kicked my ass" tbh im going along with it becase I dont wanna lose any teeth Jul 31 18:54:06 With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ Jul 31 18:54:09 I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ Jul 31 18:54:10 <+SP9002_@efnet> so, he wants the win. so we're just gonna get lunch or something, then hes gonna push me to the ground and tap my ass with his foot so he can claim he "kicked my ass" tbh im going along with it becase I dont wanna lose any teeth Jul 31 18:54:11 <+SP9002_@efnet> so, he wants the win. so we're just gonna get lunch or something, then hes gonna push me to the ground and tap my ass with his foot so he can claim he "kicked my ass" tbh im going along with it becase I dont wanna lose any teeth Jul 31 18:54:12 or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ Jul 31 18:54:14 With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ Jul 31 18:54:14 With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ Jul 31 18:54:17 I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ Jul 31 18:54:18 I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ Jul 31 18:54:20 or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ Jul 31 18:54:21 or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ Jul 31 19:04:24 <+SP9002_@efnet> so, he wants the win. so we're just gonna get lunch or something, then hes gonna push me to the ground and tap my ass with his foot so he can claim he "kicked my ass" tbh im going along with it becase I dont wanna lose any teeth Jul 31 19:04:28 With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ Jul 31 19:04:31 I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ Jul 31 19:04:34 or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ Jul 31 19:21:48 <+SP9002_@efnet> so, he wants the win. so we're just gonna get lunch or something, then hes gonna push me to the ground and tap my ass with his foot so he can claim he "kicked my ass" tbh im going along with it becase I dont wanna lose any teeth Jul 31 19:21:51 With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ Jul 31 19:21:54 I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ Jul 31 19:21:57 or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ Jul 31 19:24:34 what task/function sets up the initial variable names like DEPLOY_DIR, WORKDIR, etc? Jul 31 19:25:54 yates: meta/conf/bitbake.conf sets most of those Jul 31 19:26:35 yates: bitbake -e can help you figure out where those sorts of things come from Jul 31 19:28:00 so it's done by bitbake itself? then i can assume they are available in my custom bbclass functions? Jul 31 19:28:07 no, it's not done by bitbake itself Jul 31 19:28:10 it's done by bitbake.conf in oe-core Jul 31 19:28:16 as JPEW just indicated Jul 31 19:28:35 and yes, it's in the global configuration metadata, which is accessible by classes and recipes Jul 31 19:30:36 so what dependency or inherit fires off functions in the oe-core stuff that reads this file? Jul 31 19:32:16 e.g., if i had a recipe which used a simple custom bbclass that inherited/depended on nothing, the bitbake.conf variables would not be defined. hwo do i get them defined? Jul 31 19:33:24 is there some top-level inherit to be done in my bbclass? Jul 31 19:33:38 "inherit oe-core" Jul 31 19:33:39 ? Jul 31 19:33:54 i just told you all recipes and bbclasses get access to the configuration metadata Jul 31 19:34:26 bitbake parses conf/bitbake.conf from BBPATH, then inherits all classes in INHERIT, then parses recipes and classes inherited by the recipes, then assembles a runqueue and does the build Jul 31 19:34:31 with appropriate event handlers called along the way Jul 31 19:34:48 classes and recipes always go based on the globalconfiguration metadata, so always have access to those variables Jul 31 19:35:36 you might benefit from reading http://www.aosabook.org/en/yocto.html, it has a high level overview of what bitbake does. it's not 100% current, but the basics hold true Jul 31 19:36:24 "bitbake parses conf/bitbake.conf from BBPATH". how does that make my statement "so it's done by bitbake itself" false? (of course the BBPATh has to be deifned, but big deal) Jul 31 19:36:40 ok, thanks i will definitely have a look Jul 31 19:37:54 bitbake parses a file Jul 31 19:38:02 the contents of that file are up to the layers, not bitbake itself Jul 31 19:38:12 it's like make, a build tool. what's done with it is not up to it Jul 31 19:40:44 but bitbake does not have to be instructed to scan BBPATH and load the .conf file(s) there. that behavior is built-in to bitbake. sure, the conf files are custom Jul 31 19:40:51 is that not true? Jul 31 19:41:54 very few specific files are hardcoded. bblayers.conf, layer.conf in each layer, and bitbake.conf. everything else, and the contents of those files, are all controlled by the layers Jul 31 19:42:24 you may think the distinction is academic, but 1) it helps to understand the dividing line between bitbake and oe if you want to understand what's actually happenign, and 2) oe/oe-core isn't the only project using bitbake Jul 31 19:45:18 makes perfect sense to me, and it is these academic distinctions are fundamental to my ability to build a model of how this system works. so i am good with academic. Jul 31 19:46:37 a mental model, that is. Jul 31 19:46:43 kergoth: Out of curosity, who else uses bitbake? Jul 31 19:48:15 yeah, some folks prefer bottom-up learning, others top-down. i find an understanding of the big picture and how the pieces fit together to be helpful Jul 31 19:48:43 <+SP9002_@efnet> so, he wants the win. so we're just gonna get lunch or something, then hes gonna push me to the ground and tap my ass with his foot so he can claim he "kicked my ass" tbh im going along with it becase I dont wanna lose any teeth Jul 31 19:48:47 With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ Jul 31 19:48:50 JPEW: isar for one, they use bitbake to build debian images from debian package feeds, and has classes to use debian tooling to build debian packages from recipes Jul 31 19:48:51 I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ Jul 31 19:48:54 section A.4, "The Hello World Example" in the bitbake manual is one of the most useful pieces of info i've come across in the project Jul 31 19:48:54 or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ Jul 31 19:49:00 JPEW: https://github.com/ilbers/isar Jul 31 19:49:13 i loathe bottom-up. Jul 31 19:49:21 their priorities are very different than oe-core, and doesn't cross-compile at all, or didn't until recently Jul 31 19:50:13 uses debootstrap/multistrap/etc to construct a chroot (not just a sysroot) for the builds, and requires sudo Jul 31 19:50:22 * kergoth worked on it a little recently Jul 31 19:50:34 kergoth: Interesting Jul 31 19:51:19 it really is, yeah. one of the first real world non-oe uses of bitbake i've seen other than oe-lite (which is worth mentioning too, they do a number of things differently) Jul 31 20:23:43 I just moved to Yocto Rocko and for some reason its as if bitbake no longer sees the system $PATH Jul 31 20:23:55 anyone ever see this? Jul 31 20:26:21 if I put the full path to my application it will find it, but then fails later because it can't find xsltproc (even though that is in my $PATH as well) Jul 31 20:26:58 pabdaddy: you may hit recipe-specific sysroots? Jul 31 20:27:08 pabdaddy: make sure your recipes declare all their dependencies. Jul 31 20:35:13 neverpanic this worked on morty but now it doesn't Jul 31 20:35:16 its very weird Jul 31 20:35:48 other issue I'm having is i keep getting 'no provider' errors on things like /bin/perl Jul 31 20:38:02 btw, looked in sysroots and I don't have anything but sysroots-components i have files but no files for recipe i'm interested in Jul 31 20:39:54 If I read the branches correctly, morty didn't have recipe-specific sysroots, and rocko does Jul 31 20:40:33 http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/meta/classes/staging.bbclass?h=rocko&id=9107d6ca144ac1f6169830dee25dae2dad775333 for an explanation what it does Jul 31 20:41:07 Basically, everything your recipe didn't specify a dependency on isn't there. So if you're lacking /bin/perl, check whether its in your DEPENDS. If it isn't, it should be. Jul 31 20:42:32 i have a recipe and bbclass that should run do_mkfat32 and do_copyfiles. i see them in the dependencies of the -e output, but they don't seem to be actually running: https://paste.fedoraproject.org/paste/eKPbe8MnJbYftGUBnZSBbQ Jul 31 20:43:26 <+SP9002_@efnet> so, he wants the win. so we're just gonna get lunch or something, then hes gonna push me to the ground and tap my ass with his foot so he can claim he "kicked my ass" tbh im going along with it becase I dont wanna lose any teeth Jul 31 20:43:26 With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ Jul 31 20:43:28 I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ Jul 31 20:43:31 or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ Jul 31 20:43:45 <+SP9002_@efnet> so, he wants the win. so we're just gonna get lunch or something, then hes gonna push me to the ground and tap my ass with his foot so he can claim he "kicked my ass" tbh im going along with it becase I dont wanna lose any teeth Jul 31 20:43:47 pabdaddy: also: https://www.yoctoproject.org/docs/current/mega-manual/mega-manual.html#migration-2.3-recipe-specific-sysroots Jul 31 20:43:48 With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ Jul 31 20:43:52 I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ Jul 31 20:43:55 or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ Jul 31 20:44:09 gosh, that's annoying... Jul 31 20:45:02 the recipe bitbakes without error... Jul 31 20:46:06 any ideas why they aren't being run? Jul 31 20:48:19 Your _task_deps don't seem like anything is depending on your two custom tasks Jul 31 20:52:30 neverpanic: i don't see why you're saying that. they are both in the _task_deps list. Jul 31 20:54:09 perhaps i'm not interpreting _task_deps correclty Jul 31 20:54:12 corretly Jul 31 20:54:15 they're in, but only mentioned in the list of tasks. Non of your custom tasks have parents. Jul 31 20:54:30 I'd suggest you format the struct in $task_deps Jul 31 20:54:43 https://p.dnnr.de/fH8s8QfrcTJHxn15 Jul 31 20:55:07 did you do that by hand? Jul 31 20:55:20 No, I piped it through python -mjson.tool Jul 31 20:55:33 (after replacing the single quotes with double quotes) Jul 31 20:57:26 like this: cat bitbake.out | python -mjson.tool Jul 31 20:57:37 i get "No JSON object could be decoded" Jul 31 20:57:47 (i replaced ' with ") Jul 31 20:57:54 No. I copy-pasted the relevant part form the output, replaced single quotes with double quotes in vim and piped it through python -mjson.tool Jul 31 20:58:19 oh, crap. yeah. Jul 31 21:20:54 got it Jul 31 21:24:08 <+SP9002_@efnet> so, he wants the win. so we're just gonna get lunch or something, then hes gonna push me to the ground and tap my ass with his foot so he can claim he "kicked my ass" tbh im going along with it becase I dont wanna lose any teeth Jul 31 21:24:11 With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ Jul 31 21:24:14 I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ Jul 31 21:24:17 or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ Jul 31 21:24:44 if i modify .bb and write it to disk, then shouldn't bitbake definitely rerun it? i am getting "Attempted n tasks of which n didn't need to be rerun" Jul 31 21:26:00 yates: It will only re-run the tasks that changed Jul 31 21:26:05 only if your modifications affect the tasks being run, and bitbake knows about it Jul 31 21:26:14 E.g. if the SRC_URI and checksums didn't change, why would it re-run the fetch and unpack phases? Jul 31 21:26:49 ok Jul 31 21:27:02 does -c cleansstate subsume -c clean? Jul 31 21:27:48 cleansstate cleans the work directory + the sstate cache (ie the cache that it uses to restore tasks that were already completed), clean just cleans the work directory Jul 31 21:28:15 Usually if you're recipe is written right, you sholdn't have to run cleansstate. Reality sometimes differs and it's a helpful tool to debug. Jul 31 21:29:20 ok Jul 31 21:36:32 is there a function that will emit a message on the screen when running a recipe? i've tried "echo" but i don't see its output Jul 31 21:36:39 just for debugging Jul 31 21:37:10 we don't run recipes, we run tasks, but yes, you can use bbnote/bberror/bbwarn or bb.note/bb.error/bb.warn if shell or python, respectively Jul 31 21:38:51 thanks Jul 31 21:39:43 neverpanic: Let me ask you another question. We have a recipe with a library that uses openssl 1.0.0 but when I try to build the recipe it says that openssl 1.0.0 is not provided (only 1.0.2 is provided) . However, the library that we use was built with openssl 1.0.2 but if you grep the library it will say 1.0.0. Jul 31 21:40:20 ok, my tasks now have parents, but they are still not running: https://paste.fedoraproject.org/paste/BRIfVrVewQK10Yuc8ztB3g Jul 31 21:41:02 neverpanic: Just wondering if yocto should label all providers as 1.0.0 and not worry about the minor rev Jul 31 21:41:07 and yet the recipe completes without error Jul 31 21:41:09 pabdaddy: SOVERSION is often not equal to the recipe version, and especially in OpenSSL's case I think it isn't. Jul 31 21:41:36 pabdaddy: And no, Yocto should use the SOVERSION to label things, as that's what matters for linking. Jul 31 21:42:05 neverpanic: I was able to work around the issue by manually changing 1.0.0 to 1.0.2 in the library Jul 31 21:42:16 neverpanic: its a hack but it seems to work Jul 31 21:42:54 yates: this would be easier if you shared your recipe, but making do_mkfat32fs a dependency of do_build looks like a good first step. Jul 31 21:42:59 pabdaddy: It's a hack. Don't do that. Jul 31 21:43:31 neverpanic: here is image_type_fat32.bbclass: https://paste.fedoraproject.org/paste/RZN5Qs10zisxca3sZxVQCw Jul 31 21:43:40 neverpanic: so how then do you fix it? I recompiled our library and it still says 1.0.0 in the library itself even though it built with 1.0.2 openssl Jul 31 21:43:50 and linux-fs.bb: https://paste.fedoraproject.org/paste/4GYpFluveStupZ7MANfxdg Jul 31 21:44:40 yates: I think do_build is the last task to execute, so you may want to do mkfat32fs before that Jul 31 21:45:15 there needs to be a dependency chain copyfiles -> mkfat32fs -> build (or mkfat32fs -> copyfiles -> build, not sure in your case) Jul 31 21:45:45 yes, i thought that's what i was speicfying Jul 31 21:45:48 pabdaddy: It's absolutely fine that the library links against libssl1.0.0, that's the SOVERSION provided by OpenSSL (the project) 1.0.2 Jul 31 21:46:13 yates: you specified mkfat32fs *after* do_build Jul 31 21:46:30 right. Jul 31 21:47:02 now we got some action, baby! Jul 31 21:47:14 errors, but that's action... Jul 31 21:53:01 neverpanic: this is where i get confused. How do you specify the provider in your recipe if the provider version doesn't exist? In this case openembedded is building openssl 1.0.2n I believe but my recipe has a library that says its using 1.0.0? Jul 31 21:54:02 pabdaddy: You don't. Just specify a dependency on the OpenSSL recipe. Yocto will automatically figure out that the openssl 1.0.2n recipe provides libssl1.0.0 and libcrypto1.0.0 Jul 31 21:56:00 neverpanic: so are you saying that i should create a .bbappend and then add DEPENDS += ? Jul 31 21:56:16 neverpanic: bbappend for openssl that is Jul 31 21:56:45 Didn't you say *your* library uses openssl? Shouldn't your recipe specify a dependency on OpenSSL then, not the other way around? Jul 31 21:58:10 neverpanic: you are correct. So i guess I should be adding the DEPENDS to my recipe. The next question would be what then would that line look like? 'DEPENDS = "openssl"?? Jul 31 21:59:45 pabdaddy: https://www.yoctoproject.org/docs/current/mega-manual/mega-manual.html#var-DEPENDS and 3.1.7 to 3.1.9 of https://www.yoctoproject.org/docs/latest/bitbake-user-manual/bitbake-user-manual.html#appending-and-prepending Jul 31 22:01:00 neverpanic: thanks! Jul 31 22:01:26 neverpanic: I still have the issue of bitbake not seeing my $PATH Jul 31 22:01:41 neverpanic: any idea how that could happen? Jul 31 22:01:56 why do you need it to? Jul 31 22:02:47 <+SP9002_@efnet> so, he wants the win. so we're just gonna get lunch or something, then hes gonna push me to the ground and tap my ass with his foot so he can claim he "kicked my ass" tbh im going along with it becase I dont wanna lose any teeth Jul 31 22:02:51 With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ Jul 31 22:02:54 I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ Jul 31 22:02:57 or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ Jul 31 22:06:17 neverpanic: we have a recipe that relies on a binary to compile yang files. and this binary is in the $PATH. if i put an absolute path in the recipe it fixes that issue but then can't find xsltproc which is also in the $PATH Jul 31 22:07:10 neverpanic: just seems like I'm missing something. this seems basic and worked when we were using morty Jul 31 22:07:33 You should write a recipe that puts your compiler binary into the proper sysroot location; that would (a) fix the path issues automatically, and (b) you could have it depend on libxslt-native, which would provide xsltproc Jul 31 22:07:52 pabdaddy: this may or may not be the result of recipe-specific sysroots. Hard to tell. Jul 31 22:09:10 neverpanic: let's just say it is, would the fix then be to add the path to the recipe? Jul 31 22:09:44 You can try, but then you'll still need a dependency on libxslt-native for xsltproc to be in $PATH? Jul 31 22:09:46 is there a way to perform a function in a task that requires root privileges? Jul 31 22:09:52 like mount? Jul 31 22:09:56 yates: no Jul 31 22:10:00 No, you can't mount. Jul 31 22:10:36 which is part of why i suggested use of wic or investigation of other methods for partitioning and fs construction, lacking root means you often need to use other tools Jul 31 22:12:37 like a jail? Jul 31 22:13:03 well, let me see how the existing rootfs image does it for ext4 Jul 31 22:13:24 remember i am on an old morty branch... Jul 31 22:14:31 neverpanic: i have xsltproc in /usr/bin. If /usr/bin is also in the path i add to the recipe would that work? Or would I also need a DEPENDS += "libxslt-native" Jul 31 22:15:33 pabdaddy: The "correct" way to re-use it from /usr/bin used to be declaring a dependency on libxslt-native and the adding ASSUME_PROVIDED="libxslt-native" in your local.conf, but that may have changed with recipe-specific sysroots, so I can't answer that question right now Jul 31 22:23:05 can wic create fat32 partitions? Jul 31 22:23:55 neverpanic: I'm gonna run, but thanks for all your help. And just an FYI...adding this as the first line in do_compile worked,PATH=$PATH:~/confd/bin:/usr/bin, but it seems like bad practice Jul 31 22:24:10 very bad practice, yes Jul 31 22:24:38 kergoth: I just don't understand why its not seeing my $PATH Jul 31 22:25:13 bitbake uses a sanitized path to avoid build reproducibility problems Jul 31 22:25:27 only tools listed in HOSTTOOLS are allowed to be used from the host Jul 31 22:25:33 or HOSTTOOLS_NONFATAL Jul 31 22:25:44 assuming you're on a recent oe-core, anyway Jul 31 22:25:48 (or poky) Jul 31 22:26:50 without that we run into tons of problems with projects we build automatically enabling optional features and dependencies on some hosts but not others Jul 31 22:26:52 huge headache Jul 31 22:27:00 leads to non-reproducible builds Jul 31 22:27:46 also tends to cause failures when using sstate cache binaries built on one host on another host Jul 31 22:27:56 so yeah, add your tool to HOSTTOOLS_NONFATAL Jul 31 22:28:09 better would be to follow neverpanic's advice and use -native recipe dependencies Jul 31 22:28:35 yeah, if you have the choice, do it right from the start and save yourself the headaches down the road when you don't have the time to fix them. Jul 31 22:32:44 so is the correct format for an application called ~/confd/bin/confdc 'HOSTOOLS_NONFATAL += "~/confd/bin/confdc" ? Jul 31 22:34:05 where is the help (user manual) for wic? i've googled and don't see it Jul 31 22:34:22 no manpage either Jul 31 22:35:03 yates: always a good bet to start in the mega-manual: https://www.yoctoproject.org/docs/current/mega-manual/mega-manual.html#creating-partitioned-images-using-wic Jul 31 22:35:30 thank you! Jul 31 22:35:45 pabdaddy: no, HOSTTOOLS_NONFATAL += "confdc" Jul 31 22:35:50 pabdaddy: grep oe-core for HOSTTOOLS Jul 31 22:36:31 kergoth: i tried that and it doesn't work Jul 31 22:36:50 kergoth: run.do_compile.20161: confdc: not found Jul 31 22:38:58 kergoth: confdc is our binary Jul 31 22:39:23 as i said, HOSTTOOLS_NONFATAL += "confdc" Jul 31 22:40:20 kergoth: thats exactly what i id Jul 31 22:40:21 did Jul 31 22:40:42 if it's in your PATH and is in HOSTTOOLS_NONFATAL, then it'll be able to run in your recipe Jul 31 22:40:58 most likely PATH isn't what you think it is, or you're on an older release, or it's not re-running the hosttools setup Jul 31 22:41:05 worst case wipe tmp and build again Jul 31 22:41:11 that'll force it to re-run the hosttools setup Jul 31 22:42:25 kergoth: in recipe HOSTTOOLS_NONFATAL += "confdc xsltproc" and here is the $PATH Jul 31 22:42:34 it's not a recipe configuration setting Jul 31 22:42:44 it's a global variable used by a one-time setup before running any recipes Jul 31 22:42:45 oooo Jul 31 22:42:47 set it in local.conf Jul 31 22:43:00 ahhhh Jul 31 22:43:31 why couldn't i just sudo such commands? Jul 31 22:43:44 does bitbake block that somehow? Jul 31 22:43:57 yates: you could, assuming your user is set up to allow it, but it's horrible, violates all oe-core policies, you'd be on your own Jul 31 22:44:05 but yes, it's workable, assuming you're set to NOPASSWD Jul 31 22:44:22 ok Jul 31 22:44:37 kergoth: can this go in my layer.conf instead? We don't check in the build directory to our repo Jul 31 22:44:49 pabdaddy: better would be your distro Jul 31 22:45:06 layer.conf changing build behavior violates yocto layer compliance rules Jul 31 22:45:20 ic Jul 31 22:45:33 maybe you don't care about that, it might work, but it's not the way to go Jul 31 22:45:47 changes you'd normally put in local.conf but you want to persist belong in your distro Jul 31 22:45:54 we rely on nxp distro to start and have never changed it Jul 31 22:46:32 sounds likke it's time to start your own. you can use that as a starting point, though, either by copying it or including/requiring it in your distro .conf (and ensuring both your distro and nxp are in DISTROOVERRIDES, if you care about that) Jul 31 22:47:07 folks greatly overestimate the difficulty of creating 1) a distro and 2) an image recipe. both are actually really trivial, particularly since you can copy existing ones if needed Jul 31 22:47:25 ok. you and neverpanic have given me a lot to think about. Thanks for all the help!!!! Jul 31 22:48:21 the number of folks that either put everything in local.conf or start bbappending oe-core images make me sad :) Jul 31 23:11:57 kergoth: we should probably document it really clearly... Aug 01 00:41:19 With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ Aug 01 00:41:19 I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ Aug 01 00:41:19 Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate Aug 01 00:41:25 A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ Aug 01 02:19:42 With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ Aug 01 02:36:18 With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ Aug 01 02:36:22 I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ Aug 01 02:36:25 Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate Aug 01 02:36:28 A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ **** ENDING LOGGING AT Wed Aug 01 03:00:00 2018