February 2018 - Darwin-kernel

fail to install xnu 10.13.3
by ln panicall 27 Feb '18

27 Feb '18

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=outlook.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=Jerx/YMQPKQhylq8alIPh/jrOmUFomZo6NJ2sEH3T38=; b=EHeaKXjOx1vOnQAH6wMajlgcR2GUsoKvC25pQAzIsJmeUgoIngcDaEWBroBFcXszHJroFkZM0l7vf6qo+z7wZ5JGN9nvvDCdOGX9euWptqKgHRi9fxaf6O3zNuOC6kuy2zK5NUuqHRSuM8LS6TDOAYmlg+1vGQT9nrBwZQ0bmfJsdbzw48yvq9XzVP2w79vAu0RZfLz2mGCvaBr9msUZ7W+SsUKEFNhIrp51bLY7gpfrGztwewsuXm2L0ntslf0iu1vNtZ/Qcf29gQ92A01ys5GQuiFJLE4Iws1389eFTToyIa0+cxozAarohiiGtMAMJdgdcF5tM0mujW55BBaRiw== Spamdiagnosticmetadata: NSPM Spamdiagnosticoutput: 1:99 Thread-index: AQHTr3AX4M8iASTb+kOVnxrJDDSlwg== Thread-topic: fail to install xnu 10.13.3 Dear All, I already successfully compiled xnu 10.13.3 but failed to install it. When I try to rebuild the kernelcache, the command 'sudo kextcache -i /' always got a lot of errors. For example: In interface com.apple.kpi.private of __kernel__, couldn't find symbol _kern_packet_set_timestamp. I got hundreds of these kind errors. After I installed it, my vm os could not reboot. Does anyone have any idea about this? BTW, I have successful experience on osx 10.11.3. Best Regards, Panicall _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: https://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Compile KASAN kernel
by Andrew Zui 15 Feb '18

15 Feb '18

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=outlook.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=Antak3LdqB10j/HR2PN50MeIQwqRNWYhAeiHWcuMbTE=; b=ovsa0f/BwHv/3rAHgXYQ7/7axnd8fLFzhjnFrDu7xkXh/f/gdiyBH30b9fbgM49FYVVnqERGIqbt4y/c2N6dJONPZ19V1THvuQktIFXk2SYqwr/M6BLSv0RWDfpeRG7trDCdULONGFnSNV152Tl6iBXmQq1vNVMsHCyy8QM1ASTqrBwp18ZFXxDuYWZgMxxYAiOpl66v4VpZULvK8J/wr+txXADKCNQaenv0U8eeUqTO8Xf/2mW/lamec2Uq4TYlg2W2a885JXVhHoSpAfsvXAHchGgupmd+7k4+SwU0C2NlrOsUbCd4MXOmPZ38+UaTZ0UwudxKM2Xd/hsIr0gqZQ== Spamdiagnosticmetadata: NSPM Spamdiagnosticoutput: 1:99 Thread-index: AQHTpdF7KJy2YLZb50uq28JRkaufb6OkdQOAgADyu4CAAEAIEA== Thread-topic: Compile KASAN kernel Thanks Aaron, with your help I was able to successfully compile KASAN kernel. Unfortunately, I can confirm that it hangs on boot. I cannot provide a stack trace at the moment since I don't have a proper debugging setup, but I suspect it is the same issue as above. Please note that I was able to boot the debug kernel built from the same source (4570.41.2, booted on MacOS 10.13.3 build 17D47). Also, would it be possible for Apple to release KASAN kernels in the future KDK releases? That would be very convenient. Regards, Andrew _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: https://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Compile KASAN kernel
by N 15 Feb '18

15 Feb '18

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=me.com; s=04042017; t=1518698233; bh=aUg8kk7Df0syatmwyGqN0WxOmeHbiHwfpjbDa1DRbSQ=; h=Content-type:MIME-version:Subject:From:Date:Message-id:To; b=QhBi3QpL1YoOYrmay1BnwDyhcguQ4/oZPSOzwAIzTLFuN6tE8jbY6S6NIUTVqy/G9 QIzMdHjxEtl4vcW13y10YgoyW4582ayznDtMVbeUKcZVl8liAS5TokLr5HeHSEt1Jj vEfnZiTOR7lyWBKcY27Gdxy1dSthHEo4h5LAlIwb+OhCgCrnvbHp3vYpeLnnzBpQWL U/1mg1fpQYNk9Oy0kz4KZNAP2ceSRRd3LtUk4IbcF+/nf2CTl/22qaZZJ6YN98GQAP UiRrS7IpNKoqeC9abcazFaTGJZDbnhLhZAD494MAMUodBQvB9MQGBcuSsrg7DACaFl HElA3s38BSV/w== Dear Aaron, I could not get a KASAN build of xnu-4570.1.46 to boot on a VMWare Fusion VM or a real machine. I have set my boot arguments to "-v debug=0x100 kcsuffix=kasan keepsyms=1"; in both cases, I see no log in the console, and the kernel seems to hang. Here is a backtrace I have obtained from a VM: (lldb) bt * thread #1, stop reason = signal SIGTRAP * frame #0: 0xffffff8002a5ef51 kernel.kasan`vstart_trap_handler_14 + 1 frame #1: 0xffffff8002a4213b kernel.kasan`cpuid_fn(selector=0, result=0xffffff8002118d90) at cpuid.c:236 frame #2: 0xffffff8002a3f567 kernel.kasan`cpuid_set_generic_info(info_p=0xffffff8004dff000) at cpuid.c:490 frame #3: 0xffffff8002a3f123 kernel.kasan`cpuid_set_info at cpuid.c:827 frame #4: 0xffffff8002a41779 kernel.kasan`cpuid_info at cpuid.c:1041 frame #5: 0xffffff8002a41ca9 kernel.kasan`cpuid_leaf7_features at cpuid.c:1165 frame #6: 0xffffff80029f4f99 kernel.kasan`intel_entropysource(buf=0xffffff8004c7f5c8, nbytes=0xffffff8002118e70) at random.c:168 frame #7: 0xffffff80029f4304 kernel.kasan`entropy_readall(buf=0xffffff8004c7f5b8, nbytes_persource=16) at random.c:200 frame #8: 0xffffff80029f40ee kernel.kasan`early_random at random.c:341 frame #9: 0xffffff8002a53c07 kernel.kasan`physmap_init at i386_init.c:207 frame #10: 0xffffff8002a53551 kernel.kasan`Idle_PTs_init at i386_init.c:306 frame #11: 0xffffff8002a532c5 kernel.kasan`vstart(boot_args_start=0x000000000766a000) at i386_init.c:631 (I have modified master_boot_idt64 to have a separate vector per exception.) I have then modified vstart to call pal_serial_init for KASAN builds as well, hoping that I would get some log over serial, however, I am getting the same exception: (lldb) bt * thread #1, stop reason = signal SIGTRAP * frame #0: 0xffffff801a05f1f4 kernel.kasan`vstart_trap_handler_14 + 4 frame #1: 0xffffff801a05797d kernel.kasan`ml_phys_write_data(paddr=4261634076, data=90, size=4) at loose_ends.c:435 frame #2: 0xffffff801a057ab0 kernel.kasan`ml_phys_write_word(paddr=0x00000000fe03601c, data=90) at loose_ends.c:484 frame #3: 0xffffff801bbe6860 kernel.kasan`mmio_uart_present at pe_serial.c:234 frame #4: 0xffffff801bbe665f kernel.kasan`mmio_uart_probe at pe_serial.c:261 frame #5: 0xffffff801bbe6556 kernel.kasan`serial_init at pe_serial.c:383 frame #6: 0xffffff801a033699 kernel.kasan`pal_serial_init at pal_routines.c:77 frame #7: 0xffffff801a053292 kernel.kasan`vstart(boot_args_start=0x000000001ec59000) at i386_init.c:597 Seemingly, I am getting a page fault, but I am not sure why it happens at this stage. Unfortunately, I can debug only the virtual machine, but I suspect the same happens on a real one. I would be happy to hear what could be going wrong here. If needed, I can provide any additional information. Thank you in advance. > On 14 Feb 2018, at 23:08, Aaron Carroll <aaronc(a)apple.com> wrote: > > >> On Feb 14, 2018, at 12:33, Andrew Zui <andrew.zui(a)outlook.com> wrote: >> >> Hi, >> >> I'm trying to pin down a memory corruption in my kext, and I found out that >> the latest kernel supports KASAN. However, when trying to compile it I get >> the following error: >> >> make[7]: *** No rule to make target >> `xnu-4570.41.2/san/kasan-blacklist-dynamic', needed by >> `xnu-4570.41.2/BUILD/obj/KASAN_X86_64/san/KASAN/kasan_blacklist_dynamic.h'. >> Stop. >> >> I see that 'kasan_blacklist_dynamic.h' is generated via >> 'san/tools/generate_dynamic_blacklist.py', but for it to work the script has >> to be pointed to 'kasan-blacklist-dynamic' file, which is missing. >> >> Is there any workaround available? Or is this functionality only for >> internal use? > > This should do the trick: > > $ echo '__kernel__:_ZN6OSKext8copyInfoEP7OSArray:memld' > > san/kasan-blacklist-dynamic > > _______________________________________________ > Do not post admin requests to the list. They will be ignored. > Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) > Help/Unsubscribe/Update your Subscription: > https://lists.apple.com/mailman/options/darwin-kernel/scandium%40me.com > > This email sent to scandium(a)me.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: https://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Compile KASAN kernel
by Aaron Carroll 14 Feb '18

14 Feb '18

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com > On Feb 14, 2018, at 12:33, Andrew Zui <andrew.zui(a)outlook.com> wrote: > > Hi, > > I'm trying to pin down a memory corruption in my kext, and I found out that > the latest kernel supports KASAN. However, when trying to compile it I get > the following error: > > make[7]: *** No rule to make target > `xnu-4570.41.2/san/kasan-blacklist-dynamic', needed by > `xnu-4570.41.2/BUILD/obj/KASAN_X86_64/san/KASAN/kasan_blacklist_dynamic.h'. > Stop. > > I see that 'kasan_blacklist_dynamic.h' is generated via > 'san/tools/generate_dynamic_blacklist.py', but for it to work the script has > to be pointed to 'kasan-blacklist-dynamic' file, which is missing. > > Is there any workaround available? Or is this functionality only for internal > use? This should do the trick: $ echo '__kernel__:_ZN6OSKext8copyInfoEP7OSArray:memld' > san/kasan-blacklist-dynamic _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: https://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists… This email sent to site_archiver(a)lists.apple.com

1 0

Compile KASAN kernel
by Andrew Zui 14 Feb '18

14 Feb '18

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=outlook.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=rblBLvQC2+9/43yNXTajYz1oSv5DdDV6f++S6tMf+OM=; b=BvIiFbKOyakfU8wXA5HaCYpY47ajPffe7PiREgBmR17sPGWJwAlgZUqCnVBt3Q6B3bG4Khr3N44oOqB3eRGG9mAYy8iCaboxCwzF6nVj1zUFm3G84A/8oDkhiZa1K0MH/i7BDWNpZednCJHseTClBt7d7fh6tnqxRfVV0o889LlfZc3D74VZtMY2/l/LXTxT20m2ummPB/AQrjmEFiuREEPP8S66u/6vH+JMOAWFcvHa4umF8mA7uOQNNXZGuQiL4RztoAwG97V79tSAhz/JPbmpvTjzLdTx0AJYakoYejG9BLPEi3MY7W1QjOfB8qre9LpzerdNfCNiWloj1GWtrw== Spamdiagnosticmetadata: NSPM Spamdiagnosticoutput: 1:99 Thread-index: AQHTpdF7KJy2YLZb50uq28JRkaufbw== Thread-topic: Compile KASAN kernel Hi, I'm trying to pin down a memory corruption in my kext, and I found out that the latest kernel supports KASAN. However, when trying to compile it I get the following error: make[7]: *** No rule to make target `xnu-4570.41.2/san/kasan-blacklist-dynamic', needed by `xnu-4570.41.2/BUILD/obj/KASAN_X86_64/san/KASAN/kasan_blacklist_dynamic.h'. Stop. I see that 'kasan_blacklist_dynamic.h' is generated via 'san/tools/generate_dynamic_blacklist.py', but for it to work the script has to be pointed to 'kasan-blacklist-dynamic' file, which is missing. Is there any workaround available? Or is this functionality only for internal use? Regards, Andrew _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: https://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists… This email sent to site_archiver(a)lists.apple.com

1 0