June 2019 - Darwin-dev - lists.apple.com

Re: 10.14.2-10.14.5 Source Release timeline
by Clifford Sekel via Darwin-dev 29 Jun '19

29 Jun '19

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=pd-devs-org.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=o4edJ8fiGHYdeI0QwBF3mO4GhCB8LC2Tlw9FuelBPWk=; b=yB2FHNANIGhe6oMy3lvB+e1bDHPlPqH/NdkbHE0nY2hFNOjptDHCKUBsH0UR9ccYQG 4cIE87zXBtO8/7hCjAb7S8TIA2IhFfBox18O+tpjLsFLbHxO+fQnN81wPhxym8+Eit5a TejopZUSZMb1YRxcO5DLnrIfSKPwsiv++C614ohlSNP74FtPjL6j9xIJlVjFHxddsjy3 Tgm5fvnDVANQl/uSwZo/UKsRqC1Z9WIIBoTaaXZJe4EDBzHm4wkoELNgtyi5hqrprxJl cQXhm3MUuZFloVpbylnDe+DWjicBzTsBvnMpUVrjwdRx3c+NmDSDQkRVPNwRdI14rVK+ Ct5Q== It is but according to CMake on Swift it's version 1338 https://github.com/apple/swift-corelibs-foundation/blob/master/CoreFoundati… and 10.14 is 1575.12 if you look at the infoPlist in the CF framework so that's why I asked about the version being updated/released on opensource.apple.com that all Thanks Cliff Sekel On Fri, Jun 28, 2019 at 3:03 PM Marcus Johnson <bumblebritches57(a)gmail.com> wrote: > Yeah, isn't it written in Swift? > > _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: https://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.ap… This email sent to site_archiver(a)lists.apple.com

1 0

Re: 10.14.2-10.14.5 Source Release timeline
by Marcus Johnson via Darwin-dev 29 Jun '19

29 Jun '19

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:message-id:mime-version:subject:date:in-reply-to:cc:to :references; bh=0X+t9HY8w3kMnYy0ZGcHTBbi7kYvd4+UhwKOEkwV40o=; b=tnkfsYmkMhfRoxZaDYNV3Qcm6wKRkbruuq7cOVShpEAnkYVOQ81639LNvOnbNtQVuv B/00ZyxwGaB8u/0wmWmvypBxQ794GYkpwONzLkfe2kvRbyGD7P5ieCSmhQUAhg4wOqVS g9pB4C5dbz1+rE+dUsGxLGOWK8mUN8gnVk9mukehYOYEP+e5XSWrk9g/7L7NJIfw8Cpx nhD0JySbL3FybJb3Ipu3YKgSzd6dUj5mvnCBTtAaa3iqk1l5ZH+Tos9MInzE8R0mNDW6 KqDUNg4mSk6rjnGRo8BOajsr5PvoUftndMsfcqOmtVntcugFkrI4KjUeIlb1YRq2TRHo 2gCg== I did actually, "click on the click", the code isn't exactly very browsable. > On Jun 29, 2019, at 6:05 AM, Jean-Daniel <mailing(a)xenonium.com> wrote: > > Nice to see you took the time to click on the click before answering… > > >> Le 28 juin 2019 à 21:03, Marcus Johnson <bumblebritches57(a)gmail.com >> <mailto:bumblebritches57@gmail.com>> a écrit : >> >> Yeah, isn't it written in Swift? > _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: https://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.ap… This email sent to site_archiver(a)lists.apple.com

1 0

Re: 10.14.2-10.14.5 Source Release timeline
by Jean-Daniel via Darwin-dev 29 Jun '19

29 Jun '19

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=xenonium.com; s=201804; t=1561802727; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=MlwEna6YVUa2t8VOLu2ORYTv8dSZZn6XcX5o5m3v3yU=; b=s+pE5X+HSB7q6YfFtAyDhgrQlCJw2ztS2ud+pItvbiscSl4b/iThZIs5q03dNsWETiTamG 0e2AI/vmIRZ1wqYadoaUK2iBgAYOHE6vIhiKIP76D2ctq3NLyPOmtFz84ETL1gHPwRoODB 2HUVVOHqbaXi59y3wBaKDPKh7lAahIk= Nice to see you took the time to click on the click before answering… > Le 28 juin 2019 à 21:03, Marcus Johnson <bumblebritches57(a)gmail.com> a écrit : > > Yeah, isn't it written in Swift? _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: https://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.ap… This email sent to site_archiver(a)lists.apple.com

1 0

Re: 10.14.2-10.14.5 Source Release timeline
by lowell! via Darwin-dev 29 Jun '19

29 Jun '19

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=me.com; s=04042017; t=1561795031; bh=ZzcGZ5F4Xt4gqNtZbfShg4lYhR7qx3qOlwBJNivbxyE=; h=From:Content-Type:Subject:Date:To:Message-Id; b=FX9soyLOWA1m7rGeLTSaDDQ9lA5LDIhlh7phczDRo1G7Nvhct1qAW+C2I+InjyEbg SHblWfRpijWDbcfaB8fz0dwEszpNA52uO4tQCp0QG5Go0EVUb2+SwKCZY1eoTEVzzW 2csvV5sXHHqchaSIMOtQ360WLIJsdak1mDREUUbu6ujqbw6Ghw7lLHa2NP6T5YQXYQ g6PieP6UjzR1rOoeN4zBm9gCRsm9zE1guSc/v6snZmWOCehX8O77soAhpuXe50xQn8 IMSjKhES14S1oi1pkhRVGaFmu0mPwXe/264SEyW1ZB1GIP/b4VkzczSppxWYIUZomr Gk/mFiBptAsaQ== It's written in C. > On Jun 28, 2019, at 12:03 PM, Marcus Johnson via Darwin-dev > <darwin-dev(a)lists.apple.com> wrote: > > Yeah, isn't it written in Swift? > _______________________________________________ > Do not post admin requests to the list. They will be ignored. > Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) > Help/Unsubscribe/Update your Subscription: > https://lists.apple.com/mailman/options/darwin-dev/lowellv%40me.com > > This email sent to lowellv(a)me.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: https://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.ap… This email sent to site_archiver(a)lists.apple.com

1 0

Re: 10.14.2-10.14.5 Source Release timeline
by Marcus Johnson via Darwin-dev 28 Jun '19

28 Jun '19

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=EOm6rnE1PlbkdgoY0Q6IA6UDK/Ybcu1EJCMNcQu1K2w=; b=bTCs1S8/CNdU8gWBy+DZPtemX0yWqC8yHFJAZGRpVZF0gJuuX8QXhPFmseex1UOoLs gSxaW0p5ftcIf/hfao0rq5cyWSYLLooiF4El81CO0w93HWbXX2V8Q64YxWrFUHmB9egS vXw85XozJwT9+Mylj4SQ2Q4PQtP3mxgO7Ia2KiB+47ke0848sjCmzQOcsX9eg/Wbm2uY JhBQOOdjMqXFNfAkPFUhZ9RJTGkw8FlQnpCBOrutCc8gbRD4pO+LPSYUVJjd092jfx63 5Sw7YbjoC/8jGgUGzsMMgAb5oCLI5C+3zS9+wr3b+USHcVq1+ZiYZWKkyQcyRX5rnhYZ 54XA== > > Yeah, isn't it written in Swift? _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: https://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.ap… This email sent to site_archiver(a)lists.apple.com

1 0

ABI for atexit and static termination routines.
by Software Developer via Darwin-dev 28 Jun '19

28 Jun '19

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bt1383820pop.onmicrosoft.com; s=selector1-bt1383820pop-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=G1EbH5mjzoGC30fDEuLl4VBwrRqWgDoFIPrOfORVoFo=; b=gjTCwDPDqebFJOH0fTL6SyvS5azh5aHIBwDudi2qShDmVV1f6IXcWFdWalMhbxNRoDzvXVee83Nie0fTOGRKrJziK9HL9kqdwJbBMNqQAAtyn1+pipGZeEAFX7at0HPOxJfvGX1tISz/Qfy2srov0Fwk8KJz/e15JAXRQMOGDJ8= Thread-index: AQHVLY/KE7tccurkME69bYl1K27WIA== Thread-topic: ABI for atexit and static termination routines. Do we have a formal ABI specification for the order in which termination routines (for example, specified in mod_term_func / __DATA,__mod_term_func sections) are executed with respect to functions registered via atexit? For example, SysV ABI doc says: "Termination functions specified by users via the atexit mechanism must be executed before any termination functions of shared objects.” (my note: ^^^ termination functions specified in .fini sections for ELF platforms, for example) The posix standard atexit entry is silent on ordering w.r.t static termination. —— This (SysV spec) is not the current situation on Darwin-based systems, where it appears that the __DATA,__mod_term_.func functions are executed _before_ the ones registered via atexit. ===== Anyway, this means that one doesn’t end up with a strict nesting of ctor/dtor in the case that we have static c++ ctor/dtors in the same context as ones specified by __attribute__ ((constructor))/ __attribute__ ((destructor)), since the static c++ dtors get run via atexit .. and end up *after* the ones run for __attribute__ ((destructor)), whereas the ctors for __attribute__ ((constructor)) are run *before* the c++ static ctors. so we get attr_constructor_ctor cxx_ctor attr_destructor_dtor cxx_dtor instead of (what the user might expect) attr_constructor_ctor cxx_ctor cxx_dtor attr_destructor_dtor (with GCC the -fno-use-cxa-atexit is honoured, and we can get to expected nesting [because that forces the c++ dtor into the .mod_term_funcs section] however, with Xcode/LLVM the flag doesn’t appear to have that effect). So .. I am not sure if this is a bug, or an intention of the ABI - and need to figure this out in order to know how to solve the problem (conflict in expectations between sysv-based tests and darwin) in my toolchains. thanks Iain _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: https://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.ap… This email sent to site_archiver(a)lists.apple.com

1 0

Re: 10.14.2-10.14.5 Source Release timeline
by Jean-Daniel via Darwin-dev 28 Jun '19

28 Jun '19

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=xenonium.com; s=201804; t=1561709256; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=bd3C9W3wp1EaWEJ8fGFxPr20GJQlYI5uaHi5YvMtnZY=; b=vAJX4Ll+69OnR/30969sDM+fQSJ+j2TJtS5XDR7mjLcU6p4IBu8R8gmMDkWic3rvDoVFDT xjvNpgfwxYYnYl0nkn5Ugwc8i49zy7lvtCHNavCzqBEBYhANdBlRLXnUDlqPamZSpqVEWd Y2eBDBtr/N/z4U/KL3t3O7n3aAmZ8Vk= > Le 28 juin 2019 à 00:03, Clifford Sekel via Darwin-dev > <darwin-dev(a)lists.apple.com> a écrit : > > OpenSource Dev, > > We at PureDarwin were wonder when the Darwin Sources for MacOS would be > released? > > Also, will a newer version of CoreFoundation be released as well? Is there something that prevent you to use the Swift CoreFoundation ? https://github.com/apple/swift-corelibs-foundation/tree/master/CoreFoundati… <https://github.com/apple/swift-corelibs-foundation/tree/master/CoreFoundati…> _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: https://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.ap… This email sent to site_archiver(a)lists.apple.com

1 0

10.14.2-10.14.5 Source Release timeline
by Clifford Sekel via Darwin-dev 27 Jun '19

27 Jun '19

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=pd-devs-org.20150623.gappssmtp.com; s=20150623; h=mime-version:from:date:message-id:subject:to:cc; bh=QL33IVJswRR5ob98woOY009BoqkyUmLW6mxLjIX3/tY=; b=fQ3+otPUWT/gaQDCBCPTp4L7kMNxe1xbgF7Bx9fxTQ1A1GCpzNucSrut3noJkRIp/8 A6AvOlFArA+Azd0tLiFwiC+nO0wtiTW3rcQpiLlZsuTlg5x5F37ekZN/4S8cvB8WLmLo C4akmcXQaANt/ufoupksahgfplSQ1mTJBnDKFzwVcfkPZ9sq1w2VYnFMw6T6TI5jX4mi o5WVtN9O2Qe+d7+d+MQ4/AO82Yz80EV10mrSrvLncF29VMtEGlHN8OI/jf8OLCHuRWwV 9slVeUDox8H8hbtI+8TNY5NhL6rBKyBMPcz4eUIPVm/7qxZrnIzFxY5yNICqphe/OVsg kVlQ== OpenSource Dev, We at PureDarwin were wonder when the Darwin Sources for MacOS would be released? Also, will a newer version of CoreFoundation be released as well? Thanks Cliff Sekel Lead Engineer/Project Manager PureDarwin _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: https://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.ap… This email sent to site_archiver(a)lists.apple.com

1 0

Audit Pipe Drops
by b via Darwin-dev 06 Jun '19

06 Jun '19

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Hello everyone, I am crossposting this message to the darwin dev list and the trustedbsd-audit list since relevant knowledge might be shared among members of both lists and I was not really sure how to properly present the issue to both lists separately. Also, my post is quite long as it bundles the outcome of several days of debugging. Please excuse. I am currently reading a cloned bsm audit pipe from a user space client on macOS to retrieve information about process creation and operations on the system (pc|ex). In the future I want to add other audit classes as well. I am currently looking at bsmtrace as a reference implementation of the read loop. There is one major issue, though, that took me a while to become aware of. The audit pipe is allowed to drop audit records in the kernel, which eventually is technically inevitable of course. The issue I am facing is finding a reliable solution to avoid this. Drops can occur only in audit_pipe_append (audit_pipe.c) under two conditions, (1) the queue is full or (2) the kernel was not able to allocate memory without blocking. (1) can generally be managed in user space client code. There is only one scenario I found (up to now) where even the maximum audit pipe length is insufficient and that is system wake up procedure. Even before the system emits kIOMessageSystemWillPowerOn there are lots and lots of audit events that eventually max out the audit pipe. (2) can’t be influenced from a user space client, at least not that I am aware of. This happens sporadically but reproducibly when the system is under a lot of stress, e.g. when a lot of processes are spawned at a time and start executing some audited code. All this leads to several questions of which I am not sure if they qualify as potential bug reports or enhancement requests. I would be more than happy if someone with a better understanding of things could comment on them or even suggest possible solution approaches. - (1) could clearly be solved by increasing the allowed maximum audit pipe length which currently is 1024. This maximum value is probably several years old by now and I could imagine that in the meantime the xnu kernel has become a lot more „talkative“. Is there some technical limitation that would prevent an increase? - I am wondering how the global audit trail that is written to disk is able to perform better, i.e. does not drop (seemingly), than the cloned audit pipe purely in memory? Is there some penalty associated with passing memory from the kernel to user space? How does the global audit trail not struggle with the M_NOWAIT policy? - Since the audit pipe tries to acquire memory by calling malloc with the M_NOWAIT flag, which I assume happens for a reason, is there some strategy or configuration available from user space to ease the restraint on kernel memory allocation – or am I simply out of luck here? - I am surely not an expert on memory allocation and even less so in kernel space. With that said, I imagine that allocating only one block of memory for both, pointer (ape) and memory blob (ape->ape_record), instead of two separate memory allocations would half the potential for M_NOWAIT failure. - Potential for both (1) and (2) could at least be reduced by further filtering events in the kernel. I am not interested in each and every audit event type. The FreeBSD Handbook has the notion that „audit event classes may be customized by modifying the audit_class and audit_event configuration files“. I assume this could also mean adding custom audit classes and associating them with the event types of interest. How can this be done programmatically for local audit trails? Are there any code examples available? I hope this does not come across (too) snarky but my expectation towards a security mechanism is first and foremost reliability. Information loss is definitely not supportive in that. Therefore I either hope for a viable existing solution for my problem or am very eager for a fix to the issues at hand. Thanks, Benjamin _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: https://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.ap… This email sent to site_archiver(a)lists.apple.com

1 0