July 2005 - Darwin-dev - lists.apple.com

Re: severe gcc problems
by Bill Northcott 18 Jul '05

18 Jul '05

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com 4.0.0 (Apple Computer, Inc. build 5026) First problem is that I'm unable to build my analytical derivative library. When I try to compile a static lib with -03, I get after several hours of compilation: Hmm, if I switch to -O0, it works and 54M libder.a gets properly archived. I'm however unable to use this archive because of tens of thousands of errors like this one: /usr/bin/ld: libder.a(d_iDS_d_EX_ld.o) relocation overflow for relocation entry 140066 in section (__TEXT,__text) (displacement too large) This looks as if it might be relevant: http://lists.apple.com/archives/Unix-porting/2002/Apr/msg00149.html A 54MB archive is very big by normal standards. Bill Northcott _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… On 18/07/2005, at 7:19 AM, Tomas Zahradnicky wrote: I'm trying to compile some scientific application. I've problems with gcc g++ -c -o d_iDS_d_EX_delta.o -g -O3 d_iDS_d_EX_delta.c cc1plus(1322) malloc: *** vm_allocate(size=3888427008) failed (error code=3) cc1plus(1322) malloc: *** error: can't allocate region cc1plus(1322) malloc: *** set a breakpoint in szone_error to debug This is failing because it is trying to allocate nearly 4GB of memory. This will clearly fail in a 32 bit process like the compiler. Whether this was caused by a compiler problem or something in the code, there is not enough information to even guess. What systems does this code build on successfully? This email sent to site_archiver(a)lists.apple.com

1 0

Re: Link Errors -- Relocation Overflow
by Bob Clark 17 Jul '05

17 Jul '05

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com <http://lists.apple.com/archives/darwin-development/2001/May/ msg00620.html> suggests that data sizes bigger than 32MB won't work; hmmm. None of the individual libraries are larger than 32MB, but cumulatively they probably are. But if that's related, then why is the link failing for (as far as I can tell) all static libraries being linked? I don't think (although I could be wrong) that this is the issue. Thanks for the suggestion, Peter. The punchline: this didn't seem to work. --Bob _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… Since it's been awhile, my original message is at: <http://lists.apple.com/archives/Darwin-dev/2005/Jun/msg00120.html>. This looks like a good avenue for attack. Run size on everything, then try linking with fewer libraries until you get unresolved symbol errors instead. Then see what the total sizes are for the set that breaks it. (Sorry about the delay -- this is a back-burner project and there was a lot of monkey-work that I did to try to attack from this perspective.) As soon as I pull a single static library I get unresolved symbol errors. (If I attack from the opposite direction and start out with zero static libraries and just add the static libraries suggested by the unresolved symbol errors, then as soon as I reach zero unresolved symbol errors, the "relocation overflow" errors pop up.) I even threw out the static libraries altogether and started adding the original source files to my project, as needed to fix the unresolved-symbol errors. Again, just as I dropped the last source file to my project and the link was able to resolve all the symbols, the mysterious (and infuriating) "relocation overflow" errors all popped up. Furthermore, I ran size on all the libraries -- the sum of all the TEXT segments was well under the 32MB barrier; in fact, the sum is just over 4 MB. (The file size of the static libraries also sums to around 4 MB.) (There were no other wonky-looking segment sizes either.) So: it looks to me like it's a different link "phase" that's causing the "relocation overflow" errors, although not knowing the internal workings of the linker I'm just speculating. Any further suggestions will fall on receptive and appreciative ears. :-) This email sent to site_archiver(a)lists.apple.com

1 0

Re: netinfo header files on Panther
by Stéphane Sudre 17 Jul '05

17 Jul '05

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On vendredi, juillet 15, 2005, at 10:55 PM, Chris Vitale wrote: Hello, In case you can stand Objective-C: #import <Cocoa/Cocoa.h> #include <DNSServiceDiscovery/DNSServiceDiscovery.h> #include <DirectoryService/DirServices.h> #include <DirectoryService/DirServicesUtils.h> #include <DirectoryService/DirServicesConst.h> @interface PBDirectoryServicesManager : NSObject { tDirReference directoryServicesReference_; tDataBufferPtr dataBuffer_; tDirNodeReference localNodeReference_; NSMutableDictionary * usersCache_; NSMutableDictionary * groupsCache_; } + (PBDirectoryServicesManager *) defaultManager; - (void) _buildCaches; - (void) increaseDataBuffer; - (NSMutableArray *) usersArray; - (NSMutableArray *) groupsArray; - (NSString *) userAccountForUID:(int) inUID; - (NSString *) groupForGID:(int) inGID; @end ------8<------------8<-------------8<------------- #import "PBDirectoryServicesManager.h" const long PBDS_BUFFER_SIZE = 8192; @implementation PBDirectoryServicesManager + (PBDirectoryServicesManager *) defaultManager { static PBDirectoryServicesManager * sDSManager=nil; if (sDSManager==nil) { sDSManager=[PBDirectoryServicesManager new]; [sDSManager _buildCaches]; } return sDSManager; } - (id) init { self=[super init]; if (self!=nil) { tDirStatus tStatus; tStatus = dsOpenDirService(&directoryServicesReference_); if (dataBuffer_!=NULL) { unsigned long tDirectoryNodeCount; unsigned long tDirectoryNodeIndex; long error; char * tDirectoryNodePath; tDirectoryNodeCount=0; tDirectoryNodePath=NULL; if (error == eDSBufferTooSmall) { [self increaseDataBuffer]; } } while (error == eDSBufferTooSmall); if ( error == eDSNoErr ) { if (tDirectoryNodeCount!= 0) { tDataList * tDirectoryName; error = 1; } } } if (tDirectoryNodePath!=NULL) { long error = eDSNoErr; tDataList * tNodeList; if (error==eDSNoErr) { return self; } } } } dsCloseDirService(directoryServicesReference_); } return nil; } return self; } - (void) dealloc { if (localNodeReference_!=NULL) { dsCloseDirNode(localNodeReference_); } if (dataBuffer_!=NULL) { dsDataBufferDeAllocate(directoryServicesReference_,dataBuffer_); } if (directoryServicesReference_!=NULL) { dsCloseDirService(directoryServicesReference_); } } #pragma mark - - (void) increaseDataBuffer { unsigned long tBufferSize = dataBuffer_->fBufferSize; dsDataBufferDeAllocate(directoryServicesReference_, dataBuffer_); #pragma mark - - (void) _buildCaches { long error = eDSNoErr; unsigned long tRecordCount; tContextData context = NULL; tDataList * tRecordName; // Users tRecordCount=0; if (tRecordName != NULL) { tDataList * tRecordType; if (tRecordType!=NULL) { tDataList * tAttributesType; // We're interesting by the uid and account name dsDataListDeallocate(directoryServicesReference_, tRecordName ); } // Groups error = eDSNoErr; context = NULL; tRecordCount=0; if (tRecordName != NULL) { tDataList * tRecordType; if (tRecordType!=NULL) { tDataList * tAttributesType; // We're interesting by the gid and group name dsDataListDeallocate(directoryServicesReference_, tRecordName ); } } error = eDSNoErr; for (i = 1; (i <= inCount) && (error == eDSNoErr);i++) { tAttributeListRef attributeListRef = 0; tRecordEntry * recordEntryPtr = NULL; if ( error == eDSNoErr && recordEntryPtr!=NULL) { char * tRecordName=NULL; unsigned long j; if (error == eDSNoErr && attributeEntryPtr) { unsigned long k; valueEntryPtr = NULL; break; } else { // A COMPLETER } } attributeEntryPtr = NULL; dsCloseAttributeValueList(valueRef); valueRef = 0; } else { // A COMPLETER } } free(tRecordName); } recordEntryPtr = NULL; dsCloseAttributeList(attributeListRef); } else { // A COMPLETER } } return nMutableDictionary; } - (NSMutableArray *) usersArray { NSMutableArray * tMutableArray=nil; int tCount; tCount=[usersCache_ count]; tMutableArray=[NSMutableArray arrayWithCapacity:tCount]; if (tMutableArray!=nil && tCount>0) { NSEnumerator * tKeyEnumerator; NSNumber * tKey; tKeyEnumerator=[usersCache_ keyEnumerator]; while (tKey=[tKeyEnumerator nextObject]) { NSDictionary * tDictionary; [tMutableArray addObject:tDictionary]; } } return tMutableArray; } - (NSMutableArray *) groupsArray { NSMutableArray * tMutableArray=nil; int tCount; tCount=[groupsCache_ count]; tMutableArray=[NSMutableArray arrayWithCapacity:tCount]; if (tMutableArray!=nil && tCount>0) { NSEnumerator * tKeyEnumerator; NSNumber * tKey; tKeyEnumerator=[groupsCache_ keyEnumerator]; while (tKey=[tKeyEnumerator nextObject]) { NSDictionary * tDictionary; [tMutableArray addObject:tDictionary]; } } return tMutableArray; } - (NSString *) userAccountForUID:(int) inUID { return [usersCache_ objectForKey:[NSNumber numberWithInt:inUID]]; } - (NSString *) groupForGID:(int) inGID { return [groupsCache_ objectForKey:[NSNumber numberWithInt:inGID]]; } @end _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… Since new users are not added to /etc/passwd I doubted that the standard C password functions would work. I thought I'd have to use Apple's fancy pants APIs. getpwent worked just fine. - (NSMutableDictionary *) _dictionaryWithLocalRef:(tDirNodeReference) inReference data:(tDataBufferPtr) inData count:(unsigned long) inCount; if (tStatus == eDSNoErr) { dataBuffer_ = dsDataBufferAllocate(directoryServicesReference_, PBDS_BUFFER_SIZE ); do { error = dsFindDirNodes(directoryServicesReference_,dataBuffer_,NULL,eDSLocalNode Names,&tDirectoryNodeCount,NULL); tDirectoryName = dsDataListAllocate(directoryServicesReference_); if (tDirectoryName!=NULL) { for (tDirectoryNodeIndex = 1;(tDirectoryNodeIndex <= tDirectoryNodeCount) && (error == eDSNoErr); tDirectoryNodeIndex++ ) { error = dsGetDirNodeName(directoryServicesReference_,dataBuffer_,tDirectoryNodeI ndex, &tDirectoryName ); if ( error == eDSNoErr ) { tDirectoryNodePath = dsGetPathFromList(directoryServicesReference_,tDirectoryName, "/" ); if (tDirectoryNodePath!= NULL) { dsDataListDeallocate(directoryServicesReference_, tDirectoryName ); break; } else { NSLog(@"[PBDirectoryServicesUtilities.m:70 dsGetPathFromList failed"); } } } } else { NSLog(@"[PBDirectoryServicesUtilities.m:77 dsDataListAllocate failed"); tNodeList = dsBuildFromPath(directoryServicesReference_,tDirectoryNodePath, "/" ); if ( tNodeList != NULL ) { error = dsOpenDirNode( directoryServicesReference_, tNodeList, &localNodeReference_); dsDataListDeallocate(directoryServicesReference_,tNodeList); dataBuffer_=dsDataBufferAllocate( directoryServicesReference_, tBufferSize*2 ); } tRecordName = dsBuildListFromStrings(directoryServicesReference_,kDSRecordsAll,NULL); tRecordType = dsBuildListFromStrings(directoryServicesReference_,kDSStdRecordTypeUsers ,NULL); tAttributesType = dsBuildListFromStrings(directoryServicesReference_, kDS1AttrUniqueID, NULL); if (tAttributesType!=NULL) { do { error = dsGetRecordList(localNodeReference_,dataBuffer_,tRecordName,eDSExact,tRe cordType,tAttributesType,0,&tRecordCount,&context); if ( error == eDSNoErr ) { usersCache_=[[self _dictionaryWithLocalRef:localNodeReference_ data:dataBuffer_ count:tRecordCount] retain]; if (usersCache_==nil) { error=eUndefinedError; } } else if ( error == eDSBufferTooSmall ) { [self increaseDataBuffer]; } } while (((error == eDSNoErr) && (context != NULL)) || (error == eDSBufferTooSmall) ); dsDataListDeallocate(directoryServicesReference_,tAttributesType); } dsDataListDeallocate(directoryServicesReference_,tRecordType); } tRecordName = dsBuildListFromStrings(directoryServicesReference_,kDSRecordsAll,NULL); tRecordType = dsBuildListFromStrings(directoryServicesReference_,kDSStdRecordTypeGroup s,NULL); tAttributesType = dsBuildListFromStrings(directoryServicesReference_, kDS1AttrPrimaryGroupID, NULL); if (tAttributesType!=NULL) { do { error = dsGetRecordList(localNodeReference_,dataBuffer_,tRecordName,eDSExact,tRe cordType,tAttributesType,0,&tRecordCount,&context); if ( error == eDSNoErr ) { groupsCache_=[[self _dictionaryWithLocalRef:localNodeReference_ data:dataBuffer_ count:tRecordCount] retain]; if (groupsCache_==nil) { error=eUndefinedError; } } else if ( error == eDSBufferTooSmall ) { [self increaseDataBuffer]; } } while (((error == eDSNoErr) && (context != NULL)) || (error == eDSBufferTooSmall) ); dsDataListDeallocate(directoryServicesReference_,tAttributesType); } dsDataListDeallocate(directoryServicesReference_,tRecordType); } - (NSMutableDictionary *) _dictionaryWithLocalRef:(tDirNodeReference) inReference data:(tDataBufferPtr) inData count:(unsigned long) inCount { NSMutableDictionary * nMutableDictionary=nil; unsigned long i; long error; tAttributeEntry * attributeEntryPtr = NULL; tAttributeValueEntry * valueEntryPtr = NULL; nMutableDictionary=[NSMutableDictionary dictionaryWithCapacity:inCount]; error = dsGetRecordEntry(inReference, inData, i, &attributeListRef, &recordEntryPtr); error = dsGetRecordNameFromEntry( recordEntryPtr, &tRecordName ); if (error==eDSNoErr && tRecordName!=NULL) { for (j = 1; (j <= recordEntryPtr->fRecordAttributeCount) && (error == eDSNoErr);j++) { tAttributeValueListRef valueRef = 0; error = dsGetAttributeEntry(inReference,inData, attributeListRef, j, &valueRef, &attributeEntryPtr); for (k = 1; (k <= attributeEntryPtr->fAttributeValueCount) && (error == eDSNoErr);k++) { error = dsGetAttributeValue(inReference,inData,k,valueRef,&valueEntryPtr); if ( error == eDSNoErr && valueEntryPtr!=NULL) { [nMutableDictionary setObject:[NSString stringWithUTF8String:tRecordName] forKey:[NSNumber numberWithInt:atoi(valueEntryPtr->fAttributeValueData.fBufferData)]]; dsDeallocAttributeValueEntry(directoryServicesReference_,valueEntryPtr ); dsDeallocAttributeEntry(directoryServicesReference_,attributeEntryPtr); dsDeallocRecordEntry(directoryServicesReference_,recordEntryPtr); tDictionary=[NSDictionary dictionaryWithObjectsAndKeys:[usersCache_ objectForKey:tKey],@"Name", tKey,@"ID", nil]; tDictionary=[NSDictionary dictionaryWithObjectsAndKeys:[groupsCache_ objectForKey:tKey],@"Name", tKey,@"ID", nil]; This email sent to site_archiver(a)lists.apple.com

1 0

severe gcc problems
by Tomas Zahradnicky 17 Jul '05

17 Jul '05

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Hi, I'm trying to compile some scientific application. I've problems with gcc 4.0.0 (Apple Computer, Inc. build 5026) g++ -c -o d_iDS_d_EX_delta.o -g -O3 d_iDS_d_EX_delta.c cc1plus(1322) malloc: *** vm_allocate(size=3888427008) failed (error code=3) cc1plus(1322) malloc: *** error: can't allocate region cc1plus(1322) malloc: *** set a breakpoint in szone_error to debug Do I want too much from gcc or there's a solution to those? Tomas -- # Ing. Tomas Zahradnicky, Jr. # The Czech Technical University # Dept of Computer Science, FEE-CTU Prague _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… First problem is that I'm unable to build my analytical derivative library. When I try to compile a static lib with -03, I get after several hours of compilation: Hmm, if I switch to -O0, it works and 54M libder.a gets properly archived. I'm however unable to use this archive because of tens of thousands of errors like this one: /usr/bin/ld: libder.a(d_iDS_d_EX_ld.o) relocation overflow for relocation entry 140066 in section (__TEXT,__text) (displacement too large) This email sent to site_archiver(a)lists.apple.com

1 0

Re: netinfo header files on Panther
by Chris Vitale 15 Jul '05

15 Jul '05

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Hello, Since new users are not added to /etc/passwd I doubted that the standard C password functions would work. I thought I'd have to use Apple's fancy pants APIs. getpwent worked just fine. Thanks, vitale On Fri, 2005-07-15 at 13:21 -0700, Jason Townsend wrote: > On Jul 15, 2005, at 12:20 PM, Finlay Dobbie wrote: > > On 7/15/05, Chris Vitale <cvitale(a)trustednetworktech.com> wrote: > >> I need to find all users and UIDs on a local system from a > >> daemon. I'd > >> like to use the netinfo API (rather than command line tools) but I > >> can't > >> locate netinfo/ni.h on my local machine or in an SDK on the apple > >> site. > >> What am I missing? > > > > The NetInfo API is deprecated and not supported. Don't use it. > > > > The recommended replacement is the Open Directory (né Directory > > Services) API. > > > > If all you need is to get a list of the users and UIDs, then you can > > probably get away with just using getpwent(). > > Open Directory API documentation is here: > > http://developer.apple.com/documentation/Networking/Conceptual/ > Open_Directory/ > > It's often not necessary to do an exhaustive enumeration... if you > could explain why you want to do that there might be a more efficient > approach that would scale better in situations where there are > thousands or hundreds of thousands of users. > > -Jason _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: netinfo header files on Panther
by Jason Townsend 15 Jul '05

15 Jul '05

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com The NetInfo API is deprecated and not supported. Don't use it. If all you need is to get a list of the users and UIDs, then you can probably get away with just using getpwent(). Open Directory API documentation is here: -Jason _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… On Jul 15, 2005, at 12:20 PM, Finlay Dobbie wrote: On 7/15/05, Chris Vitale <cvitale(a)trustednetworktech.com> wrote: I need to find all users and UIDs on a local system from a daemon. I'd like to use the netinfo API (rather than command line tools) but I can't locate netinfo/ni.h on my local machine or in an SDK on the apple site. What am I missing? The recommended replacement is the Open Directory (né Directory Services) API. http://developer.apple.com/documentation/Networking/Conceptual/ Open_Directory/ It's often not necessary to do an exhaustive enumeration... if you could explain why you want to do that there might be a more efficient approach that would scale better in situations where there are thousands or hundreds of thousands of users. This email sent to site_archiver(a)lists.apple.com

1 0

Re: netinfo header files on Panther
by Finlay Dobbie 15 Jul '05

15 Jul '05

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Domainkey-signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=OIQCVKBDPq5gdEuB6KDJzbuM9SPI+GxGUXm0Ic2HPviZbkbEsSnXRs21kqRq36h6i/4MnoLGzCO1kUxBu1pGrjjP5rsdtzP3pL7UylEl5K/LtcuGK/Gyn3ZMxAn8k+k3eKMqMJAJuv4zTNiILn2ZdlgwZ4eoh9InvRxv9p3SB90= On 7/15/05, Chris Vitale <cvitale(a)trustednetworktech.com> wrote: > Hello, > > I need to find all users and UIDs on a local system from a daemon. I'd > like to use the netinfo API (rather than command line tools) but I can't > locate netinfo/ni.h on my local machine or in an SDK on the apple site. > What am I missing? The NetInfo API is deprecated and not supported. Don't use it. The recommended replacement is the Open Directory (né Directory Services) API. If all you need is to get a list of the users and UIDs, then you can probably get away with just using getpwent(). -- Finlay _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

netinfo header files on Panther
by Chris Vitale 15 Jul '05

15 Jul '05

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Hello, I need to find all users and UIDs on a local system from a daemon. I'd like to use the netinfo API (rather than command line tools) but I can't locate netinfo/ni.h on my local machine or in an SDK on the apple site. What am I missing? I googled around and someone on the postfix list recommended using the ni.h file from Jaguar on Panther. That kind of behavior makes me uneasy. vitale _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

CUPS admin. control and command-line printing failure
by Derick Centeno 14 Jul '05

14 Jul '05

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Darwin 8.2 Source Code Available
by Kevin Van Vechten 12 Jul '05

12 Jul '05

site_archiver(a)lists.apple.com Delivered-To: Darwin-dev(a)lists.apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… The Darwin team is pleased to announce the availability of the source code for Darwin 8.2. These sources correspond to Mac OS X 10.4.2, and are available via the web at <http://www.opensource.apple.com/ darwinsource/>. [Jul 12 2005] -- Kevin Van Vechten <kvv(a)apple.com> Open Source Software Engineer Apple Computer This email sent to site_archiver(a)lists.apple.com

1 0