• Open Menu Close Menu
  • Apple
  • Shopping Bag
  • Apple
  • Mac
  • iPad
  • iPhone
  • Watch
  • TV
  • Music
  • Support
  • Search apple.com
  • Shopping Bag

Lists

Open Menu Close Menu
  • Terms and Conditions
  • Lists hosted on this site
  • Email the Postmaster
  • Tips for posting to public mailing lists
accessibility and iTunes?!?
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

accessibility and iTunes?!?


  • Subject: accessibility and iTunes?!?
  • From: Ondra Cada <email@hidden>
  • Date: Wed, 4 Oct 2006 19:19:41 +0200

Hello all,

although direct sending of events would be much better for my purpose, since I got no luck with it so far, I am also testing the accessibility API. I've got a strange results though... do I overlook something, or does the thing just not the heck work?!?

Whatever did I try, AXUIElementCopyElementAtPosition at the best found a window, much more often it found application only. So, I've rigged my own simple recursive go-thru-children-and-check-hits method.

The core looks like this:

id kind,val;
CGPoint cgp;
CGSize cgs;
if (AXUIElementCopyAttributeValue(ui,kAXRoleAttribute, (CFTypeRef*)&kind)!=0) return NULL;
if (AXUIElementCopyAttributeValue(ui,kAXPositionAttribute, (CFTypeRef*)&val)!=0) return NULL;
if (!AXValueGetValue((AXValueRef)val,kAXValueCGPointType,&cgp)) return NULL;
if (AXUIElementCopyAttributeValue(ui,kAXSizeAttribute, (CFTypeRef*)&val)!=0) return NULL;
if (!AXValueGetValue((AXValueRef)val,kAXValueCGSizeType,&cgs)) return NULL;
NSRect rr=NSMakeRect(cgp.x,cgp.y,cgs.width,cgs.height);
NSLog(@"searching %@ in %@, %@",NSStringFromPoint (pt),kind,NSStringFromRect(rr));
if (!NSPointInRect(pt,rr)) return NULL;


Looks fair, or have I overlooked something?

Does not work. With iTunes 6.0.4 (3) I keep getting horrible y- coordinates:

2006-10-04 19:04:25.895 Media Center[8694] searching {738, 773} in AXWindow, {{518, 260}, {710, 556}}
2006-10-04 19:04:25.896 Media Center[8694] found, trying 6 children...
2006-10-04 19:04:25.898 Media Center[8694] searching {738, 773} in AXScrollBar, {{892, 17317}, {15, 83}}
2006-10-04 19:04:25.903 Media Center[8694] searching {738, 773} in AXScrollBar, {{892, 17317}, {15, 83}}
...


With iTunes 7.0 (70) the coordinates seem right, but instead of scrollbars and similar I keep getting some unknown elements (whose lists of actions are empty)...

2006-10-04 19:11:18.021 Media Center[275] searching {403, 638} in AXWindow, {{190, 119}, {710, 556}}
2006-10-04 19:11:18.021 Media Center[275] found, trying 1 children...
2006-10-04 19:11:18.021 Media Center[275] searching {403, 638} in AXUnknown, {{190, 119}, {710, 556}}
2006-10-04 19:11:18.022 Media Center[275] found, trying 1 children...
2006-10-04 19:11:18.022 Media Center[275] searching {403, 638} in AXUnknown, {{190, 119}, {710, 556}}
2006-10-04 19:11:18.022 Media Center[275] found, trying 1 children...
...


Dammit. How the heck does one control another application?!?
---
Ondra Čada
OCSoftware:     email@hidden               http://www.ocs.cz
private         email@hidden             http://www.ocs.cz/oc


_______________________________________________ Do not post admin requests to the list. They will be ignored. Cocoa-dev mailing list (email@hidden) Help/Unsubscribe/Update your Subscription: This email sent to email@hidden
  • Follow-Ups:
    • Re: accessibility and iTunes?!?
      • From: Eric Schlegel <email@hidden>
  • Prev by Date: Re: NSCell editing weirdness
  • Next by Date: Re: NSImage and F_NOCACHE
  • Previous by thread: Re: NSImage and F_NOCACHE
  • Next by thread: Re: accessibility and iTunes?!?
  • Index(es):
    • Date
    • Thread