Re: AVFoundation and kYUVSPixelFormat from AVPlayer
Re: AVFoundation and kYUVSPixelFormat from AVPlayer
- Subject: Re: AVFoundation and kYUVSPixelFormat from AVPlayer
- From: vade <email@hidden>
- Date: Wed, 12 Oct 2011 03:28:40 -0400
In my experience with AVFoundation, its really not ready for anything more than simple playback apps using Core Animation / AVPlayerLayer.
You have noticed there is no visual context replacement, and no way to get reasonably fast access to CVPixelbufferRefs of CVOpenGLTextureRefs at all. Anyone who wants to handle processing/display or do anything out of the ordinary with the pixels from an AVPlayerItem is, for the time being, probably wasting their time.
32 bit background process leveraging the older QTVisualContext API and sharing the frames with IOSurface provides more flexibility, more codec support, and higher performance (amazingly) in many scenarios.
I was very sad when I saw the limited codec support, and the API limitations of AVFoundation, its not quite a replacement for Quicktime, or even QTKit. I hope that changes soon though. FWIW, I did file a bug/request for expanded API usage, and a complaint (and 5 or so) or performance of fetching CVPixelBuffers from Core Media Samples during the 10.7 beta...
2C++
On Oct 11, 2011, at 11:04 PM, Mr. Gecko wrote:
> I understand this and have things to account for this already working. I would explain what my program does, but that will take a long time. Basically the reason I need it in CVImageBufferRef using YUV format of pixles is because I am doing off process playing of video and just receiving the images to render using NSOpenGLView with memory maps and shared memory between the processes.
>
> On 10/11/11 9:46 PM, Robert Monaghan wrote:
>> Hi,
>>
>> A quick word of warning, while QTKit is being deprecated for AVFoundation/Core Media, there is no third party codec support in the new APIs. I would consider this while you develop your app. I doubt that 3rd party codec support for Core media is going to arrive as fast (or as complete) as we would like.
>>
>> bob.
>> (A quicktime codec developer that would love to write AVFoundation/Core Media Codecs, but can't.)
> _______________________________________________
>
> Cocoa-dev mailing list (email@hidden)
>
> Please do not post admin requests or moderator comments to the list.
> Contact the moderators at cocoa-dev-admins(at)lists.apple.com
>
> Help/Unsubscribe/Update your Subscription:
>
> This email sent to email@hidden
_______________________________________________
Cocoa-dev mailing list (email@hidden)
Please do not post admin requests or moderator comments to the list.
Contact the moderators at cocoa-dev-admins(at)lists.apple.com
Help/Unsubscribe/Update your Subscription:
This email sent to email@hidden