0

I'm try to make a feature that apply filter frame capture from camera and stream via network.

Because of bad performance while apply filter in CMSampleBuffer or CVPixelBuffer (CPU side), i try to convert data from CMSampleBuffer (raw from camera capture) to CIImage (CPU side) then using some built-in filter of Core Image. When I convert back to CVPixelByteBuffer (or CMSampleBuffer) for encoded with VideoToolbox, it's is too slow to achieve real-time target with smooth fps (I guest the reason is tranfer data from GPU to CPU).

So, is there any way to using CIImage or GL texture (like draw texture to a surface as MediaCodec input) as VideoToobox 's input? Or faster convert from CGImage/CIImage to CVSampleBuffer, or using shading language? I think this is possible because Messenger, Snapchat, Snow, ... can do well in old device like iPhone 5)

Thank all.

Nicol Bolas
  • 449,505
  • 63
  • 781
  • 982
Hanh Nguyen
  • 1
  • 1
  • One of my favorite reousrces - FlexMonkey. Check out if this will help you: http://flexmonkey.blogspot.com/2015/07/applying-cifilters-to-live-camera-feed.html?view=magazine it's in Swift 2 but I think it may help you. (If not, try searching his site. Several more posts - and repos - may be of help.) –  Nov 07 '17 at 20:17
  • Thank @dfd, but it's performance is not enough to achieve my real-time target – Hanh Nguyen Nov 15 '17 at 02:29

0 Answers0