0

In NodeJS, I need to run some Vision API call on a live video stream.

What pre-processing to do to select the best frame before calling the API ?

  • Compare frame N with N-1 ? How ?
  • Detect motion blur ?
  • What frame rate should I use ? 1 fps ?

I didn't find best practice to extract frames from video for SaaS Computer Vision processing. It seems to be a common use case ? Video are too large to upload.

Jean-Philippe Encausse
  • 1,491
  • 2
  • 22
  • 40
  • Although this doesn't directly answer your question, you might look at the team's sample app (in C#) for suggestions: https://github.com/Microsoft/Cognitive-Samples-VideoFrameAnalysis – cthrash Sep 19 '16 at 20:38
  • I don't understand, it seems the code pick frames and send them async to microsoft cognitive services but there is no local analysis ? – Jean-Philippe Encausse Sep 20 '16 at 11:19
  • The Cognitive Services APIs all run in the cloud. The repo was intended to show how you might use the image-based APIs instead of the full-blown video-based ones. – cthrash Sep 20 '16 at 12:50

0 Answers0