Get exact frame from a video in Android

Question

So I have an app where users can take videos, and I want to grab specific frames from the file. When I use the method MediaMetaDataRetriever.getFrameAtTime(), it can only extract one frame for every second, but I want to grab frames between the seconds as well. I also tried to implement Jcodec into my project to grab the right frames:

FrameGrab.getFrame(new File(videoFileToRetreive.getVideoFile()), currentFrame);,

However, no matter what number I put into currentFrame, the image is always returns the first frame of the video. Is there any way to perform something like this without the use of ffmpeg? If anyone knows an answer it'd be greatly appreciated.

score 1 · Answer 1 · answered Feb 22 '17 at 20:47

1

I ended up using an FFmpeg android library found here: https://github.com/wseemann/FFmpegMediaMetadataRetriever

answered Feb 22 '17 at 20:47

hermt2

844
3
14
33

Did you use the pre-build `.aar` files? I just posted a question about this - https://stackoverflow.com/questions/52253127/generate-apk-for-different-architectures-ffmpegmediametadataretriever – ClassA Sep 10 '18 at 07:41

Nick Cardoso · Answer 2 · 2017-02-22T20:20:46.067

0

Presumably if you are using MediaMetaDataRetriever you are also using MediaPlayer from the same framework.

If this is the case, MediaPlayer provides the method seekTo(millis)

Unfortunately seekTo moves the track to a timestamp rather than a Frame, but you should be able to work out the correct position to move to if you know the frame rate.

Also: when looking at getFrameAtTime the parameter it takes is 'uSecs' which I take to be microseconds - this means that the method can return far more than one frame per second - the problem you are seeing may be because if there is no frame at that exact microsecond, it takes a nearby frame

This means is that if your video has 30fps, there will be a frame every 33.333 uSecs, so make sure to use intervals near that size when calling getFrameAtTime

edited Feb 22 '17 at 20:20

answered Feb 22 '17 at 20:00

Nick Cardoso

20,807
14
73
124

I've tried this, but it only skips to the keyframes which exist every one second again. Is there no way to ignore this? – hermt2 Feb 22 '17 at 20:20
I'm not all that familiar tbh, I just took a little look at the source code because the problem was interesting, sorry – Nick Cardoso Feb 22 '17 at 20:21
Do you have control over the video types supplied? Maybe another format with a different codec will offer better results – Nick Cardoso Feb 22 '17 at 20:22
It's a video from a custom camera that I made. – hermt2 Feb 22 '17 at 20:23

score 0 · Answer 3 · edited May 31 '18 at 04:04

0

I have the same problem.

MediaMetaDataRetriever.getFrameAtTime() works as you want in API 27.

edited May 31 '18 at 04:04

4b0

21,981
30
95
142

answered May 31 '18 at 04:03

Jeff

23
3

score 0 · Answer 4 · edited Feb 20 '21 at 19:40

0

you can use the same library media metadata **retriver.MediaMetaDataRetriever.getFrameAtTime(OPTION_CLOSEST)**. you need to use OPTION_CLOSEST rather than OPTION_CLOSEST_SYNC.OPTION_CLOSEST_SYNC is faster than OPTION_CLOSEST but it replaces every first frame with 30 frames in a second. OPTION_CLOSEST is slow as compared to OPTION_CLOSEST_SYNC but it works fine.

edited Feb 20 '21 at 19:40

Amir Dora.

2,831
4
40
61

answered Feb 20 '21 at 18:13

kamran liaqat

1

Get exact frame from a video in Android

4 Answers4