Facebase MLKit face detection failed with front camera when using CameraX

Question

I am trying to implement face detection using Firebase MLKit and CameraX ImageAnalysis. It works fine when using back camera, but when i tried with front camera, it detected nothing:

val config = PreviewConfig.Builder()
        .setLensFacing(CameraX.LensFacing.FRONT)
        .build()
val previewUseCase = Preview(config)
previewUseCase.setOnPreviewOutputUpdateListener { previewOutput ->
    viewFinder.post {
        removeView(viewFinder)
        addView(viewFinder, 0)
        viewFinder.surfaceTexture = previewOutput.surfaceTexture
        updateTransform(previewOutput)
    }
}

val highAccuracyOpts = FirebaseVisionFaceDetectorOptions.Builder()
    .setPerformanceMode(FirebaseVisionFaceDetectorOptions.ACCURATE)
    .build()
val detector = FirebaseVision.getInstance().getVisionFaceDetector(highAccuracyOpts)
val imageAnalysisConfig = ImageAnalysisConfig.Builder()
    .setImageReaderMode(ImageAnalysis.ImageReaderMode.ACQUIRE_LATEST_IMAGE)
    .build()
val imageAnalysis = ImageAnalysis(imageAnalysisConfig).apply {
    setAnalyzer(
        Executors.newSingleThreadExecutor(),
        ImageAnalysis.Analyzer { image, rotationDegrees ->
            if (image.image != null && isBusy.compareAndSet(false, true)) {
                val visionImage = FirebaseVisionImage.fromMediaImage(image.image!!, degreesToFirebaseRotation(rotationDegrees))
                detector.detectInImage(visionImage)
                    .addOnSuccessListener { faces ->
                        // faces.size always zero when using front camera
                        Timber.d("${faces.size}")
                        isBusy.set(false)
                    }
                    .addOnFailureListener { error ->
                        Timber.d("$error")
                    }
            }
        })
}

CameraX.bindToLifecycle(lifecycleOwner, previewUseCase, imageAnalysis)

I tested on Nokia 8.1 with Android 10. I tried https://github.com/firebase/quickstart-android/tree/master/mlkit which does not use CameraX and it works fine with front camera.

score -1 · Answer 1 · answered Oct 18 '19 at 17:00

Solved it by setting lensfacing for ImageAnalysis to CameraX.LensFacing.FRONT:

val imageAnalysisConfig = ImageAnalysisConfig.Builder()
    .setLensFacing(CameraX.LensFacing.FRONT)
    .setImageReaderMode(ImageAnalysis.ImageReaderMode.ACQUIRE_LATEST_IMAGE)
    .build()

Facebase MLKit face detection failed with front camera when using CameraX

1 Answers1