1

I'm trying to use the new Google machine learning sdk, ML Kit, on an Android devices that run Android 9. From the official site:

ML Kit makes it easy to apply ML techniques in your apps by bringing Google's ML technologies, such as the Google Cloud Vision API, TensorFlow Lite, and the Android Neural Networks API together in a single SDK. Whether you need the power of cloud-based processing, the real-time capabilities of mobile-optimized on-device models, or the flexibility of custom TensorFlow Lite models, ML Kit makes it possible with just a few lines of code.

I think it means that on a device with at least Android 8.1 (according to the documentation of nnapi) the SDK can uses NNAPI. But when I run the same app on a device with Android 7.1 (where nnapi is not supported) I obtain the same performance of the device that use Android 9 (and in theory the NNAPI). How i can use ML Kit with NNAPI? I am doing something wrong? Link to documentation of mlkit: https://firebase.google.com/docs/ml-kit/

Ibrahim Ulukaya
  • 12,767
  • 1
  • 33
  • 36
pado
  • 123
  • 1
  • 11

1 Answers1

5

According to this Oct 2018 paper: AI Benchmark: Running Deep Neural Networks on Android Smartphones, the NNAPI is defaults to the CPU path when no specific hardware and/or no drivers are available. Toward the end of the paper it notes that a number of devices have implementation issues.

As the paper's authors include representatives from Qualcomm, ARM, Huawei, MediaTek, and ETH Zurich, it is probably the most comprehensive overview of the state of machine learning on Android.

In Jan 2019 Google announced TensorFlow Lite with GPU acceleration in developer preview which will address some of the issues raised in the paper.

2020 July Update:

The researchers have a site at: http://ai-benchmark.com/

And have updated their paper in Oct 2019: AI Benchmark: All About Deep Learning on Smartphones in 2019

Morrison Chang
  • 11,691
  • 3
  • 41
  • 77