You may want to check out the Google Photos Library API: http://developers.google.com/photos
Once a user has authorized your app, you can access the library and filter media items by content category. For example, you could find photos that contain animals, landmarks or are of receipts.
Unfortunately there's no option in this API to find labels that have been assigned to a particular image or video.
If you would like to classify your own images that are not part of Google Photos, you could use the Google Cloud Vision API to detect labels and other image attributes.
If you are after an on-device option, you could also take a look at Tensorflow Mobile and Tensorflow Lite and use a prepared image labeling model.