In the documentation, it says that there could be other values for this key:
appRecognitionVerdict
can have the following values:
PLAY_RECOGNIZED
The app and certificate match the versions distributed by Google Play.
UNRECOGNIZED_VERSION
The certificate or package name does not match Google Play records.
UNEVALUATED
Application integrity was not evaluated. A necessary requirement was missed, such as the device not being trustworthy enough.
I believe the easiest incorrect result to obtain would be UNRECOGNIZED_VERSION
, for testing it I would try to build a version with an unpublished version code (i.e. greater than any version published on the Play Store) or an invalid package name (but maybe building the app would fail with this option).
In my own tests, simply building an app that is not published on the Play Store (i.e. built locally) is enough to trigger this verdict.
I do not understand exactly what you mean by the binary modification, I mean what changes you made in the binary. The token verification system is probably more sensitive to some binary changes than others.
You could also try to build your app with a different keystore (if you use a keystore that you have listed a SHA in the Firebase settings, it is likely going to be considered as safe/recognized).