Questions tagged [firebase-test-lab]

Firebase Test Lab provides cloud-based infrastructure for testing Android and iOS apps. This includes test experience integrated into Android Studio, gcloud command-line tool, and Firebase Console. For comprehensive testing before releasing your app, Firebase Test Lab gives you access to physical & virtual devices installed and running in a Google data center.

Firebase Test Lab is a component of the Firebase suite and provides cloud-based infrastructure for testing Android and iOS apps. With one operation you can initiate testing of your app across a wide variety of devices and device configurations. Test results — including logs, videos, and screenshots — are made available in your project in the Firebase Console. Even if you haven't written any test code for your app, Test Lab can exercise your app automatically, looking for crashes.

Related tags:

348 questions
5
votes
0 answers

Firebase Test Lab & Google Pre-launch report Google sign in fails/normal users are unaffected

I’m having a strange issue with Google sign in my app, done using FirebaseUI. I have added the 3 SHA-1 keys needed for OAuth in my Firebase Console (debug, release and app signing key), updated my google-services.json file and made sure everything…
5
votes
2 answers

Android App Crawler not working -> Permission Denial failure

I was trying to run app crawler locally in order to test robo scripts created in Android Studio. I followed this handy article (https://android.jlelse.eu/test-robo-scripts-locally-useful-for-firebase-test-lab-pre-launch-reports-41da83d5769f) and…
5
votes
1 answer

App crawler in Android Jetpack tool not working locally as mentioned in developers documentation

I am using the following command: java -jar crawl_launcher.jar --apk-file path/to/my/app.apk --android-sdk path/to/my/android/sdk I followed the steps mentioned in the https://developer.android.com/training/testing/crawler but it's not even…
5
votes
2 answers

Prevent firebase test labs from clicking ads

I used Firebase Test Lab to test my app before uploading it to Google Play. Looking at the screenshots and video it looks like real ads are displayed from admob and then clicked on. Now I know you can set test devices to show test ads but I cannot…
5
votes
1 answer

Test React Native App using Firebase TestLab

Is it possible to test a React Native (Expo Managed) app using Firebase TestLab? I have not succeeded. Several possible routes, none successful thus far: 1) Is it possible to force a Robo Test to keep running for a specified period of time? …
user2330237
  • 1,629
  • 5
  • 20
  • 39
5
votes
2 answers

Not able to find solution for detecting camera button for different devices in Espresso script to be run on Firebase Test Lab

I have to create a script using Espresso to test my app in Firebase test lab. My app uses Camera to capture images and I have opened the default camera app. For testing on my device I give package name for the testing device that I am using. The…
4
votes
0 answers

RuntimeException: Error in evaluationEvaluation: status: 13 value: {message=Invalid or unexpected token}

when i uploaded to google play console, and review finished. apk rejected by showing this error. how to solve this problem, anyone have a solution? FATAL EXCEPTION: Thread-9 java.lang.RuntimeException: java.lang.RuntimeException: Error in…
4
votes
0 answers

How to use --directories-to-pull to save files created by app in Firebase Test Lab

I'm using Firebase Test Lab to run integration tests of my app written in Flutter. I would like to pull all files created by the app and save it in the results bucket. It seems like the --directories-to-pull argument is what I need:…
Giuseppe Cianci
  • 407
  • 3
  • 9
4
votes
1 answer

Android package test does not have a signature matching the target

There are many similar question about the app signature, like this. But none are my case. I used to have a CI that run ./gradlew :App:assembleDebug :App:assembleAndroidTest To save time I try to parallelise both assemble commands in two different…
Canato
  • 3,598
  • 5
  • 33
  • 57
4
votes
1 answer

Android Firebase: Robo script failing on Location Permissions Dialog

My recorded Firebase Robo scripts fail due to system dialogs such as the "For a better experience, turn on device location" dialog. When recording the script, it shows: Requested permissions android.permissions.ACCESS_FINE_LOCATION …
Nissi
  • 205
  • 3
  • 13
4
votes
1 answer

Android Studio doesn't record Robo Test

I've Android Studio (AS) 3.4.1. Trying to record a Robo Script for the UI for my Flutter project. Followed pretty much everything from Google's Firebase Test Lab. The recording only records phone's physical button press but not any tap on the…
Sukhi
  • 13,261
  • 7
  • 36
  • 53
4
votes
1 answer

Instrumentation tested app crashes due to Chrome auto-update on Firebase Test Lab

While running instrumentation tests on Google's Firebase Test Lab, the tested app is crashing due to Google Chrome being updated in the background. The tested app indeed has some WebViews but they are not displayed during the test run. The video…
4
votes
1 answer

Firebase VDT does not run Gherkin (Cucumber) tests

I'm running integration tests with VDT. I build the two APKs and then I send them following the tutorial that is referenced here: https://firebase.google.com/docs/test-lab/android/continuous for Bitrise. Firebase successfully runs my non-Cucumber…
1048576
  • 615
  • 9
  • 27
4
votes
1 answer

Getting "The test APK does not contain the test runner class specified by the user or the manifest file." with Firebase

I am getting the following error trying to run UI tests on firebase through commandline: Test [matrix-1dy3j2omlw7n9] has been created in the Google Cloud. Firebase Test Lab will execute your instrumentation test on 1 device(s). Creating…
Fred Chan
  • 97
  • 7
4
votes
2 answers

How to download file from Firebase Test Lab device

I am trying to download files from a Google Firebase Test Lab device. These files are generated from running instrumented tests. The files are screenshots. I need to download the screenshots because subsequent runs of the tests will compare…
Michael Osofsky
  • 11,429
  • 16
  • 68
  • 113
1 2
3
23 24