Skip to main content

Using Firebase Test Lab for Android Continuous Testing

Appcircle is integrated with Firebase Test Lab for continuous testing. You can build your app in Appcircle and deploy it directly to the Firebase Test Lab to run automated tests.

Setting Up a Firebase Project and a Service Account​

To start with the Firebase Test Lab, you need to have an associated Firebase Project, which is created in the Firebase console. Go to the console, press the "Add Project" button and specify the project name and the other settings:

After your project is created, go to the Google Cloud Platform console to create a service account. Press the "Create Service Account" button and follow the prompts to create a service account with the Editor role:

Once the service account is created, click on the three dot menu next to the service account and press "Create Key".

Select the key format as "JSON" and download the created key. We will be using this key for Appcircle to be able to deploy apps to Firebase Test Lab.

As the final step, go to the Google Developers Console API Library page and find and enable the following APIs:

  • Google Cloud Testing API
  • Cloud Tool Results API.

Firebase Test Lab Authentication Configuration in Appcircle​

To start, go to the environment variables section and add the service account JSON key created in the previous step as a new environment variable. Take a note of the variable name, which will be necessary in the workflow configuration.

Then select the related environment variable group in the build configuration of the project that will be using Firebase Test Lab.

Build Workflow Configuration for Firebase Test Lab​

To utilize Firebase Test Lab in your builds, open the workflow editor and add the "Firebase Test Lab for Android" step after the build or sign steps. If you want to run instrumentation tests, also add the "Android Build for UI Testing" step before the Firebase Test Lab step.

If you want to use the UI Test Build output or the Signed Build output in Firebase Test Lab, add any of these steps before the Firebase Test Lab step and take a note of the output path of these steps. You will need this environment variable for testing configuration.

Before the build, the last task is to configure the Firebase Test Lab for Android step:

  • Project ID: Enter the name of the Firebase project created
  • Key File: Enter the name of the key file uploaded as an environment variable ($ is required before the key name).
  • Test Type: Select a test type. robo and instrumentation are supported.
  • Bucket Name: Enter a bucket name to store the test results in a Google Cloud Storage bucket.
  • APK Path: The default value is the APK produced by the "Android Build" step. You can specify a different environment variable to use the APK files produced in other steps.
  • Test APK Path: Specify the environment variable to the path of the APK build for UI testing
  • Extra Arguments: For further configuration of the test run. Please refer to the Google Cloud CLI Documentation.

Once everything is set up, press save to save your step configuration. Then you can configure and run your build just like any other app.

Viewing the Firebase Test Lab Step Results​

Once your build is done, you can view the results of the Firebase Test Lab step in the build logs.

The full details of the tests are accessible in the Firebase console and in your Google Cloud Storage bucket for analysis.