Have you ever developed an Android application and publish it to Google Play? What will you do if you get a user review like -
When you publish an app to Google play, it must be well tested to avoid the potential bugs. There's a ton of test scenarios that should be executed before publishing an app. To save the testing effort, you need a testing tool. One of the best testing tool for Android app is Selendroid.
What is the Selendroid?
Selendroid is a test automation framework for multi type of mobile application: native and hybrid android app and mobile web.
You can write the tests using the Selenium 2 client APIs. Because Selendroid still reuses of the existing Selenium infrastructure for the web
Selendroid is a powerful testing tool. It can be used on emulators and real devices
Why do we need Selendroid?
Selendroid is a great testing tool. But you may still doubt its usefulness.
This section will introduce the important feautures of the Selendroid to answer the question why you need Selendroid.
- You can test the application under test using Selendroid without any modification of the app. You just need the binary file (APK) installed on the computer. In order to install the binary file on the device, the test app and mobile app must be signed with same sign key
- Selendroid test app can interact with multiple devices or simulators simultaneously. It's a great advantage of Selendroid. So you can test your app with various android devices to check compatibility.
- Selendroid can simulate human-user actions on an app, such as touch, swipe, drag and drop on devices
- You can change the hardware devices (Plug and unplug) during the testing without restarting or stopping the test. Selendroid recognizes the new devices automatically
- Corresponding to the Android API version up, Selendroid also supports the new Android API (From API 10 to API 19)
- Selendroid also has some built in inspector tool to help you identify the UI element of application under test. For example the ID of button, text field, text view…
Selendroid architecture
Selendroid is based on the Android instrumentation framework. Selendroid tests are written base on the Selenium Web driver client API, so it support full integration with current Selenium frameworks.
The folllowing figure describe the architecture of Selendroid
Selendroid contains 4 major components:
- Web Driver Client – The Java client library based on Selenium. This library should be installed on the computer (which is used to develop the test cases)
- Selendroid-Server – The server which runs be in the app under test on Android device or simulator. This is the main components of Selendroid architecture
- Android Driver-App - A built in Android driver, Web View app to test the mobile web.
- Selendroid-Standalone – This component is used to install the Selendroid server and the application under test (AUT)
Getting started with Selendroid
You already known the importance of the Selendroid. Now let's get our hands dirty with Selendroid.
There're 3 steps should be done before first test with Selendroid
Setting up Selendroid environment
Selendroid can work on Window, Linux and Mac OS. In this tutorial, we will setup Selendroid in Window OS.
Before using Selendroid, you need install following package first
- Java SDK (minimum 1.6)You must accept the license agreement and download the java installer (Choose x64 or x86 base on your OS)Download and install the Java SDK as normal software
- Latest version of Android SDK
- Your computer must have atleast one Android Virtual Device (AVD), or a real Android device plugged into the PC.
- Selendroid Standalone with dependencies, Selendroid Client and Selenium Client
- Eclipse software
- Set up the JAVA_HOME and ANDROID_HOMEStep 1) On Window, right click Computer -> Properties -> Advance System SettingStep 2) System Properties window display, select tab Advanced -> Environment VariablesStep 3) The Environment window display, click New -> Enter a variable ANDROID_HOME as followingThe variable value is the path to android-sdks which you already installed.Find the system variable Path -> Edit -> Add the following line after the current lineSimilar to ANDROID_HOME, add new variable JAVA_HOME with value as belowThe value is the Path to your Java JDK installationStep 4) Restart your PC -> Done
How to launch Selendroid
Step 1) Getting an application under test
You can use existing Selendroid test app to check that how Selendroid works (Link to sample application under test)
Once download is complete, copy this APK and the above Selendroid Standalone jar file to a folder with name "Guru99"
Step 2) Launch the Selendroid
Open the terminal on Windows & navigate to the folder Guru99 created in step 1.
Run the following command
The output will display as following
After running this command, Selendroid-standalone http server starts! The default port number of this server is 4444. All hardware device as well as Android Virtual Device will be scanned and recognized automatically. Selendroid will identify the Android target version and device screen size.
To check the Android target version as well as the device information, you can launch following URL on browser:
Selendroid basic command
This section introduce you some basic Selendroid-Standalone command line. You may use them to setup the Selendroid testing environment
- Setting port of SelendroidThe default port of Selendroid is 4444. But you can change to other port by adding parameter to the command to launch SelendroidParameter: -port [port number]For example:In above command, 5555 is the new port.
So the URL to check the Android target version is changed to: http://localhost:5555/wd/hub/status
- Specify the location of the application under test (Binary APK file). Selendroid often required the absolute path for this fileParameter: -app [file path]For example:In above command, the Selendroid automatically find the binary file base on the "C:\Guru99App.apk" to get the information of the application under test.Check the URL http://localhost:4444/wd/hub/status, you will see this information
- Change the port the Selendroid uses to communicate with instrumentation server. Selendroid uses the port 8080 as the defaultParameter: -selendroidServerPort [port number]ExampleThe port now is changed to 9000
- Change the timeout to start emulators. The unit is milliseconds.Parameter: -timeoutEmulatorStartBy default Selendroid will wait 300,000 milliseconds until the emulator starts. You can change to new timeout (200,000 ms) by commandAfter this time our expired, if the emulator cannot start, the Selendroid will throw the exception error (Error occurred while looking for devices/emulators.) then stop running
- When you start the Selendroid command on terminal, you will see a log printed out on the screen. You can change the type of log you see by adding following parameterParameter: -logLevel [type of log]The log level values are: ERROR, WARNING, INFO, DEBUG and VERBOSE. Default: ERROR.For example, set Selendroid to print the WARNING log only, you can use this commandThe Selendroid only print the WARNING log
Start your first test with Selendroid
This section is a step by step guide to create your first test script using Selendroid
Suppose we have an Android application under test name Guru99App. The application include a text field and a button name "Show Text".
We need execute following test case using Selendroid
Test Cases
|
Condition
|
Expected output:
|
|
The binary of the application under test is available
Device is connected to PC
|
The text "Text Show here" is change to the text
which user enter in text field
|
Step 1) Create a Java project in Eclipse
Step 2) Add selenium and Selendroid jar file in eclipse environments
Right click Guru99Test Project -> Build Path -> Add External Archives
Navigate to the folder which stored the jar files
There're 3 jar files should be added
- selendroid-client-0.10.0.jar : Selendroid java client library
- selendroid-standalone-0.11.0-with-dependencies :Selendroid standalone server library
- selenium-java-2.40.0.jar : Selenium Web Driver library
Select all -> Choose Open to add jar file to the project
Step 3) after adding the above library, those libraries will be added to the Reference Libraries of the test project. Tester can use the APIs of those library to develop the test program
Create package "com.guru.test"and add java file "Guru99Test.java" like below
Right Click Guru99Test -> New -> Package
Type com.guru.test to the Name field on New Java Package dialog à Finish
The Eclipse will create a list folders and sub folders like this in the source code structure
Step 4) Install TestNG for Eclipse
In Eclipse, Help -> Install New Software, in the Install Dialog, click Add and enter the following
- Name: TestNG
- Location: http://beust.com/eclipse
Press OK -> Next to install the TestNG
Step 5) Copy the Guru99App.apk to the folder of Test App
Step 6) Get the ID of application under test.
Suppose we have an APK file name Guru99App.apk. Follow the step which is described in previous section, execute the command on terminal
Open following link in browser
The information of device is displayed, copy the appId value "com.guru99app:1.0"
Step 7) Open the file Guru99Test.java (in sample code) and change as following
To create a new test session with Selendroid, you have to provide the app id in the format: com.guru99app:1.0. This app Id can is identified in step 6. If you don't set the app Id matching the Android device, the test session will throw error and will not start.
After initializing the found device, Selendroid creates a customized selendroid-server and installs the Selendroid server on it
Selendroid also installs the application under test and starts the selendroid-server on device
After initzalizing the test session succesfully, the test command is started executing on device. (Such as enter text, press button…). If the test app ends the test session, the emulator will stop automatically
Step 8) Start the new test session
Launch the Selendroid server using following command on terminal like step 6
After the Selendroid Server started, open the sample test project Guru99test on Eclipse, set a breakpoint at line 77 on file Guru99Test.java by double click to the line 77 -> A dot will display like below
Start a test session by right Click to Guru99Test project -> Debug As -> TestNg Test.
A test session will start like below
Step 9) Get the Id of GUI element of application under test
After test session start successfully, open browser, navigate to the URL http://localhost:4444/inspector
You will see the Application Under Test is launched like below
Use mouse hover to each UI element of AUT (Button, TextField, Text Label), the ID of each element will hightlight on the right pane
After this step, you can get the ID of each above UI element
- Button Show Text ID : "btnShow"
- Text Field ID: "edtText"
- Label Text ID: "txtView"
Those IDs will be used in next step
Step 10) Enter the test program like below
A test program using Selendroid includes 3 sections
Setup Test:
Following is the code for setup test, it will set up the condition for a test session.In case of an error, the Selendroid will throw the exception and the test app will stop.
The code include the commments to explain each the statement.
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
| package com.guru.test; import io.selendroid.SelendroidCapabilities; import io.selendroid.SelendroidConfiguration; import io.selendroid.SelendroidDriver; import io.selendroid.SelendroidLauncher; import io.selendroid.device.DeviceTargetPlatform; import org.openqa.selenium.By; import org.openqa.selenium.WebDriver; import org.openqa.selenium.WebElement; import org.testng.Assert; import org.testng.annotations.AfterSuite; import org.testng.annotations.BeforeSuite; import org.testng.annotations.Test; /** * @author Guru99 Test App using Selendroid * Application under test: Guru99App * */ public class Guru99Test { //Declare web driver variable private WebDriver driver; /** * Setup the environment before testing * @throws Exception */ @BeforeSuite public void setUp() throws Exception { //Start selendroid-standalone during test SelendroidConfiguration config = new SelendroidConfiguration(); // Add the selendroid-test-app to the standalone server config.addSupportedApp("Guru99App.apk"); //start the standalone server SelendroidLauncher selendroidServer = new SelendroidLauncher(config); selendroidServer.launchSelendroid(); // Create the selendroid capabilities SelendroidCapabilities capa = new SelendroidCapabilities(); // Specify to use selendroid's test app capa.setAut("com.guru99app:1.0"); // Specify to use the Android device API 19 capa.setPlatformVersion(DeviceTargetPlatform.ANDROID19); // Don't request simulator, use real device capa.setEmulator(false); //capa.wait(10000000); // Create instance of Selendroid Driver driver = new SelendroidDriver(capa); } |
Execute Test
Below is the code to execute a test. The code includes the commments
Here are the test steps again
- Enter the text "Hello Guru""
- Click Show Text Button
- Wait a while
- Verify that the app display the text as user enter to text field (Ex. Display the text "Hello Guru")
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
| /** * Start execute the test case * 01. Enter the text "Selendroid" to the textfield * 02. Press OK button * @throws Exception */ @Test public void selendroidTest() throws Exception { // Print the log System.out.print("Start executing test"); // Find the input text field on screen // The id of this text field was get from step 9 WebElement inputField = driver.findElement(By.id("edtText")); // Verify that the text field enabled so user can enter text Assert.assertEquals("true", inputField.getAttribute("enabled")); // Enter a text to text field inputField.sendKeys("Hello Guru"); // click Show Text button // The id of this button was get from step 9 WebElement button = driver.findElement(By.id("btnShow")); button.click(); // Delay time to take effect Thread.sleep(5000); //Find the label "Text Show Here" on screen // The id of this label was get from step 9 WebElement txtView = driver.findElement(By.id("txtView")); //Get the text display on screen String expected = txtView.getText(); // Verify that the text which user enter on text field is same as text display on screen Assert.assertEquals(expected, inputField.getText()); } |
Finish Test
Following code will complete the test by stopping the Selendroid driver.
1
2
3
4
5
6
7
8
9
| /** * Stop the Selendroid driver * */ @AfterSuite public void tearDown() { driver.quit(); } |
You can see the detail in sample code included in this article.
Step 10) Connect Android device to the PC via USB cable. Points to observe -
- Please make sure the device has no screen lock configured.
- Devices must be plugged in via USB to the computer that the selendroid-standalone component is running on.
- The device should install at least Android Target Version API 10
Step 11) Run the Test App: Right click Guru99test -> Run as -> TestNG test
Step 10) The Script start executed as following
Step 12) After test finishes execution, TestNG auto generates the test report as following
Good Job, you are done the test now.
Summary
Summary
- Selendroid is a very powerful tool for testing Android native app, hybrid app as well as the web app.
- It can be used on real devices as well as the simulator.
- It also allows you to run tests in parallel by running test on multi devices.
- The entire Selendroid suite is comprised of four components:
- Web Driver client,
- Selendroid-Server,
- Android Driver App
- Selendroid-stand alone
- To use Selendroid you need Java JDK, Android SDK and Eclipse installed.
.png)
.png)
.png)
.png)
.png)
.png)
