On the Accuracy of Automated GUI Testing for Embedded Systems

Automated GUI (Graphical User Interface) testing tools are software programs used to test application user interfaces and to verify their functionalities. However, due to the uncertainty of runtime execution environments GUI operations may not be reproduced at the DUT (Device Under Test) on time. The incorrect GUI operations then result in test failures. In this work we design SPAG (Smart Phone Automated GUI) to avoid non-deterministic events by batching the event sequences and reproducing them on the DUT directly. Furthermore, SPAG dynamically changes the timing of the following operation so that all event sequences can be performed on time. We conducted our experiments on Acer Liquid smart phone and compared SPAG with Monkeyrunner. Our experiments showed that SPAG can maintain an accuracy of up to 99.5%.