基于图像匹配的移动应用自动化测试方法研究 - 计算机工程与应用.pdf

Computer Engineering and Applications 计算机工程与应用 2016 ，52（13） 43 ⦾理论与研发⦾ 基于图像匹配的移动应用自动化测试方法研究 李昕宇，侯春萍，王宝亮，宁国津，于奎星 LI Xinyu, HOU Chunping, WANG Baoliang, NING Guojin, YU Kuixing 天津大学 电子信息工程学院，天津 300072 School of Electronic and Information Engineering, Tianjin University, Tianjin 300072, China LI Xinyu, HOU Chunping, WANG Baoliang, et al. Research on automated testing of mobile applications based on image matching. Computer Engineering and Applications, 2016, 52 （13）：43-47. Abstract ：Massive mobile applications have made the research of testing technology for mobile applications becoming a focus. The realization of automation test of mobile software can save time and manpower. An automation testing method based on the screenshot annotation and image matching is proposed. Taking the limited resolution and restricted details of the mobile phone screen into account and considering the characteristics of the mobile phone interface, such as images, text areas, lists, grids and so on, SURF feature points matching, RANSAC algorithm optimization and projection transfor- mation can be used to compare a phone interface screenshot and the reference automatically. Experiments show that this method is 1.69 times faster than SIFT, and 2.01 times faster than manual work, and it can check out 106 UI bugs out of 109 found by manual work, which is 1.71 times more accurate than SURF before optimization. Key words ：mobile application testing; testing automation; image matching; Speeded Up Robust Feature （SURF）; RANSAC algorithm 摘 要：海量的移动应用使得面向移动应用的测试技术研究成为当前的研究热点，通过基于手机截图的移动应用软 件自动化测试，可以节省大量的时间和人力，以此为背景提出了一种基于图像匹配和手机截屏区域标注的自动化测 试方法。主要考虑到手机界面分辨率和显示细节有限的特点，并根据移动应用在移动终端中UI 中的图像、文字、列 表、网格等各种区域显示的特点，通过SURF 特征点匹配、RANSAC 算法优化和投影变换，以及区域树优化，实现移 动应用的UI 截图与基准截图的自动匹配和对比。实验结果证明通过采用设计的自动化测试方法，单进程运行的效 率是采用SIFT 算法的1.69 倍，是手工的2.01 倍；能检测出人工检测发现的109 个界面显示问题中的106 个，准确率是 未经优化前的1.71 倍。 关键词：手机应用测试；自动化测试；图像匹配；快速鲁棒性特征（SURF ）；RAN