Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
article

An automated oracle for verifying GUI objects

Published: 01 July 2001 Publication History

Abstract

Recently, software testers have relied more on automated testing to test software. Automated testing method consists of the three modules: test case design, execution, and verification. Yet, to accomplish these three phases, we are always in a dilemma due to a lack of a verification function. Nearly all the commercial automated testing tools cannot efficiently compare graphic objects though GUI (Graphic User Interface) software is now more crucial than text based user interface. This research develops a technique that aids automatic behavior verification for a particularly difficult problem: determining the correction of screen output. Methodology to capture and compare screen output is presented and a case study using Microsoft® PowerPoint® is described.

References

[1]
Fewster, Mark. Software Test Automation, Addison Wesley, New York, 1999.
[2]
Dustin, Elfriede. "Lessons in Test Automation" Software Testing & Quality Magazine, September/October 1999
[3]
Using Rational Robot Release Z5, Rational Software Corporation, MA, 1999.
[4]
Marick, Brian. "When should a Test Be Automated?" International Software Quality Week, May 1998.

Cited By

View all
  • (2020)ADVISOR: An Adjustable Framework for Test Oracle Automation of Visual Output SystemsIEEE Transactions on Reliability10.1109/TR.2019.295750769:3(1050-1063)Online publication date: Sep-2020
  • (2018)Adaptive Random Testing in Detecting Layout Faults of Web ApplicationsInternational Journal of Software Engineering and Knowledge Engineering10.1142/S021819401850040728:10(1399-1428)Online publication date: 25-Sep-2018
  • (2018)VISORJournal of Systems and Software10.1016/j.jss.2017.06.023136:C(266-277)Online publication date: 1-Feb-2018
  • Show More Cited By

Recommendations

Reviews

John R. Dance

The author describes a tool that can help verify the correctness of graphical output. A common method of image testing is to do a bit-by-bit comparison. This tool attempts to raise image comparison to a logical level by capturing the graphical application programming interface (API) calls and then doing some comparisons of the results. It appears to be successful in some small test cases. In short, the tool captures graphical API calls and boils them down into the set of points used in the drawing API. Given this set of points, a second image can be compared by looking either at the point set itself, or by looking at the angles and lengths of the vectors to those points. Looking at the angles and lengths allows scaled images to be compared. While this tool appears to work in these two test cases, there are plenty of drawbacks. For example, image rotation, translation, and skewing cannot be tested. In addition, inclusion of bitmap images will cause the comparisons to fall back to a bit-by-bit style. While the paper succeeded in making me think of additional uses or variations of this technique, the English is rather poor and makes the paper hard to follow in places. There are four references; however, a quick search on the Web resulted in many relevant and related topics. Not being an expert in GUI testing techniques, I wonder how much these techniques have been tried and/or documented by others. Online Computing Reviews Service

Access critical reviews of Computing literature here

Become a reviewer for Computing Reviews.

Comments

Information & Contributors

Information

Published In

cover image ACM SIGSOFT Software Engineering Notes
ACM SIGSOFT Software Engineering Notes  Volume 26, Issue 4
July 2001
66 pages
ISSN:0163-5948
DOI:10.1145/505482
Issue’s Table of Contents
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2001
Published in SIGSOFT Volume 26, Issue 4

Check for updates

Author Tags

  1. GUI testing
  2. Software testing
  3. automated testing

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 03 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2020)ADVISOR: An Adjustable Framework for Test Oracle Automation of Visual Output SystemsIEEE Transactions on Reliability10.1109/TR.2019.295750769:3(1050-1063)Online publication date: Sep-2020
  • (2018)Adaptive Random Testing in Detecting Layout Faults of Web ApplicationsInternational Journal of Software Engineering and Knowledge Engineering10.1142/S021819401850040728:10(1399-1428)Online publication date: 25-Sep-2018
  • (2018)VISORJournal of Systems and Software10.1016/j.jss.2017.06.023136:C(266-277)Online publication date: 1-Feb-2018
  • (2017)Prediction of Kp index using NARMAX models with a robust model structure selection method2017 9th International Conference on Electronics, Computers and Artificial Intelligence (ECAI)10.1109/ECAI.2017.8166414(1-6)Online publication date: Jun-2017
  • (2014)Eliminating Human Visual Judgment from Testing of Financial Charting SoftwareJournal of Software10.4304/jsw.9.2.298-3129:2Online publication date: 1-Feb-2014
  • (2014)Automated Test Oracles10.1016/B978-0-12-800160-8.00003-6(113-199)Online publication date: 2014
  • (2013)Graphical user interface (GUI) testingInformation and Software Technology10.1016/j.infsof.2013.03.00455:10(1679-1694)Online publication date: 1-Oct-2013
  • (2012)A distributed, cross-platform automation testing framework for GUI-driven applicationsProceedings of 2012 2nd International Conference on Computer Science and Network Technology10.1109/ICCSNT.2012.6526035(723-726)Online publication date: Dec-2012
  • (2012)An initial study on ideal GUI test case replayabilityProceedings of 2012 IEEE International Conference on Automation, Quality and Testing, Robotics10.1109/AQTR.2012.6237736(376-381)Online publication date: May-2012
  • (2011)Using concepts of content‐based image retrieval to implement graphical testing oraclesSoftware Testing, Verification and Reliability10.1002/stvr.46323:3(171-198)Online publication date: 2-May-2011
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media