FortressCheck: automatic testing for generic properties
Pages 1290 - 1296
Abstract
QuickCheck is a random testing library designed for the purely functional programming language Haskell. Its main features include a descriptive yet embedded domain-specific testing language, a variety of test generators including a generator for functions, and a set of operations for monitoring generated inputs. QuickCheck is limited to ad-hoc testing, compared to more systematic testing methods such as full coverage testing. However, experiences showed that well-factored functions and properties make the QuickCheck approach as effective as systematic testing while maintaining its conciseness. QuickCheck and its variants are now available in dozens of programming languages.
We present a version of QuickCheck for the Fortress programming language in this paper. Fortress is an object-oriented language with extensive support for functional programming, with the strong emphasis on high-performance computing, parallelism by default, and growability of the language. While the main features of QuickCheck are straight-forward to implement, we are extending them to support unique features of Fortress and to support seamless integration to Fortress. We observed that the prevalent uses of implicit parallelism in Fortress call for testing parallel language constructs especially those using side effects. Also, because Fortress provides both subtype polymorphism and parametric polymorphism unlike Haskell, testing both polymorphic properties becomes interesting. We propose FortressCheck to test implicit parallelism and to test parametric polymorphism via reflection, by generating first-class type objects and using QuickCheck's own implication checking as a safety mechanism.
References
[1]
QuickCheck++. http://software.legiasoft.com/quickcheck/.
[2]
QuickCheck --- Wikipedia, The Free Encyclopedia. http://en.wikipedia.org/w/index.php?title=QuickCheck.
[3]
E. Allen, D. Chase, J. Hallett, V. Luchangco, J.-W. Maessen, S. Ryu, G. L. Steele Jr., and S. Tobin-Hochstadt. The Fortress Language Specification Version 1.0 β, March 2007.
[4]
E. Allen, D. Chase, J. Hallett, V. Luchangco, J.-W. Maessen, S. Ryu, G. L. Steele Jr., and S. Tobin-Hochstadt. The Fortress Language Specification Version 1.0, March 2008.
[5]
E. Allen, R. Culpepper, J. D. Nielsen, J. Rafkind, and S. Ryu. Growing a syntax. In Foundations of Object-Oriented Languages, 2009, Jan. 2009.
[6]
D. Bravender. qc: A Quickcheck implementation for Python. http://github.com/dbravender/qc.
[7]
K. Claessen and J. Hughes. QuickCheck: An Automatic Testing Tool for Haskell. http://www.cse.chalmers.se/~rjmh/QuickCheck/.
[8]
K. Claessen and J. Hughes. QuickCheck: a lightweight tool for random testing of Haskell programs. In ICFP '00: Proceedings of the fifth ACM SIGPLAN international conference on Functional programming, pages 268--279, New York, NY, USA, 2000. ACM.
[9]
K. Claessen, M. Palka, N. Smallbone, J. Hughes, H. Svensson, T. Arts, and U. Wiger. Finding race conditions in Erlang with QuickCheck and PULSE. In ICFP '09: Proceedings of the 14th ACM SIGPLAN international conference on Functional programming, pages 149--160, New York, NY, USA, 2009. ACM.
[10]
C. Csallner and Y. Smaragdakis. Jcrasher: an automatic robustness tester for java. Softw. Pract. Exper., 34(11): 1025--1050, 2004.
[11]
P. Godefroid, N. Klarlund, and K. Sen. DART: directed automated random testing. SIGPLAN Not., 40(6): 213--223, 2005.
[12]
J. Hughes. personal communication, Nov. 2010.
[13]
D. Ikegami. RushCheck: a lightweight random testing tool for Ruby. http://rushcheck.rubyforge.org/.
[14]
T. Jung. quickcheck: Java implementation of QuickCheck. https://quickcheck.dev.java.net/.
[15]
R. Nilsson. ScalaCheck. http://code.google.com/p/scalacheck/.
[16]
C. Pacheco, S. K. Lahiri, M. D. Ernst, and T. Ball. Feedback-directed random test generation. In ICSE '07: Proceedings of the 29th international conference on Software Engineering, pages 75--84, Washington, DC, USA, 2007. IEEE Computer Society.
[17]
C. E. Scheidegger. Scheme-Check: Randomized Unit Testing for PLT Scheme. http://www.inf.ufrgs.br/~carlossch/scheme-check/. Currently only available via Wayback Machine: http://web.archive.org/web/20050212183945/www.inf.ufrgs.br/~carlossch/scheme-check/.
[18]
K. Schelfthout. FsCheck: A random testing framework. http://fscheck.codeplex.com/.
[19]
K. Sen, D. Marinov, and G. Agha. CUTE: a concolic unit testing engine for C. In ESEC/FSE-13: Proceedings of the 10th European software engineering conference held jointly with 13th ACM SIGSOFT international symposium on Foundations of software engineering, pages 263--272, New York, NY, USA, 2005. ACM.
Index Terms
- FortressCheck: automatic testing for generic properties
Recommendations
Type checking modular multiple dispatch with parametric polymorphism and multiple inheritance
OOPSLA '11In previous work, we presented rules for defining overloaded functions that ensure type safety under symmetric multiple dispatch in an object-oriented language with multiple inheritance, and we showed how to check these rules without requiring the ...
ArbitCheck: A Highly Automated Property-Based Testing Tool for Java
ICSTW '14: Proceedings of the 2014 IEEE International Conference on Software Testing, Verification, and Validation WorkshopsLightweight property-based testing tools are becoming popular these days. With property-based testing, developers can test properties of the system under test against large varieties of randomly generated inputs without writing test cases. Despite the ...
Automatic Test Generation for Haskell Programming Assignments
ITiCSE '20: Proceedings of the 2020 ACM Conference on Innovation and Technology in Computer Science EducationAutomatic testing of programming assignments is highly desirable as it can provide fast feedback for the students and allows the teachers to teach efficiently even in courses with many students. However, writing tests for students' solutions can be ...
Comments
Information & Contributors
Information
Published In
March 2011
1868 pages
ISBN:9781450301138
DOI:10.1145/1982185
- Conference Chairs:
- William Chu,
- W. Eric Wong,
- Program Chairs:
- Mathew J. Palakal,
- Chih-Cheng Hung
Copyright © 2011 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 21 March 2011
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
Conference
SAC'11
Sponsor:
Acceptance Rates
Overall Acceptance Rate 1,650 of 6,669 submissions, 25%
Upcoming Conference
SAC '25
- Sponsor:
- sigapp
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 119Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 23 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in