Abstract
In this paper we present the design and implementation of a framework for comprehensive performance evaluation of algorithms, modules, and libraries. Our framework allows for the definition of well-defined test inputs and the subsequent scheduling and execution of structured tests. In addition, the framework provides a web-based interface for user interaction and allows for the convenient browsing, plotting, and statistical analysis of test results. We furthermore report on our experience in using the new framework in the development of cryptographic protocols and algorithms—specifically in the context of secure multi-party computation.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Yao, A.: Protocols for Secure Computations. In: Foundations of Computer Science, vol. 23, pp. 160–164. IEEE (1982)
Goldreich, O.: Foundations of Cryptography. Basic Applications, vol. 2. Cambridge University Press (2009)
Molyneaux, I.: The Art of Application Performance Testing, vol. 1. O’Reilly Media (2009)
IBM: Rational Performance Tester, http://www-01.ibm.com/software/awdtools/tester/performance/
Hewlett Packard: HP LoadRunner, http://www8.hp.com/us/en/software/software-product.html?compURI=tcm:245-935779
Apache Software Foundation: Apache JMeter, http://jmeter.apache.org/
Aston, P.: The Grinder, a Java Load Testing Framework, http://grinder.sourceforge.net/
Chen, S., Moreland, D., Nepal, S., Zic, J.: Yet Another Performance Testing Framework. In: Australian Conference on Software Engineering (ASWEC), pp. 170–179 (2008)
Zhang, L., Chen, Y., Tang, F., Ao, X.: Design and Implementation of Cloud-based Performance Testing System for Web Services. In: Conference on Communications and Networking in China (CHINACOM), pp. 875–880 (2011)
Amazon Web Services LLC: Amazon Elastic Compute Cloud (Amazon EC2) (2012), http://aws.amazon.com/ec2/
Cramer, R., Damgård, I., Nielsen, J.: Multiparty Computation, an Introduction (2009)
Freedman, M., Nissim, K., Pinkas, B.: Efficient Private Matching and Set Intersection. In: Cachin, C., Camenisch, J.L. (eds.) EUROCRYPT 2004. LNCS, vol. 3027, pp. 1–19. Springer, Heidelberg (2004)
De Cristofaro, E., Tsudik, G.: Practical Private Set Intersection Protocols with Linear Complexity. In: Sion, R. (ed.) FC 2010. LNCS, vol. 6052, pp. 143–159. Springer, Heidelberg (2010)
Micciancio, D.: A First Glimpse of Cryptography’s Holy Grail. Commun. ACM 53(3), 96–96 (2010)
Paillier, P.: Public-Key Cryptosystems Based on Composite Degree Residuosity Classes. In: Stern, J. (ed.) EUROCRYPT 1999. LNCS, vol. 1592, pp. 223–238. Springer, Heidelberg (1999)
Damgard, I., Jurik, M.: A Generalisation, a Simplification and Some Applications of Paillier’s Probabilistic Public-Key System. In: Kim, K.-C. (ed.) PKC 2001. LNCS, vol. 1992, pp. 119–136. Springer, Heidelberg (2001)
IEEE: Standard for System and Software Verification and Validation (2012)
Reenskaug, T.: Model-Viewer-Controller. Technical report, XEROX PARC (1978)
The Pylons Project: Pyramid (2012), http://www.pylonsproject.org/
SQLAlchemy Authors and Contributors: SQLAlchemy, http://www.sqlalchemy.org/
Mako Authors and Contributors: Mako Templates for Python, http://www.makotemplates.org/
MySQL AB: MySQL - The World’s Most Popular Open Source Database (2011), http://www.mysql.com/
Crockford, D.: The application/json Media Type for JavaScript Object Notation (JSON). RFC 4627 (Informational) (July 2006)
Hunter, J.: Matplotlib (2011), http://matplotlib.sourceforge.net/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 IFIP International Federation for Information Processing
About this paper
Cite this paper
Mayer, D.A., Steele, O., Wetzel, S., Meyer, U. (2012). CaPTIF: Comprehensive Performance TestIng Framework. In: Nielsen, B., Weise, C. (eds) Testing Software and Systems. ICTSS 2012. Lecture Notes in Computer Science, vol 7641. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34691-0_6
Download citation
DOI: https://doi.org/10.1007/978-3-642-34691-0_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34690-3
Online ISBN: 978-3-642-34691-0
eBook Packages: Computer ScienceComputer Science (R0)