Abstract
Cloud computing provides on-demand resource provisioning for scalable applications with a pay-as-you-go pricing model. However, the cost-efficient use of virtual resources requires the application to exploit the available resources efficiently. Will an application perform equally well on fewer or cheaper resources? Will the application successfully finish on these resources? We have previously proposed a model-centric approach, ABS-YARN, for prototyping deployment decisions to answer such questions during the design of an application. In this paper, we make model-centric predictions for applications on Amazon Web Services (AWS), which is a prominent platform for cloud deployment. To demonstrate how ABS-YARN can help users make deployment decisions with a high cost-performance ratio on AWS, we design several workload scenarios based on MapReduce benchmarks and execute these scenarios on ABS-YARN by considering different AWS resource purchasing options.
Supported by the EU projects H2020-644298 HyVar: Scalable Hybrid Variability for Distributed Evolving Software Systems (http://www.hyvar-project.eu).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
For details, see https://aws.amazon.com/ec2/pricing.
References
Amazon EC2 FAQs. Q: What is an “EC2 compute unit” and why did you introduce it? https://aws.amazon.com/ec2/faqs/#hardware-information. Accessed 27 April 2016
Amazon EC2 Instance Types. https://aws.amazon.com/ec2/instance-types/?nc1=h_ls
Apache Hadoop. http://hadoop.apache.org/
Armbrust, M., Fox, A., Griffith, R., Joseph, A.D., Katz, R., Konwinski, A., Lee, G., Patterson, D., Rabkin, A., Stoica, I., Zaharia, M.: A view of cloud computing. Commun. ACM 53(4), 50–58 (2010)
Bjørk, J., de Boer, F.S., Johnsen, E.B., Schlatte, R., Tapia Tarifa, S.L.: User-defined schedulers for real-time concurrent objects. Innovations Syst. Softw. Eng. 9(1), 29–43 (2013)
Bort, J.: Amazon still dominates the $16 billion cloud market. UK Business Insider, February 2015. http://uk.businessinsider.com/synergy-research-amazon-dominates-16-billion-cloud-market-2015-2
Clavel, M., Durán, F., Eker, S., Lincoln, P., Martí-Oliet, N., Meseguer, J., Talcott, C.L.: All About Maude - A High-Performance Logical Framework: How to Specify, Program and Verify Systems in Rewriting Logic. LNCS, vol. 4350. Springer, Heidelberg (2007)
Garfinkel, S.L.: An evaluation of Amazon’s grid computing services: EC2, S3, and SQS. Technical report TR-08-07, Center for Research on Computation and Society School for Engineering and Applied sciences, Harvard University, August 2007. https://dash.harvard.edu/handle/1/24829568
Hähnle, R., Johnsen, E.B.: Designing resource-aware cloud applications. IEEE Comput. 48(6), 72–75 (2015)
Hazelhurst, S.: Scientific computing using virtual high-performance computing: a case study using the Amazon elastic computing cloud. In: Proceedings of the 2008 Annual Research Conference of the South African Institute of Computer Scientists and Information Technologists on IT research in Developing Countries: Riding the Wave of Technology, SAICSIT 2008, pp. 94–103. ACM (2008)
Jackson, K.R., Ramakrishnan, L., Muriki, K., Canon, S., Cholia, S., Shalf, J., Wasserman, H.J., Wright, N.J.: Performance analysis of high performance computing applications on the amazon web services cloud. In: 2nd IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2010, pp. 159–168. IEEE (2010)
Johnsen, E.B., Hähnle, R., Schäfer, J., Schlatte, R., Steffen, M.: ABS: a core language for abstract behavioral specification. In: Aichernig, B.K., de Boer, F.S., Bonsangue, M.M. (eds.) FMCO 2010. LNCS, vol. 6957, pp. 142–164. Springer, Heidelberg (2011)
Johnsen, E.B., Schlatte, R., Tapia Tarifa, S.L.: Integrating deployment architectures and resource consumption in timed object-oriented models. J. Logical Algebraic Methods Programm. 84(1), 67–91 (2015)
Lin, J.-C., Yu, I.C., Johnsen, E.B., Lee, M.-C.: ABS-YARN: a formal framework for modeling hadoop YARN clusters. In: Stevens, P., et al. (eds.) FASE 2016. LNCS, vol. 9633, pp. 49–65. Springer, Heidelberg (2016). doi:10.1007/978-3-662-49665-7_4
Murthy, A., Vavilapalli, V., Eadline, D., Niemiec, J., Markham, J.: Apache Hadoop YARN: Moving Beyond MapReduce and Batch Processing with Apache Hadoop 2. Addison-Wesley Professional, Reading (2014)
Napper, J., Bientinesi, P.: Can cloud computing reach the top 500? In: Proceedings of the Combined Workshops on UnConventional High Performance Computing Workshop Plus Memory Access Workshop, UCHPC-MAW 2009, pp. 17–20. ACM (2009)
Ostermann, S., Iosup, A., Yigitbasi, N., Prodan, R., Fahringer, T., Epema, D.: An early performance analysis of cloud computing services for scientific computing. Technical report PDS-2008-006, Delft University of Technology, December 2008. http://www.ds.ewi.tudelft.nl/reports/2008/PDS-2008-006.pdf
Ramakrishnan, L., Jackson, K.R., Canon, S., Cholia, S., Shalf, J.: Defining future platform requirements for e-science clouds. In: Proceedings of the 1st ACM Symposium on Cloud Computing, SoCC 2010, pp. 101–106. ACM (2010)
Stantchev, V.: Performance evaluation of cloud computing offerings. In: 2009 Third International Conference on Advanced Engineering Computing and Applications in Sciences, ADVCOMP 2009, pp. 187–192. IEEE (2009)
Vavilapalli, V.K., Murthy, A.C., Douglas, C., Agarwal, S., Konar, M., Evans, R., Graves, T., Lowe, J., Shah, H., Seth, S., Saha, B., Curino, C., O’Malley, O., Radia, S., Reed, B., Baldeschwieler, E.: Apache hadoop YARN: yet another resource negotiator. In: Lohman, G.M. (ed.) ACM Symposium on Cloud Computing (SOCC 2013), pp. 5:1–5:16 (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing AG
About this paper
Cite this paper
Johnsen, E.B., Lin, JC., Yu, I.C. (2016). Comparing AWS Deployments Using Model-Based Predictions. In: Margaria, T., Steffen, B. (eds) Leveraging Applications of Formal Methods, Verification and Validation: Discussion, Dissemination, Applications. ISoLA 2016. Lecture Notes in Computer Science(), vol 9953. Springer, Cham. https://doi.org/10.1007/978-3-319-47169-3_39
Download citation
DOI: https://doi.org/10.1007/978-3-319-47169-3_39
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-47168-6
Online ISBN: 978-3-319-47169-3
eBook Packages: Computer ScienceComputer Science (R0)