Abstract
In Data Stream Management Systems (DSMSs), as long as continuous streams of data are arriving in the system, queries are executing on these input data. Regarding high volume of input data, having high processing capacity by using multiple processors is non-negligible. Also, many applications of DSMSs, such as traffic control systems, and health monitoring, have real-time nature. To support these features, this paper aims at developing an efficient multiprocessor real-time DSMS. To achieve efficiency, a multiprocessor real-time scheduling algorithm is proposed based on partitioning approach. In this algorithm, each received query has a chance to fit into any processor with first fit assignment. If it could not fit due to its utilization then that query is broken into some queries with smaller processing capacity based on utilization of processors. We conduct performance studies with real workloads. The experimental results show that the proposed algorithm outperforms the simple partitioning algorithm.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Babu, S., Widom, J.: Continuous queries over data streams. ACM SIGMOD Record 30(3) (September 2001)
Arasu, A., Babcock, B., Babu, S., Cieslewicz, J., Datar, M., Ito, K., Motwani, R., Srivastava, U., Widom, J.: STREAM: The Stanford Stream Data Manager. In: Proc. of ACM SIGMOD, USA (2003)
Abadi, D., Carney, D., Çetintemel, U., Cherniack, M., Convey, C., Erwin, C., Galvez, E., Hatoun, M., Hwang, J., Maskey, A., Rasin, A., Singer, A., Stonebraker, M., Tatbul, N., Xing, Y., Yan, R., Zdonik, S.: Aurora: A Data Stream Management System. In: ACM SIGMOD Conference (2003)
Wei, Y., Son, S.H., Stankovic, J.A.: RTSTREAM: real-time query processing for data streams. Object and Component-Oriented Real-Time Distributed Computing (2006)
Carpenter, J., Funk, S., Holman, P., Srinivasan, A., Anderson, J., Baruah, S.: A categorization of real-time multiprocessor scheduling problems and algorithms. In: Handbook on Scheduling Algorithms, Methods, and Models, pp. 30.1–30.19 (2004)
Stankovic, J.A., Son, S., Hansson, J.: Misconceptions About Real-Time Databases. IEEE Computer 32, 29–36 (1998)
Safaei, A.A., Haghjoo, M.S.: Parallel Processing of Continuous Queries over Data Streams. Distributed and Parallel Databases 28(2-3), 93–118 (2010)
Safaei, A.A., Haghjoo, M.S.: Dispatching of Stream Operators in Parallel Execution of Continuous Queries. Submitted to the Journal of Scheduling (June 2010)
Li, X., Wang, H.: Adaptive Real-time Query Scheduling over Data Streams. In: VLDB 2007 (September 2007)
Schmidt, S., Berthold, H., Lehner, W.: Qstream: Deterministic querying of data streams. In: Proc. of International Conference on Very Large Data Bases (VLDB 2004), Toronto, Canada, August 30 - September 3, pp. 1365–1368 (2004)
Schmidt, S., Legler, T., Lehner, W.: Robust Real-time Query Processing with Qstream. In: Proceedings of the 31st VLDB Conference, Trondheim, Norway (2005)
Alemi, M.: Real-time Task Scheduling in Data Stream Management System. MSc. Thesis, Iran University of Science and Technology (2011)
Alemi, M., Haghjoo, M.S., Safaei, A.S.: Multiprocessor Real-Time Scheduling in Data Stream Management Systems. In: Third National Conference in Iran (2011) (in Persian)
Internet Traffic Archive, http://www.acm.org/sigcomm/ITA/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Alemi, M., Safaei, A.A., Hagjhoo, M.S., Abdi, F. (2011). PDMRTS: Multiprocessor Real-Time Scheduling Considering Process Distribution in Data Stream Management System. In: Cherifi, H., Zain, J.M., El-Qawasmeh, E. (eds) Digital Information and Communication Technology and Its Applications. DICTAP 2011. Communications in Computer and Information Science, vol 167. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-22027-2_15
Download citation
DOI: https://doi.org/10.1007/978-3-642-22027-2_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-22026-5
Online ISBN: 978-3-642-22027-2
eBook Packages: Computer ScienceComputer Science (R0)