Adaptive technique for automatic communication access pattern discovery applied to data prefetching in distributed applications using neural networks and stochastic models
Pages 292 - 303
Abstract
The distributed computing performance is usually limited by the data transfer rate and access latency. Techniques such as data caching and prefetching were developed to overcome this limitation. However, such techniques require the knowledge of application behavior in order to be effective. In this sense, we propose new application communication behavior discovery techniques that, by classifying and analyzing application access patterns, is able to predict future application data accesses. The proposed techniques use stochastic methods for application state change prediction and neural networks for access pattern discovery based on execution history, and is evaluated using the NAS Parallel Benchmark suite.
References
[1]
Kotz, D., Ellis, C.S.: Practical prefetching techniques for multiprocessor file systems. Journal of Distributed and Parallel Databases 1(1) (1993) 33-51
[2]
Madhyastha, T.M., Reed, D.A.: Input/output access pattern classification using hidden Markov models. In: Proceedings of the Fifth Workshop on Input/Output in Parallel and Distributed Systems, San Jose, CA, ACM Press (1997) 57-67
[3]
Lei, H., Duchamp, D.: An analytical approach to file prefetching. In: 1997 USENIX Annual Technical Conference, Anaheim, California, USA (1997)
[4]
Dodonov, E., Sousa, J.Q., Guardia, H.C.: Gridbox: securing hosts from malicious and greedy applications. In: Proceedings of the 2nd workshop on Middleware for grid computing, New York, NY, USA, ACM Press (2004) 17-22
[5]
Mello, R., Senger, L., Yang, L.: Automatic text classification using an artificial neural network. High Performance Computational Science and Engineering 1 (2005) 1-21
[6]
Bailey, D.H., Barszcz, E., Barton, J.T., Browning, D.S., Carter, R.L., Dagum, D., Fatoohi, R.A., Frederickson, P.O., Lasinski, T.A., Schreiber, R.S., Simon, H.D., Venkatakrishnan, V., Weeratunga, S.K.: The nas parallel benchmarks. The International Journal of Supercomputer Applications 5 (3) (1991) 63-73
[7]
Cao, P., Felten, E.W., Karlin, A.R., Li, K.: A study of integrated prefetching and caching stategies. In: Proceedings of the 1995 ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems, ACM Press (1995) 188-197
[8]
Dodonov, E., Guardia, H.C.: An architecture for integrated caching and prefetching mechanisms for distributed parallel file systems. In: Proceedings of the 2002 CLEI. (2002)
[9]
Reddy, A.L.N.: Evaluation of caching strategies for a multimedia storage server. In: International Conference on Multimedia Computing and Systems. (1997) 118-125
[10]
Cortes, T., Labarta, J.: Linear aggressive prefetching: A way to increase the performance of cooperative caches. In: Proceedings of the Joint International Parallel Processing Symposium and IEEE Symposium on Parallel and Distributed Processing, San Juan, Puerto Rico (1999) 45-54
[11]
Bianchini, R., Pinto, R., Amorim, C.L.: Data prefetching for software DSMs. In: International Conference on Supercomputing. (1998) 385-392
[12]
Mehrotra, S., Harrison, L.: Examination of a memory access classification scheme for pointer-intensive and numeric programs. In: ICS96. (1996) 133-140
[13]
Senger, L.J., Mello, R.F., Santana, M.J., Santana, R.C.: An on-line approach for classifying and extracting application behavior on linux. In Yang, L.T., Guo, M., eds.: High Performance Computing: Paradigm and Infrastructure. John Wiley and Sons (2005)
[14]
Carpenter, G.A., Grossberg, S.: Art 2: Selforganisation of stable category recognition codes for analog input patterns. Applied Optics 26 (1987) 4919-4930
[15]
Waibel, A., Hanazawa, T., Hinton, G., Shikano, K., Lang, K.: Phoneme recognition using time delay neural networks. IEEE Transactions on Accoustics, Speech and Signal Processing 37 (1989) 328-339
[16]
Burns, G., Daoud, R., Vaigl, J.: LAM: An Open Cluster Environment for MPI. In: Proceedings of Supercomputing Symposium. (1994) 379-386
[17]
Dodonov, E., de Mello, R.F., Yang, L.T.: A network evaluation for lan, man and wan grid environments. In Yang, L.T., Amamiya, M., Liu, Z., Guo, M., Rammig, F.J., eds.: EUC. Volume 3824 of Lecture Notes in Computer Science., Springer (2005) 1133-1146
[18]
Zell, A., Mache, N., Sommer, T., Korb, T.: Design of the snns neural network simulator. In Kaindl, H., ed.: 7. Österreichische Artificial-Intelligence-Tagung. Springer, Berlin, Heidelberg (1991) 93-102
Recommendations
Data access history cache and associated data prefetching mechanisms
SC '07: Proceedings of the 2007 ACM/IEEE conference on SupercomputingData prefetching is an effective way to bridge the increasing performance gap between processor and memory. As computing power is increasing much faster than memory performance, we suggest that it is time to have a dedicated cache to store data access ...
Automatic Compiler-Inserted Prefetching for Pointer-Based Applications
Special issue on cache memory and related problemsAs the disparity between processor and memory speeds continues to grow, memory latency is becoming an increasingly important performance bottleneck. While software-controlled prefetching is an attractive technique for tolerating this latency, its ...
Increasing hardware data prefetching performance using the second-level cache
Techniques to reduce or tolerate large memory latencies are critical for achieving high processor performance. Hardware data prefetching is one of the most heavily studied solutions, but it is essentially applied to first-level caches where it can ...
Comments
Information & Contributors
Information
Published In
December 2006
950 pages
ISBN:3540680675
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 04 December 2006
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 17 Oct 2024
Other Metrics
Citations
View Options
View options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in