Abstract
A critical challenge in quantitative financial risk analysis is the effective computation of volatility and correlation. However, the dynamic nature of financial data environments create the challenges for robust correlation computing, particularly when the number of financial instruments and the volume of transactions grow dramatically. To this end, in this paper, we present an organized study of rank correlation computing for financial risk analysis in dynamic environments. Specifically, we focus on Kendall’s τ, which is widely recognized as a robust correlation measure for evaluating financial risk. Kendall’s τ is not widely used in practice partially because its computation complexity is O(n 2), making it difficult to frequently recompute in dynamic environments. After carefully studying the computational properties of Kendall’s τ, we reveal that Kendall’s τ is very computation-friendly for incremental computing of correlations, since the relativity of existing observations will not change as new observations come in. Based on this finding, we develop a τGrow algorithm for dynamically computing Kendall’s τ. Also, even for one-time static Kendall’s τ computation, we observe that the Kendall’s τ correlations on smaller time pieces can provide concise summaries of how Kendall’s τ evolves over the whole period. Finally, the effectiveness and the efficiency of the proposed methods have been demonstrated through the experiments on real-world financial data.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Ahmed, K.M., El-Makky, N.M., Taha, Y.: A note on beyond market baskets: Generalizing association rules to correlations. SIGKDD Explorations 1(2), 46–48 (2000)
Allen, S.: Financial Risk Management: A Practitioner’s Guide to Managing Market and Credit Risk. Wiley (2003)
Ayinde, O., Yang, Y.-H.: Face recognition approach based on rank correlation of gabor-filtered images. Pattern Recognition 35(6), 1275–1289 (2002)
Brin, S., Motwani, R., Silverstein, C.: Beyond market baskets: Generalizing association rules to correlations. In: Proceedings ACM SIGMOD International Conference on Management of Data, pp. 265–276 (1997)
Davis, M.K., Chen, G.: Graphing kendalls τ. Computational Statistics & Data Analysis 51, 2375–2378 (2007)
Elton, E.J., Gruber, M.J., Brown, S.J., Goetzmann, W.N.: Modern Portfolio Theory and Investment Analysis. Wiley (2006)
Gnanadeskian, R., Kettenring, J.: Robust estimates, residuals, and outlier detection with multiresponse data. Biometrika 28, 81–124 (1972)
Griffin, H.: Graphic computation of tau as a coefficient of disarray. Journal of American Statistical Association 53, 441–447 (1958)
Harwood, D., Subbarao, M., Davis, L.S.: Texture classification by local rank correlation. Computer Vision, Graphics, and Image Processing 32(3), 404–411 (1985)
Hull, J.C.: Options, Futures, and Other Derivatives, 6th edn. Prentice-Hall (2006)
Jermaine, C.: The computational complexity of high-dimensional correlation search. In: Proceedings of the 2001 IEEE International Conference on Data Mining (ICDM), pp. 249–256 (2001)
Jermaine, C.: Playing hide-and-seek with correlations. In: Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2003)
Kendall, M.G.: A new measure of rank correlation. Biometrica 30, 81–89 (1938)
Kendall, M.G.: Rank Correlation Methods, 4th edn. Griffin (1970)
Lindskog, F.: Linear correlation estimation. Technical report, RiskLab (2000)
Markowitz, H.M.: Portfolio selection. Journal of Finance 7(1), 77–91 (1952)
Melucci, M.: On rank correlation in information retrieval evaluation. SIGIR Forum 41(1), 18–33 (2007)
Muselet, D., Trémeau, A.: Rank correlation as illumination invariant descriptor for color object recognition. In: ICIP, pp. 157–160 (2008)
Rachev, S.T., Menn, C., Fabozzi, F.J.: Fat-Tailed and Skewed Asset Return Distributions: Implications for Risk Management, Portfolio Selection, and Option Pricing. Wiley (2005)
Xiong, H., Shekhar, S., Tan, P., Kumar, V.: Exploiting a support-based upper bound of pearson’s correlation coefficient for efficiently identifying strongly correlated pairs. In: Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 334–343 (2004)
Xiong, H., Shekhar, S., Tan, P.-N., Kumar, V.: Taper: A two-step approach for all-strong-pairs correlation query in large databases. IEEE Transactions on Knowledge and Data Engineering (TKDE) 18(4), 493–508 (2006)
Yilmaz, E., Aslam, J.A., Robertson, S.: A new rank correlation coefficient for information retrieval. In: SIGIR, pp. 587–594 (2008)
Zhou, W., Xiong, H.: Volatile correlation computation: a checkpoint view. In: KDD, pp. 848–856 (2008)
Zumbach, G.: Riskmetrics technical document. Technical report, J.P. Morgan and Reuters (1996)
Zumbach, G.: The riskmetrics 2006 methodology. Technical report, RiskMetrics Group (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhou, W., Xiao, K., Song, F. (2011). Dynamic Rank Correlation Computing for Financial Risk Analysis. In: Xiong, H., Lee, W.B. (eds) Knowledge Science, Engineering and Management. KSEM 2011. Lecture Notes in Computer Science(), vol 7091. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25975-3_24
Download citation
DOI: https://doi.org/10.1007/978-3-642-25975-3_24
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-25974-6
Online ISBN: 978-3-642-25975-3
eBook Packages: Computer ScienceComputer Science (R0)