Abstract
Recent advances in Computer Vision and Machine Learning empowered the use of image and positional data in several high-level analyses in Sports Science, such as player action classification, recognition of complex human movements, and tactical analysis of team sports. In the context of sports action analysis, the use of positional data allows new developments and opportunities by taking into account players’ positions over time. Exploiting the positional data and its sequence in a systematic way, we proposed a framework that bridges association rule mining and action recognition. The proposed Sports Action Mining (SAM) framework is grounded on the usage of positional data for recognising actions, e.g., dribbling. We hypothesise that different sports actions could be modelled using a sequence of confidence levels computed from previous players’ locations. The proposed method takes advantage of an association rule mining algorithm (e.g., FPGrowth) to generate displacement sequences for modelling actions in soccer. In this context, transactions are sequences of traces representing player displacements, while itemsets are players’ coordinates on the pitch. The experimental results pointed out the Random Forest classifier achieved a balanced accuracy value of 93.3% for detecting dribbling actions, which are considered complex events in soccer. Additionally, the proposed framework provides insights on players’ skills and player’s roles based on a small amount of positional data.
Similar content being viewed by others
Notes
https://www.statsperform.com/ (As of September 2021).
http://www.uel.br/grupo-pesquisa/remid/?page_id=145 (As of September 2021).
References
Agrawal R, Srikant R et al (1994) Fast algorithms for mining association rules. In: Proc. 20th int. conf. very large data bases, vol 1215. VLDB, pp 487–499
Baccouche M, Mamalet F, Wolf C, Garcia C, Baskurt A (2010) Action classification in soccer videos with long short-term memory recurrent neural networks. In: Proceedings of the 20th International conference on artificial neural networks: Part II, Springer-Verlag, Berlin, ICANN’10, pp 154–159
Barros RML, Misuta MS, Menezes RP, Figueroa PJ, Moura FA, Cunha SA, Anido R, Leite NJ (2007) Analysis of the distances covered by first division brazilian soccer players obtained with an automatic tracking method. Journal of Sports Science & Medicine 6(2):233–242
Batista J, Goncalves B, Sampaio J, Castro J, Abade E, Travassos B (2019) The influence of coaches’ instruction on technical actions, tactical behaviour, and external workload in football small-sided games. Montenegrin Journal of Sports Science and Medicine 8(1):29
Borgelt C (2005) An implementation of the fp-growth algorithm. In: Proceedings of the 1st international workshop on open source data mining: frequent pattern mining implementations, pp 1–5
Chawla S, Estephan J, Gudmundsson J, Horton M (2017) Classification of passes in football matches using spatiotemporal data. ACM Trans Spatial Algorithms Syst 3(2). https://doi.org/10.1145/3105576
Chengyan LI, Feng S, Sun G, (2020) Dce -miner: an association rule mining algorithm for multimedia based on the mapreduce framework. Multimedia Tools and Applications 79(23):16771–16793. https://doi.org/10.1007/s11042-019-08361-y
Cioppa A, Deliège A, Giancola S, Ghanem B, Van Droogenbroeck M, Gade R, Moeslund TB (2020) A context-aware loss function for action spotting in soccer videos. In: 2020 IEEE/CVF Conference on computer vision and pattern recognition (CVPR), pp 13123–13133
Connolly GJ, Grayson L (2021) From play to practice: Athlete development for coaches. Strategies 34(3):45–48. https://doi.org/10.1080/08924562.2021.1896935
Cuevas C, Quilón D, García N (2020) Techniques and applications for soccer video analysis: A survey. Multimedia Tools and Applications 79(39):29685–29721. https://doi.org/10.1007/s11042-020-09409-0
Cunha SA, Moura FA, Castellani RM, Barbieri FA, Santiago PRP (2011) Futebol: Aspectos Multidisciplinares para o Ensino e Treinamento. Guanabara Koogan
Cust EE, Sweeting AJ, Ball K, Robertson S (2019) Machine and deep learning for sport-specific movement recognition: a systematic review of model development and performance. Journal of Sports Sciences 37(5):568–600. https://doi.org/10.1080/02640414.2018.1521769 (pMID: 30307362)
Davids K, Araújo D, Correia V, Vilar L (2013) How small-sided and conditioned games enhance acquisition of movement and decision-making skills. Exercise and Sport Sciences Reviews 41(3):154–161
De Barros RML, Russomanno TG, Brenzikofer R, Figueroa PJ (2006) A method to synchronise video cameras using the audio band. Journal of Biomechanics 39(4):776–780. https://doi.org/10.1016/j.jbiomech.2004.12.025
Decroos T, Dzyuba V, Haaren JV, Davis J (2017) Predicting soccer highlights from spatio-temporal match event streams. AAAI 17:1302–1308
Duda RO, Hart PE, Stork DG (2000) Pattern classification, 2nd edn. Wiley-Interscience, USA
Fakhar B, Rashidy Kanan H, Behrad A (2019) Event detection in soccer videos using unsupervised learning of spatio-temporal features based on pooled spatial pyramid model. Multimedia Tools and Applications 78(12):16995–17025. https://doi.org/10.1007/s11042-018-7083-1
Feng N, Song Z, Yu J, Chen YPP, Zhao Y, He Y, Guan T (2020) Sset: a dataset for shot segmentation, event detection, player tracking in soccer videos. Multimedia Tools and Applications 79(39):28971–28992. https://doi.org/10.1007/s11042-020-09414-3
Figueroa PJ, Leite NJ, Barros RM (2003) A flexible software for tracking of markers used in human motion analysis. Computer Methods and Programs in Biomedicine 72(2):155–165. https://doi.org/10.1016/S0169-2607(02)00122-0
Gan W, Lin JW, Fournier-Viger P, Chao HC, Yu P (2019) A survey of parallel sequential pattern mining. ACM Transactions on Knowledge Discovery from Data 13(3), https://doi.org/10.1145/3314107, cited By 64
Gao L, Li X, Song J, Shen HT (2020) Hierarchical lstms with adaptive attention for visual captioning. IEEE Transactions on Pattern Analysis and Machine Intelligence 42(5):1112–1131. https://doi.org/10.1109/TPAMI.2019.2894139
Giancola S, Amine M, Dghaily T, Ghanem B (2018) Soccernet: A scalable dataset for action spotting in soccer videos. In: The IEEE Conference on computer vision and pattern recognition (CVPR) workshops, pp 1711–1721
Goes F, Meerhoff L, Bueno M, Rodrigues D, Moura F, Brink M, Elferink-Gemser M, Knobbe A, Cunha S, Torres R et al (2020) Unlocking the potential of big data to support tactical performance analysis in professional soccer: A systematic review. European J Sport Sci:1–16
Grahne G, Zhu J (2003) Efficiently using prefix-trees in mining frequent itemsets. In: FIMI, vol 90, p 65
Han J, Pei J, Yin Y (2000) Mining frequent patterns without candidate generation. ACM Sigmod Record 29(2):1–12
Hosseini M, Eftekhari Moghadam A (2012) Semantic analysis of soccer video based on a fuzzy event mining approach. In: The 16th CSI International symposium on artificial intelligence and signal processing (AISP 2012), pp 080–085
Janetzko H, Sacha D, Stein M, Schreck T, Keim DA, Deussen O (2014) Feature-driven visual analytics of soccer data. In: 2014 IEEE Conference on visual analytics science and technology (VAST), pp 13–22
Ward JH Jr (1963) Hierarchical grouping to optimize an objective function. J Am Stat Assoc 58(301):236–244. https://doi.org/10.1080/01621459.1963.10500845
Karpathy A, Toderici G, Shetty S, Leung T, Sukthankar R, Fei-Fei L (2014) Large-scale video classification with convolutional neural networks. In: 2014 IEEE Conference on computer vision and pattern recognition, pp 1725–1732
Kim HJ, Shin JH, Song Yh, Chang JW (2019) Privacy-preserving association rule mining algorithm for encrypted data in cloud computing. In: 2019 IEEE 12th International conference on cloud computing (CLOUD), IEEE, pp 487–489
Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Pereira F, Burges CJC, Bottou L, Weinberger KQ (eds) Advances in neural information processing systems 25, Curran Associates, Inc., pp 1097–1105
Leal K, Pinto A, Torres R, Elferink-Gemser M, Cunha S (2021) Characterization and analyses of dribbling actions in soccer: a novel definition and effectiveness of dribbles in the 2018 fifa world cup russia. Human Movement:10–17, https://doi.org/10.5114/hm.2021.104182
Li K, Liu L, Wang F, Wang T, Duić N, Shafie-khah M, Catalão JP (2019) Impact factors analysis on the probability characterized effects of time of use demand response tariffs using association rule mining method. Energy Conversion and Management 197:111891
Li R, Bhanu B (2019) Fine-grained visual dribbling style analysis for soccer videos with augmented dribble energy image. In: The IEEE Conference on computer vision and pattern recognition (CVPR) workshops, pp 0–0
Li X, Wang Y, Li D (2019) Medical data stream distribution pattern association rule mining algorithm based on density estimation. IEEE Access 7:141319–141329
Link D, Lang S, Seidenschwarz P (2016) Real time quantification of dangerousity in football using spatiotemporal tracking data. PLOS ONE 11(12):1–16. https://doi.org/10.1371/journal.pone.0168768
Lo TY, Yo C, Wu-Ye C, Huang C, Chang JH (2019) Kinematics analysis of cutting with dribbling during different approach speeds and cutting directions in soccer. International Journal of Performance Analysis in Sport 19(2):216–226. https://doi.org/10.1080/24748668.2019.1586504
Maddala TKK, Kishore PVV, Eepuri KK, Dande AK (2019) Yoganet: 3-d yoga asana recognition using joint angular displacement maps with convnets. IEEE Transactions on Multimedia 21(10):2492–2503
Martin PE, Benois-Pineau J, Péteri R, Morlier J (2020) Fine grained sport action recognition with twin spatio-temporal convolutional neural networks. Multimedia Tools and Applications 79(27):20429–20447. https://doi.org/10.1007/s11042-020-08917-3
Memmert D, Lemmink KA, Sampaio J (2017) Current approaches to tactical performance analyses in soccer using position data. Sports Medicine 47(1):1–10
Moura FA, Martins LEB, Anido RDO, Barros RMLD, Cunha SA (2012) Quantitative analysis of brazilian football players’ organisation on the pitch. Sports Biomechanics 11(1):85–96. https://doi.org/10.1080/14763141.2011.637123 (pMID: 22518947)
Moura FA, Martins LEB, Cunha SA (2014) Analysis of football game-related statistics using multivariate techniques. Journal of Sports Sciences 32(20):1881–1887. https://doi.org/10.1080/02640414.2013.853130
Raghunathan A, Murugesan K (2010) Optimized frequent pattern mining for classified data sets. International Journal of Computer Applications 1(27):20–29
Rein R, Memmert D (2016) Big data and tactical analysis in elite soccer: future challenges and opportunities for sports science. SpringerPlus 5(1):1–13
Rodriguez MD, Ahmed J, Shah M (2008) Action mach a spatio-temporal maximum average correlation height filter for action recognition. In: 2008 IEEE Conference on computer vision and pattern recognition, pp 1–8
Rousseeuw PJ (1987) Silhouettes: A graphical aid to the interpretation and validation of cluster analysis. Journal of Computational and Applied Mathematics 20:53–65. https://doi.org/10.1016/0377-0427(87)90125-7
Scheffer T (2001) Finding association rules that trade support optimally against confidence. In: European conference on principles of data mining and knowledge discovery, Springer, pp 424–435
Stein M, Häußler J, Jäckle D, Janetzko H, Schreck T, Keim DA (2015) Visual soccer analytics: Understanding the characteristics of collective team movement based on feature-driven analysis and abstraction. ISPRS International Journal of Geo-Information 4(4):2159–2184. https://doi.org/10.3390/ijgi4042159
Stein M, Seebacher D, Karge T, Polk T, Grossniklaus M, Keim DA (2019) From movement to events: Improving soccer match annotations. In: International conference on multimedia modeling, Springer, pp 130–142
Tenga A, Holme I, Ronglan LT, Bahr R (2010) Effect of playing tactics on achieving score-box possessions in a random series of team possessions from norwegian professional soccer matches. Journal of Sports Sciences 28(3):245–255. https://doi.org/10.1080/02640410903502766 (pMID: 20391096)
Tenga A, Holme I, Ronglan LT, Bahr R (2010) Effect of playing tactics on goal scoring in norwegian professional soccer. Journal of Sports Sciences 28(3):237–244. https://doi.org/10.1080/02640410903502774 (pMID: 20391095)
Thurachon W, Kreesuradej W (2021) Incremental association rule mining with a fast incremental updating frequent pattern growth algorithm. IEEE Access 9:55726–55741. https://doi.org/10.1109/ACCESS.2021.3071777
Tsunoda T, Komori Y, Matsugu M, Harada T (2017) Football action recognition using hierarchical lstm. In: 2017 IEEE Conference on computer vision and pattern recognition workshops (CVPRW), pp 155–163. https://doi.org/10.1109/CVPRW.2017.25
Vats K, Neher H, Clausi DA, Zelek J (2019) Two-stream action recognition in ice hockey using player pose sequences and optical flows. In: 2019 16th Conference on computer and robot vision (CRV), pp 181–188
Wilson RS, Smith NMA, de Paula Ramos S, Caetano FG, Rinaldo MA, Santiago PRP, Cunha SA, Moura FA (2019) Dribbling speed along curved paths predicts attacking performance in match-realistic one vs. one soccer games. Journal of Sports Sciences 37(9):1072–1079. https://doi.org/10.1080/02640414.2018.1544110 (pMID: 30470166)
Acknowledgements
This study was financed in part by Coordination for the National Council for Scientific and Technological Development (CNPq) of Brazil - Grant of Project 420562/2018-4 and Fundação Araucária (Paraná, Brazil). We also thank the financial support of FAPESP (Grants #2016/50250-1, #2017/20945-0, #2018/19007-9, #2019/16253-1, #2019/17729-0, and #2019/22262-3).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Barbon Junior, S., Pinto, A., Barroso, J.V. et al. Sport action mining: Dribbling recognition in soccer. Multimed Tools Appl 81, 4341–4364 (2022). https://doi.org/10.1007/s11042-021-11784-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-021-11784-1