VC dimensions of group convolutional neural networks
References
[1]
Anthony M., Bartlett P.L., Bartlett P.L., et al., Neural network learning: Theoretical foundations, vol. 9, cambridge university press Cambridge, 1999.
[2]
Bartlett P.L., Harvey N., Liaw C., Mehrabian A., Nearly-tight VC-dimension and pseudodimension bounds for piecewise linear neural networks, Journal of Machine Learning Research 20 (1) (2019) 2285–2301.
[3]
Bekkers, E. J. (2020). B-Spline CNNs on Lie groups. In International conference on learning representations.
[4]
Bekkers E.J., Lafarge M.W., Veta M., Eppenhof K.A., Pluim J.P., Duits R., Roto-translation covariant convolutional networks for medical image analysis, in: International conference on medical image computing and computer-assisted intervention, Springer, 2018, pp. 440–448.
[5]
Bietti A., Venturi L., Bruna J., On the sample complexity of learning under geometric stability, Advances in Neural Information Processing Systems 34 (2021) 18673–18684.
[6]
Bruna J., Mallat S., Invariant scattering convolution networks, IEEE Transactions on Pattern Analysis and Machine Intelligence 35 (8) (2013) 1872–1886.
[7]
Cohen T., Welling M., Group equivariant convolutional networks, in: Proceedings of the 33rd international conference on machine learning, in: Proceedings of machine learning research, vol. 48, PMLR, New York, New York, USA, 2016, pp. 2990–2999.
[8]
Elesedy, B. (2022). Group Symmetry in PAC Learning. In ICLR 2022 workshop on geometrical and topological representation learning.
[9]
Elesedy B., Zaidi S., Provably strict generalisation benefit for equivariant models, in: International conference on machine learning, PMLR, 2021, pp. 2959–2969.
[10]
Finzi M., Welling M., Wilson A.G., A practical method for constructing equivariant multilayer perceptrons for arbitrary matrix groups, 2021, arXiv preprint arXiv:2104.09459.
[11]
Folland G.B., Real analysis: Modern techniques and their applications, in: Pure and applied mathematics: A wiley-interscience series of texts, monographs and tracts, 2nd ed, Wiley-Interscience, 1999.
[12]
Goodfellow I., Bengio Y., Courville A., Deep learning, MIT Press, 2016, http://www.deeplearningbook.org.
[13]
Jenner, E., & Weiler, M. (2022). Steerable Partial Differential Operators for Equivariant Neural Networks. In International conference on learning representations.
[14]
Keriven N., Peyré G., Universal invariant and equivariant graph neural networks, Advances in Neural Information Processing Systems 32 (2019).
[15]
Kondor R., Trivedi S., On the generalization of equivariance and convolution in neural networks to the action of compact groups, in: International conference on machine learning, PMLR, 2018, pp. 2747–2755.
[16]
Krizhevsky A., Sutskever I., Hinton G.E., Imagenet classification with deep convolutional neural networks, Advances in Neural Information Processing Systems 25 (2012).
[17]
LeCun Y., Boser B., Denker J.S., Henderson D., Howard R.E., Hubbard W., et al., Backpropagation applied to handwritten zip code recognition, Neural Computation 1 (4) (1989) 541–551.
[18]
Lim L.-H., Nelson B.J., What is an equivariant neural network?, 2022, arXiv preprint arXiv:2205.07362.
[19]
Mallat S., Understanding deep convolutional networks, Philosophical Transactions of the Royal Society of London A (Mathematical and Physical Sciences) 374 (2065) (2016).
[20]
Mohri M., Rostamizadeh A., Talwalkar A., Foundations of machine learning, MIT Press, 2018.
[21]
Procesi C., Lie groups: An approach through invariants and representations, vol. 115, Springer, 2007.
[22]
Sannai A., Imaizumi M., Kawano M., Improved generalization bounds of group invariant/equivariant deep networks via quotient feature spaces, in: Uncertainty in artificial intelligence, PMLR, 2021, pp. 771–780.
[23]
Shalev-Shwartz S., Ben-David S., Understanding machine learning: From theory to algorithms, Cambridge University Press, 2014.
[24]
Shao H., Montasser O., Blum A., A theory of pac learnability under transformation invariances, Advances in Neural Information Processing Systems 35 (2022) 13989–14001.
[25]
Sosnovik I., Moskalev A., Smeulders A., DISCO: accurate discrete scale convolutions, 2021, arXiv preprint arXiv:2106.02733.
[26]
Sosnovik, I., Szmaja, M., & Smeulders, A. (2020). Scale-Equivariant Steerable Networks. In International conference on learning representations.
[27]
Wästlund J., An elementary proof of the Wallis product formula for pi, American Mathematical Monthly 114 (10) (2007) 914–917.
[28]
Weiler, M., & Cesa, G. (2019). General E(2)-Equivariant Steerable CNNs. In Conference on neural information processing systems.
[29]
Worrall, D. E., Garbin, S. J., Turmukhambetov, D., & Brostow, G. J. (2017). Harmonic Networks: Deep Translation and Rotation Equivariance. In 2017 IEEE conference on computer vision and pattern recognition (CVPR), (pp. 7168–7177).
Recommendations
Convolutional neural networks for wavelet domain super resolution
Proposed a super resolution method with higher reconstruction accuracy than before.Cast super resolution as a problem of estimating sparse wavelet detail coefficients.Estimated sparse wavelet coefficients using a convolutional neural network (CNN)...
Towards dropout training for convolutional neural networks
Recently, dropout has seen increasing use in deep learning. For deep convolutional neural networks, dropout is known to work well in fully-connected layers. However, its effect in convolutional and pooling layers is still not clear. This paper ...
Theory of deep convolutional neural networks: Downsampling
AbstractEstablishing a solid theoretical foundation for structured deep neural networks is greatly desired due to the successful applications of deep learning in various practical domains. This paper aims at an approximation theory of deep ...
Comments
Information & Contributors
Information
Published In
The Authors.
Publisher
Elsevier Science Ltd.
United Kingdom
Publication History
Published: 04 March 2024
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 10 Nov 2024
Other Metrics
Citations
View Options
View options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in