Theory of Structural Learning
- 1 The Department of Artificial Intelligence, College of Computer Science, Guangdong Polytechnic Normal University, Guangzhou, China
Abstract
This is the first paper to be written on the theory of structural learning. The first section outlines the overall concept; the second section proposes the logical universe as the environment for structural learning; the third, fourth and fifth sections detail the theories of the Central Diagram Processor, Software Diagram and Diagram Thinking, with the Central Diagram Processor acting as the machine’s brain, the Software Diagram as its body, and the Diagram Thinking as its life activities; finally, the sixth section explains existing research achievements in machine life and structural learning. The main purpose of this paper is to recommend the idea of Structural Learning for Machine Life to human society.
- Liu, D.H. (2024) Logical Structure School I (Five Fundamental Theories). Intelligent Control and Automation , 15, 125-159. https://doi.org/10.4236/ica.2024.154008
- Liu, D.H. (2024) The Fundamental Theory of Artificial Intelligence—Logic Structure and Logic Engineering. Intelligent Control and Automation , 15, 28-62. https://doi.org/10.4236/ica.2024.151003
- Liu, D.H. (2024) Logical Structure School II (Nine Applied Theories). Intellig ent Control and Automation , 15, 160-214. https://doi.org/10.4236/ica.2024.154009
- Chen, J., Zhou, D., Tang, Y., Yang, Z., Cao, Y. and Gu, Q. (2020) Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep Neural Networks. Proceedings of the Twenty - Ninth International Joint Conference on Artificial Intelligence , Yokohama, 11-17 July 2020, 3267-3275. https://doi.org/10.24963/ijcai.2020/452
- Dauphin, Y.N., Pascanu, R., Gulcehre, C., et al. (2014) Identifying and Attacking the Saddle Point Problem in High Dimensional Nonconvex Optimization. NeurIPS 2014, Montréal, 8-13 December 2014, 2933-2941.
- Wang, Y.X., Ramanan, D. and Hebert, M. (2017) Learning to Model the Tail. Proceedings of the 31 st International Conference on Neural Information Processing Systems , Long Beach, 4-9 December 2017, 7032-7042.
- Cao, K., Wei, C., Gaidon, A., et al. (2019) Learning Imbalanced Datasets with Label Distribution Aware Margin Loss. Proceedings of the 33 rd International Conference on Neural Information Processing Systems , Vancouver, 8-14 December 2019, 1567-1578.
- Duchi, J., Hazan, E. and Singer, Y. (2011) Adaptive Subgradient Methods for Online Learning and Stochastic Optimization. Journal of Machine Learning Research , 12, 2121-2159.
- Yang, Z., Dai, Z., Yang, Y., et al. (2019) XLNet: Generalized Autoregressive Pretraining for Language Understanding. arXiv: 1906.08237.
- Bartlett, P.L. (1998) The Sample Complexity of Pattern Classification with Neural Networks: The Size of the Weights Is More Important than the Size of the Network. IEEE Transactions on Information Theory , 44, 525-536. https://doi.org/10.1109/18.661502
- Neyshabur, B., Tomioka, R. and Srebro, N. (2015) Norm-Based Capacity Control in Neural Networks. arXiv: 1503.00036.
- Bartlett, P.L., Foster, D.J. and Telgarsky, M.J. (2017) Spectrally Normalized Margin Bounds Forneural Networks. arXiv: 1706.08498.