Design of Hanman Entropy Network from Radial Basis Function Network
- 1 CSE Department MVSR Engg. College, Nadergul, Hyderabad, India
- 2 Pennsylvania State University State College, PA, USA
- 3 CSE Department California State University Northridge, CA, USA
Abstract
Different learning algorithms have been developed in the literature for training the radial basis function network (RBFN). In this paper, a new neural network named as Hanman Entropy Network (HEN) is developed from RBFN based on the Information set theory that deals with the representation of possibilistic uncertainty in the attribute/property values termed as information source values. The parameters of both HEN and RBFN are learned using a new learning algorithm called JAYA that solves the constrained and unconstrained optimization problems and is bereft of algorithm-specific parameters. The performance of HEN is shown to be superior to that of RBFN on four datasets. The advantage of HEN is that it can use both information source values and their membership values in several ways whereas RBFN uses only the membership function values.
- Rumelhart, D.E., Hinton, G.E. and Williams, R.J. (1986) Nature, 323, 533-536. https://doi.org/10.1038/323533a0
- Moody, J. and Darken, C.J. (1989) Neural Computation, 1, 281-294. https://doi.org/10.1162/neco.1989.1.2.281
- Hecht-Nielsen, R. (1987) Applied Optics, 26, 4979-4984. https://doi.org/10.1364/AO.26.004979
- Bullinaria, J.A. (2015) Radial Basis Function Networks: Algorithms, Neural Computation: Lecture 14. http://www.cs.bham.ac.uk/~jxb/INC/l14.pdf
- Poggio, T. and Girosi, F. (1990) Proceedings of IEEE, 78, 1481-1497. https://doi.org/10.1109/5.58326
- Grover, J. and Hanmandlu, M. (2018) Applied Intelligence, 48, 3394-3410. https://doi.org/10.1007/s10489-018-1154-x
- Rao, R.V. (2016) International Journal of Industrial Engineering Computations, 7, 19-34. https://doi.org/10.5267/j.ijiec.2015.8.004
- Jang, J.S.R., Sun, C.T. and Mizutani, E. (2009) Neuro-Fuzzy and Soft-Computing: A Computational Approach to Learning and Machine Intelligence. PHI Learning Private Limited, New Delhi.
- Orr, M.J.L. (1995) Neural Computation, 7, 606-623. https://doi.org/10.1162/neco.1995.7.3.606
- Xie, T.T., Yu, H. and Wilamowski, B. (2011) Comparison between Traditional Neural Networks and Radial Basis Function Networks. Industrial Electronics (ISIE). IEEE International Symposium, Gdansk, 27-30 June 2011, 1194-1199.
- Parappa, S.N. and Pratap Singh, M.P. (2013) International Journal of Advancements in Research & Technology, 2, 112-125.
- Pierre, C. (2008) Neural Information Processing—Letters and Reviews, 8, 25-29.
- Schwenker, F., Kestler, H.A. and Palm, G. (2001) Neural Networks, 14, 439-458. https://doi.org/10.1016/S0893-6080(01)00027-2
- Rao, R.V. and Patel, V. (2013) Scientia Iranica, 20, 710-720. https://doi.org/10.1016/j.scient.2012.12.005
- Rao, R.V., Savsani, V.J. and Vakharia, D.P. (2011) Computer-Aided Design, 43, 303-315. https://doi.org/10.1016/j.cad.2010.12.015
- Rao, R.V. and Kalyankar, V.D. (2012) Journal of Materials and Manufacturing Processes, 27, 978-985. https://doi.org/10.1080/10426914.2011.602792
- Zhang, Y., Yang, X., Cattani, C., Rao, R.V. and Wang, S. (2016) Entropy, 18, 77. https://doi.org/10.3390/e18030077