The purpose of the research is to develop a universal algorithm for partial texture segmentation of any visual images. The main peculiarity of the proposed segmentation procedure is the extraction of only homogeneous fine-grained texture segments present in the images. At first, an initial seed point is found for the largest and most homogeneous segment of the image. This initial seed point of the segment is expanded using a region growing method. Other texture segments of the image are extracted analogously in turn. At the second stage, the procedure of merging the extracted segments belonging to the same texture class is performed. Then, the detected texture segments are input to a neural network with competitive layers which accomplishe s more accurate delineation of the shapes of the extracted texture segments. The proposed segmentation procedure is fully unsupervised, <i> i.e. </i>, it does not use any a priori knowledge on either the type of textures or the number of texture segments in the image. The research results in development of the segmentation algorithm realized as a computer program tested in a series of experiments that demonstrate its efficiency on grayscale natural scenes.
KeywordsTexture FeatureTexture WindowHomogeneous Fine-Grained Texture SegmentExtraction of Texture SegmentTexture Segmentation
Alkama, S., Chahir, Y. and Berkani, D. (2015) Label Maps Fusion for the Marginal Segmentation of Multi-Component Images. Neural Network World, 25, 405-426. https://doi.org/10.14311/NNW.2015.25.021
Caenen, G., Ferrari, V., Zalesny, A. and Van Gool, L. (2002) Analyzing the Layout of Composite Textures. Proceedings of the 2nd International Workshop on Texture Analysis and Synthesis, Copenhagen, June 2002, 15-19.
Donoser, M. and Bischof, H. (2008) Using Covariance Matrices for Unsupervised Texture Segmentation. Proceedings of the 19th International Conference on Pattern Recognition, Tampa, 8-11 December 2008, 1-4. https://doi.org/10.1109/ICPR.2008.4761350
Malik, J., Belongie, S., Leung, T. and Shi, J.B. (2001) Contour and Texture Analysis for Image Segmentation. International Journal of Computer Visio, 43, 7-27. https://doi.org/10.1023/A:1011174803800
Wolf, L., Huang, X.L., Martin, I. and Metaxas, D. (2006) Patch-Based Texture Edges and Segmentation. Proceedings of the 9th European Conference on Computer Vision, Graz, 7-13 May 2006, 481-493. https://doi.org/10.1007/11744047_37
Fauzi, M.F.A. and Lewis, P.H. (2003) A Fully Unsupervised Texture Segmentation Algorithm. Proceedings of British Machine Vision Conference, Norwich, September 2003, 519-528. https://doi.org/10.5244/C.17.53
Mahbubur Rahman, M.D. (2012) Unsupervised Natural Image Segmentation Using Mean Histogram Features. Journal of Multimedia, 7, 332-340.
Todorovic, S. and Ahuja, N. (2009) Texel-Based Texture Segmentation. Proceedings of the 12th IEEE International Conference on Computer Vision, Kyoto, 29 September-2 October 2009, 841-848. https://doi.org/10.1109/ICCV.2009.5459308
Wei, H. and Bartels, M. (2006) Unsupervised Segmentation Using Gabor Wavelets and Statistical Features In LIDAR Data Analysis. Proceedings of the 18th International Conference on Pattern Recognition, Hong Kong, 20-24 August 2006, 667-670.
Yang, A.Y., Wright, J., Ma, Y. and Sastry, S.S. (2008) Unsupervised Segmentation of Natural Images via Lossy Data Compression. Computer Vision and Image Understanding, 110, 212-225. https://doi.org/10.1016/j.cviu.2007.07.005
Angelova, A. and Zhu, S. (2013) Efficient Object Detection and Segmentation for Fine-Grained Recognition. Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition, Portland, 23-28 June 2013, 811-818. https://doi.org/10.1109/CVPR.2013.110
Melendez, J., Puig, D. and Garcia, M.A. (2010) Multi-Level Pixel-Based Texture Classification through Efficient Prototype Selection via Normalized Cut. Pattern Recognition, 43, 4113-4123. https://doi.org/10.1016/j.patcog.2010.06.014
Goltsev, A. (1996) An Assembly Neural Network for Texture Segmentation. Neural Networks, 9, 643-653. https://doi.org/10.1016/0893-6080(95)00136-0
Goltsev, A. and Wunsch, D.C. (1998) Inhibitory Connections in the Assembly Neural Network for Texture Segmentation. Neural Networks, 11, 951-962. https://doi.org/10.1016/S0893-6080(98)00053-7
Kussul, E.M., Rachkovskij, D.A. and Baidyk, T.N. (1991) On Image Texture Recognition by Associative-Projective Neurocomputer. Proceedings of Conference on Intelligent Engineering Systems through Artificial Neural Networks, St. Louis, 10-13 November 1991, 453-458.
Kussul, E.M., Baidyk, T.N., Lukovitch, V.V. and Rachkovskij, D.A. (1993) Adaptive Neural Network Classifier with Multifloat Input Coding. Proceedings of the 6th International Conference, Nimes, 25-29 October 1993, 209-216.
Ruiz-Del-Solar, J. (2000) Neural-Based Architectures for the Segmentation of Textures. Proceedings of the 15th International Conference on Pattern Recognition, Barcelona, 6 August 2002, 1080-1083. https://doi.org/10.1109/ICPR.2000.903733
Kussul, E.M., Kasatkina, L.M., Rachkovskij, D.A. and Wunsch, D.C. (1998) Application of Random Threshold Neural Networks for Diagnostics of Micro Machine Tool Condition. Proceedings of the IEEE International Joint Conference on Neural Networks, Anchorage, May 1998, 241-244.
Lukovich, V.V., Goltsev, A.D. and Rachkovskij, D.A. (1997) Neural Network Classifiers for Micromechanical Equipment Diagnostics and Micromechanical Product Quality Inspection. Proceedings of the 5th European Congress on Intelligent Techniques and Soft Computing, Aachen, 8-11 September 1997, 534-536.
Rachkovskij, D.A. and Kussul, E.M. (1998) DataGen: A Generator of Datasets for Evaluation of Classification Algorithms. Pattern Recognition Letters, 19, 537-544. https://doi.org/10.1016/S0167-8655(98)00053-1
Frolov, A.A., Husek, D. and Rachkovskii, D.A. (2006) Time of Searching for Similar Binary Vectors in Associative Memory. Cybernetics and Systems Analysis, 42, 615-623. https://doi.org/10.1007/s10559-006-0098-z
Gol’tsev, A.D. (1991) Structured Neural Networks with Learning for Texture Segmentation in Images. Cybernetics and Systems Analysis, 27, 927-936. https://doi.org/10.1007/BF01246527
Mobahi, H., Rao, S.R., Yang, A.Y., Sastry, S.S. and Ma, Y. (2011) Segmentattion of Natural Images by Texture and Boundary Compression. International Journal of Computer Vision, 95, 86-98. https://doi.org/10.1007/s11263-011-0444-0
Wang Y. and Xu L.H. (2018) Unsupervised Segmentation of Greenhouse Plant Images Based on Modified Latent Dirichlet Allocation. PeerJ, 6, e5036. https://doi.org/10.7717/peerj.5036
Hisashi, S. (2017) Automatic Color Image Segmentation Using a Square Elemental Region-Based Seeded Region Growing and Merging Method. arXiv preprint, 1711.09352.
Long, P., Lu, H.X. and Wang, A. (2018) A Novel Unsupervised Two-Stage Technique in Color Image Segmentation. Chinese Journal of Electronics, 27, 405-412. https://doi.org/10.1049/cje.2018.01.011
Ontrup, J. and Ritter, H. (1998) Perceptual Grouping in a Neural Model: Reproducing Human Texture Perception. University of Bielefeld, Bielefeld, 59 p.
Wersing, H., Steil, J.J. and Ritter, H. (2001) A Competitive-Layer Model for Feature Binding and Sensory Segmentation. Neural Computation, 13, 357-387. https://doi.org/10.1162/089976601300014574
Ritter, H. (1990) A Spatial Approach to Feature Linking. Proceedings of the International Neural Network Conference, Paris, 9-13 July 1990, 898-901. https://doi.org/10.1007/978-94-009-0643-3_124
Goltsev, A. and Gritsenko, V. (2013) Algorithm of Sequential Finding the Characteristic Features of Homogeneous Texture Regions for the Problem of Image Segmentation. Cybernetics and Computer Engineering, 173, 25-34.
Goltsev, A., Gritsenko, V. and Húsek, D. (2017) Extraction of Homogeneous Fine-Grained Texture Segments in Visual Images. Neural Network World, 27, 447-477. https://doi.org/10.14311/NNW.2017.27.024
Goltsev, A., Gritsenko, V., Kussul, E. and Baidyk, T. (2015) Finding the Texture Features Characterizing the Most Homogeneous Texture Segment in the Image. In: Rojas, I., Joya, G. and Catala, A., Eds., Advances in Computational Intelligence. IWANN 2015. Lecture Notes in Computer Science, Vol. 9094, Springer, Cham, 287-300.
Goltsev, A., Rachkovskij, D. and Wunsch, D. (2000) A Neural Network for Segmentation of Line Drawings into Lines of Different Orientations. Intelligent Engineering Systems through Artificial Neural Networks, 10, 217-224.
Goltsev, A. and Rachkovskij, D. (2001) A Recurrent Neural Network for Partitioning of Hand Drawn Characters into Strokes of Different Orientations. International Journal of Neural Systems, 11, 463-475. https://doi.org/10.1142/S0129065701000862
Cui, W.H., Guan, Z.Q. and Zhang, Z.Y. (2008) An Improved Region-Growing Algorithm for Image Segmentation. Proceedings of International Conference on Computer Science and Software Engineering, Vol. 6, Wuhan, 12-14 December, 2008, 93-96. https://doi.org/10.1109/CSSE.2008.891
Fan, J.P., Zeng, G.H., Body, M. and Hacid, M.S. (2005) Seeded Region Growing: An Extensive and Comparative Study. Pattern Recognition Letters, 26, 1139-1156. https://doi.org/10.1016/j.patrec.2004.10.010
Kamdi S. and Krishna, R.K. (2012) Image Segmentation and Region Growing Algorithm. International Journal of Computer Technology and Electronics Engineering, 2, 103-107.
Mancas, M., Gosselin, B. and Macq, B. (2005) Segmentation Using a Region-Growing Thresholding. Image Processing: Algorithms and Systems IV, San Jose, CA, 17 January 2006, 388-398.
Peng, Q. (2015) An Image Segmentation Algorithm Research Based on Region Growth. Journal of Software Engineering, 9, 673-679. https://doi.org/10.3923/jse.2015.673.679
Qin, A.K. and Clausi, D.A. (2010) Multivariate Image Segmentation Using Semantic Region Growing with Adaptive Edge Penalty. IEEE Transactions on Image Processing, 19, 2157-2170. https://doi.org/10.1109/TIP.2010.2045708
Wan, S.Y. and Higgings, W.E. (2003) Symmetric Region Growing. IEEE Transactions on Image Processing, 12, 1007-1015. https://doi.org/10.1109/TIP.2003.815258
Kim, T.H., Lee, K.M. and Lee, S.U. (2013) Learning Full Pairwise Affinities for Spectral Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 1690-1703. https://doi.org/10.1109/TPAMI.2012.237
Li, Z.G., Wu, X.M. and Chang, S.F. (2012) Segmentation Using Superpixels: A Bipartite Graph Partitioning Approach. Proceeding of IEEE Conference on Computer Vision and Pattern Recognition, Providence, 16-21 June 2012, 789-796. https://doi.org/10.1109/CVPR.2012.6247750
Ojala, T. and Pietikainen, M. (1999) Unsupervised Texture Segmentation Using Feature Distributions. Pattern Recognition, 32, 477-486. https://doi.org/10.1016/S0031-3203(98)00038-7
Comaniciu, D. and Meer, P. (2002) Mean Shift: A Robust Approach toward Feature Space Analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24, 603-619. https://doi.org/10.1109/34.1000236
Felzenszwalb, P.F. and Huttenlocher, D.P. (2004) Efficient Graph-Based Image Segmentation. International Journal of Computer Vision, 59, 167-181. https://doi.org/10.1023/B:VISI.0000022288.19776.77
Jähne, B., Scharr, H. and Körkel, S. (2000) Principles of Filter Design. In: Jähne, B., Scharr, H., Körkel, S., Jähne, B., Haussecker, H. and Geissler, P. Eds., Handbook of Computer Vision and Applications, Vol. 2: Signal Processing and Pattern Recognition, Academic Press, San Diego, 125-152.
http://cs.brown.edu/~pff/segment/
Gritsenko, V.I. and Rachkovskij, D.A. (2019) Methods for Vector Representation of Objects for Fast Similarity Estimation. Naukova Dumka, Kiev. (In Russian)
Rachkovskij, D.A. (2017) Binary Vectors for Fast Distance and Similarity Estimation. Cybernetics and Systems Analysis, 53, 138-156. https://doi.org/10.1007/s10559-017-9914-x
Rachkovskij, D.A. (2017) Index Structures for Fast Similarity Search for Binary Vectors. Cybernetics and Systems Analysis, 53, 799-820. https://doi.org/10.1007/s10559-017-9983-x