Unsupervised pre-trained filter learning approach for efficient convolution neural network

Rehman, S; Tu, S; Waqas, M; Huang, Y; Rehman, O; Ahmad, B; Ahmad, S

Abstract

The concept of Convolution Neural Network (ConvNet or CNN) is evaluated from the animal visual cortex. Since humans can learn through experience, similarly, ConvNet changes its weight accordingly to accomplish the desired output through backpropagation. In this paper, we provide a comprehensive survey of the relationship between ConvNet with different pre-trained learning methodologies and its optimization effects. These hybrid networks further develop the state-of-the-art algorithms in recognition, classification, and detection of images, speeches, texts, and videos. Furthermore, some task-specific applications of ConvNet have been introduced in computer vision. To validate the survey, we also perform some experiments on a public face and skin detection dataset to provide an authentic solution. The experimental results on the benchmark dataset highlight the merit of efficient pre-trained learning algorithms for optimized ConvNet. To motivate the follow-up research, we identify open problems and present future directions with regards to optimized ConvNet system design parameters and unsupervised learning.

Citation

Rehman, S., Tu, S., Waqas, M., Huang, Y., Rehman, O., Ahmad, B., & Ahmad, S. (2019). Unsupervised pre-trained filter learning approach for efficient convolution neural network. Neurocomputing, 365, 171-190. https://doi.org/10.1016/j.neucom.2019.06.084

• Journal Article Type: Article
• Acceptance Date: Jun 16, 2019
• Online Publication Date: Sep 6, 2019
• Publication Date: Sep 6, 2019
• Deposit Date: Aug 31, 2022
• Journal: Neurocomputing
• Print ISSN: 0925-2312
• Publisher: Elsevier
• Volume: 365
• Pages: 171-190
• DOI: https://doi.org/10.1016/j.neucom.2019.06.084
• Publisher URL: https://doi.org/10.1016/j.neucom.2019.06.084
• Additional Information: Funders : National Natural Science Foundation of China