Skip to main content

Research Repository

Advanced Search

Compressive sensing based convolutional neural network for object detection

Wu, Yirui; Meng, Zhouyu; Palaiahnakote, Shivakumara; Lu, Tong

Authors

Yirui Wu

Zhouyu Meng

Tong Lu



Abstract

Deep neural networks (DNN) have shown significant performance in several domains including computer vision and machine learning. Convolutional Neural Networks (CNN), known as a particular type of DNN, have shown their promising potentials in discovering vision-based patterns from quantity of labeled images. Many CNN-based algorithms are thus proposed to solve the problem of object detection and object recognition. However, CNN-based systems are hard to deploy on embedded systems due to their computationally and storage intensive. In this paper, we propose a method to compress convolutional neural network to decreases its computation and storage cost by exploiting inherent redundancy property of parameters in different kinds of layers of CNN architecture. During the compression, we firstly construct parameter matrices from different kinds of layers and convert parameter matrices to frequency domain through discrete cosine transform (DCT). Due to the smooth property of parameters when processing images, the resulting frequency matrices are dominated by low-frequency components. We thus prune high-frequency part to emphasize the dominating part of frequency matrix and make the frequency matrix sparse. Then, the sparse frequency matrices are sampled with distributed random Gaussian matrix under the guiding of compress sensing. Finally, we retrain the network with the sampling matrices to fine-tune the remaining parameters. We evaluate the proposed method on several typical convolutional neural network and show it outperforms one latest compression approach.

Citation

Wu, Y., Meng, Z., Palaiahnakote, S., & Lu, T. (2020). Compressive sensing based convolutional neural network for object detection. Malaysian journal of computer science, 33(1), 78-89. https://doi.org/10.22452/mjcs.vol33no1.5

Journal Article Type Article
Online Publication Date Jan 31, 2020
Publication Date Jan 31, 2020
Deposit Date Nov 15, 2024
Journal Malaysian Journal of Computer Science
Print ISSN 0127-9084
Peer Reviewed Peer Reviewed
Volume 33
Issue 1
Pages 78-89
DOI https://doi.org/10.22452/mjcs.vol33no1.5