Sawant, Shrutika S. and Bauer, J. and Erick, F. X. and Ingaleshwar, Subodh and Holzer, N. and Ramming, A. and Lang, E. W. and Goetz, Th (2022) An optimal-score-based filter pruning for deep convolutional neural networks. APPLIED INTELLIGENCE, 52 (15). pp. 17557-17579. ISSN 0924-669X, 1573-7497
Full text not available from this repository. (Request a copy)Abstract
Convolutional Neural Networks (CNN) have achieved excellent performance in the processing of high-resolution images. Most of these networks contain many deep layers in quest of greater segmentation performance. However, over-sized CNN models result in overwhelming memory usage and large inference costs. Earlier studies have revealed that over-sized deep neural models tend to deal with abundant redundant filters that are very similar and provide tiny or no contribution in accelerating the inference of the model. Therefore, we have proposed a novel optimal-score-based filter pruning (OSFP) approach to prune redundant filters according to their relative similarity in feature space. OSFP not only speeds up learning in the network but also eradicates redundant filters leading to improvement in the segmentation performance. We empirically demonstrate on widely used segmentation network models (TernausNet, classical U-Net and VGG16 U-Net) and benchmark datasets (Inria Aerial Image Labeling Dataset and Aerial Imagery for Roof Segmentation (AIRS)) that computation costs (in terms of Float Point Operations (FLOPs) and parameters) are reduced significantly, while maintaining or even improving accuracy.
| Item Type: | Article |
|---|---|
| Uncontrolled Keywords: | SEGMENTATION; CNN; Deep learning; Filter pruning; Image segmentation; Model compression; Redundancy |
| Subjects: | 500 Science > 530 Physics 500 Science > 570 Life sciences |
| Divisions: | Biology, Preclinical Medicine > Institut für Biophysik und physikalische Biochemie > Prof. Dr. Elmar Lang |
| Depositing User: | Dr. Gernot Deinzer |
| Date Deposited: | 06 Feb 2024 13:36 |
| Last Modified: | 06 Feb 2024 13:36 |
| URI: | https://pred.uni-regensburg.de/id/eprint/57781 |
Actions (login required)
 |
View Item |
