Waterfall Atrous Spatial Pooling Architecture for Efficient Semantic Segmentation.
We present a new efficient architecture for semantic segmentation, based on a “Waterfall” Atrous Spatial Pooling architecture, that achieves a considerable accuracy increase while decreasing the number of network parameters and memory footprint. The proposed Waterfall architecture leverages the efficiency of progressive filtering in the cascade architecture while maintaining multiscale fields-of-view comparable to spatial pyramid configurations. Additionally, our method does not rely on a postprocessing stage with Conditional Random Fields, which further reduces complexity and required training time. We demonstrate that the Waterfall approach with a ResNet backbone is a robust and efficient architecture for semantic segmentation obtaining state-of-the-art results with significant reduction in the number of parameters for the Pascal VOC dataset and the Cityscapes dataset.
We propose the “Waterfall Atrous Spatial Pyramid” module, shown in Figure 2. WASP is a novel architecture with Atrous Convolutions that is able to leverage both the larger Field-of-View of the Atrous Spatial Pyramid Pooling configuration and the reduced size of the cascade approach.
Figure 2: WASP Module.
Examples of the WASPnet architecture for segmentation are shown in Figures 3 and 4 for the PASCAL VOC and Cityscapes datasets, respectively.
Figure 3: Segmentation samples for the Pascal VOC dataset.
Figure 4: Segmentation samples for the CItyscapes dataset.
Link to the published article at Sensors: https://doi.org/10.3390/s19245361
Datasets:
Both datasets used in this paper and required for training, validation, and testing can be downloaded directly from the dataset websites below:
Pascal VOC: http://host.robots.ox.ac.uk/pascal/VOC/
Cityscapes: https://www.cityscapes-dataset.com
Pre-trained Models:
The pre-trained weights for both Pascal VOC and Cityscapes datasets can be downloaded here.
Contact:
Bruno Artacho:
E-mail: bmartacho@mail.rit.edu
Website: https://www.brunoartacho.com
Andreas Savakis:
E-mail: andreas.savakis@rit.edu
Website: https://www.rit.edu/directory/axseec-andreas-savakis
Citation:
Artacho, B.; Savakis, A. Waterfall Atrous Spatial Pooling Architecture for Efficient Semantic Segmentation. Sensors 19, no. 24: 5361, 2019.
Latex:
@article{artacho2019waterfall,
title={Waterfall Atrous Spatial Pooling Architecture for Efficient Semantic Segmentation},
author={Artacho, Bruno and Savakis, Andreas},
journal={Sensors},
volume={19},
number={24},
pages={5361},
year={2019},
publisher={Multidisciplinary Digital Publishing Institute},
DOI ={"https://doi.org/10.3390/s19245361" }
}