STDC/configs/deeplabv3plus

Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation

Introduction

Official Repo

Code Snippet

DeepLabV3+ (CVPR'2018)

@inproceedings{deeplabv3plus2018,
  title={Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation},
  author={Liang-Chieh Chen and Yukun Zhu and George Papandreou and Florian Schroff and Hartwig Adam},
  booktitle={ECCV},
  year={2018}
}

Results and models

:::{note} D-8/D-16 here corresponding to the output stride 8/16 setting for DeepLab series. MG-124 stands for multi-grid dilation in the last stage of ResNet. :::

Cityscapes

Method	Backbone	Crop Size	Lr schd	Mem (GB)	Inf time (fps)	mIoU	mIoU(ms+flip)	config	download
DeepLabV3+	R-50-D8	512x1024	40000	7.5	3.94	79.61	81.01	config	model | log
DeepLabV3+	R-101-D8	512x1024	40000	11	2.60	80.21	81.82	config	model | log
DeepLabV3+	R-50-D8	769x769	40000	8.5	1.72	78.97	80.46	config	model | log
DeepLabV3+	R-101-D8	769x769	40000	12.5	1.15	79.46	80.50	config	model | log
DeepLabV3+	R-18-D8	512x1024	80000	2.2	14.27	76.89	78.76	config	model | log
DeepLabV3+	R-50-D8	512x1024	80000	-	-	80.09	81.13	config	model | log
DeepLabV3+	R-101-D8	512x1024	80000	-	-	80.97	82.03	config	model | log
DeepLabV3+ (FP16)	R-101-D8	512x1024	80000	6.35	7.87	80.46	-	config	model | log
DeepLabV3+	R-18-D8	769x769	80000	2.5	5.74	76.26	77.91	config	model | log
DeepLabV3+	R-50-D8	769x769	80000	-	-	79.83	81.48	config	model | log
DeepLabV3+	R-101-D8	769x769	80000	-	-	80.98	82.18	config	model | log
DeepLabV3+	R-101-D16-MG124	512x1024	40000	5.8	7.48	79.09	80.36	config	model | log
DeepLabV3+	R-101-D16-MG124	512x1024	80000	9.9	-	79.90	81.33	config	model | log
DeepLabV3+	R-18b-D8	512x1024	80000	2.1	14.95	75.87	77.52	config	model | log
DeepLabV3+	R-50b-D8	512x1024	80000	7.4	3.94	80.28	81.44	config	model | log
DeepLabV3+	R-101b-D8	512x1024	80000	10.9	2.60	80.16	81.41	config	model | log
DeepLabV3+	R-18b-D8	769x769	80000	2.4	5.96	76.36	78.24	config	model | log
DeepLabV3+	R-50b-D8	769x769	80000	8.4	1.72	79.41	80.56	config	model | log
DeepLabV3+	R-101b-D8	769x769	80000	12.3	1.10	79.88	81.46	config	model | log

ADE20K

Method	Backbone	Crop Size	Lr schd	Mem (GB)	Inf time (fps)	mIoU	mIoU(ms+flip)	config	download
DeepLabV3+	R-50-D8	512x512	80000	10.6	21.01	42.72	43.75	config	model | log
DeepLabV3+	R-101-D8	512x512	80000	14.1	14.16	44.60	46.06	config	model | log
DeepLabV3+	R-50-D8	512x512	160000	-	-	43.95	44.93	config	model | log
DeepLabV3+	R-101-D8	512x512	160000	-	-	45.47	46.35	config	model | log

Pascal VOC 2012 + Aug

Method	Backbone	Crop Size	Lr schd	Mem (GB)	Inf time (fps)	mIoU	mIoU(ms+flip)	config	download
DeepLabV3+	R-50-D8	512x512	20000	7.6	21	75.93	77.50	config	model | log
DeepLabV3+	R-101-D8	512x512	20000	11	13.88	77.22	78.59	config	model | log
DeepLabV3+	R-50-D8	512x512	40000	-	-	76.81	77.57	config	model | log
DeepLabV3+	R-101-D8	512x512	40000	-	-	78.62	79.53	config	model | log

Pascal Context

Method	Backbone	Crop Size	Lr schd	Mem (GB)	Inf time (fps)	mIoU	mIoU(ms+flip)	config	download
DeepLabV3+	R-101-D8	480x480	40000	-	9.09	47.30	48.47	config	model | log
DeepLabV3+	R-101-D8	480x480	80000	-	-	47.23	48.26	config	model | log

Pascal Context 59

Method	Backbone	Crop Size	Lr schd	Mem (GB)	Inf time (fps)	mIoU	mIoU(ms+flip)	config	download
DeepLabV3+	R-101-D8	480x480	40000	-	-	52.86	54.54	config	model | log
DeepLabV3+	R-101-D8	480x480	80000	-	-	53.2	54.67	config	model | log

LoveDA

Method	Backbone	Crop Size	Lr schd	Mem (GB)	Inf time (fps)	mIoU	mIoU(ms+flip)	config	download
DeepLabV3+	R-18-D8	512x512	80000	1.93	25.57	50.28	50.47	config	model | log
DeepLabV3+	R-50-D8	512x512	80000	7.37	6.00	50.99	50.65	config	model | log
DeepLabV3+	R-101-D8	512x512	80000	10.84	4.33	51.47	51.32	config	model | log

Note:

• FP16 means Mixed Precision (FP16) is adopted in training.