configs/second/README.md

Second: Sparsely embedded convolutional detection

SECOND: Sparsely Embedded Convolutional Detection

Abstract

LiDAR-based or RGB-D-based object detection is used in numerous applications, ranging from autonomous driving to robot vision. Voxel-based 3D convolutional networks have been used for some time to enhance the retention of information when processing point cloud LiDAR data. However, problems remain, including a slow inference speed and low orientation estimation performance. We therefore investigate an improved sparse convolution method for such networks, which significantly increases the speed of both training and inference. We also introduce a new form of angle loss regression to improve the orientation estimation performance and a new data augmentation approach that can enhance the convergence speed and performance. The proposed network produces state-of-the-art results on the KITTI 3D object detection benchmarks while maintaining a fast inference speed.

Introduction

We implement SECOND and provide the results and checkpoints on KITTI dataset.

Results and models

KITTI

Backbone	Class	Lr schd	Mem (GB)	Inf time (fps)	mAP	Download
SECFPN	Car	cyclic 80e	5.4		78.2	model | log
SECFPN (FP16)	Car	cyclic 80e	2.9		78.72	model| log
SECFPN	3 Class	cyclic 80e	5.4		65.3	model | log
SECFPN (FP16)	3 Class	cyclic 80e	2.9		67.4	model | log

Waymo

Backbone	Load Interval	Class	Lr schd	Mem (GB)	Inf time (fps)	mAP@L1	mAPH@L1	mAP@L2	mAPH@L2	Download
SECFPN	5	3 Class	2x	8.12		65.3	61.7	58.9	55.7	log
above @ Car			2x	8.12		67.1	66.6	58.7	58.2
above @ Pedestrian			2x	8.12		68.1	59.1	59.5	51.5
above @ Cyclist			2x	8.12		60.7	59.5	58.4	57.3

Note:

• See more details about metrics and data split on Waymo HERE. For implementation details, we basically follow the original settings. All of these results are achieved without bells-and-whistles, e.g. ensemble, multi-scale training and test augmentation.
• FP16 means Mixed Precision (FP16) is adopted in training.

Citation

@article{yan2018second,
  title={Second: Sparsely embedded convolutional detection},
  author={Yan, Yan and Mao, Yuxing and Li, Bo},
  journal={Sensors},
  year={2018},
  publisher={Multidisciplinary Digital Publishing Institute}
}