PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. Point cloud is an important type of geometric data structure. Due to its irregular format, most researchers transform such data to regular 3D voxel grids or collections of images. This, however, renders data unnecessarily voluminous and causes issues. In this paper, we design a novel type of neural network that directly consumes point clouds and well respects the permutation invariance of points in the input. Our network, named PointNet, provides a unified architecture for applications ranging from object classification, part segmentation, to scene semantic parsing. Though simple, PointNet is highly efficient and effective. Empirically, it shows strong performance on par or even better than state of the art. Theoretically, we provide analysis towards understanding of what the network has learnt and why the network is robust with respect to input perturbation and corruption.

References in zbMATH (referenced in 18 articles )

Showing results 1 to 18 of 18.
Sorted by year (citations)

  1. Eliasof, Moshe; Sharf, Andrei; Treister, Eran: Multimodal 3D shape reconstruction under calibration uncertainty using parametric level set methods (2020)
  2. Lang, Xufeng; Sun, Zhengxing: Structure-aware shape correspondence network for 3D shape synthesis (2020)
  3. Liu, Xinhai; Han, Zhizhong; Hong, Fangzhou; Liu, Yu-Shen; Zwicker, Matthias: LRC-net: learning discriminative features on point clouds by encoding local region contexts (2020)
  4. Pai, Gautam; Joseph-Rivlin, Mor; Kimmel, Ron; Sochen, Nir: On geometric invariants, learning, and recognition of shapes and forms (2020)
  5. Qian Xie, Yu-Kun Lai, Jing Wu, Zhoutao Wang, Yiming Zhang, Kai Xu, Jun Wang: MLCVNet: Multi-Level Context VoteNet for 3D Object Detection (2020) arXiv
  6. Sun, Xiao; Lian, Zhouhui: EasyMesh: an efficient method to reconstruct 3D mesh from a single image (2020)
  7. Yang, Baorong; Yao, Junfeng; Wang, Bin; Hu, Jianwei; Pan, Yiling; Pan, Tianxiang; Wang, Wenping; Guo, Xiaohu: P2MAT-NET: learning medial axis transform from sparse point clouds (2020)
  8. Cheng, Xuan; Zeng, Ming; Lin, Jinpeng; Wu, Zizhao; Liu, Xinguo: Efficient (L_0) resampling of point sets (2019)
  9. Chen, Mingjia; Zou, Qianfang; Wang, Changbo; Liu, Ligang: EdgeNet: deep metric learning for 3D shapes (2019)
  10. Chui, Charles K.; Lin, Shao-Bo; Zhou, Ding-Xuan: Deep neural networks for rotation-invariance approximation and learning (2019)
  11. Hofer, Christoph D.; Kwitt, Roland; Niethammer, Marc: Learning representations of persistence barcodes (2019)
  12. Hu, Siyu; Chen, Xuejin: Preventing self-intersection with cycle regularization in neural networks for mesh reconstruction from a single RGB image (2019)
  13. Krishna Murthy Jatavallabhula, Edward Smith, Jean-Francois Lafleche, Clement Fuji Tsang, Artem Rozantsev, Wenzheng Chen, Tommy Xiang, Rev Lebaredian, Sanja Fidler: Kaolin: A PyTorch Library for Accelerating 3D Deep Learning Research (2019) arXiv
  14. Liu, Jiarui; Xia, Qing; Li, Shuai; Hao, Aimin; Qin, Hong: Quantitative and flexible 3D shape dataset augmentation via latent space embedding and deformation learning (2019)
  15. Rezaei, Masoumeh; Rezaeian, Mehdi; Derhami, Vali; Sohel, Ferdous; Bennamoun, Mohammed: Deep learning-based 3D local feature descriptor from mercator projections (2019)
  16. Song, Youcheng; Sun, Zhengxing; Wu, Yunjie; Li, Hongyan: Coarse-to-fine segmentation for indoor scenes with progressive supervision (2019)
  17. Williams, Reed M.; IlieĊŸ, Horea T.: Practical shape analysis and segmentation methods for point cloud models (2018)
  18. William L. Hamilton, Rex Ying, Jure Leskovec: Inductive Representation Learning on Large Graphs (2017) arXiv