OctNet: Learning Deep 3D Representations at High Resolutions. We present OctNet, a representation for deep learning with sparse 3D data. In contrast to existing models, our representation enables 3D convolutional networks which are both deep and high resolution. Towards this goal, we exploit the sparsity in the input data to hierarchically partition the space using a set of unbalanced octrees where each leaf node stores a pooled feature representation. This allows to focus memory allocation and computation to the relevant dense regions and enables deeper networks without compromising resolution. We demonstrate the utility of our OctNet representation by analyzing the impact of resolution on several 3D tasks including 3D object classification, orientation estimation and point cloud labeling.

References in zbMATH (referenced in 11 articles )

Showing results 1 to 11 of 11.
Sorted by year (citations)

  1. Ghadai, Sambit; Lee, Xian Yeow; Balu, Aditya; Sarkar, Soumik; Krishnamurthy, Adarsh: Multi-resolution 3D CNN for learning multi-scale spatial features in CAD models (2021)
  2. Ping, Yuhan; Wei, Guodong; Yang, Lei; Cui, Zhiming; Wang, Wenping: Self-attention implicit function networks for 3D dental data completion (2021)
  3. Hackel, Timo; Usvyatsov, Mikhail; Galliani, Silvano; Wegner, Jan D.; Schindler, Konrad: Inference, learning and attention mechanisms that exploit and preserve sparsity in CNNs (2020)
  4. Liu, Xinhai; Han, Zhizhong; Hong, Fangzhou; Liu, Yu-Shen; Zwicker, Matthias: LRC-net: learning discriminative features on point clouds by encoding local region contexts (2020)
  5. Pai, Gautam; Joseph-Rivlin, Mor; Kimmel, Ron; Sochen, Nir: On geometric invariants, learning, and recognition of shapes and forms (2020)
  6. Rosu, Radu Alexandru; Quenzel, Jan; Behnke, Sven: Semi-supervised semantic mapping through label propagation with semantic texture meshes (2020)
  7. Stutz, David; Geiger, Andreas: Learning 3D shape completion under weak supervision (2020)
  8. Chen, Mingjia; Zou, Qianfang; Wang, Changbo; Liu, Ligang: EdgeNet: deep metric learning for 3D shapes (2019)
  9. Jens Behley, Martin Garbade, Andres Milioto, Jan Quenzel, Sven Behnke, Cyrill Stachniss, Juergen Gall: SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR Sequences (2019) arXiv
  10. Shaoshuai Shi, Xiaogang Wang, Hongsheng Li: PointRCNN: 3D Object Proposal Generation and Detection from Point Cloud (2019) arXiv
  11. Ghadai, Sambit; Balu, Aditya; Sarkar, Soumik; Krishnamurthy, Adarsh: Learning localized features in 3D CAD models for manufacturability analysis of drilled holes (2018)