0) Overview
Dataset:
Metrics:
1) Papers:
Realistic Dataset
HoliCity: A City-Scale Data Platform for Learning Holistic 3D Structures (CoRR'20) [Project] [Paper] [Code]
OASIS: A Large-Scale Dataset for Single Image 3D in the Wild (CVPR'20) [Project] [Paper]
3D Scene Graph: A Structure for Unified Semantics, 3D Space, and Camera (ICCV'19) [Project] [Paper]
The Replica Dataset: A Digital Replica of Indoor Spaces (CoRR'19) [Paper] [Code]
Matterport3D: Learning from RGB-D Data in Indoor Environments (3DV'17) [Project] [Paper] [Code]
[2D-3D-S] Joint 2D-3D-Semantic Data for Indoor Scene Understanding (CoRR'17) [Project] [Paper]
ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes (CVPR'17) [Project] [Paper]
SceneNN: a Scene Meshes Dataset with aNNotations (3DV'16) [Project] [Paper]
SUN RGB-D: A RGB-D Scene Understanding Benchmark Suite (CVPR'15) [Project] [Paper]
SUN3D: A Database of Big Spaces Reconstructed using SfM and Object Labels (ICCV'13) [Project] [Paper]
[NYUv2] Indoor Segmentation and Support Inference from RGBD Images (ECCV'12) [Project] [Paper]
Synthetic Dataset
MINERVAS: Massive INterior EnviRonments VirtuAl Synthesis (CoRR'21) [Project] [Paper]
3D-FRONT: 3D Furnished Rooms with layOuts and semaNTics (ICCV'21) [Project] [Paper] [Code] [Rendering Tool]
Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understanding (ICCV'21) [Project] [Paper] [Code]
OpenRooms: An End-to-End Open Framework for Photorealistic Indoor Scene Datasets (CVPR'21) [Project] [Paper]
Structured3D: A Large Photo-realistic Dataset for Structured 3D Modeling (ECCV'20) [Project] [Paper] [Code]
InteriorNet: Mega-scale Multi-sensor Photo-realistic Indoor Scenes Dataset (BMVC'18) [Project] [Paper]
SceneNet RGB-D: Can 5M Synthetic Images Beat Generic ImageNet Pre-training on Indoor Segmentation? (ICCV'17) [Project] [Paper]
[SUNCG] Semantic Scene Completion from a Single Depth Image (CVPR'17) [Paper]
SceneNet: Understanding Real World Indoor Scenes With Synthetic Data (CVPR'16) [Project] [Paper]
The SYNTHIA Dataset: A Large Collection of Synthetic Images for Semantic Segmentation of Urban Scenes (CVPR'16) [Project] [Paper]
Survey:
State-of-the-art in Automatic 3D Reconstruction of Structured Indoor Environments (Computer Graphics Forum'20) [Paper]
Indoor Scene Understanding in 2.5/3D for Autonomous Agents: A Survey (IEEE Access'19) [Paper]
RGBD Datasets: Past, Present and Future (CVPR Workshop'16) [Project] [Paper]
Perspective Image
Holistic 3D Scene Understanding from a Single Image with Implicit Representation (CVPR'21) [Paper]
Total3DUnderstanding: Joint Layout, Object Pose and Mesh Reconstruction for Indoor Scenes from a Single Image (CVPR'20) [Paper] [Code]
3D Object Detection from a Single RGB Image via Perspective Points (NIPS'19) [Paper]
Hoilistc++ Scene Understanding: Single-view 3D Holistic Scene Parsing and Human Pose Estimation with Human-Object Interaction and Physical Commonsense (ICCV'19) [Project] [Paper] [Code]
Complete 3D Scene Parsing from an RGBD Image (IJCV'18) [Paper]
Cooperative Holistic Scene Understanding: Unifying 3D Object, Layout, and Camera Pose Estimation (NeurIPS'18) [Project] [Paper] [Code]
Holistic 3D Scene Parsing and Reconstruction from a Single RGB Image (ECCV'18) [Project] [Paper] [Code]
Factoring Shape, Pose, and Layout from the 2D Image of a 3D Scene (CVPR'18) [Project] [Paper] [Code]
Im2CAD (CVPR'18) [Project] [Paper]
DeepContext: Context-Encoding Neural Pathways for 3D Holistic Scene Understanding (ICCV'17) [Project] [Paper]
Emptying, Refurnishing, and Relighting Indoor Spaces (SIGGRAPH Asia'16) [Project] [Paper]
Scene Parsing by Integrating Function, Geometry and Appearance Models (CVPR'13) [Project] [Paper]
Understanding Indoor Scenes using 3D Geometric Phrases (CVPR'13) [Paper]
Recovering Free Space of Indoor Scenes from a Single Image (CVPR'12) [Paper]
Efficient Exact Inference for 3D Indoor Scene Understanding (ECCV'12) [Paper]
Efficient Structured Prediction for 3D Indoor Scene Understanding (CVPR'12) [Paper]
Estimating Spatial Layout of Rooms using Volumetric Reasoning about Objects and Surfaces (NeurIPS'10) [Paper]
Thinking Inside the Box: Using Appearance Models and Context Based on Room Geometry (ECCV'10) [Paper]
Panoramic Image
DeepPanoContext: Panoramic 3D Scene Understanding with Holistic Scene Context Graph and Relation-based Optimization (ICCV'21) [Paper] [Code]
Automatic 3D Indoor Scene Modeling from Single Panorama (CVPR'18) [Paper]
Pano2CAD: Room Layout From A Single Panorama Image (WACV'17) [Paper]
PanoContext: A Whole-room 3D Context Model for Panoramic Scene Understanding (ECCV'14) [Project] [Paper]
Others
References:
https://github.com/bertjiazheng/awesome-scene-understanding